中文翻译
摘要: Anthropic wants AI development to slow down globally, warns humans could lose control otherwise
Synopsis
In a long article on its website, titled "When AI builds itself", Anthropic said it would...
正文
Anthropic wants AI development to slow down globally, warns humans could lose control otherwise
Synopsis
In a long article on its website, titled "When AI builds itself", Anthropic said it would be good to have the option to slow or temporarily pause frontier AI development, citing safety risks and loss of control over the models as they self-improve.
Jun 05, 2026, 01:24:00 PM IST
Follow us
Leading artificial intelligence (AI) company Anthropic, which is within kissing distance of a trillion-dollar valuation thanks to its
AI systems
, which have moved markets and changed the nature of white-collar jobs, now wants the technology to slow down.
ADVERTISEMENT
In a long article on its website, titled "When AI builds itself", Anthropic said it would be good to have the option to slow or temporarily pause frontier
AI development
, citing safety risks and loss of control over the models as they self-improve.
The company claims that slowing down would be effective if done verifiably and globally.
Anthropic plans to organise conversations involving policymakers, researchers, civil society and other AI companies to address these questions.
The timing of this discussion seems strange, as the AI startup filed its draft papers to go public just last week. It had raised $65 billion in pre-IPO funding, at a valuation of about $965 billion.
Why does Anthropic want a slowdown?
ADVERTISEMENT
The Claude maker said it is delegating a lot of its AI development to AI systems themselves, speeding up their work. Extrapolating from this trend, the company claims this could mean an AI capable of fully autonomously designing and developing its own successor, a process it termed "
recursive self-improvement
".
Anthropic cited multiple reasons why this is bad news:
ADVERTISEMENT
ADVERTISEMENT
The main fear is the loss of human control over these systems. If systems build their own successors, the way they are secured and monitored could go out of human hand
采集时间: 2026-06-05 20:16:49
AI人工智能Anthropic