AI Safety
Anthropic Calls for Global AI Pause as Self-Improving Systems Outpace Safeguards
Anthropic calls for a global pause on frontier AI development, warning that models are approaching the ability to improve without human intervention. Critics call it fear‑based marketing from a company now valued at $965 billion.
The Call: A Brake Pedal for AI Development
Anthropic is urging the world AI labs to slow down. In a report published Thursday, the company -- now valued at $965 billion after a $65 billion Series H round last month -- called for a global pause on frontier AI development, arguing that the latest models are beginning to show signs they could eventually escape human control.
Co‑founder Jack Clark framed it bluntly to the:1 You want the option to be able to take your foot off the gas and put your foot on the brake. Right now, it is like the AI industry has a gas pedal, but it does not have a brake pedal.
"You want the option to be able to take your foot off the gas and put your foot on the brake. Right now, it is like the AI industry has a gas pedal, but it does not have a brake pedal."
What Anthropic Is Actually Proposing
The proposal, detailed in the Anthropic Institute report and covered by AFP/France 24, is not a unilateral stop. The proposal requires multiple major AI companies in multiple countries -- most notably the US and China -- agreeing to stop at the same time, under verifiable rules.
We believe it would be good for the world to have the option to slow or temporarily pause frontier AI development to enable societal structures and alignment research to keep up with the advance of the technology, the report states. The Wall Street Journal notes the company compared the problem to nuclear arms control.
The Critics: Fear‑Based Marketing at a $965B Valuation
The pushback was immediate. OpenAI CEO Sam Altman, quoted by the New York Post, characterized the call as strategic marketing: It is clearly incredible marketing to say, We have built a bomb, we are about to drop it on your head. We will sell you a bomb shelter for $100 million.
Wharton professor Ethan Mollick offered a more measured take, per the Post: There is a bit of navel‑gazing, some marketing, and a lot of very sincere beliefs about what Anthropic thinks is likely in the near future of AI. The timing is hard to ignore: Anthropic just dethroned OpenAI as the most valuable AI company, and its restricted Mythos model serves as Exhibit A. Critics note the company is simultaneously preparing for an IPO while telling everyone else to slow down.
The Evidence: Why Anthropic Says Now Is Different
Anthropic argument rests on data showing AI is already dramatically speeding up AI development itself. The report and the 1 highlight: 80% of Anthropic code is now AI‑written; reliable task length is doubling every four months; Claude Mythos Preview achieved a 52x speedup on ML training code. I am worried for my kids if we as a society do not have a serious conversation, Clark told the BBC.
Political Reality: The US‑China Cold War on AI
The proposal faces an uphill battle in Washington. As AFP reports, US officials argue any slowdown risks handing China a decisive strategic edge. President Trump discussed cooperating with China on AI safety during a Beijing visit, and signed an executive order this week allowing 30‑day reviews. But the BBC notes testing remains voluntary. Major AI firms have not committed to pausing.
What This Means for Builders
For developers and builders, the pause debate is not just policy. If a global slowdown were achieved, it would directly affect API availability, model access, and the pace of capability improvements. The more immediate reality is that no pause is happening. The AI race continues at full speed. For builders, that means the capability curve keeps climbing -- and the safety questions remain unresolved.
Sources
- 1.BBC(bbc.com)
Jun 5, 2026
Google Cloud Quietly Lays Off Cybersecurity Teams as AI Investment Takes Priority
Google has laid off employees across its Cloud division's cybersecurity units, including the Threat Intelligence Group and Mandiant teams, as it redirects resources to AI. The cuts are part of a broader industry trend of security teams being shrunk while AI spending surges.
Jun 5, 2026
Perplexity Brings Orchestrator Agent Personal Computer to Windows
Perplexity's Personal Computer agent is expanding from Mac to Windows, giving millions of developers and enterprise users desktop-level AI orchestration across 19 models. The launch follows a Computex demo showing hybrid local-cloud inference that decides where to process each task in real time.
Jun 5, 2026
AI Cited as Top Cause of US Tech Layoffs for Third Straight Month as 38K Jobs Cut in May
US tech companies announced over 38,000 job cuts in May 2026, with AI cited as the leading reason for the third consecutive month. AI-related layoffs hit a record 38,579 (40% of all cuts) as companies redirect billions to AI infrastructure.
Related News
May 31, 2026
Anthropic Hits $965B Valuation, Overtakes OpenAI as Most Valuable AI Startup
Anthropic closed a $65 billion Series H round at a $965 billion valuation, leapfrogging OpenAI to become the most valuable private AI startup. Run-rate revenue crossed $47 billion. With chip manufacturers joining the round and an IPO potentially this year, the AI funding race is now a battle for compute infrastructure.
May 31, 2026
Claude Opus 4.8 Tops GPT-5.5 With Dynamic Workflows and 4x Better Honesty
Anthropic shipped Claude Opus 4.8 just 41 days after 4.7, introducing Dynamic Workflows that coordinate swarms of subagents, topping GPT-5.5 on SWE-Bench Pro by over 10 points, and delivering a model that is four times more honest about its own uncertainty.
May 31, 2026
Microsoft Cancels Claude Code Licenses, Pushes Engineers to Copilot CLI
Microsoft is canceling Claude Code licenses across its Experiences + Devices division by June 30, steering thousands of engineers toward GitHub Copilot CLI. The move follows Uber burning through its entire 2026 AI budget on Claude Code in just four months, signaling that enterprise AI coding costs are reshaping how Big Tech allocates its tools budget.