Anthropic backs urgent call for the most powerful AI labs to hit the brakes
The New Stack Amanda Caswell ● Covered by 51 sources
More than 1,100 AI researchers and executives, including Anthropic CEO Dario Amodei, signed an open letter calling for governments to enable deliberate slowing of frontier AI development if safety measures fall behind capability advances. Anthropic's June research showed that over 80% of code merged into its codebase is now written by Claude, raising concerns about recursive self-improvement and systems designing their own successors faster than researchers can evaluate them. The petition has prompted congressional interest, including the bipartisan AI Kill Switch Act, while major labs are already implementing tougher testing, longer validation cycles, and stronger runtime monitoring rather than pausing development entirely.
Why it matters
Less than a week after OpenAI disclosed that two experimental AI models escaped their testing environment during a cybersecurity exercise The post Anthropic backs urgent call for the most powerful AI labs to hit the brakes appeared first on The New Stack.
Also covered by
- The Batch — Kimi K3 Redraws the Open Frontier, Muse Spark 1.1 Undercuts Competitors, Cloudflare Moves to Cut Off Crawlers
- TechCrunch AI — Microsoft is openly competing with OpenAI, Anthropic more than ever
- Zvi (Don't Worry About the Vase) — Frontier Lab Employee Open Letter Calls For Being Able to Pace the Frontier
- TLDR Dev — The real AI risk is inside the labs
- TLDR — The AI Future Is for Everyone
- The Neuron — Anthropic opposes blanket open-weight AI ban but wants targeted controls
- Latent Space — [AINews] Fearing RSI: OpenAI, Anthropic, GDM, Meta, Thinky cosign letter to "Pace" AI development, as HuggingFace details Machine-Speed Offensive Cyberattack
- The Verge — AI leaders sign statement asking the government to do something about automated AI
- The Verge — AI’s finally expensive enough to make Wall Street nervous
- Latent Space — [AINews] Much ado about Open Weights
- TechCrunch AI — Anthropic’s Dario Amodei responds: doesn’t oppose open-weight models, but fears Chinese AI
- The New Stack — Anthropic wants tests, not bans, as OpenAI and Google back open weights
- Anthropic News — Our position on open-weights models
- TechCrunch AI — Satya Nadella says companies that trust one AI for everything may not survive
- The New Stack — Microsoft is racing to make OpenAI optional
- TLDR Dev — Open-weight AI is having its Kubernetes moment. Let's not ruin it
- TLDR — AI is Oil, Not God
- NVIDIA — Industry Leaders Unite in Open Secure AI Alliance for AI Safety and Security
- The New Stack — Nvidia, Palantir, Hugging Face join 30 others in race to defend open-weight AI from cyber threats
- The Verge — Nvidia, Microsoft launch open AI security alliance – without OpenAI, Google, or Anthropic
- The New Stack — Microsoft and Google DeepMind agree on AI control — but not on who holds it
- The Neuron — NVIDIA, Microsoft, and Meta Tell Washington Not to Lock Down Open AI
- The Neuron — Alphabet's Future Spending Commitments Reached $811B as AI Investment Surged
- Exponential View — 🔮 Copy that: The curious case of AI distillation #594
- The New Stack — Microsoft, Nvidia, Meta and 22 others defended open weights. Anthropic and OpenAI didn’t sign.
- Sequoia — America’s Open-Model Paradox
- The New Stack — Jensen Huang made his first X post. He used it to lobby Washington about open-weight AI.
- TechCrunch AI — As US weighs response to Chinese AI, industry urges against broad open-weight restrictions
- TLDR Dev — The Arguments Against Open Source AI are Very Bad
- TLDR — Inside China's All-Out Push to Catch Up With American AI Chips
- The Algorithmic Bridge — White House’s Response to China Lacks Confidence in America
- Allen Institute (AI2) — Who gets to understand AI?
- TechCrunch AI — Experts say exploiting Anthropic’s Fable isn’t how Kimi K3 got so good
- TechCrunch AI — Treasury threatens sanctions after White House claims Moonshot distilled Anthropic’s Fable
- The New Stack — Kimi K3: White House alleges Fable 5 siphoning
- TechCrunch AI — Arcee, a US open source AI lab, says Chinese models are not inherently dangerous
- Rest of World — The U.S. wants to contain China’s AI. Silicon Valley keeps using it
- TechCrunch AI — US threatens sanctions against Chinese AI models over IP theft
- The Neuron — Washington Backed Away from Banning Chinese Open AI Models, For Now
- The Verge — America needs to stop getting shocked by Chinese AI
- The Algorithmic Bridge — 7 Consequences of America Finally Losing Its AI Edge to China
- TechCrunch AI — OpenAI is scared of open-weight models. Should the US be?
- MIT Technology Review AI — China’s AI models have Trump’s AI world at war with itself
- Simon Willison — Who’s Afraid of Chinese Models?
- ChinaTalk — China's Mythos Moment
- The Verge — China delivers a one-two punch to America’s AI dominance
- The Algorithmic Bridge — Moonshot is Chinese But Its AI Models Are From Another Planet
- TechCrunch AI — Kimi: Threat or menace?
- Platformer — China has a new top model
- TechCrunch AI — Moonshot’s upcoming Kimi 3 is expected to close the gap with Anthropic’s Opus 4.8
