TLDRocket
Sign in

Anthropic researcher Jacob Coxon resigned after warning that frontier AI could pose an existential risk, including a more-than-10% chance of human extinction within the decade

Executive move ● Confirmed 87% confidence first seen

Anthropic researcher Jacob Coxon resigned and publicly criticized major AI labs, saying their safety efforts were inadequate and that systems they are building could lead to human extinction by the end of the decade. The resignation and his statements—particularly the cited “more than 10%” figure—prompted wide public and political debate about whether frontier labs should slow down development and strengthen oversight and evaluation.

AI 2040 Plan A AI 2040 slowdown plan AIUC AIUC-1 Andrew Yang Anthropic Astra model Barack Obama Bryan Cantrill Cabinet Office China Chris Lehane Claude Constellation Research Inc. Dario Amodei David Sacks DeepMind Demis Hassabis Denis Shilov Donald Trump Elon Musk Epoch AI Gallup Google Google DeepMind Holger Mueller Hugging Face JS Denain Jacob Coxon Jasmine Lambert Jensen Huang Jessica Ji Jonathan Kanter King Charles King Charles III MIT Technology Review Marc Benioff Mark Zuckerberg Medicines and Healthcare products Regulatory Agency (MHRA) Meta Microsoft Mike Johnson ModelTalk Mustafa Suleyman NVIDIA Nathan Lambert Noam Brown OpenAI Pew Research Center Philadelphia RSI (lossy self-improvement) Rajiv Dattani Robert Tappan Morris Rune Kvist Salesforce Sam Altman Siena University SpaceX Steve Eisman The New York Times U.S. Congress UK Government UK Joint Committee on Human Rights United States VicOne.Robot We Must Pace the Frontier White Circle White House Will Douglas Heaven Xi Jinping AI bill AI capability improvements AI data centers AI natives AI regulation AI safety and regulation AI safety regulation Agentforce All-In Summit All-In podcast Alphabet Amazon Americans Annenberg Public Policy Center Anthropic Claude Sonnet 5 Anthropic researcher Anthropic’s alignment lead Artificial Intelligence Act Artificial Intelligence Underwriting Company Associated Press Astra BBC Berkeley, California Bernie Sanders Bitcoin Bloomberg BloombergNEF CBS Sunday Morning Cabinet Office spokesperson Carnegie Mellon University Center for Security and Emerging Technology Claude Mythos Claude Sonnet Claude Sonnet 5 Codex Cornell Data Center Health Protection Pledge David Hubinger Decoder Democratic Party Disney Dreamforce Dreamforce Dumfries House Environmental Protection Agency Europe European Union Evan Hubinger Ezra Klein Facebook Faculty First Harmonic GPT-4 GPT-6 Germany Goldman Sachs Grace Huckins House of Representatives Humanist AI code of conduct Insight Media Group Ireland Jakub Pachocki Japan Jensen Huang says AI safety should be handled as an engineering issue by companies Lawrence Tallon Leonid Brezhnev Lionsgate METR METR Matt Burns Mythos 5 NVIDIA H100 Netflix Netherlands Niall Firth On Equity OpenAI model (unspecified) Paradox of the Worried West Paris Pew Research survey Politico Ribbit Capital Richard Nixon Ruben Bloom SAG-AFTRA SALT I Satya Nadella Scotland Sean O’Kane September 2026 Sherman Act SiliconANGLE SpaceXAI Steve Bannon The Ezra Klein Show The New Stack The Verge U.S. federal government UK Parliament UK government United Kingdom United Kingdom Government United States Congress United States Department of Justice United States House Judiciary Committee United States House of Representatives Vox WGAE Wall Street Washington University in St. Louis X agent-led cybersecurity incidents bioterrorism cyberattacks federal regulation government regulation independent evaluators independent monitoring persistent botnet sovereign cloud superintelligence third-party evaluation third-party evaluators xAI

Decision brief

What changed
Anthropic researcher Jacob Coxon resigned publicly after saying AI labs, including Anthropic, are not taking safety risks seriously enough. In the cited coverage, he warned there is more than a 10 percent chance advanced AI could kill all humans by the end of the decade and criticized continued work toward self-improving systems.
Why it matters
This raises reputational and governance pressure on frontier AI labs and any companies partnering with them, because a public resignation from a safety-linked researcher can intensify scrutiny of risk management, containment, and development pacing. For decision-makers, the immediate issue is not whether Coxon is correct, but whether stakeholder expectations around safety assurance, board oversight, and vendor accountability are rising faster than current practices.
Affected roles
CEO COO CTO CISO
Evidence
All three cited outlets report the same core facts: Coxon resigned from Anthropic and publicly warned that AI safety risks are being underestimated, including a stated greater-than-10 percent extinction risk by decade end. The Verge and TechCrunch are independent mainstream tech publications, and Trending Topics EU reports a consistent account, giving cross-outlet consistency on the event even though the claims themselves are primarily attributed to Coxon.
What remains uncertain
The coverage does not verify Coxon’s probability estimate, whether his views reflect broader internal consensus at Anthropic, or whether Anthropic will change policy or development pace in response. It is also unclear from the coverage what specific safety failures, internal escalation steps, or governance disagreements led to the resignation beyond the public statements reported.
Monitor next
Watch for any formal Anthropic response or policy change on safety governance, model containment, or release pacing following Coxon’s resignation.

Analytical support, not advice — assumptions and open questions stated above.

Source coverage

More than 1 in 10 chance AI ‘could kill all humans,’ says Anthropic safety lead after colleague quits The Verge independent Anthropic Researcher Quits: “They Are Gambling With Our Lives” Trending Topics independent The AI policy window is open. We need to act. OpenAI official ‘Gambling with our lives’: Anthropic researcher quits, warns against self-improving AI TechCrunch independent Anthropic researcher quits with a warning: Self-improving AI could "kill us all" Ars Technica independent Anthropic researcher’s resignation sparks broad AI safety discussion SiliconANGLE independent UK needs new laws for AI in healthcare, says watchdog BBC News independent The Singularity Paradox The Algorithmic Bridge Anthropic researcher Jacob Coxon quits over self-improving AI risk WIRED newsletter AI #185: Preference Cascade Zvi (Don't Worry About the Vase) One resignation turned the embers of AI fear into a wildfire Interconnects newsletter Why did this AI doomer moment break the internet when so many others didn't? Fortune independent The AI safety vibe shift Platformer An ex-Anthropic researcher claims that AI could kill us all. But he fails to answer the most essential question: What are we supposed to do about it? Fortune independent OpenAI CEO Sam Altman is open to slowing cutting-edge AI progress Bloomberg newsletter Detecting and countering misuse of AI: September 2026 TLDR Dev newsletter AI’s existential crisis explodes but AI companies plunge ahead anyway SiliconANGLE independent Everyone agrees AI could kill us all. Congress is thinking about maybe doing something about it. Fortune independent UK government rejects 'kill switch' idea for dangerous AI BBC News independent An Anthropic researcher’s doomsday warning comes at a very interesting time TechCrunch independent Roundtables: Will AI really kill us all? MIT Technology Review independent Trump is giving data centers a pass to pollute The Verge independent Jacob Coxon warns AI could kill us all. Anthropic’s own report exposes safety gaps. The New Stack Anthropic CEO says it’s time to pump the brakes on AI The Verge independent Anthropic boss Dario Amodei calls for AI development to slow down BBC News independent Anthropic CEO outlines plan to ‘pace the frontier’ TechCrunch independent Dramatic insider warnings over AI fall flat with some in Silicon Valley BBC News independent The week the AI freakout went mainstream CSET Georgetown AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBC BBC News independent Trump and Mike Johnson think the AI industry is overreacting The Verge independent Trump downplays AI risks after dire expert warnings and calls to slow development down BBC News independent Obama urges Democrats to have a ‘clear plan’ for AI safeguards TechCrunch independent AI 2040 Plan A: audited compute and concrete mechanisms to slow down AI 2040 newsletter OpenAI asked Congress whether an AI industry slowdown would be legal under antitrust rules WIRED newsletter TBPN: what AI ‘doomers’ actually propose for slowing down TBPN newsletter Questions mount over what an AI 'slowdown' would look like BBC News independent What’s behind the AI industry’s latest warnings of doom? TechCrunch independent Anthropic’s 3-Step ‘Pace the Frontier’ Plan Wins OpenAI, xAI and Microsoft Support: Is It Too Late to Slow AI Down? MarkTechPost While Barack Obama urges Democrats to make AI a campaign issue, Trump downplays the need to slow development despite dire warnings Fortune independent Committee calls for bill to address AI threat to human rights BBC News independent “Whoever Wins AI, Wins”: Trump Dismisses AI Risk Warnings, Citing Race With China Trending Topics independent AI’s biggest rivals agree: slow down The Neuron newsletter Anthropic CEO Dario Amodei warns AI is advancing faster than expected CBS News newsletter Trump warns against slowing AI for fear China will take the lead Financial Times newsletter The AI-as-Normal-Technology view of loss-of-control incidents AI as Normal Technology We Must Pace the Frontier darioamodei.com newsletter Why are there concerns AI could threaten humanity, and how real are they? BBC News independent The AI apocalypse warning that finally went mainstream Fortune independent We Must Pace The Frontier Zvi (Don't Worry About the Vase) Jensen Huang puts Trump on speakerphone onstage to announce robots won’t take over the world The Verge independent What is AI, how does it work and why are some people concerned about it? BBC News independent What execs and politicians are saying about slowing down AI development The Verge independent The AI industry has taken a doomer turn. What now? MIT Technology Review independent Is Big Tech’s AI slowdown a safety pact or a cartel? The Verge independent AI leaders want to hit the brakes after years of reckless speed Ars Technica independent The contagion of fear Simon Willison’s Weblog industry analysis The AI Industry Has Finally Discovered the Hardest Test: Politics The Algorithmic Bridge Nvidia CEO Jensen Huang tells Trump ‘we’re not going to let [an AI slowdown] happen’ TechCrunch independent Following: The government doesn't want to regulate AI Platformer Jensen Huang took a call from Trump, and showed off something else, too TechCrunch independent Trump tells Americans not to ‘kill the golden goose’ rejecting voters’ turn against AI and data centers Fortune independent David Sacks: companies should decide pacing to improve safety, not a government-wide slowdown YouTube newsletter AP reports Trump opposed enhanced AI oversight, stressing staying ahead of China The Associated Press newsletter Trump argues the main AI guardrail is a “strong and smart” president Axios newsletter ModelTalk: Pacing the Frontier ChinaTalk Early Anthropic hire, former METR COO have found a way to rein in rogue AI agents TechCrunch independent Roundtables: Could AI really kill us all? MIT Technology Review independent AI and data centers are incredibly unpopular in every poll The Verge independent The AI data center boom is colliding with cities scarred by big industry TechCrunch independent Nvidia boss says AI 'doesn't need new laws' as safety concerns grow BBC News independent AI agent certification startup AIUC raises $40M to begin auditing frontier models SiliconANGLE independent We don’t need AI regulation — leave safety to us, Nvidia’s Jensen Huang says TechCrunch independent Mark Zuckerberg Takes Aim at Anthropic in Debate Over AI Slowdown The New York Times newsletter Microsoft says AI rival Anthropic could have 'disastrous impact' on humanity BBC News independent Trump Goes Full Hoax on AI Existential Risk Zvi (Don't Worry About the Vase) Rethinking Robot Safety in the Age of AI IEEE Spectrum Underwriting Superintelligence: Backing Agents you can Sue — Rune Kvist, AIUC Latent Space newsletter AI labs want in-house auditors — but maybe they should shut the front door first TechCrunch independent Inside the suddenly explosive world of AI safety The Verge independent Anthropic’s CEO wants AI to slow down. European VCs ask: Who really benefits? Tech Funding News independent Microsoft AI CEO says AI threats are real, and Anthropic is making it worse The Verge independent AI is feared globally as the destroyer of jobs The Verge independent Salesforce's Marc Benioff to AI industry: Regulate yourselves or get sued Fortune independent AI #186: The World Takes Notice Zvi (Don't Worry About the Vase) King Charles warns of 'existential danger' of AI falling into wrong hands BBC News independent The AI Superintelligence Slowdown The Verge independent As Anthropic heads towards a $2 trillion IPO, some of the loudest critics are company insiders Fortune independent Even the king of England has his hesitations about AI TechCrunch independent Is the AI safety debate about safety or control? TechCrunch independent As AI CEOs clash over regulation, a new culture war is brewing Fortune independent The people building the most powerful AI are telling us to slow down. Congress should listen before it's too late Fortune independent King Charles III holds court with AI’s biggest players—and warns it could soon be too late to rein in the technology Fortune independent Anthropic details practical metrics to help monitor the speed of AI development SiliconANGLE independent ‘It’s the modern nuclear arms race’: safety expert Denis Shilov on slowing down AI Sifted independent ‘Big Short’ Investor Steve Eisman Says AI Companies Want to ‘Manufacture a Crisis’ Trending Topics independent Could AI really kill us all? Your questions, answered. MIT Technology Review independent What Hollywood thinks about existential AI warnings The Verge independent The Preference Cascade Is Only Getting Started Zvi (Don't Worry About the Vase) Dario Amodei and other AI leaders want to ‘Pace the Frontier’ but…how? TechCrunch independent 🚨 AI doesn’t need a mind to run amok Exponential View The AI regulation smackdown isn’t over The Verge independent Does AI need an antitrust exemption so it doesn’t kill everyone???? The Verge independent 🔮 AI politics & the future of growth ++ #602 Exponential View AI safety conversations have gotten unbelievable TechCrunch independent Where I stand on RSI Interconnects newsletter As AI companies get closer to 'recursive self-improvement,' this physics professor calls full autonomy 'the worst idea in the history of humanity' Fortune independent Not all AI workers think the tech could kill everyone BBC News independent No one is surprised that Nvidia’s Jensen Huang thinks AI fears are overblown. The Verge independent Is the AI industry really ready to slow down? TechCrunch independent Pacing AI won’t solve the governance gap SiliconANGLE independent 📈 Monday data: More AI numbers, more clarity? Exponential View 11 Charts the AI Industry Doesn’t Want You to See (pt. 2) The Algorithmic Bridge America is in the wrong AI race with China Rest of World The Business of Building God Strange Loop Canon newsletter Don’t be fooled by this summer of AI hype MIT Technology Review independent Debating RSI, the US-China Gap, and Jaggedness with JS Denain of Epoch AI Interconnects newsletter The real AI threat isn’t China, it’s accelerationism Fortune independent Dario Amodei wants to slow AI. China isn’t taking orders Rest of World Americans Fear AI Will Make the World Worse, Love It Anyway 404 Media Even Americans who use AI every day are worried about it TechCrunch independent Jensen Huang Thinks AI Alarmism Has Gone Too Far The New York Times newsletter Jensen Huang talks about AI and climate change like a supervillain The Verge independent US is head over heels for AI agents, while Europe remains dubious SiliconANGLE independent Nvidia CEO Jensen Huang: “We’re Going to Use a Lot More Fossil Fuel” Trending Topics independent On Ezra Klein’s Podcast With Jensen Huang Zvi (Don't Worry About the Vase)

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.