Xi Jinping offered BRICS an open-source AI base backed by China’s open-weight model leadership, while U.S. leaders argued over whether to slow frontier model development. The proposal cited by Anthropic CEO Dario Amodei lays out three stages for pacing the frontier. The likely outcome is a tighter split between a BRICS push for downloadable open weights and U.S. efforts combining model pace limits with stronger chip and weight protections.
AI researchers and executives sparked a debate about whether advanced AI systems pose an existential threat after Anthropic’s alignment lead and former Anthropic researcher Jacob Coxon raised concerns and discussed odds of human extinction. The discussion centered on Coxon’s resignation and a stated chance of more than 10% within the next decade. The conversation shifts from doom narratives and their credibility to how such statements may be handled in Anthropic’s IPO filing and whether AI safety efforts can control near-term risks rather than focusing on hypothetical timelines.
AI leaders and researchers are pushing for a slowdown in AI development, with some staff describing fear about future risks and rival CEOs reportedly agreeing. A key concrete proposal is a three-point plan from Anthropic’s Dario Amodei that includes independent monitoring of models as they’re developed, plus industry-wide and global regulation. The debate shifts from whether to build faster to how (or whether) “slowdown” can be enforced, amid concerns it could benefit competitors and disrupt broader AI expansion plans.
An ex-Anthropic researcher told the BBC that AI staff are “genuinely frightened” by how fast the technology is advancing. He said there is a strong chance that people could all die in the immediate future if progress continues at its current rate. As a result, broader debate has intensified over whether the risks are being exaggerated for market or regulatory pressure versus requiring coordinated slowdowns and safety controls.
Every AI story that matters,
in your inbox by 8am.
TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the
day in two minutes. Follow companies and topics for alerts, or get the
briefing in Slack. Free, no spam, unsubscribe anytime.
Reading TLDRocket needs no cookies, and the readership counts we rely on come from
our own cookieless analytics. Google Analytics is the exception: it sets cookies and
reports to Google, so it stays switched off until you allow it. You can change your
mind any time from “Cookie settings” in the footer.
Strictly necessary
Session security and form protection (tldrocket-session,
XSRF-TOKEN, 2 hours). The site cannot work without them,
so they need no consent.
Always on
Google Analytics 4 (_ga,
_ga_<id>, up to 2 years). Measures which
stories and sections readers use. Google acts as a third-party processor and may
store the data outside the EU. No advertising, no profiling, no data sold.
