Anthropic is partnering with Accenture to run independent embedded evaluation of frontier AI, including red-teaming and alignment and safeguards testing. The companies expect to invest at least $1 billion over the next five years to build evaluation capacity. This will add evaluators with near-employee access inside labs, producing incident reporting and a more verifiable public account of model safety while Anthropic keeps accountability.
A US intelligence report generated with AI tools incorrectly said a Chinese ship carried components for China’s nuclear arms program, nearly leading to an air-supported interception and boarding.
US officials removed a Chinese AI search tool briefly used on the Federal Register website, after reports flagged a mismatch with law enforcement claims about Alibaba models. The FBI last month named Alibaba as one of 6 Chinese firms tied to “industrial-scale distillation.” National Archives pulled the Qwen option, while it and other US agencies have not publicly explained when the tool was added or why it was removed.
Dario Amodei outlined a plan for Anthropic to “pace the frontier” using independent safety evaluators and coordination between AI labs in democratic countries. A week after an Anthropic researcher’s doomsday warning, the proposal drew industry support and Jensen Huang’s pushback. The discussion shifts to whether labs can agree on what “slowing down” means and who would enforce it.
OpenAI and Microsoft’s internal court filings claim their training-data scraping could trigger a “doom loop” that harms the web. The documents were unsealed in the New York Times’ case against OpenAI and Microsoft. The filings are being used to support arguments that the companies’ approach could damage web ecosystems and undermine claims about fair use.
TechCrunch’s Equity podcast discusses Dario Amodei’s plan to “pace the frontier” of AI development using independent safety evaluators and coordination among AI labs. The episode highlights Automattic’s boardroom turmoil tied to Matt Mullenweg’s 33-hour ouster. It shifts the focus to whether labs can agree on what “slowing down” means and who should enforce it, while also recapping major tech deals mentioned in the show.
NOAN launched its second release, positioning its “fact layer” for business AI agents. The update is the company’s 2nd launch, made available today. It provides a verified, versioned source of company-approved facts via API and MCP so models, agents, and apps can use the same information.
Taiwan Stock Exchange chair Sherman Lin outlined efforts to broaden the TAIEX beyond TSMC and improve listing standards to attract more investors. TAIEX is up about 55% for the year so far, while TSMC is up by 50%. The exchange is pushing more AI-supply-chain and “hidden champions” listings and using its Power Up corporate governance program, with IPO fundraising still far below Hong Kong.
404 Media and The Intercept discussed how private companies enable government surveillance and how AI is used in warfare. They recorded the podcast live in Los Angeles on September 12. As a result, the episode focuses on AI’s role in surveillance pipelines and war, and raises concerns about future risks.
A DeepSeek researcher’s viral blog post argued that geopolitics and an “arms race” dynamic are driving AI developers toward publishing more capable systems, while also warning that concentrated control could push society toward a “Cyberpunk 2077” outcome. On September 13, after DeepSeek V4.1-Flash was released, the researcher said that AI-written kernels will likely match or surpass his work within 6 months to a year. The fallout includes sympathetic coverage across Chinese media and online tech communities, while DeepSeek did not support or remove the post.
Behind the Blog discusses why 404 Media reporters should keep pushing through reporting issues, including a review of AI-generated music on Spotify that appears under real artists’ names. It says the reporting took “a couple of weeks” and references 404 Media. The takeaway is a renewed focus on how prevalent the misuse of digital music distribution is, prompting continued scrutiny rather than letting the problem fade.
Zvi (Don't Worry About the Vase)·3 weeks ago·
25
● 125 sources
The article argues that public concern about existential risk from AI is spreading via a preference cascade that pulls more media, politics, and industry voices into safety debates. It cites a Politico poll showing nearly two-thirds of Americans (about 30%–33% mean) perceive at least a moderate risk of AI destroying humanity. It says the debate should intensify next by expanding efforts inside labs and pushing for concrete policy and technical work rather than relying on outreach alone.
Virginia Gov. Abigail Spanberger issued Executive Order 22 to regulate data center development and establish an AI task force to evaluate risks to Virginians. The order bans executive branch officials from signing non-disclosure agreements (NDAs) for data center projects. It requires slower or more controlled approvals via noise and backup-generation reviews and adds government oversight through the AI task force.
Mozilla’s State of Open Source AI report says open-source and open-weight AI has moved from experimentation to production use, with Europe gaining ground mainly in deployment and infrastructure. On Hugging Face, it cites 2.5 million public models and 13 million users, and on OpenRouter open-weight models grew to about a third of usage by late 2025. Europe is pushed to focus on tooling, orchestration, compliance, and sovereignty efforts (including UK plans like a £500M program) rather than only chasing frontier model capability.
California Gov. Gavin Newsom issued an executive order to set up an expert group to recommend stronger AI safety rules for state law, including a potential requirement for a kill switch on frontier models. The recommendations are due within 2 months. This would shift California toward more mandatory AI oversight, with possible requirements for onsite independent audit groups and third-party standards for transparency and risk reports.
OpenAI introduced the Australian Youth Safety Blueprint to guide safer AI experiences for young people. The roadmap has six pillars. This creates a structured plan for how OpenAI will protect and empower young users as they use AI.
Steve Eisman said leading AI companies are trying to create a crisis to benefit themselves, dismissing AI doomsday warnings as self-serving marketing. He pointed to an IPO that Anthropic has already “confidentially filed” for. The debate over AI safety slowdowns shifts toward viewing regulation and competitive positioning, rather than an imminent AI catastrophe.
The author describes mixed reactions to large language models, saying they often speak in an unsettling human-like tone and can confidently invent information. The piece points to “polling” where people both find models useful and think they will be bad for society. The author concludes they still should be used, but warns against anthropomorphizing agents and favors avoiding interactions with models that seem to mimic untrusted “people.”
Agent-owned verification-and-repair loops leave only terminal green attestation records, so the failed attempts and intermediate code changes needed for incident investigations can disappear. The proposal extends existing provenance approaches from SLSA levels L1 to L3 to cover the agent verification loop, not just the build and deployment chain. Teams should retain a first-class, structured iteration history (failures, diffs, governing model/config, and attempt links) alongside the final commit and attestation so accountable people can reconstruct what the agent did.
Denis Shilov, founder of the Paris AI safety startup White Circle, said AI should face scrutiny comparable to the nuclear industry in order to slow down its development. He cited “€80o” as a concrete figure in the article. His position pushes for tighter safety oversight and more cautious rollout of AI systems.
Hard Fork ended after focusing for most of its run on understanding how LLMs and AI safety affect companies and everyday life. The final show wrapped up ahead of Machine Gods launching the week of October 19, with episodes planned twice a week. The shift moves coverage from the New York Times podcast to a new Kevin Roose/NPR project under Machine Gods Media, including expanded YouTube output and more frequent publishing.
Every AI story that matters,
in your inbox by 8am.
TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the
day in two minutes. Follow companies and topics for alerts, or get the
briefing in Slack. Free, no spam, unsubscribe anytime.
Reading TLDRocket needs no cookies, and the readership counts we rely on come from
our own cookieless analytics. Google Analytics is the exception: it sets cookies and
reports to Google, so it stays switched off until you allow it. You can change your
mind any time from “Cookie settings” in the footer.
Strictly necessary
Session security and form protection (tldrocket-session,
XSRF-TOKEN, 2 hours). The site cannot work without them,
so they need no consent.
Always on
Google Analytics 4 (_ga,
_ga_<id>, up to 2 years). Measures which
stories and sections readers use. Google acts as a third-party processor and may
store the data outside the EU. No advertising, no profiling, no data sold.
