TLDRocket
Sign in

AI Evaluation

360 summarised stories about AI Evaluation, each linking back to the original source. Browse all topics →

+ Follow this topic

Saturday, 12 September 2026

Anthropic CEO outlines plan to ‘pace the frontier’

TechCrunch 1 month ago 53 ● 125 sources

Anthropic CEO Dario Amodei called for AI companies to slow the improvement of AI model capabilities and described three strategies to do it in a new blog post. He said Anthropic is “unilaterally committing” to using embedded third-party evaluators (like METR) to verify pacing and safety commitments. As a result, evaluators would get badges, desks, and laptops with access comparable to internal risk teams, while governments and other frontier firms would be urged to match the approach.

“Same mission, bigger stage”: OpenAI hires Git AI founders to help Codex prove its ROI

The New Stack 1 month ago 4

OpenAI hired Git AI founders Aidan Cunniffe and Sasha Varlamov to join the Codex team and use Git AI to measure how coding agents perform for businesses. The founders will start work in time for Codex on September 12, 2026. Git AI’s open-source tracking will be kept while OpenAI is expected to use its data to help enterprises verify Codex’s ROI, potentially winding down Git AI’s standalone commercial business.

Jacob Coxon warns AI could kill us all. Anthropic’s own report exposes safety gaps.

The New Stack 1 month ago 9 ● 125 sources

Jacob Coxon warned that AI could pose extreme existential risks while developer reporting highlighted monitoring weaknesses in real incident reviews. Anthropic’s offline monitor flagged about 1% of actions in retrospective testing of Mythos 5, rising to about 50% when the model’s written reasoning was removed from what the monitor saw. Developers are urged to change agent evaluation by testing monitoring judgments against justification text, protecting logs and permissions, and judging monitors on action outcomes rather than explanations.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.