TLDRocket
Sign in

AI Evaluation

358 summarised stories about AI Evaluation, each linking back to the original source. Browse all topics →

+ Follow this topic

Thursday, 1 October 2026

Opus 5.5 loves to tell you ‘this matters’ (and other AI writing tells)

TechCrunch 2 weeks ago 13

Researchers at Graphite analyzed writing habits of frontier language models to identify persistent linguistic “tells” that distinguish AI-generated prose from human writing. They defined 13,000 phrases as tells that were at least twice as common in AI content as in a 10,000-article human control set, finding that Claude Opus 5.5 uses “this matters” 116 times more often and “dependable” 23 times more often. Em-dash overuse is reduced or nearly eliminated, but other telltale constructions shift rather than disappearing, with each model version showing its own distinct quirks.

With most information hidden, the game Stratego

Ars Technica 2 weeks ago 4

Ataraxos, an AI system by researchers from Carnegie Mellon, MIT, NYU, and Stanford, beat top Stratego player Pim Niemeijer 15 games to 1. The system was trained using 16 GPUs. This shows that imperfect-information board games with long-running hidden information can now be solved to human-beating levels with comparatively modest computing resources, shifting Stratego from an AI-stalemate into a new benchmark for AI research.

RLTL;DR: Self-Improvement by Internalizing Self-Generated Feedback

Apple Machine Learning Research 2 weeks ago 16

RLTL;DR proposes a reinforcement-learning method that uses the verifier’s output after each failed attempt to generate self-written feedback for the agent. The paper’s approach is to have the agent write a single TL;DR insight per failure that conditions the next rollout. As a result, the agent can self-improve even when success is rare and there are no teacher models or example solutions available.

How Much of a Harness Does a Strong Agent Need for Autonomous ML Engineering?

Apple Machine Learning Research 2 weeks ago 18

The paper tests autonomous MLE coding agents and finds that elaborate multi-agent and retrieval harnesses don’t improve results over a minimal-harness coding agent when using an equal time budget and the same frontier LLM backbone. It specifically reports that open-source state-of-the-art harnesses offer no advantages over a single-session minimal-harness baseline. As a result, the authors argue that the extra machinery layers are mostly redundant for current MLE benchmarks and that spending effort on hand-crafted harnesses around strong models gives poor returns.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.