289 summarised stories about AI Benchmarking, each linking back to the original source. Browse all topics →
YouTube 3 weeks ago 8 ● 20 sources
The article compares GPT-6 Sol, GPT-6 Luna, and Claude Opus 5.5 on coding, reasoning, writing, agents, pricing, and everyday work. It says Opus 5.5 is the reason today’s benchmark got much harder. As a result, the round focuses on how model performance shifts under the updated, tougher benchmark conditions.
The New Stack 3 weeks ago 17
A study of query decomposition in RAG systems found that splitting a multi-intent question into sub-queries retrieves the right passages but still leaves most sub-intents excluded from the final 2,000-token packed context. In a production-default pipeline, 31.1% of sub-intents were starved even after their evidence was retrieved. The fix changes from improving retrieval to changing allocation/packing policy (with example results rising from 68.9% to 89.4% coverage when allocation is adjusted).
claude.dev Blog 3 weeks ago 27
Claude.ai’s core website and desktop app experience was sped up by about 3x over a two-week sprint, after users reported it was slow. At the 75th percentile, time to reach a typeable page on a fresh claude.ai load dropped from 3.1 seconds to 0.55 seconds. The team used Claude Tag with lab benchmarks and CI guardrails, shipping thousands of performance changes with flags and then ratcheting benchmarks to keep improvements in production.
qwenintelligence.com 3 weeks ago 11
Qwen packaged a planner, a mobile-use agent, and a creative agent into one stack for mobile-agent testing. The stack comes with public benchmarks and leaderboards. This makes it easier to run and compare mobile-agent workflows using the provided code and results pages.
SiliconANGLE 3 weeks ago 9 ● 9 sources
Google launched two text-to-speech models, Gemini 3.8 Flash TTS and Gemini 3.8 Flash-Lite TTS, through its cloud platform.
The daily briefing
TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.
TLDRocket
18 October 2026
AI oversight stopped being a PowerPoint exercise today and got hands-on. Anthropic said it has given outside AI watchdog METR “employee-like” access, embedding a METR team in its offices with access to hardware and internal systems so risk evaluation can run closer to the actual model and infrastructure—not just post-hoc reports. That trend of tightening control shows up elsewhere: U.S. banks and brokerages are blocking outside AI agents from logging in and moving money, with Charles Schwab reporting it blocks agents “in the tens and twenties each week,” while routing limited balance viewing and analysis through Schwab’s own MCP servers. Even the courts are joining in—at least eight states sued OpenAI, alleging ChatGPT helps “cyberhacking agents” and misleads adults, raising the stakes for how tightly companies must constrain agent behavior.
Read the full briefing →