AI Benchmarking

296 summarised stories about AI Benchmarking, each linking back to the original source. Browse all topics →

Key players

OpenAI Anthropic GPT-6 Astra MarkTechPost Google The New Stack

Wednesday, 29 July 2026

How enabling two settings tripled our scores on the ARC-AGI-3 benchmark

OpenAI 2 months ago 17

Researchers found that enabling two specific API settings in GPT-5.6 tripled performance on the ARC-AGI-3 benchmark by retaining reasoning processes and enabling compaction. The settings improved scores significantly while also enhancing efficiency metrics. This adjustment demonstrates that model configuration can substantially impact benchmark performance without requiring model retraining or architectural changes.

Read the full story

AI Benchmarking GPT-5 Advanced Reasoning

The Sequence AI of the Week #903: Laguna, the 118 Billion Parameters that Walks Into a Trillion-Parameter Bar

Substack 2 months ago 33 ● 3 sources

Poolside AI released Laguna, a 118 billion-parameter open-weight model that substantially outperforms much larger models on multiple benchmarks, scoring 70.2% on Terminal-Bench 2.1 compared to 64.0% for DeepSeek-V4-Pro-Max at 1.6 trillion parameters. On the harder DeepSWE benchmark, Laguna achieves 40.4 versus DeepSeek-V4-Pro-Max's 9.0, showing a 4x score advantage despite using 13 times fewer parameters. The result challenges expectations that model performance scales primarily with parameter count and suggests architectural or training innovations enable competitive performance at smaller scale.

Read the full story

AI Benchmarking Open-Weight Models

Every AI story that matters,
in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.