AI Benchmarking

290 summarised stories about AI Benchmarking, each linking back to the original source. Browse all topics →

Key players

OpenAI Anthropic GPT-6 Astra MarkTechPost Google The New Stack

Saturday, 5 September 2026

OpenAI quietly boosts some of Astra's evaluation metrics, and continues to change others post-launch

OpenAI updated multiple evaluation benchmark metrics for its GPT-6 Astra model after its Sept. 3 launch blog, with some Astra scores rising while some rival-model scores fell. The reported hallucination rate for Astra changed from 4.2% to 2% within hours, and later returned to 4.2%. The result is a moving target for comparing model performance across checkpoints and harnesses, fueling scrutiny over how evaluations are configured and reported.

Read the full story

OpenAI AI Benchmarking Model Evaluation GPT-5

GPT-6 Still Behind Fable 5.1 As Artificial Analysis Overhauls Intelligence Index

Trending Topics 1 month ago 30 ● 19 sources

Artificial Analysis released Intelligence Index v4.2, reworking the benchmark to emphasize harder tasks and more private held-out test data. Private, held-out test sets now make up 40% of the Index weighting, up from the 20% used in v4.1. The leaderboard order stays the same with Anthropic’s Claude Fable 5.1 first and OpenAI’s GPT-6 Astra second, while grading and several benchmarks are updated (with GPQA Diamond removed).

Read the full story

OpenAI Anthropic AI Benchmarking Agentic Workflows

Every AI story that matters,
in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.