TLDRocket
Sign in

AI Benchmarking

290 summarised stories about AI Benchmarking, each linking back to the original source. Browse all topics →

+ Follow this topic

Tuesday, 15 September 2026

Google’s new speech model Gemini 3.8 Live supports real-time reasoning

SiliconANGLE 1 month ago 35 ● 7 sources

Google launched Gemini 3.8 Live and Gemini 3.8 Live Extended Thinking to cut latency in voice AI by enabling near-real-time reasoning and simultaneous speech-and-thought processing while running background tool calls. Gemini 3.8 Live Extended Thinking scored 82.6 on the Artificial Analysis Speech to Speech Quality Index. Developers and enterprises can now use the models via the Gemini API, Google AI Studio, and Gemini Enterprise private preview, with Gemini 3.8 Live priced at $0.005 per minute for audio inputs and $0.018 per minute for outputs, and the Extended Thinking variant adding separate charges for reasoning tokens and extra inputs like video and documents.

Can Skills Learned in Games Transfer to Real-World Work?

Latent Space 1 month ago 41

Good Start Labs trained an AI model inside a game set in 1830 and then tested it on finance-research tasks to see whether game-learned skills transfer. The company found that only a multi-turn terminal-agent setup improved performance on the Finance-Agent benchmark, while single-turn question answering did not. The results pushed the company to focus on training design—especially tool-using, goal-directed environments with verifiable rewards—because that’s what makes the skills carry into downstream work.

Exclusive: Paying for frontier AI models buys 4-month head start at 5x the cost

Ars Technica 1 month ago 46 ● 9 sources

Mozilla reports the performance gap between US frontier AI models and top Chinese open-weights models has narrowed to 4.4 months, changing how companies choose between them. It says Kimi K3 scores only 3 points behind Anthropic’s Fable 5 while costing 30 percent as much. The result is a shift toward open models as the default for most routine work, reserving paid closed models for specific heavy workloads like expert tasks and long-context retrieval.

A theoretical separation between quantum computers & LLMs

IBM Research 1 month ago 41

Researchers proved a theoretical separation showing shallow quantum circuits outperform limited transformer-style LLM models on specific computational tasks, both for returning correct values and for sampling from a target distribution. The circuit depth stays close to constant while the functional separation uses an iterated index problem solved by a close-to-constant-depth quantum circuit with a single classical AND gate. The work expands the known frontier of quantum-vs-classical lower bounds by extending them against stronger LLM capabilities like chain-of-thought and by motivating benchmarks for comparing quantum systems to LLMs.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.