TLDRocket
Sign in

AI Benchmarking

285 summarised stories about AI Benchmarking, each linking back to the original source. Browse all topics →

+ Follow this topic

Thursday, 1 October 2026

Exclusive: Nine-person Halluminate raises $30 million, counts four top U.S. AI labs as customers

Fortune 22

Halluminate raised a Series A to build AI training environments for financial workflows and is using benchmarks to identify where AI agents fail on deal due-diligence tasks. The round brought in $30 million and increased its total funding to $38.5 million. The company will turn benchmark failure modes into reinforcement-learning environments and focus first on frontier model labs rather than enterprise customers.

Cohere Releases Embed 5: How It Compares to Voyage 4 Large, Gemini Embedding 2, and OpenAI

MarkTechPost 2 weeks ago 46 ● 2 sources

Cohere released Embed 5, a new embedding model family for enterprise search, RAG, and agentic retrieval with two tiers (Pro and Fast). Embed 5 Fast costs $0.08 per 1M text tokens. It lets you index with Pro and query with Fast in the same embedding space, offers shared multi-modal inputs (text and images) and reduced vector storage options, and is deployable via Cohere’s API and Model Vault or through vLLM on private VPC/on-prem setups.

With most information hidden, the game Stratego

Ars Technica 2 weeks ago 4

Ataraxos, an AI system by researchers from Carnegie Mellon, MIT, NYU, and Stanford, beat top Stratego player Pim Niemeijer 15 games to 1. The system was trained using 16 GPUs. This shows that imperfect-information board games with long-running hidden information can now be solved to human-beating levels with comparatively modest computing resources, shifting Stratego from an AI-stalemate into a new benchmark for AI research.

Gemini 4 Argon: Our Next Era of Frontier Intelligence

Google 2 weeks ago 50 ● 16 sources

Google announced Gemini 4 Argon, a new frontier AI model, and is rolling it out first to a trusted set of cyber defenders through its Fairwind Program while seeking phased pre-release access via a U.S. government process. It will launch with $2 per million input tokens and $10 per million output tokens (and cached input at 95% off), with the output token limit increased to 1M tokens from 64K. Access will expand gradually beyond the cyber cohort—after safety and guardrails iterations—starting with paid API customers and Google AI Ultra subscribers.

NVIDIA Releases Kumo Tabular: Open Tabular Foundation Models That Predict New Rows in a Single Forward Pass

MarkTechPost 2 weeks ago 18 ● 2 sources

NVIDIA released Kumo Tabular, a new family of tabular foundation models for classification and regression that predicts new rows from labeled context in a single forward pass. The Small/Medium/Large models range from about 28M to 215M parameters. It comes packaged with NVIDIA’s structured-data foundation model (SDM) library and permissive OpenMDW-1.1 weights that allow commercial use, plus reported top benchmark results like an Elo score of 1950 on TabArena.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.