34 summarised stories about Benchmarking, each linking back to the original source. Browse all topics →
OpenAI 7 months ago 29
OpenAI and Pacific Northwest National Laboratory created DraftNEPABench, a benchmark for testing how AI agents can help with federal environmental permitting documents. The benchmark shows potential to reduce the time spent drafting National Environmental Policy Act documents by up to 15%. The tool could speed up infrastructure review processes that currently delay federal projects.
The daily briefing
TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.
TLDRocket
15 October 2026
Meta used today’s open-weight model drop to make a point: “frontier” doesn’t have to stay in the datacenter. Muse Spark Open ships as an 816B multimodal model with a 1 million–token context window, paired with Muse Code for coding and agent-style workflows—and it comes with strings. The license is free for use and fine-tuning, but it adds revenue-linked conditions (including advance notice above $20 million) and asks developers to display “Built with Muse Spark Open.” Running locally is a hardware project in itself: Meta says you need about 1TB of RAM. Still, the rollout is broad—Meta is making it available via multiple API platforms for desktop-focused tasks, and now through Amazon SageMaker JumpStart for deploy-to-your-own-AWS-account use, including BF16 and a 4-bit NVFP4 variant.
Read the full briefing →