Researchers released ScarfBench, an open benchmark for evaluating AI agents on Java framework migration tasks across Spring, Jakarta EE, and Quarkus. The benchmark contains 34 applications, 204 migration tasks, and approximately 151,000 lines of code, with success measured by whether applications build, deploy, and preserve behavior. Current frontier AI agents achieve less than 10% behavioral success on the benchmark, revealing that dependency management across configuration, infrastructure, and runtime environments—rather than code translation itself—is the primary migration challenge.
Every Eval Ever and Hugging Face Community Evals have integrated their evaluation result systems to enable cross-posting and linking of benchmark scores across platforms. The combined datastore now contains approximately 229,000 evaluation results across 22,000 models and 2,200 benchmarks, drawn from 31 different reporting formats. Users can now submit evaluation results to both platforms simultaneously using a converter tool, with results appearing on model pages and linking back to full standardized records for reproducibility and interpretation.
GeneBench-Pro is a new benchmark for testing AI systems on genomics and biology tasks using real-world datasets. The benchmark evaluates performance across complex scientific research problems in these domains. Organizations can now measure how well AI models handle actual genomic data rather than simplified test cases.
Every AI story that matters,
in your inbox by 8am.
TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the
day in two minutes. Follow companies and topics for alerts, or get the
briefing in Slack. Free, no spam, unsubscribe anytime.
Reading TLDRocket needs no cookies, and the readership counts we rely on come from
our own cookieless analytics. Google Analytics is the exception: it sets cookies and
reports to Google, so it stays switched off until you allow it. You can change your
mind any time from “Cookie settings” in the footer.
Strictly necessary
Session security and form protection (tldrocket-session,
XSRF-TOKEN, 2 hours). The site cannot work without them,
so they need no consent.
Always on
Google Analytics 4 (_ga,
_ga_<id>, up to 2 years). Measures which
stories and sections readers use. Google acts as a third-party processor and may
store the data outside the EU. No advertising, no profiling, no data sold.
