TLDRocket
Sign in

AI Evaluation

360 summarised stories about AI Evaluation, each linking back to the original source. Browse all topics →

+ Follow this topic

Tuesday, 15 September 2026

AI agent certification startup AIUC raises $40M to begin auditing frontier models

SiliconANGLE 1 month ago 18 ● 125 sources

AI agent certification startup AIUC announced a $40M funding round to start auditing frontier AI models beyond the agents built on top of them. The certification process includes running an agent through about 5,000 combinations of risk and attack for the business using it, with recertification every quarter. As a result, AIUC plans to extend its audit and insurance work to frontier models, where it says security and reliability checks are increasingly blocking deployments.

Your Agent Aced the Task. Will It Do It Again?

Hugging Face 1 month ago 17 ● 2 sources

A ReAct agent using GPT-4.1 completed AppWorld tasks in 77.4% of runs on average but only 53.0% of tasks on all 5 repeated runs, exposing a 24.4-point consistency gap. The project introduced the Consistency Analyzer and consistency guidelines, then cut the gap from 24.4pp to 12.0pp, raising aggregate Pass^5 from 53.0% to 69.0% (Mean@5 from 77.4% to 81.0%). Reporting shifts from average accuracy to also tracking Pass^k, and the new tooling is offered to make agents more reliable without reducing average performance.

[AINews] AEF-1 standard emerges for Third Party Evaluators, as Xai, OpenAI, and Anthropic all cosign

Latent Space 1 month ago 29 ● 30 sources

AI Evaluator Forum (AEF) released AEF-1, a baseline standard for independent third-party AI evaluations with rules on evaluator access, conflicts of interest, funding relationships, recusal, and transparency, and Xai, OpenAI, and Anthropic cosigned it. The AI Evaluator Forum itself was formed in December 2025. Labs can now align on a more concrete third-party evaluation framework, changing how outside evaluators are recruited and audited for safety and alignment claims.

AgentScore

Product Hunt 1 month ago 44

Latitude launched AgentScore as its 9th launch, offering a daily quality score for production agents connected to Latitude across outcome, reliability, cost, speed, and safety. The score updates daily. As a result, teams can track whether their agents are improving or getting worse over time.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.