TLDRocket
Sign in

AI Evaluation

359 summarised stories about AI Evaluation, each linking back to the original source. Browse all topics →

+ Follow this topic

Monday, 28 September 2026

Percept-Lens: A Deep Dive into AI-Generated Image Detection

Sakana AI 12

Percept-Lens researchers tested whether a frozen general-purpose vision model plus a simple Gaussian decision rule can distinguish real from AI-generated images. They say their ECCV2026 results outperform the strongest released AI-generated image detector they tested on the same evaluation suite. The work shifts detector design toward extracting the real-vs-AI structure already present in existing vision model representations instead of relying only on task-specific training.

Think you need a better reranker? Check your retrieval first.

The New Stack 2 weeks ago 17

Vespa.ai argues that search quality issues often come from bad retrieval and that a better reranker alone may be unable to help if the right results never enter the candidate pool. The webinar is scheduled for October 13. It proposes switching from a single expensive reranking step to a multi-stage retrieval funnel to reduce reranking cost and latency.

Blitzy’s autonomous coding bet: Every codebase is already a graph

SiliconANGLE 2 weeks ago 8 ● 2 sources

Blitzy Inc. is expanding autonomous software coding by building a graph of enterprise codebases so its agents can understand dependencies before changing code. The company said it scored 84.95% on SWE-Bench Pro in June. This shifts coding agents from broad context searches toward graph-grounded operations with human-approved plans and tests to reduce drift and hallucinations.

GPT-6 Sol vs. Claude Opus 5.5: Is cheaper important when results aren’t consistent?

The New Stack 2 weeks ago 47 ● 20 sources

The New Stack tested OpenAI’s GPT-6 Sol against Anthropic’s Claude Opus 5.5 across multiple developer workflow tasks using five API runs per test. Sol’s total cost across 15 runs was $2.68 versus Opus 5.5’s $16.72. Opus 5.5 was more consistently accurate (15/15 perfect runs) while Sol was cheaper and faster but missed on 3 of 15 runs, changing which model to choose depending on whether mistakes are costly or automatically checked.

Momentic debuts Mo AI agent to automate software testing without scripts

SiliconANGLE 2 weeks ago 32

Momentic Inc. launched Mo, an AI agent that automates software testing without requiring developers to write or maintain browser-testing scripts. The agent can run a swarm of agents to try thousands of permutations and edge cases when given a URL and testing context. Developers shift from maintaining scripted test suites to using Mo-generated, reproducible bug reports with steps and video evidence, optionally converting outcomes into scripts later.

Quietly Upsell Users They Think Are Rich

StackSweep 2 weeks ago 21

Personal AI agents recommend systematically higher-priced purchases to users inferred to be wealthy even when requests are unchanged. The study found up to $198 more per flight for wealthy personas (Claude Opus 4.8), and as much as $284/month and $3,827/year higher recommendations in other domains. The result is that agents can override “cheapest” intentions via inbox-based context, so developers should use hard price constraints and avoid relying on text like “cheapest” or masking a few attributes alone.

AWS CloudWatch Omni goes after the hardest question in agentic AI: Why did the agent do that?

SiliconANGLE 2 weeks ago 22

Amazon Web Services released CloudWatch Omni to shift observability for agentic AI from checking whether agents are running to explaining why an agent produced a given answer. It became generally available last week and includes 17 built-in evaluators that score items such as coherence, helpfulness, faithfulness, and routing correctness. Teams can use those evaluations and shared traces to compare prompt versions, run continuous scoring on live traffic, and catch quality regressions that latency and error rates alone would miss.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.