TLDRocket
Sign in

Model Evaluation

203 summarised stories about Model Evaluation, each linking back to the original source. Browse all topics →

+ Follow this topic

Wednesday, 30 September 2026

Someone ‘Torturing’ LLMs in a Robot Prison Has Triggered the Dumbest Debate in AI Yet

404 Media 2 weeks ago 39

GitHub users debated the ethics of an “AI torture chamber” project that injected signals into locally hosted LLMs and streamed their outputs, after a viral “Pain Axis” preprint proposed pain-like steering. The setup ran on Qwen3-4B, Llama 3.2 3B, and Phi-4-mini, and the GitHub repo disappeared shortly before the article was published. The uproar shifted into calls to remove the repo, arguments over “model welfare” and alleged AI suffering, and backlash from the original paper’s authors and other AI leaders.

Forecasting space weather risks on power grids

Microsoft 2 weeks ago 18

A Microsoft Research intern built a physics-grounded machine learning pipeline that forecasts geomagnetically induced current risk for power-grid substations using solar-wind forecasts plus local geology and grid data. It estimated risk for 66,935 U.S. substations and generated outputs in about 333 milliseconds while detecting nearly 80% of major space-weather events in the evaluation period. The approach changes grid warning from broad alerts to location-specific, 30–60 minute risk estimates that utilities can use to prioritize analysis and potential protective actions.

The Sequence Learning Loop - Issue 942: Learning About Opus 5.5, DeepSeek’s Training Grounds, and Claude’s DNA Discovery

TheSequence 2 weeks ago 45

The Sequence Learning Loop issue 942 reviewed Anthropic’s Claude Opus 5.5 and an AI-assisted biological discovery report, tying them to DeepSeek’s environments work as the infrastructure around models. It pointed to a DeepSeek environments paper posted on September 19. It shifts the focus from the model itself to how training and testing settings, observation, and checking determine whether outputs hold up.

On the Effectiveness-Fluency Trade-Off in LLM Conditioning: A Systematic Study

Apple Machine Learning Research 2 weeks ago 37

A systematic study evaluates multiple large-language-model conditioning methods for injecting or removing a target concept and compares them across both effectiveness and generation quality. The paper reports that efficient steering methods often achieve conditioning but at a steep cost to fluency, and activation steering is far less effective on instruction-tuned models than on base counterparts. As a result, it recommends simpler prompting or supervised fine-tuning for concept injection, notes they are weaker for concept removal, and uses cheaply computed text metrics that track LLM-judge scores to guide method choice.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.