Model Optimization

41 summarised stories about Model Optimization, each linking back to the original source. Browse all topics →

Key players

Hugging Face OpenAI Anthropic NVIDIA Alibaba Apple

Tuesday, 18 August 2026

How Much Memory Does Your Agent Actually Need?

Hugging Face 1 week ago 20

A study of ALTK-Evolve found that agents benefit from different amounts of self-distilled memory guidelines depending on model capability: stronger models gain from the full guideline set, weaker models perform better with selective retrieval, and saturated models show no improvement.The strongest result was gpt-oss-120b gaining +16.1 percentage points in task completion using curated retrieval while adding only 5% token overhead, compared to full guideline injection which cost 51% more tokens.This means agentic memory should be calibrated per model tier rather than simply maximized, with prompt caching making even large guideline sets affordable in production.

Read the full story

Agentic AI Agent Architecture Model Optimization

The Sequence Knowledge - Issue 916: From Thinking Longer to Learning Better

TheSequence 1 week ago 43

Researchers are exploring test-time compute distillation, a method where AI models learn to replicate in a single forward pass what they achieve through expensive inference-time techniques like sampling multiple candidates and voting. The approach treats the ensemble of samples plus voting as a better model and attempts to compress that capability back into the network weights. This technique could reduce inference costs while maintaining accuracy gains that previously required expensive test-time compute scaling.

Read the full story

Advanced Reasoning Inference Optimization Model Optimization

Every AI story that matters,
in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.