118 summarised stories about Cost Optimization, each linking back to the original source. Browse all topics →
OpenAI 2 years ago 44
Anthropic added prompt caching to its API, which reduces costs for repeated input sections by storing them in the model's cache. Cached tokens cost 90% less than standard tokens after a 1,024-token minimum, and cached content remains available for five minutes. Users can lower expenses for applications that process the same documents, codebases, or instructions repeatedly.
The daily briefing
TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.
TLDRocket
17 October 2026
Microsoft’s MAI-Base-2 announcement sets the pace for the day, shifting attention from flashy model demos to the plumbing that makes large language models practical. The 2T-parameter base model is designed to become a full LLM after additional training, with 80B parameters activated per prompt. Microsoft says it trained the model for 38 days on 16,000 Nvidia GB200 chips using 50T tokens, and that MAI-Base-2 is up to 12× more hardware-efficient. The company’s licensing plan—availability through “trusted partners” on Azure—signals a platform strategy: build a reusable foundation that can spawn multiple task-specific LLM lines, rather than betting everything on a single downstream model.
Read the full briefing →