118 summarised stories about Cost Optimization, each linking back to the original source. Browse all topics →
Together AI 1 year ago 30
An AI company released an updated Batch Inference API offering a redesigned interface, support for more models, and rate limits increased to 30 billion tokens. The rate limit increase represents a 3000× improvement over the previous version. The enhancement enables users to process large datasets at 50% lower cost compared to real-time API pricing.
The daily briefing
TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.
TLDRocket
17 October 2026
Microsoft used today’s announcement to zoom in on what matters in scaling: not just raw capability, but the plumbing behind it. The company revealed MAI-Base-2, a 2T-parameter base model designed to be converted into full LLMs with additional training. Per Microsoft, only 80B parameters activate per prompt, and the training run ate 50T tokens over 38 days using 16,000 Nvidia GB200 GPUs. The headline claim: MAI-Base-2 is up to 12× more hardware-efficient than its predecessors, a metric that will matter to anyone trying to keep inference costs from swallowing margin.
Read the full briefing →