TLDRocket
Sign in

AI Efficiency

132 summarised stories about AI Efficiency, each linking back to the original source. Browse all topics →

+ Follow this topic

Wednesday, 9 September 2026

Apple's iPhone 18 Pro adds variable camera aperture and a more powerful chip

Ars Technica 1 month ago 25 ● 7 sources

Apple released the iPhone 18 Pro with updated camera controls and a new A20 Pro chip. The A20 Pro is Apple’s first 2 nm iPhone chip. As a result, users get a variable aperture camera and improved AI/ML processing via a larger Neural Engine design, alongside faster CPU and GPU performance.

Pretraining Progress Is Mostly Coming From Data

Dwarkesh Podcast 1 month ago 10

Researchers compared pretraining recipes and data corpora from 2019 to 2025 and found more of the compute-efficiency gains came from data than from model changes. Data improvements contributed 3.24x more compute efficiency gains than model improvements (12.0x for data vs 3.7x for models) at a 1e19 FLOPs budget. The study concludes data and model improvements are mostly independent additively (88% of OLMES score variance explained), so progress is increasingly driven by better data engineering rather than interacting with specific model tweaks.

Inside the Megakernel Serving Engine for North Mini Code

Cohere 1 month ago 2

Cohere released a serving engine for its North Mini Code model built around a decode megakernel running BF16 on a single H100. On batch size 1 it reached 292 tok/s, or 62% of the H100’s bandwidth ceiling (SoL), and was about 1.58× faster than vLLM end-to-end. The serving stack changes from many small decode kernels with synchronization gaps to a single persistent kernel that uses task-level scheduling and synchronization to raise decode throughput without measurable accuracy loss.

What the CPU shortage means for software teams

Katelyn Lesse 1 month ago 33

The tech industry is facing a CPU supply shortage that is tightening infrastructure bottlenecks for software teams, including agentic workloads. Server orders are quoting about 6 months and prices are up roughly 10–20% since March. Teams now need to forecast and capacity-plan CPU usage earlier, optimize how capacity is isolated and utilized, and improve cluster bring-up and software efficiency.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.