Baseten's Philip Kiely and Ali Taha discuss inference engineering as a specialized discipline for turning trained model weights into fast, reliable production APIs, covering techniques like quantization, speculative decoding, and cache-aware routing. In one GLM-5.2 experiment, quantizing more of the model increased throughput by 20% while preserving benchmark quality because errors in different layers cancelled each other out. Inference optimization has become as critical as model training itself, enabling gains of 20% to 200% and making models up to 10 times faster at scale.
A data roundup reports that ChatGPT users are applying the tool to tasks outside their primary job roles, employees using AI for multiple use cases report twice the productivity gains compared to single-use adoption, and agentic AI patents grew 59% globally in the past year to represent 9% of all AI application patents. Companies in the AI supply chain value chain are outperforming the broader market, with Bloomberg's AI Value Chain companies beating earnings expectations by 71% versus 27% for the S&P 500 in Q2. The data suggests AI adoption is broadening across job functions and that infrastructure and supply chain companies are capturing disproportionate value from AI expansion.
European tech companies raised €30 billion in H1 2026, up 46% from H1 2025, but the number of funding rounds fell 18% to 1,555, indicating capital concentration in fewer deals. Seven mega-funding rounds occurred, including Isomorphic Labs' €1.8 billion Series B and Nscale's €1.7 billion Series C, with AI and infrastructure companies receiving the majority of capital. The exit market contracted 25% to 559 acquisitions while IPOs dropped 43% to eight, though completed deals were larger in value.
Microsoft raised Xbox Series X prices by £170, citing rising memory chip costs driven partly by AI industry demand for processors. The price increase applies to a console released six years ago, joining broader console price hikes across the industry in recent months. Higher hardware costs may push consumers toward game streaming services and away from traditional console purchases.
Larry Ellison built Oracle into a major AI infrastructure player by securing deals after Trump's policy changes, but the company's heavy debt load is now drawing investor concern about whether his AI strategy can sustain itself. Oracle's leverage ratios have risen significantly as Ellison committed billions to data center buildouts and AI partnerships. If sentiment shifts or capital markets tighten, the company could face pressure to prove these investments generate returns before debt becomes unmanageable.
Every AI story that matters,
in your inbox by 8am.
TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the
day in two minutes. Follow companies and topics for alerts, or get the
briefing in Slack. Free, no spam, unsubscribe anytime.
Reading TLDRocket needs no cookies, and the readership counts we rely on come from
our own cookieless analytics. Google Analytics is the exception: it sets cookies and
reports to Google, so it stays switched off until you allow it. You can change your
mind any time from “Cookie settings” in the footer.
Strictly necessary
Session security and form protection (tldrocket-session,
XSRF-TOKEN, 2 hours). The site cannot work without them,
so they need no consent.
Always on
Google Analytics 4 (_ga,
_ga_<id>, up to 2 years). Measures which
stories and sections readers use. Google acts as a third-party processor and may
store the data outside the EU. No advertising, no profiling, no data sold.
