OpenAI unveiled Jalapeño, its first custom inference processor developed with Broadcom, designed to reduce dependence on Nvidia GPUs. Early testing shows significantly better performance-per-watt than current alternatives, with the chip specifically optimized for low-cost inference on real-time coding models. The move allows OpenAI to control more of its infrastructure stack, potentially improving operating economics and enabling faster, more reliable, and cheaper service delivery.
OpenAI and Broadcom unveiled Jalapeño, a custom AI chip designed for inference workloads, marking OpenAI's first entry into silicon manufacturing. The chip was designed in nine months and will be deployed starting late 2026, with significant scaling expected in 2027 and early 2028. OpenAI aims to reduce dependence on Nvidia GPUs and build a complete technology stack to serve AI models more efficiently and affordably.
IBM announced 0.7 nanometer transistor chips, the smallest in the world, using a new three-dimensional nanostack architecture with innovations in wafer bonding and memory scaling. The chips are 70% more efficient than IBM's previous 2 nanometer chips from 2021, and could theoretically enable AI accelerators to deliver 9,000 TOPS compared to current accelerators' 1,500 TOPS, potentially reducing training time for large language models from three months to two weeks. The nanostack design could support a decade of further chip innovations by stacking transistors vertically rather than only shrinking them horizontally.
Every AI story that matters,
in your inbox by 8am.
TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the
day in two minutes. Follow companies and topics for alerts, or get the
briefing in Slack. Free, no spam, unsubscribe anytime.
Reading TLDRocket needs no cookies, and the readership counts we rely on come from
our own cookieless analytics. Google Analytics is the exception: it sets cookies and
reports to Google, so it stays switched off until you allow it. You can change your
mind any time from “Cookie settings” in the footer.
Strictly necessary
Session security and form protection (tldrocket-session,
XSRF-TOKEN, 2 hours). The site cannot work without them,
so they need no consent.
Always on
Google Analytics 4 (_ga,
_ga_<id>, up to 2 years). Measures which
stories and sections readers use. Google acts as a third-party processor and may
store the data outside the EU. No advertising, no profiling, no data sold.