AI inference workloads are pushing data center design beyond GPU performance toward storage latency, network bandwidth, data movement, and power as organizations deploy generative and agentic apps in production. Kioxia reported random-read performance improved by 76% and random-write performance by over 100% moving from CM7 to its BiCS8-based CM9 drives. Systems increasingly use coordinated full-stack architectures—such as storage supporting cached context—to hit latency and throughput goals while managing power limits and data “gravity” concerns.
Silicon Data raised $30 million to create a reference price and index for GPU rental so Wall Street can hedge AI compute costs. The startup plans to launch compute futures trading on the CME on October 5, pending regulatory approval. If approved, GPU compute pricing and hedging tied to the index and futures contract become available through CME trading.
Relativity Networks raised $22 million in funding to deploy hollow-core fiber optic cables that transmit data 30% faster than conventional fiber by routing light through a vacuum chamber instead of glass. The company achieved a signal latency reduction from five microseconds per kilometer to three and a half microseconds, with a hyperscaler also committing to a $40 million follow-on order. This speed improvement allows data centers to span larger geographic distances before latency becomes problematic, potentially reshaping where AI infrastructure can be built as compute scales across multiple campuses.
Memory prices have surged 500% in 12 months, with 128GB DDR5 kits now ten times more expensive than historical lows, while hyperscalers have locked in nearly all global DRAM production capacity through 2027 with advance deposits. DRAM chips now cost over half as much per kilogram as solid gold, reversing Moore's Law for memory as AI infrastructure demand outstrips supply. This shortage is forcing AI companies to secure multi-year supply commitments and fundamentally reshaping hardware economics for training and inference systems.
Every AI story that matters,
in your inbox by 8am.
TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the
day in two minutes. Follow companies and topics for alerts, or get the
briefing in Slack. Free, no spam, unsubscribe anytime.
Reading TLDRocket needs no cookies, and the readership counts we rely on come from
our own cookieless analytics. Google Analytics is the exception: it sets cookies and
reports to Google, so it stays switched off until you allow it. You can change your
mind any time from “Cookie settings” in the footer.
Strictly necessary
Session security and form protection (tldrocket-session,
XSRF-TOKEN, 2 hours). The site cannot work without them,
so they need no consent.
Always on
Google Analytics 4 (_ga,
_ga_<id>, up to 2 years). Measures which
stories and sections readers use. Google acts as a third-party processor and may
store the data outside the EU. No advertising, no profiling, no data sold.
