NVIDIA
·
2 hours ago
● 3 sources
NVIDIA released Spectrum-6, a 102.4-terabit-per-second Ethernet switch system that doubles the capacity of previous-generation switches, designed to connect hundreds of thousands of GPUs in large AI training facilities. CoreWeave, Microsoft, Nebius, SpaceX AI and Tesla are among the first to deploy Spectrum-6 as part of NVIDIA's Vera Rubin platform. The switch enables better coordination between GPUs during large-scale training and inference, reducing bottlenecks that occur when GPUs need to exchange data continuously at gigascale.
TLDR
·
6 hours ago
AMD launched Helios, its first rack-scale AI system, with Microsoft as a major new customer joining Meta, OpenAI, and Oracle. The Helios system is estimated to cost between $5 million and $5.5 million, compared to Nvidia's Vera Rubin at $3.5 million to $4 million, and AMD will begin shipping later this year. AMD's entry into rack systems could increase its data center GPU market share from 4.5% to potentially 20-25%, challenging Nvidia's 95% dominance in this segment.
The Verge
·
11 hours ago
Data centers powering AI models consume enormous amounts of energy and water while producing air pollution and greenhouse gas emissions, with GPUs in these facilities now drawing scrutiny for environmental and health impacts. Training Meta's Llama 3.1 could generate air pollution equivalent to 10,000 round-trip car journeys between Los Angeles and New York, and AI data centers' power consumption is projected to reach 165-326 terawatt-hours annually by 2028 in the US. Communities are increasingly concerned as data centers expand in their regions, raising utility costs and local pollution while many consumers question whether promised AI benefits justify the environmental costs.
