Nvidia’s AI advantage is moving beyond the GPU

TechCrunch · 1 month ago · 7 ● 3 sources

Nvidia is reframing its AI advantage as shifting from just GPU sales to efficiency gains in the surrounding rack-level systems that orchestrate data movement for megascale compute. It reported “upwards of 3x improvement” in these operations via its Vera CPU for traffic direction that prevents bottlenecks on flash and helps lower tokens-per-watt. As a result, competition is moving toward whole-system performance rather than GPU chips alone, with Nvidia aiming to benefit from the buildout of Vera Rubin-based infrastructures.