Why Performance per Watt Is the Ultimate Metric for AI Infrastructure Efficiency

NVIDIA · 2 days ago

NVIDIA argues that performance per watt is the critical efficiency metric for AI infrastructure, as it determines how many tokens can be generated within a fixed power budget. The NVIDIA Blackwell NVL72 platform delivers up to 25x better performance per watt compared to the Hopper generation when serving mixture-of-experts models across a 72-GPU domain. This efficiency advantage will determine which organizations can scale their AI operations in a power-constrained environment.