The AI compute gap: Enterprises are buying infrastructure faster than they can measure what it costs

VentureBeat · 3 months ago · 36 ● 5 sources

Across 107 enterprises surveyed, AI infrastructure spending is accelerating faster than organizations can track its costs, with most unable to measure unit economics clearly despite rapid buying decisions. 83% of enterprises report GPU utilization of 50% or less, and only 44% can rigorously track what their AI compute costs, while 45% plan to evaluate AI-specialized cloud providers within the next year despite almost none using them today. The result is a compute gap where enterprises are investing aggressively in infrastructure they do not yet use while lacking visibility into the economics of what they already own, with 64% planning to switch or add infrastructure providers within twelve months.