Why the first GPU financiers are turning to inference chips in a $400 million deal

TechCrunch · 3 months ago · 34

General Compute, an AI inference cloud startup, secured a $400 million loan from Upper90 backed by SambaNova inference chips, marking the first time inference-specific hardware was used as collateral. The SN50 chips are designed to provide 16 times faster inference than GPU-based clouds while reducing costs through power efficiency and eliminating the need for expensive water-cooling systems. This financing signals a broader shift toward cheaper inference infrastructure using open-source models as alternatives to expensive frontier AI systems become more cost-competitive.