AI Inference

36 summarised stories about AI Inference, each linking back to the original source. Browse all topics →

Tuesday, 28 April 2026

Tenstorrent’s Galaxy Blackhole AI servers escape the event horizon

The Register 2 months ago

Tenstorrent announced general availability of its Galaxy Blackhole AI compute platform, which packages 32 Blackhole accelerators into 6U systems offering 23 petaFLOPS of FP8 performance for $110,000 per node. A four-node Galaxy Supercluster costs $440,000 and can process a 100,000 token prompt in under four seconds while generating up to 300 tokens per second for DeepSeek V3. The improved software stack now supports considerably more models than before, with the company claiming 90 percent of Hugging Face models run on the platform, and Tenstorrent expects broader adoption through datacenter providers like Cirrascale and Equinix.

AI Accelerators AI Hardware AI Inference Tenstorrent

Microsoft's GitHub shifts to metered AI billing amid cost crisis

The Register 2 months ago

GitHub is switching Copilot from request-based to usage-based token billing on June 1, 2026, after subsidizing expensive inference costs became unsustainable. Copilot Pro subscribers will receive 1,000 AI Credits per month at $0.01 per credit, with complex models like Anthropic's Opus seeing pricing multipliers increase from 7.5x to 27x. Customers will face variable costs based on token consumption and can define overflow budgets or wait for monthly resets, while subscription rates remain unchanged but more expensive model usage is now explicitly metered.

AI Cost & Economics AI Inference AI Monetization GitHub