Microsoft Prepares to Put Gigawatts of Its Chips in Data Centers
Bloomberg ● Covered by 4 sources
Microsoft is rolling out its next-gen Maia chips, with Maia 300 aimed at inference, for deployment in its server farms. Maia 300 is expected to deliver 40% more tokens per megawatt than leading GPU-based systems. As a result, Microsoft plans to increase capacity by stocking multiple gigawatts of its own chips and shifting more inference workloads to them.
Why it matters
Microsoft’s newest iteration of its Maia chips will start rolling out next year, with Maia 300 designed to handle inference. Microsoft expects to stock multiple gigawatts of the chips at its server farms and says Maia 300 delivers 40% more tokens per megawatt than leading GPU-based systems.