Microsoft reveals cutting-edge MAI-Base-2 model with 2T parameters
SiliconANGLE 4 days ago 43 ● 3 sources
Microsoft’s AI research team detailed its MAI-Base-2 base model, which is built to be converted into full LLMs via additional training. The model has 2 trillion parameters and activates 80 billion per prompt, and it was trained for 38 days on 16,000 Nvidia GB200 chips with 50 trillion tokens. Microsoft says MAI-Base-2 is up to 12 times more hardware-efficient, will be licensed to “trusted partners” on Azure, and will be used to power a new line of LLMs.