Aleph Alpha Releases Kolibri: A 78.1B Open-Weight English-German MoE Model With Only 3.46B Active Parameters
MarkTechPost 1 week ago 19 ● 2 sources
Aleph Alpha released Kolibri, an open-weight English-German Mixture-of-Experts language model designed for regulated, sovereign deployments. Kolibri has 78.1B total parameters but activates 3.46B (4.4%) per token and supports up to 1,048,576 tokens of context. The release adds Apache 2.0 model weights plus a vLLM deployment path with FP8 serving, reasoning control, and tool-call parsing, enabling users to run and fine-tune it on specified NVIDIA GPUs.