Introducing Mellum2: A 12B Mixture-of-Experts Model by JetBrains

Hugging Face Blog · 1 month ago

JetBrains released Mellum2, a 12-billion-parameter Mixture-of-Experts model trained on natural language and code under the Apache 2.0 license. The model activates only 2.5 billion parameters per token while delivering more than twice the inference speed of similarly sized competitors. Mellum2 is designed for latency-sensitive tasks like routing, retrieval-augmented generation, summarization, and agent subtasks within larger AI systems.