TLDRocket
Sign in

Mixture-of-Experts

18 summarised stories about Mixture-of-Experts, each linking back to the original source. Browse all topics →

Monday, 16 March 2026

Introducing Mistral Small 4

Mistral AI 4 months ago

Mistral released Small 4, a single model that combines text reasoning, image processing, and coding capabilities previously split across separate specialized models. The model has 119 billion total parameters with 6 billion active per token, a 256,000 token context window, and achieves 40% lower latency and 3 times higher throughput than its predecessor. Users can now deploy one versatile model instead of switching between separate systems for chat, reasoning, and coding tasks.