TLDRocket
Sign in

Mixtral of experts

Mistral AI Covered by 4 sources

Mistral AI released Mixtral 8x7B, a sparse mixture-of-experts language model with open weights under Apache 2.0 license. The model has 46.7 billion total parameters but uses only 12.9 billion per token, matching or outperforming GPT-3.5 and Llama 2 70B on most benchmarks while running 6 times faster. Developers can now deploy the model using open-source tools like vLLM and access it through Mistral's API platform.

Also covered by

Related stories

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads 60+ sources, removes duplicate coverage, and summarises the day in two minutes. Free, no spam, unsubscribe anytime.