Mixtral of experts

Mistral AI · 2 years ago

Mistral AI released Mixtral 8x7B, a sparse mixture-of-experts language model with open weights under Apache 2.0 license. The model has 46.7 billion total parameters but uses only 12.9 billion per token, matching or outperforming GPT-3.5 and Llama 2 70B on most benchmarks while running 6 times faster. Developers can now deploy the model using open-source tools like vLLM and access it through Mistral's API platform.