TLDRocket
Sign in

Language Models

181 summarised stories about Language Models, each linking back to the original source. Browse all topics →

+ Follow this topic

Monday, 11 December 2023

Mixtral of experts

Mistral AI 2 years ago 45 ● 4 sources

Mistral AI released Mixtral 8x7B, a sparse mixture-of-experts language model with open weights under Apache 2.0 license. The model has 46.7 billion total parameters but uses only 12.9 billion per token, matching or outperforming GPT-3.5 and Llama 2 70B on most benchmarks while running 6 times faster. Developers can now deploy the model using open-source tools like vLLM and access it through Mistral's API platform.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.