Qwen2.5: A Party of Foundation Models!
Qwen ● Covered by 3 sources
Alibaba's Qwen released Qwen2.5, a family of open-source language models in sizes from 0.5B to 72B parameters, along with specialized variants for coding and mathematics. The 72B model achieves MMLU scores above 85, HumanEval coding scores above 85, and MATH scores above 80, trained on 18 trillion tokens. The models support 128K token context windows, multilingual support for 29+ languages, and improved capabilities in long text generation, structured data understanding, and JSON output generation.
Why it matters
GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD Introduction In the past three months since Qwen2’s release, numerous developers have built new models on the Qwen2 language models, providing us with valuable feedback. During this period, we have focused on creating smarter and more knowledgeable language models. Today, we are excited to introduce the latest addition to the Qwen family: Qwen2.5. We are announcing what might be the largest opensource release in history!