Qwen
·
1 year ago
Alibaba's Qwen released Qwen2.5, a family of open-source language models in sizes from 0.5B to 72B parameters, along with specialized variants for coding and mathematics. The 72B model achieves MMLU scores above 85, HumanEval coding scores above 85, and MATH scores above 80, trained on 18 trillion tokens. The models support 128K token context windows, multilingual support for 29+ languages, and improved capabilities in long text generation, structured data understanding, and JSON output generation.
Qwen
·
1 year ago
Alibaba released Qwen2.5, a series of seven open-source language models ranging from 0.5B to 72B parameters, with new mid-size models at 14B and 32B designed for production use. The pre-training dataset expanded from 7 trillion to 18 trillion tokens, and Qwen2.5-72B achieved an MMLU score of 86.1 compared to Qwen2-72B's 84.2, while Qwen2.5-32B outperformed the larger Qwen2-72B in various benchmarks. The models show significant improvements in coding, mathematics, and long-context generation, with Qwen2.5-72B-Instruct reaching an Arena-Hard score of 81.2 and LiveCodeBench score of 55.5.
Qwen
·
1 year ago
Alibaba released Qwen2.5-Coder, an open-source coding model family trained on 5.5 trillion tokens of code and other data. The 7B version outperforms larger models like DeepSeek-Coder-V2-Lite and CodeStral-22B on code benchmarks, while maintaining math and general knowledge capabilities similar to the base Qwen2.5 model. A 32B version is forthcoming as the company aims to compete with proprietary code models.
Qwen
·
1 year ago
Alibaba released Qwen2.5-Math, an updated series of open-source mathematical language models in sizes 1.5B, 7B, and 72B parameters. The 72B-Instruct model achieved a score of 92.9 on the MATH benchmark using tool-integrated reasoning and solved 12 problems on the AIME 2024 exam compared to 1-2 problems for GPT-4 and Gemini models. The models now support both English and Chinese math problems using chain-of-thought and tool-integrated reasoning approaches, with the 7B model matching previous 72B model performance.
