Qwen2.5-Coder: Code More, Learn More!

Qwen · 1 year ago

Alibaba released Qwen2.5-Coder, an open-source coding model family trained on 5.5 trillion tokens of code and other data. The 7B version outperforms larger models like DeepSeek-Coder-V2-Lite and CodeStral-22B on code benchmarks, while maintaining math and general knowledge capabilities similar to the base Qwen2.5 model. A 32B version is forthcoming as the company aims to compete with proprietary code models.