Qwen2.5-Max: Exploring the Intelligence of Large-scale MoE Model

Qwen · 1 year ago

Alibaba released Qwen2.5-Max, a Mixture-of-Expert language model pretrained on over 20 trillion tokens, which is now available through Alibaba Cloud's API and Qwen Chat. The model outperformed DeepSeek V3 on Arena-Hard, LiveBench, LiveCodeBench, and GPQA-Diamond benchmarks while achieving competitive results on MMLU-Pro. The API is accessible through Alibaba Cloud with OpenAI-compatible endpoints for developers to integrate the model into applications.