Qwen1.5-110B: The First 100B+ Model of the Qwen1.5 Series

GitHub Pages · 2 years ago · 3

Alibaba released Qwen1.5-110B, a 110 billion parameter language model that matches Meta's Llama-3-70B performance on benchmark tests. The model achieves 8.88 on MT-Bench and 43.90% win rate on AlpacaEval 2.0, outperforming the previous 72B version of Qwen1.5. Larger model size without significant changes to training recipes demonstrates that scaling parameter count continues to improve both base and chat model capabilities.