TLDRocket
Sign in

Open Source Models

107 summarised stories about Open Source Models, each linking back to the original source. Browse all topics →

+ Follow this topic

Wednesday, 18 September 2024

Qwen2.5-Coder: Code More, Learn More!

GitHub Pages 1 year ago 51 3 sources

Alibaba released Qwen2.5-Coder, an open-source coding model family trained on 5.5 trillion tokens of code and other data. The 7B version outperforms larger models like DeepSeek-Coder-V2-Lite and CodeStral-22B on code benchmarks, while maintaining math and general knowledge capabilities similar to the base Qwen2.5 model. A 32B version is forthcoming as the company aims to compete with proprietary code models.

Qwen2.5-Math: The world's leading open-sourced mathematical LLMs

GitHub Pages 1 year ago 37 2 sources

Alibaba released Qwen2.5-Math, an updated series of open-source mathematical language models in sizes 1.5B, 7B, and 72B parameters. The 72B-Instruct model achieved a score of 92.9 on the MATH benchmark using tool-integrated reasoning and solved 12 problems on the AIME 2024 exam compared to 1-2 problems for GPT-4 and Gemini models. The models now support both English and Chinese math problems using chain-of-thought and tool-integrated reasoning approaches, with the 7B model matching previous 72B model performance.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.