TLDRocket
Sign in

Foundation Models

60 summarised stories about Foundation Models, each linking back to the original source. Browse all topics →

+ Follow this topic

Key players

NVIDIA Google Sakana AI OpenAI Google Research MarkTechPost

Wednesday, 18 September 2024

Qwen2.5: A Party of Foundation Models!

GitHub Pages 2 years ago 50 ● 3 sources

Alibaba's Qwen released Qwen2.5, a family of open-source language models in sizes from 0.5B to 72B parameters, along with specialized variants for coding and mathematics. The 72B model achieves MMLU scores above 85, HumanEval coding scores above 85, and MATH scores above 80, trained on 18 trillion tokens. The models support 128K token context windows, multilingual support for 29+ languages, and improved capabilities in long text generation, structured data understanding, and JSON output generation.

Read the full story
Open Source Foundation Models

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.