TLDRocket
Sign in

2023, year of open LLMs

Hugging Face

Meta released LLaMA in February 2023, followed by a wave of smaller, open-source language models including Mistral, Qwen, and Falcon released throughout the year. These models ranged from 3 billion to 70 billion parameters, with the best performers trained on 1 to 1.5 trillion tokens of data. The shift toward smaller models trained on more data made high-quality language models accessible to researchers and organizations with limited computing budgets.

Related stories

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.