TLDRocket
Sign in

2023, year of open LLMs

Hugging Face Blog

Meta released LLaMA in February 2023, followed by a wave of smaller, open-source language models including Mistral, Qwen, and Falcon released throughout the year. These models ranged from 3 billion to 70 billion parameters, with the best performers trained on 1 to 1.5 trillion tokens of data. The shift toward smaller models trained on more data made high-quality language models accessible to researchers and organizations with limited computing budgets.

Related stories

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads 60+ sources, removes duplicate coverage, and summarises the day in two minutes. Free, no spam, unsubscribe anytime.