BLOOM
BLOOM is a 176-billion-parameter open-source multilingual language model developed through a collaboration of over 1,000 researchers and released in 2022, capable of generating text in 46 natural languages and 13 programming languages. The model has been the subject of multiple optimization efforts, including inference acceleration techniques using DeepSpeed and quantization methods like 8-bit compression that enable it to run on more accessible hardware. BLOOM's release under the BigScience RAIL license established an influential template for responsible AI licensing frameworks that balance open access with use-based restrictions.
Updated 3 August 2026
Specifications
No specifications recorded yet.
Latest developments
Petals
TLDR Dev · 1 week ago ·
34
Incredibly Fast BLOOM Inference with DeepSpeed and Accelerate
Hugging Face Blog · 3 years ago ·
1
OpenRAIL: Towards open and responsible AI licensing frameworks
Hugging Face Blog · 3 years ago ·
26
A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes
Hugging Face Blog · 3 years ago ·
47
The Technology Behind BLOOM Training
Hugging Face Blog · 4 years ago ·
12
Introducing The World's Largest Open Multilingual Language Model: BLOOM
Hugging Face Blog · 4 years ago ·
29
Q3 2026
Q3 2022
BLOOM, a 176-billion parameter multilingual language model, released as open-source by international research collaboration Open source release
- Incredibly Fast BLOOM Inference with DeepSpeed and Accelerate
- OpenRAIL: Towards open and responsible AI licensing frameworks
- A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes
- The Technology Behind BLOOM Training
- Introducing The World's Largest Open Multilingual Language Model: BLOOM
Relationships
Products & technology
- Petals deploys this model · 1 source
- DeepSpeed integrated with this model · 1 source
- Hugging Face integrated with this model · 1 source
- Jean Zay supplies this model · 1 source
- NVIDIA supplies this model · 1 source
- BigScience develops this model · 1 source