BLOOM
BLOOM is a 176-billion-parameter open-source multilingual language model developed through a collaboration of over 1,000 researchers and released in 2022, capable of generating text in 46 natural languages and 13 programming languages. The model has been the subject of multiple optimization efforts, including inference acceleration techniques using DeepSpeed and quantization methods like 8-bit compression that enable it to run on more accessible hardware. BLOOM's release under the BigScience RAIL license established an influential template for responsible AI licensing frameworks that balance open access with use-based restrictions.
Updated 3 August 2026
Specifications
No specifications recorded yet.
Latest developments
Petals
TLDR Dev · 1 week ago ·
34
Incredibly Fast BLOOM Inference with DeepSpeed and Accelerate
Hugging Face Blog · 3 years ago ·
1
OpenRAIL: Towards open and responsible AI licensing frameworks
Hugging Face Blog · 3 years ago ·
26
A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes
Hugging Face Blog · 3 years ago ·
47
The Technology Behind BLOOM Training
Hugging Face Blog · 4 years ago ·
12
Introducing The World's Largest Open Multilingual Language Model: BLOOM
Hugging Face Blog · 4 years ago ·
29
July 2026
September 2022
August 2022
- OpenRAIL: Towards open and responsible AI licensing frameworks
- A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes
July 2022
BLOOM, a 176-billion parameter multilingual language model, released as open-source by international research collaboration Open source release
Relationships
Products & technology
- Petals deploys this model · 1 source
- DeepSpeed integrated with this model · 1 source
- Hugging Face integrated with this model · 1 source
- Jean Zay supplies this model · 1 source
- NVIDIA supplies this model · 1 source
- BigScience develops this model · 1 source