BLOOM, a 176-billion parameter multilingual language model, released as open-source by international research collaboration
Open source release Provisional 95% confidence first seen
Researchers from over 1,000 contributors across 70+ countries completed training of BLOOM, a large multilingual language model with 176 billion parameters capable of generating text in 46 natural languages and 13 programming languages. The model was trained on France's Jean Zay supercomputer over 3.5 months using 384 NVIDIA A100 GPUs and released openly under a Responsible AI License to increase accessibility of advanced AI to academia and smaller institutions.