Introducing The World's Largest Open Multilingual Language Model: BLOOM

Hugging Face Blog · 4 years ago

Researchers released BLOOM, a multilingual language model trained through a collaboration of over 1,000 researchers across 70+ countries, designed to make advanced AI more accessible to academia and smaller institutions. The model contains 176 billion parameters and can generate text in 46 natural languages and 13 programming languages, with training completed after 117 days on a French supercomputer using an estimated €3M in compute resources. The open release under a Responsible AI License allows anyone to download, study, and build upon the model locally or via cloud providers, removing previous barriers that restricted large language model access to a few industrial labs.