Graphcore and Hugging Face Launch New Lineup of IPU-Ready Transformers

Hugging Face Blog · 4 years ago

Graphcore and Hugging Face expanded the Optimum library to include 10 transformer models optimized for Graphcore's IPU processors, covering natural language processing, speech recognition, and computer vision tasks. The newly available models include BERT, GPT-2, RoBERTa, DeBERTa, BART, LXMERT, T5, HuBERT, and Wav2Vec2, each with pre-configured IPU files and pre-trained weights. Developers can now download and fine-tune these models on Graphcore systems with minimal code changes, including on the new Bow IPU processor that delivers 350 teraFLOPS and 40% better performance than previous generation hardware.