OFASys: Enabling Multitask Learning with One Line of Code!

GitHub Pages · 3 years ago · 36

Researchers released OFASys, a framework for training multimodal multitask learning models that simplifies setup by allowing users to define tasks with a single line of code through an Instruction template. The team trained OFA+, a generalist model handling text, image, speech, video, and motion data across 23 tasks spanning 7 modalities while preserving 95% of specialist model performance. The framework abstracts away implementation complexities like data preprocessing and model configuration, enabling researchers to focus on task and modality design.