Unlocking large scale AI training networks with MRC (Multipath Reliable Connection)

OpenAI Blog · 2 months ago

OpenAI released MRC, a networking protocol designed to improve reliability and performance across large supercomputer clusters used for AI training. The protocol operates through multiple data paths simultaneously, reducing failures that occur during the distributed training of large models. MRC becomes available to other hardware manufacturers and cloud providers through the Open Compute Project, potentially expanding adoption beyond OpenAI's infrastructure.