Minions: A Dynamic and Distributed Virtual GPU Cloud Built on Idle Apple Silicon Devices

Apple Machine Learning Research · 4 days ago · 40

Minions aggregates idle Apple Silicon GPUs from macOS devices into a dynamic, distributed virtual GPU cloud for large-scale machine learning inference. The paper reports that idle macOS devices can be transformed into a practical distributed GPU inference platform when centralized GPU resources are constrained. As a result, teams can run GPU inference workloads with fault tolerance and better elasticity without buying more GPU hardware.