SAM 3.1: Faster and More Accessible Real-Time Video Detection and Tracking With Multiplexing and Global Reasoning

Meta AI Blog

Meta released SAM 3.1, an updated version of its Segment Anything Model that processes video object tracking more efficiently through a technique called object multiplexing. The model doubles processing speed from 16 to 32 frames per second on a single H100 GPU by tracking up to 16 objects in a single forward pass instead of processing each object separately. This enables real-time object tracking in complex videos while reducing GPU resource requirements, making the technology feasible on smaller hardware.