Reimagining Independence: How Meta’s AI Models Are Helping the University of Pittsburgh Transform Assistive Robotics
Meta AI 40
The University of Pittsburgh's RAMMP project is integrating Meta's AI models (DINOv3 and SAM) into assistive robotic systems to enable users to control devices through natural language and vision, detecting objects like door buttons and cups in real-time. The team optimized these models to run efficiently on battery-powered edge devices, reducing memory footprint and using lower precision where needed while maintaining reliability in unpredictable everyday environments. This allows assistive robot users to interact with their surroundings more naturally without complex interfaces or network connectivity, improving their ability to perform daily activities independently.