Gemini Robotics ER 2: powering robotics with video understanding, task orchestration, and multi-robot collaboration

Google DeepMind · 2 months ago · 22 ● 7 sources

Google launched Gemini Robotics ER 2, an AI model that enables robots to understand video feeds, plan multi-step tasks, and collaborate with other robots in physical environments. The model achieves 57.4% accuracy on progress classification and 91.3% accuracy on moment-finding tasks while operating at sub-second latency required for safe real-world robotics. Developers can now access the model via the Gemini API and Google AI Studio, enabling robots to independently track progress, adapt to failures, and coordinate with other machines to complete complex workflows.