Vibe Coding XR: Accelerating AI + XR prototyping with XR Blocks and Gemini

Google Research · 3 months ago

Google announced Vibe Coding XR, a system that uses Gemini to generate functional Android XR applications from natural language descriptions in under 60 seconds by combining the LLM with the XR Blocks framework. The system achieved approximately 70% success rate initially on a dataset of 60 prompts (VCXR60), with reliability improving to higher rates through 11 major releases when using Gemini's Pro Mode. The tool enables users without XR expertise to prototype spatial computing applications, educational experiences, and interactive environments directly on Android XR headsets through voice or text prompts.