Vibe Coding XR: Accelerating AI + XR prototyping with XR Blocks and Gemini
Google Research
Google just launched Vibe Coding XR, letting you type or speak a prompt and get a working AR/VR app in under a minute. No headset coding skills needed anymore, just Gemini and words.
Based on reporting by Google Research — read the original for the full story.
Summary, retelling and take written by AI under human oversight; images are AI-generated illustrations. How we work · Report an error
Google Research dropped something this week that quietly solves a problem XR developers have complained about for years: building anything in extended reality has always meant wrestling with game engines, sensor APIs, and perception pipelines just to test a basic idea. Vibe Coding XR skips all that. Open the XR Blocks Gem in Chrome on an Android XR headset like Galaxy XR, type or speak a prompt, and Gemini writes a functional, physics-aware app in under 60 seconds.
The trick is context, not magic. Gemini gets fed a specialized system prompt packed with XR Blocks architecture, room-scale design guidelines, package management rules, and a curated set of working code templates. That grounding matters a lot, because early versions hallucinated deprecated APIs constantly. Google's internal benchmark, a 60-prompt set called VCXR60 built from four workshops with 20 Googlers, showed roughly 70% one-shot success early on. After six months and 11 releases of XR Blocks, that number has improved, though Google's own advice is blunt: use Gemini Pro over Flash if you want reliability, since animation and hand-interaction logic burns through more reasoning tokens.
The demos are the fun part. One prompt produces a Schrödinger's cat simulation where pinching sends a 3D cat into a box, and stepping within 50cm splits the box to show both the alive and dead states at once — genuinely clever spatial storytelling for a quantum mechanics concept that's normally just a thought experiment. Another turns a text description of methane, ethylene, and acetylene combustion into a full mixed-reality chemistry lab with volumetric flame renders and safety-friendly pinch-to-ignite controls. There's also a rebuilt Chrome Dino game with a voxelized dinosaur dodging cacti on a transparent lane, and a volleyball sim that reacts to both your hands and the room around you.
Under the hood it's all built on WebXR, three.js, and LiteRT.js, which keeps things web-native rather than locked into a proprietary engine. There's also a desktop simulated-reality mode so people without a headset can iterate before deploying to actual Android XR hardware, since depth sensing and hand tracking still need real device testing to shine.
Google frames this as democratizing spatial computing, letting creativity outpace technical skill. That's the pitch anyway. The company will show it off at ACM CHI 2026 and has already opened the framework and demo for anyone to try.
My take — AI-written commentary, not fact-checked reporting
I've been skeptical of vibe coding as a concept — it's a nice way to make a demo reel, less reliable as an actual engineering practice — but applying it to XR is smart because the barrier to entry there has genuinely been absurd for a decade. A 70%-ish one-shot success rate isn't production-grade, and Google admits it, but for prototyping and teaching physics or chemistry to students in a headset, that's plenty good enough. The bigger story is Google using Gemini to make its own underused hardware ecosystem, Android XR, less painful to build for, which tells you more about Google's XR ambitions than any keynote slide would.
Read more about this at: Google Research