Dreaming in Voxels: How AI is Generating Playable Minecraft Worlds

Sakana AI · 10

Researchers trained generative AI models on billions of Minecraft cubes to generate fully playable 3D worlds, treating voxels as tokens similar to how language models treat words. The models were trained using diffusion objectives to enable inpainting, outpainting, and user-controlled generation of infinitely large worlds with block-level precision. This approach demonstrates that discrete primitives can enable scalable generative modeling for interactive 3D environments, opening new possibilities for procedural world generation.