Video generation models as world simulators
OpenAI Blog 2 years ago
OpenAI trained Sora, a large-scale video generation model using diffusion and transformers on variable-length videos and images. The model can generate up to 60 seconds of high-fidelity video from text descriptions. The researchers propose that scaling video generation represents a viable approach to creating general-purpose simulators of physical phenomena.