Image GPT

OpenAI Blog · 6 years ago

OpenAI trained a large transformer model on pixel sequences to generate images, demonstrating that the same architecture used for language can produce coherent image completions and samples. The model's best variant achieved image classification accuracy competitive with top convolutional networks in unsupervised learning benchmarks. This suggests transformers can serve as general-purpose models for both language and vision tasks without architecture-specific modifications.