Better language models and their implications

OpenAI Blog · 7 years ago

OpenAI trained a large-scale unsupervised language model that generates coherent text and achieves state-of-the-art performance on multiple language modeling benchmarks. The model performs reading comprehension, machine translation, question answering, and summarization tasks without any task-specific training. This demonstrates that a single general-purpose model can handle diverse language tasks, reducing the need for separate models trained for individual applications.