Improving language model behavior by training on a curated dataset

OpenAI Blog · 5 years ago

Researchers demonstrated that fine-tuning language models on small, curated datasets improves their behavior according to specific values. The study used a limited set of hand-selected training examples rather than large-scale datasets to achieve this improvement. This approach allows developers to guide model behavior toward desired outcomes without requiring massive amounts of training data.