AI-written critiques help humans notice flaws
OpenAI Blog 4 years ago
Researchers trained AI models to write critiques identifying flaws in AI-generated summaries. Human evaluators detected flaws in summaries 30-40% more often when shown the model critiques compared to evaluating summaries alone. The approach suggests AI systems could help humans supervise other AI systems on complex evaluation tasks.