Gathering human feedback

OpenAI Blog · 8 years ago

RL-Teacher, an open-source tool, enables AI training through occasional human feedback instead of manually designed reward functions. The technique works by having humans periodically evaluate AI behavior rather than requiring engineers to code specific reward metrics upfront. This approach addresses both safety concerns in AI development and practical cases where desired outcomes are difficult to define programmatically.