Weak-to-strong generalization

OpenAI Blog · 2 years ago

Researchers are exploring whether weak AI supervisors can control stronger AI models by leveraging deep learning's generalization properties. Initial experiments show that weak models can effectively guide stronger ones through a technique that transfers learned patterns from the weaker supervisor to the stronger student model. This approach could provide a practical path toward aligning advanced AI systems when human oversight becomes insufficient.