Weak-to-strong generalization

OpenAI · 2 years ago · 9

Researchers are exploring whether weak AI supervisors can control stronger AI models by leveraging deep learning's generalization properties. Initial experiments show that weak models can effectively guide stronger ones through a technique that transfers learned patterns from the weaker supervisor to the stronger student model. This approach could provide a practical path toward aligning advanced AI systems when human oversight becomes insufficient.