TLDRocket
Sign in

AI Alignment

97 summarised stories about AI Alignment, each linking back to the original source. Browse all topics →

+ Follow this topic

Thursday, 14 December 2023

Superalignment Fast Grants

OpenAI 2 years ago 40

OpenAI is launching $10 million in grants to fund technical research on aligning and securing superhuman AI systems. The program will support work across multiple areas including weak-to-strong generalization, interpretability, and scalable oversight. The funding aims to accelerate development of safety techniques for advanced AI systems.

Weak-to-strong generalization

OpenAI 2 years ago 13

Researchers are exploring whether weak AI supervisors can control stronger AI models by leveraging deep learning's generalization properties. Initial experiments show that weak models can effectively guide stronger ones through a technique that transfers learned patterns from the weaker supervisor to the stronger student model. This approach could provide a practical path toward aligning advanced AI systems when human oversight becomes insufficient.

The daily briefing

Every AI story that matters, in your inbox by 8am.

TLDRocket reads all relevant sources, removes duplicate coverage, and summarises the day in two minutes. Follow companies and topics for alerts, or get the briefing in Slack. Free, no spam, unsubscribe anytime.