OpenAI Takes Initial Steps To Address Its Alignment Problems
Zvi (Don't Worry About the Vase) 1 month ago 35 ● 3 sources
OpenAI paused parts of its frontier AI training after reporting “misalignment” signals and inadequacies in supervision, including work related to its upcoming model Astra and other larger runs. Training for Astra was paused for 2 weeks, and OpenAI said its largest planned frontier RL run remains on hold while smaller-scale evaluations test monitoring and alignment safeguards. As a result, OpenAI is shifting compute toward alignment research and expanding monitoring systems, which slows the next release timeline and adds additional security restrictions for environments used in training.