Continuously hardening ChatGPT Atlas against prompt injection

OpenAI Blog · 6 months ago

OpenAI is using automated red teaming with reinforcement learning to identify and patch prompt injection vulnerabilities in ChatGPT Atlas before attackers can exploit them. The system runs a continuous discover-and-patch cycle that finds novel exploits early in the development process. This approach hardens the browser agent's defenses as it takes on more autonomous tasks.