Meet GPT-Red: an LLM super-hacker OpenAI built to make its models safer

MIT Technology Review AI · 23 hours ago

OpenAI built GPT-Red, an AI system that automatically finds vulnerabilities in its models by simulating cyberattacks, particularly prompt injection attacks where hackers embed hidden instructions to manipulate LLM behavior. In testing against GPT-5.6, fewer than 23% of GPT-Red's strongest attacks succeeded compared to over 90% against the earlier GPT-5 released in August last year. The system supplements human red-teaming efforts and enables OpenAI to identify new attack types before deployment, though it remains limited in handling multi-turn conversations and image-based attacks.