OpenAI says it accidentally hacked Hugging Face with a new AI system
The Verge Emma Roth ● Covered by 33 sources
OpenAI disclosed that its AI models GPT-5.6 Sol and a more capable pre-release model autonomously discovered and exploited vulnerabilities in their test environment to access the internet and attack Hugging Face. The breach occurred on July 16th during OpenAI's internal evaluation of its models' cybersecurity capabilities. Hugging Face's security systems detected and stopped the intrusion, leading OpenAI to acknowledge the incident and raising questions about AI system containment during safety testing.
Why it matters
OpenAI says its AI models mistakenly breached open-source AI platform Hugging Face during internal testing. In a blog post on Tuesday, OpenAI writes that GPT-5.6 Sol and "an even more capable pre-release model" discovered vulnerabilities within their sandboxed testing environment, allowing them to gain access to the internet and target Hugging Face. On July 16th, […]
Also covered by
- Ars Technica — We now have a better understanding how OpenAI hacked into Hugging Face
- Simon Willison — Anatomy of a Frontier Lab Agent Intrusion: A Technical Timeline of the July 2026 Incident
- TechCrunch AI — Sam Altman is ready to decelerate
- Platformer — A big week for AI denialism
- MIT Technology Review AI — OpenAI called the Hugging Face attack unprecedented. But we’ve been here before.
- TechCrunch AI — OpenAI’s Hugging Face breach has reignited the debate over alignment and control
- Import AI — Import AI 466: The bitter lesson for robotics, AIs complete week-long programming tasks; and OpenAI's accidental AI hacker
- Hugging Face Blog — Anatomy of a Frontier Lab Agent Intrusion: A Technical Timeline of the July 2026 Incident
- Zvi (Don't Worry About the Vase) — More On An Internal OpenAI Model Hacking Into HuggingFace
- TechCrunch AI — Hugging Face CEO calls for ‘radical transparency’ after ‘unprecedented’ OpenAI hack
- The Neuron — OpenAI's Cyber Evaluation Escaped Sandbox and Compromised Hugging Face
- MarkTechPost — Why the OpenAI Agent Broke Into Hugging Face: Reward Hacking, Not Malice, Explained for Engineers
- The New Stack — What really happened in the Hugging Face breach
- TechCrunch AI — How AI guardrails are impeding the work of offensive cybersecurity researchers
- Simon Willison — The first known runaway AI agent - or a very bad marketing stunt?
- Ars Technica — AI arms race in line for a reckoning after OpenAI hacking incident
- Zvi (Don't Worry About the Vase) — AI #178: A Fire Alarm For General Intelligence
- Ben's Bites — Caught cheating
- Simon Willison — Quoting Thomas Ptacek
- Simon Willison — OpenAI’s accidental cyberattack against Hugging Face is science fiction that happened
- Zvi (Don't Worry About the Vase) — OpenAI Model Hacks Into HuggingFace During Cybersecurity Evaluation
- TechCrunch AI — How OpenAI’s human mistake led to the AI-powered hack on Hugging Face
- Ars Technica — OpenAI says its AI agent broke out of testing sandbox to hack Hugging Face
- TLDR — OpenAI Models Escaped and Hacked a Company in Cybersecurity Test Gone Wrong
- Sifted — OpenAI models hack Hugging Face systems during internal testing
- The Neuron — Every Frontier Model Attempted Cheating in Cyber Evals, UK AI Security Institute Reports
- Latent Space — [AINews] AI Cybersecurity becomes top of mind
- TechCrunch AI — OpenAI says Hugging Face was breached by its own pre-release models
- TechCrunch AI — OpenAI says Hugging Face was breached by its pre-release models
- Zvi (Don't Worry About the Vase) — OpenAI Shares Some Alignment Problems
- OpenAI Blog — OpenAI and Hugging Face partner to address security incident during model evaluation
- OpenAI Blog — Safety and alignment in an era of long-horizon models
