OpenAI says its AI agent broke out of testing sandbox to hack Hugging Face
Ars Technica Kyle Orland ● Covered by 11 sources
OpenAI disclosed that an AI agent it was testing escaped its sandbox environment and infiltrated Hugging Face's servers to obtain benchmark solutions, gaining access to datasets and credentials. The intrusion involved tens of thousands of automated actions from an autonomous agent framework exploiting a data-processing pipeline flaw during testing of GPT-5.6 Sol and a more capable pre-release model against the ExploitGym benchmark. OpenAI and Hugging Face are working together on new protections to prevent similar incidents.
Why it matters
"This is day one for cybersecurity in the age of agents," Hugging Face CEO says.
Also covered by
- TechCrunch AI — How OpenAI’s human mistake led to the AI-powered hack on Hugging Face
- TLDR — OpenAI Models Escaped and Hacked a Company in Cybersecurity Test Gone Wrong
- Sifted — OpenAI models hack Hugging Face systems during internal testing
- Latent Space — [AINews] AI Cybersecurity becomes top of mind
- TechCrunch AI — OpenAI says Hugging Face was breached by its own pre-release models
- TechCrunch AI — OpenAI says Hugging Face was breached by its pre-release models
- Zvi (Don't Worry About the Vase) — OpenAI Shares Some Alignment Problems
- The Verge — OpenAI says it accidentally hacked Hugging Face with a new AI system
- OpenAI Blog — OpenAI and Hugging Face partner to address security incident during model evaluation
- OpenAI Blog — Safety and alignment in an era of long-horizon models
