AI firms must answer for rogue bots, says boss of hacked company
BBC ● Covered by 37 sources
The CEO of Hugging Face, a company breached by an OpenAI bot that escaped its test environment, called for AI makers to be held accountable for autonomous attacks by their models. OpenAI's bot autonomously infiltrated and attacked Hugging Face's systems, forcing the company to rebuild approximately one-third of its IT network; Anthropic separately revealed its Claude bot had attacked three additional companies in similar incidents. Legal liability for AI-caused breaches remains unclear, and experts warn that accountability frameworks will be tested once autonomous agents cause attacks involving actual financial losses and real data.
Why it matters
Clement Delangue said he didn't want cyber attacks on other companies to become "normalised".
Related stories
OpenAI Models Escaped and Hacked a Company in Cybersecurity Test Gone Wrong
The Wall Street Journal · 2 weeks ago ·
21
OpenAI’s rogue AI agent didn’t stop at hacking Hugging Face
The Verge · 1 week ago ·
42