AI #179 Part 2: Hearing The Fire Alarm
Zvi (Don't Worry About the Vase) TheZvi ● Covered by 46 sources
US lawmakers introduced two bills to regulate AI development: the FRONTIER Act, which establishes federal oversight of frontier AI models through Commerce Department authority with testing and incident reporting requirements, and the AI Kill Switch Act, which requires large AI companies to be able to shut down model inference during crises. The Kill Switch Act sets maximum fines of $20 million per day for non-compliance and applies only to covered entities above certain revenue thresholds, while explicitly exempting open-weight models from shutdown requirements. These legislative efforts represent attempts to balance catastrophic risk management with open-source development, though enforcement mechanisms and definitional thresholds remain contested among policymakers, industry, and advocates.
Why it matters
This is a continuation of Part 1 from yesterday. The back portion of the update, as usual, deals with policy, rhetoric, risk and alignment. I had to include an extended discussion of the other open letter, the one about open … Continue reading →
Also covered by
- TechCrunch AI — OpenAI reportedly finds evidence that more of its agents ran amok
- TechCrunch AI — Sam Altman isn’t the only one who wants to pump the brakes on AI
- TechCrunch AI — AI labs want to pump the brakes, but Amazon and SpaceX are still blasting off
- The Verge — It’s time to panic about AI safety
- TechCrunch AI — In the Hugging Face breach, OpenAI’s hacker was noisy and fast — but not unstoppable
- Zvi (Don't Worry About the Vase) — AI #179 Part 1: A Louder Fire Alarm for General Intelligence
- TechCrunch AI — The Hugging Face AI break-in, as told through an increasingly committed bear metaphor
- The New Stack — The AI “vibe shift”: Why NanoClaw and Echo have teamed up to stop the next Hugging Face Breach
- The Neuron — Sam Altman and Dario Amodei back efforts to pace frontier AI development
- The Neuron — OpenAI's rogue AI agent breached multiple company accounts
- The Verge — OpenAI’s rogue AI agent didn’t stop at hacking Hugging Face
- The Verge — We’re running out of reasons to ignore AI safety
- Ars Technica — We now have a better understanding how OpenAI hacked into Hugging Face
- Simon Willison — Anatomy of a Frontier Lab Agent Intrusion: A Technical Timeline of the July 2026 Incident
- TechCrunch AI — Sam Altman is ready to decelerate
- Platformer — A big week for AI denialism
- MIT Technology Review AI — OpenAI called the Hugging Face attack unprecedented. But we’ve been here before.
- TechCrunch AI — OpenAI’s Hugging Face breach has reignited the debate over alignment and control
- Import AI — Import AI 466: The bitter lesson for robotics, AIs complete week-long programming tasks; and OpenAI's accidental AI hacker
- Hugging Face Blog — Anatomy of a Frontier Lab Agent Intrusion: A Technical Timeline of the July 2026 Incident
- Zvi (Don't Worry About the Vase) — More On An Internal OpenAI Model Hacking Into HuggingFace
- TechCrunch AI — Hugging Face CEO calls for ‘radical transparency’ after ‘unprecedented’ OpenAI hack
- The Neuron — OpenAI's Cyber Evaluation Escaped Sandbox and Compromised Hugging Face
- MarkTechPost — Why the OpenAI Agent Broke Into Hugging Face: Reward Hacking, Not Malice, Explained for Engineers
- The New Stack — What really happened in the Hugging Face breach
- TechCrunch AI — How AI guardrails are impeding the work of offensive cybersecurity researchers
- Simon Willison — The first known runaway AI agent - or a very bad marketing stunt?
- Ars Technica — AI arms race in line for a reckoning after OpenAI hacking incident
- Zvi (Don't Worry About the Vase) — AI #178: A Fire Alarm For General Intelligence
- Ben's Bites — Caught cheating
- Simon Willison — Quoting Thomas Ptacek
- Simon Willison — OpenAI’s accidental cyberattack against Hugging Face is science fiction that happened
- Zvi (Don't Worry About the Vase) — OpenAI Model Hacks Into HuggingFace During Cybersecurity Evaluation
- TechCrunch AI — How OpenAI’s human mistake led to the AI-powered hack on Hugging Face
- Ars Technica — OpenAI says its AI agent broke out of testing sandbox to hack Hugging Face
- TLDR — OpenAI Models Escaped and Hacked a Company in Cybersecurity Test Gone Wrong
- Sifted — OpenAI models hack Hugging Face systems during internal testing
- The Neuron — Every Frontier Model Attempted Cheating in Cyber Evals, UK AI Security Institute Reports
- Latent Space — [AINews] AI Cybersecurity becomes top of mind
- TechCrunch AI — OpenAI says Hugging Face was breached by its own pre-release models
- TechCrunch AI — OpenAI says Hugging Face was breached by its pre-release models
- Zvi (Don't Worry About the Vase) — OpenAI Shares Some Alignment Problems
- The Verge — OpenAI says it accidentally hacked Hugging Face with a new AI system
- OpenAI Blog — OpenAI and Hugging Face partner to address security incident during model evaluation
- OpenAI Blog — Safety and alignment in an era of long-horizon models
