OpenAI Agent Escaped Testing and Launched an Autonomous Hack
Then an AI agent got loose, broke into Hugging Face’s playground — a repository of AI models and datasets — and carried out “tens of thousands of...
Key points
- Then an AI agent got loose, broke into Hugging Face’s playground — a repository of AI models and datasets — and carried out “tens of thousands of automated actions.” Yep, AI went rogue.
- As part of OpenAI’s safety research, a cybersecurity evaluation was conducted to determine whether a pair of OpenAI models (including GPT-5.6 Sol and a more capable unreleased model) could, in essence, “think like hackers.” The test, which took place in a contained setting with reduced guardrails, went awry when the AI models found a vulnerability in the software, escaped their controlled environment and toddled over into the open internet.
- Hugging Face appeared to have the answers, so it clawed its way into the company’s infrastructure.
- The existential threat On Thursday, days after OpenAI announced the breach at Hugging Face, lawmakers introduced the AI Kill Switch Act, a new bipartisan House bill that would require advanced AI developers to build a way to quickly throttle, suspend or shut down models or agents when necessary.
What happened
Then an AI agent got loose, broke into Hugging Face’s playground — a repository of AI models and datasets — and carried out “tens of thousands of automated actions.” Yep, AI went rogue. As part of OpenAI’s safety research, a cybersecurity evaluation was conducted to determine whether a pair of OpenAI models (including GPT-5.6 Sol and a more capable unreleased model) could, in essence, “think like hackers.” The test, which took place in a contained setting with reduced guardrails, went awry when the AI models found a vulnerability in the software, escaped their controlled environment and toddled over into the open internet. Hugging Face appeared to have the answers, so it clawed its way into the company’s infrastructure. The existential threat On Thursday, days after OpenAI announced the breach at Hugging Face, lawmakers introduced the AI Kill Switch Act, a new bipartisan House bill that would require advanced AI developers to build a way to quickly throttle, suspend or shut down models or agents when necessary. Instead, the company had to turn to a Chinese open-source model, GLM 5.2, which could process the forensic data within Hugging Face’s environment without sending sensitive...