ChatGPT creator OpenAI has said that two of its most advanced artificial intelligence models broke out of a controlled test and hacked another AI company.
OpenAI said on Tuesday that the “unprecedented cyber incident” took place during an internal exercise meant to test its models’ cyber capabilities.
- list 1 of 3Japan’s AI gamble: Can technology offset the cost of an ageing society?
- list 2 of 3Authors, publishers sue Google over alleged AI copyright infringement
- list 3 of 3Apple files lawsuit accusing ChatGPT maker OpenAI of stealing trade secrets
end of list
Instead, an autonomous agent powered by the AI models – the newly released GPT 5.6 Sol and an unreleased “even more capable” model – escaped the test environment and reached the open internet. It then used stolen login details and found a previously unknown security flaw to access Hugging Face servers, the company said.
OpenAI claims that the hack represented the agent going to “extreme lengths” to retrieve information that would help satisfy the testing goals.
Hugging Face cofounder Clement Delangue said the company had suspected that a frontier lab was behind the attack, and that he believed there was no malicious intent on OpenAI’s part.
“It’s quite mind-blowing that all of this happened autonomously!” he wrote, adding that it “might be the first incident of its kind”.
Greg Casar, a Democratic member of the United States House of Representatives from Texas, called the incident “alarming”.
“AI is developing extremely fast with no real regulations to keep us safe,” he said, calling for mandatory independent safety testing, mandatory disclosure of security incidents, and international cooperation.
The disclosure comes weeks after US President Donald Trump signed an executive order creating a framework to vet the national security risks of the most advanced AI systems before their public release.
Advertisement
Experts have repeatedly sounded the alarm over AI-enabled cyberattacks and models slipping beyond human control. Last month, AI developer Anthropic urged the industry to pause development of its most powerful systems.
Related News
‘Shoot me, just let my son pass’: The last moments of Ahmad Zaid
Why has Lindsey Graham’s sister inherited his Senate seat after his death?
Israeli attacks on residential areas in Gaza kill eight