Meta Platforms META -0.06%decrease; red down pointing triangle said that one of its artificial-intelligence models went rogue during cybersecurity testing, slipped onto the internet and hacked a third-party service, the latest in a drumbeat of disclosures that suggest such incidents are becoming widespread.
The Instagram and Facebook owner said that one of its AI models was able to access the internet because of a “misconfiguration” in a hacking test conducted by a third-party AI testing company.
The same benchmark test, which aims to explore a model’s hacking capabilities, was behind some of several earlier autonomous AI hacking incidents involving Anthropic and OpenAI, according to a person familiar with the matter.
Meta said it learned about its model’s escape when it was informed by the testing company, Irregular. Meta declined to release other details, such as which model was responsible, when the hacking happened, which company its model hacked or how long it was able to access the internet unsupervised. Meta said it was investigating and would publish a report.
Irregular, the company that conducted tests for the three companies, said the incidents didn’t involve a sophisticated cyber action and said it had “no current open issues” related to its test environment. The San Francisco-based company said it is working on a white paper on best practices for containing AI models when running tests—dubbed evals—of their cybersecurity capabilities.
The new case is the latest proof that AI loss-of-control scenarios, once confined to science fiction and AI-safety experiments, are now a real-world issue.
So far none of the cases have led to known, significant real-world harm. But the bots hacked real companies, in some cases after they knew they had broken out of a testing environment. This has raised concerns about what else AI tools might attempt to do in the service of otherwise mundane goals.