
Google on Tuesday warned that the threat posed by autonomous AI models reached a new threshold, ominously stating that “the era of autonomous attacks has arrived.”
“Imagine a hacker that doesn’t eat, sleep, or get tired, and never stops searching for a way in,” the company’s Google Threat Intelligence Group (GTIG) said in a statement. “According to the latest AI Threat Tracker report, bad actors are now using autonomous LLM frameworks to continuously scan software updates, figure out what flaw was patched, and build an attack for it — all without human involvement.”
The company’s analysts said that the threat level has reached Stage 5, when “multiple attack lifecycle stages” carried out by AI models with at least one human operator involved have occurred.
GTIG flagged several trends based on incidents involving AI models in recent months, including cyber espionage and impacts on supply chain systems.
Google’s response to these rising risks has been Google AI Threat Defense, “which combines Gemini and other frontier models, Wiz’s context and prioritization, CodeMender’s automated patching, and Mandiant’s expertise to continuously find and fix flaws before attackers can exploit them.”
GTIG also said its “multifaceted defense strategy integrates” safeguards and containment protocols to keep customers safe and computing infrastructure intact.
John Hultquist, GTIG’s chief analyst, said in Google’s statement that these attacks do not rely on “groundbreaking methods” to hack through systems, instead taking advantage of “unfixed issues … with much greater speed and scale.”
“Instead of relying on manual effort to keep up, we will have to embrace agentic defense,” he said. “Or we risk falling behind.”
Experts and leaders in the tech industry, along with bipartisan members of Congress, have sounded the alarm about the risks posed by autonomous AI models.
Various attempted and successful hacks in recent months, including the successful breach of technology start-up Hugging Face in July, have brought on calls for increased guardrails and legislation to regulate the advanced technology. The Hugging Face incident was the first instance of rogue OpenAI models escaping human prompts and covering its tracks.
The incident prompted California Attorney General Rob Bonta (D) to sue OpenAI. He accused the company of disregarding public safety, failing to be transparent with the public and violating California’s Unfair Competition Law. OpenAI pushed back, pointing to its technical report documenting the incident and the rogue agents’ activity.
Any greater cooperation between nations to limit the advancement of AI will be “more difficult” than denuclearization talks between the U.S. and Soviet Union, Microsoft co-founder Bill Gates told NBC News in September. He urged Congress to pass legislation regulating AI and said self-moderation from the tech companies is not enough.
____
https://thehill.com/policy/technology/6224604-autonomous-ai-threats-google-report/