Malicious AI Prompt Injection Attacks Increasing, but Sophistication Still Low: Google
Malicious AI Prompt Injection Attacks Increasing, but Sophistication Still Low: Google
Publish Date: 2026-04-27 08:08:00
Source Domain: www.securityweek.com
Google has analyzed AI indirect prompt injection attempts involving sites on the public web and noticed an increase in malicious attacks over the past months, but the tech giant’s researchers say their sophistication is relatively low.
Direct prompt injection is a ‘jailbreak’ where a user interacts with the AI to bypass its rules, whereas indirect prompt injection is a ‘hidden trap’ where the AI is tricked by malicious instructions found in external data.
Cybersecurity researchers have discovered many indirect prompt injection methods in recent years, using specially crafted prompts planted on websites, in emails, and developer resources to trick Gemini, Copilot, ChatGPT, and other gen-AI tools into bypassing security and facilitating data theft.
While many theoretical attack methods exist, threat intelligence experts at Google recently set out to determine the extent to which these AI vulnerabilities are being exploited in the wild.
Specifically, their research focused on indirect prompt injection attempts set up on websites on the public internet. They scanned the website snapshots saved by Common Crawl for known prompt injection patterns and used Gemini and human reviews to weed out false positives.
An analysis of the identified prompt injections found harmless pranks, attempts to deter AI agents, search engine optimization, and helpful guidance, as well as some malicious attacks.
Prank prompt injections can, for instance, instruct visiting AI assistants to change their behavior (eg, act like a baby bird and tweet like a bird).
Some website owners place helpful instructions for AI tasked with summarizing a site, but others add prompts designed to prevent assistants from crawling the website, including by telling the AI that the content is dangerous and sensitive.
Google researchers have also come across websites whose administrators attempt to boost SEO by instructing AI…
