About three in ten (29%) of cybersecurity leaders said their organisations experienced an attack on enterprise GenAI application infrastructure in the last 12 months, Gartner found.

The analysis firm’s survey of 203 cyber leaders from March to May 2025 ranging from North America, EMEA, and the Asia/Pacific regions found that 62% of organisations experienced a deepfake attack involving engineering or exploiting automated processes.

About a third (32%) said they experienced an attack on AI applications that leveraged the application prompt in the last 12 months.

Chatbot assistants are vulnerable to a variety of adversarial prompting techniques, such as attackers generating prompts to manipulate large language models (LLMs) or multimodal models into generating biased or malicious output.

“As adoption accelerates, attacks leveraging GenAI for phishing, deepfakes and social engineering have become mainstream, while other threats — such as attacks on GenAI application infrastructure and prompt-based manipulations — are emerging and gaining traction,” Akif Khan, VP analyst at Gartner said.

Recommended reading

• Report: Hackers Are Targeting AI Agents and ‘Weaponising’ GenAI
• Report: AI Agents Are Triggering Business Restructure
• 80% of Firms Say Their AI Agents Have Taken Rogue Actions

While 67% of cybersecurity leaders said emerging GenAI risks demand significant changes to existing cybersecurity approaches, Gartner said a more balanced strategy is warranted. “Rather than making sweeping changes or isolated investments, organisations should strengthen core controls and implement targeted measures for each new risk category,” said Khan.