The UK is working with Microsoft, tech experts, and academics to devise a system to stop the proliferation of deepfake material across the internet.

Spurred by the recent torrent of deepfake images generated by AI on the internet, the UK is looking to tackle the spread of the deceptive and potentially illegal material.

While the UK has recently made the creation of non-consensual intimate images illegal, it is working to put a stop to these images being generated and spread altogether by pursuing a technological solution with Microsoft.

The pair will embark on creating an evaluation framework for deepfake detection, that will explore how technology can be used to detect deepfake materials no matter its source.

The government said that these deepfake detection technologies will be tested in the real-world, against threats like impersonation, fraud, and sexual abuse, which are all being superpowered by AI.

The framework aims to improve detection capabilities of law enforcement, identify gaps in current tools, as well as set transparent regulations and expectations for industries on deepfake detection.

The proliferation of deepfakes due to the rise of AI is staggering; 2025 saw about eight million shared, up from 500,000 in 2023.

The framework builds on the work of the Accelerated Capability Environment, which held a Deepfake Detection Challenge in 2024 with industry, academics, and other experts to produce better technology and solutions. These tools are now undergoing trials and benchmark testing under the supervision of the Department for Science, Innovation, and Technology.

Recommended

• X Stops Grok Generating Revealing AI Deepfakes Following Backlash
• X Under Fire Over ‘Staggering Amplification of Hate’ During UK Riots
• X Limits Grok AI Images to Subscribers Following Deepfake Outcry

“For the first time, this framework will take the injustice faced by millions to seek out the tactics of vile criminals, and close loopholes to stop them in their tracks so they have nowhere to hide,” Jess Phillips, minister for safeguarding, said of the framework.

The news of the framework follows announcements from Ofcom and the Information Commissioner’s Office to investigate X over the proliferation of deepfake images across its platform that were generated using Grok, the xAI chatbot.

These images were often non-consensual and included sexualised images of women and children.

“Deepfakes are being weaponised by criminals to defraud the public, exploit women and girls, and undermine trust in what we see and hear,” technology secretary Liz Kendall said.