The UK government has unveiled legislation to combat the creation and distribution of AI-generated child sexual abuse material (CSAM).

Under the proposed laws, possessing or distributing AI tools designed to produce CSAM will carry penalties of up to five years in prison.

Additionally, the possession of AI-generated “paedophile manuals,” which teach offenders how to exploit AI for abuse, will be punishable by up to three years in prison.

The measures, part of the forthcoming Crime and Policing Bill, were announced following alarming warnings about the proliferation of disturbingly realistic AI-generated abuse imagery.

The Home Office revealed that AI is being misused to “nudeify” images of real children or superimpose children’s faces onto explicit content, enabling predators to groom, blackmail, and abuse victims.

Jess Phillips, the UK safeguarding minister, called the legislation a world first, stating, “This is a global problem that requires global solutions. This government is leading the way in clamping down on this horrendous crime.”

Key Provisions of the Legislation:

1. AI CSAM Tools: It will become illegal to create, possess, or distribute AI tools intended to generate child abuse material.
2. Paedophile Manuals: Possessing AI manuals teaching methods to exploit children will be criminalised.
3. Targeting Predator Websites: A new offence will criminalise individuals running websites that enable the sharing of CSAM or grooming advice, with penalties of up to 10 years in prison.
4. Enhanced Border Force Powers: Authorities will gain the right to compel individuals suspected of posing a risk to children to unlock their digital devices for inspection.

The legislation comes as the Internet Watch Foundation (IWF) reported a 380% increase in AI-generated abuse material last year, with some imagery so realistic it was treated under UK law as though it depicted actual abuse. The IWF flagged over 3,500 AI-generated CSAM images on a single dark web platform in one month, raising the urgency for action.

Home Secretary Yvette Cooper emphasised the importance of keeping laws updated to tackle emerging technologies. “Sick predators’ online activities often escalate to horrific real-world abuse. These measures are bold and necessary to protect children in an evolving digital landscape,” she said.

Recommended reading

• Capgemini: How to Build a Responsible Generative AI Strategy
• MIT Tech Review: Responsible AI Principles Urgently Needed
• Report: 58% of Business Leaders Have No AI Training

The National Society for the Prevention of Cruelty to Children (NSPCC) has also reported children reaching out to its Childline service after discovering AI-generated images of themselves online. Perpetrators have used such images to extort victims into live-streamed abuse or further exploitation.

Interim IWF Chief Executive Derek Ray-Hill welcomed the legislation, stating, “The frightening speed with which AI imagery has become indistinguishable from photographic abuse underscores the need for laws that can keep pace. These measures will have a concrete impact on online safety.”