Following global backlash, X will now prohibit its AI chatbot Grok from producing edits of photos of real people showing them in revealing outfits in areas where it is illegal.

“We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing,” a statement from X read.

This follows global alarm bells over Grok’s ‘spicy mode’ which allowed users to upload photos of real people and have the AI model make edits to ‘undress’ the images. This was often done without the consent of the person in the photo, and watchdogs found that it was being done to images of children as young as five years old.

Following the discovery of the prevelance of these deepfake images across X, governments, including the UK, urged for investigations into the social media company over child sexual abuse material (CSAM) concerns. In the UK, the Online Safety Act make it illegal to share deepfakes; the Data (Use and Access) Act, which makes it a criminal offense to create or request them, however, has yet to be enforced despite coming into law in 2025.

UK ministers called the images circulating on X “vile” and debates were begun on if the UK parliament and other government outlets should continue to use X as a social platform.

UK Prime Minister Keir Starmer described it as “vindication” following his calls for X to prohibit its AI model from producing the illegal content.

“We now geoblock the ability of all users to generate images of real people in bikinis, underwear, and similar attire via the Grok account and in Grok in X in those jurisdictions where it’s illegal,” X said.

Paid users will continue to be the only ones able to use Grok to edit images on its platform, following a change of policy shortly after the deepfake controversy arose.

Recommended

• Pressure Mounts on Apple and Google to Drop X from App Stores
• X Under Fire Over ‘Staggering Amplification of Hate’ During UK Riots
• X Limits Grok AI Images to Subscribers Following Deepfake Outcry

Still, the geographical nature of the ban means that the technology is not universally prohibited, and countries that may be behind on regulation could still see citizens producing such material as long as specific laws against it are not in place.

While going forward, the creation of deepfake ‘undressed’ images of real people in the UK will be blocked, it remains uncertain what legal proceedings will follow for people who have already been victims of the practice.

Further, Ofcom has already begun an investigation to X, and may still fine the social media firm if it is found to have been in breach of the Online Safety Act. If X is found to have broken the law, it could face a fine of up to 10% its worldwide revenue.