European Union lawmakers are moving closer to banning so-called “nudifier” apps, following growing concerns around the demonstrated risk of widely available AI systems capable of generating sexually explicit images of real people (including children) without their consent.

In a joint press release, the European Parliament’s Internal Market and Civil Liberties committees confirmed that members voted 101–9, with eight abstentions, to simplify the Artificial Intelligence Act while also proposing a ban on AI systems designed to create or manipulate explicit imagery of identifiable individuals.

The move comes amid heightened scrutiny of generative AI tools, including Elon Musk’s chatbot Grok, which has been cited as an example of how such systems – when it’s owners aren’t obligated to do so – can produce harmful outputs if safeguards are not in place.

The vote follows an earlier conclusion by the European Commission that the current AI Act does not explicitly prohibit systems capable of generating child sexual abuse material (CSAM) or sexually explicit deepfake images. Obviously, that’s far from ideal and amendments are being explored to strengthen protections.

If adopted, the proposed changes would introduce a ban on “nudifier” systems that generate or manipulate sexually explicit or intimate images resembling real individuals without their consent. The ban would not apply to AI systems that include ‘safety measures preventing users from creating such images’. That’s it – no details on what these safety measures could look like or how it could possibly hope to stem the tide of legal loopholes and workarounds.

Regardless of the actual efficacy of the proposed changes when it comes to users, the development could have implications for companies operating in the AI space. Earlier this year, xAI declined to introduce safeguards to block harmful outputs from Grok, instead stating that users would be held legally accountable for generating CSAM or non-consensual intimate imagery – though so far, seems like xAI is the only one actually facing any kind legal accountability.

While xAI has faced limited regulatory consequences in the United States, forthcoming legislation such as the Take It Down Act – due to take effect in May – could introduce significant financial penalties for similar outputs. The company’s approach, including restricting certain responses on X, may reflect efforts to mitigate potential legal risks ahead of enforcement.

In the EU, however, a ban on nudifier apps could force more direct intervention. Should the amendment pass – potentially as early as August – companies could face fines of up to 7% of their total worldwide annual turnover for non-compliance with the AI Act.

Alongside the proposed ban, lawmakers also backed measures to delay the implementation of certain rules governing high-risk AI systems. The committees supported postponing key requirements, citing concerns that necessary technical standards may not be finalised by the current August 2026 deadline.

Recommended

• X Stops Grok Generating Revealing AI Deepfakes Following Backlash
• EU Opens Investigation Into X Over Grok AI Deepfakes
• X Under Fire Over ‘Staggering Amplification of Hate’ During UK Riots

Under the proposed timeline, rules for high-risk AI systems explicitly listed in the regulation – including those used in areas such as biometrics, critical infrastructure, education, employment, law enforcement and border management – would apply from 2 December 2027. Systems covered under existing EU sectoral legislation would follow from 2 August 2028.

The committees also proposed extending the deadline for compliance with watermarking requirements for AI-generated content, though with a shorter extension than originally suggested by the Commission. Providers would have until 2 November 2026 to implement measures indicating the origin of AI-generated audio, image, video or text.

Co-rapporteur for the Internal Market and Consumer Protection committee Arba Kokalari said: “We want predictable, stop-the-clock, simplified rules that remove overlaps with sectoral legislation and reduce fragmentation between Member States. Companies now need clarity on whether they are high risk or not. If Europe wants to be competitive, we must increase investment and make it easier to use AI, not punish companies who introduce innovative AI features in safe products.”