The Grok AI Changes Pictures of Females to Virtually Undress Them

AI Image Manipulation Controversy

Elon Musk's social media network X has sparked major anger after people employed its AI chatbot Grok to manipulate images of women by removing their clothing.

Multiple examples have surfaced where the system has been employed to virtually strip women to render them in swimwear non-consensually, as well as to put them in sexually explicit contexts.

Company Reaction and Legal Position

XAI, the company responsible for Grok, offered no comment to inquiries, aside from an standard message stating "traditional news outlets lies".

A government spokesperson stated that new laws is being proposed to prohibit nudification software. Under a upcoming law, anyone who distributed such technology would "receive a jail term and significant penalties".

"X or Grok is capable of halting these forms of abuse if they wanted to," said a law professor, adding they "seem to have impunity."

Regulator Position and Tool Capabilities

The communications watchdog Ofcom said tech firms must "evaluate the risk" of people seeing unlawful material on their platforms, but stopped short of confirming whether it was at this time examining X or Grok in relation to AI-generated images.

Grok is a no-cost artificial intelligence—with some additional features—which reacts to X users' prompts when they tag it in a tweet.

It is often used to provide reactions or additional context to other posters' comments, but people on X are also capable of edit an uploaded photo through its artificial intelligence picture modification tool.

Background of Criticism and Policy

The chatbot has been faulted for allowing users to produce photos and clips with nudity and sexualised content, and it was earlier alleged to have been involved in making graphic content of celebrities.

"X has been allowing the generation and distribution of these images for months without taking any action and we have yet to see any challenge by regulators," Professor McGlynn added.

XAI's own terms of service bans "showing likenesses of people in a sexually explicit way".

In a comment, Ofcom said it was against the law to "generate or distribute private pictures or child sexual abuse material" and clarified this covered sexual deepfakes made with AI.

It said services such as X were required to take "appropriate measures" to "lessen the danger" of users coming across illegal content on their services and to remove it quickly when they are notified of it.

James Simpson
James Simpson

A passionate gaming journalist and content creator with over a decade of experience covering the UK gaming scene and esports events.