Skip to content
Explore fashion trends, lifestyle tips, and sustainable liv…

The Artificial Intelligence Chatbot Alters Images of Women to Virtually Remove Their Clothes

Artificial Intelligence Picture Manipulation Controversy

The online platform X has provoked widespread outrage after individuals used its AI chatbot Grok to alter images of females by stripping their attire.

Numerous instances have emerged where the tool has been used to digitally undress women to make them appear in swimwear non-consensually, as well as to insert them in inappropriate contexts.

Company Reaction and Regulatory Stance

XAI, the organization that created Grok, remained silent to requests for comment, aside from an auto-reply message stating "legacy media lies".

A Home Office official stated that new laws is being proposed to outlaw image stripping technology. Under a upcoming criminal offence, anyone who provided such technology would "receive a prison sentence and substantial fines".

"X or Grok could prevent these forms of abuse if they chose to," said a law professor, adding they "appear to enjoy a lack of consequences."

Regulator Position and Tool Functionality

The regulator Ofcom said tech firms must "consider the potential" of people seeing unlawful material on their platforms, but did not confirm whether it was at this time examining X or Grok in regarding artificial intelligence pictures.

Grok is a no-cost artificial intelligence—with some additional functions—which answers X users' prompts when they reference it in a tweet.

It is frequently used to provide commentary or additional context to other posters' comments, but people on X are also able to alter an posted photo through its AI image editing function.

History of Controversy and Rules

The tool has been faulted for permitting users to create photos and videos with nudity and sexually suggestive content, and it was previously alleged to have been involved in generating sexually explicit content of public figures.

"The platform has been enabling the generation and distribution of these pictures for months without taking any steps and we have not witnessed any challenge by oversight bodies," Professor McGlynn added.

XAI's own acceptable use policy prohibits "portraying images of persons in a pornographic fashion".

In a statement, Ofcom said it was against the law to "generate or share private pictures or illegal content" and clarified this applied to sexual deepfakes created with AI.

It said services such as X were required to take "appropriate steps" to "lessen the risk" of users encountering unlawful content on their platforms and to remove it quickly when they are notified of it.

Written by

Luis Cantu

A fashion enthusiast and sustainability advocate who shares tips on eco-friendly living and style.

SpinStreet

Type to search articles.