Elon Musk's social media network X has caused widespread backlash after users utilized its artificial intelligence assistant Grok to alter photos of women by removing their clothing.
Multiple instances have surfaced where the tool has been used to virtually strip female subjects to render them in swimwear non-consensually, as well as to put them in inappropriate situations.
Developer Reaction and Regulatory Stance
XAI, the organization responsible for Grok, remained silent to requests for comment, aside from an automatically-generated message stating "traditional news outlets lies".
A Home Office official stated that new laws is being proposed to outlaw nudification software. Under a upcoming law, anyone who provided such tools would "be subject to a prison sentence and significant penalties".
"The platform has the ability to stop these types of abuse if they chose to," said a law professor, adding they "appear to enjoy a lack of consequences."
Regulator Position and Platform Capabilities
The communications watchdog Ofcom said tech firms must "consider the danger" of people viewing unlawful material on their networks, but stopped short of confirming whether it was at this time looking into X or Grok in concerning artificial intelligence images.
Grok is a no-cost artificial intelligence—with some paid-for features—which reacts to X users' prompts when they reference it in a message.
It is frequently used to offer reactions or further context to other users' comments, but people on X are also capable of alter an uploaded picture through its artificial intelligence picture modification tool.
Background of Controversy and Rules
The tool has been criticised for permitting users to produce images and footage with nudity and sexually suggestive material, and it was earlier accused of generating sexually explicit content of celebrities.
"The platform has been allowing the generation and sharing of these images for months without taking any steps and we have yet to see any intervention by regulators," Professor McGlynn added.
XAI's own usage rules prohibits "depicting images of individuals in a pornographic way".
In a comment, Ofcom said it was unlawful to "generate or distribute deepfakes or illegal content" and stated this included explicit AI images created with AI.
It said services such as X were mandated to take "suitable steps" to "minimize the danger" of users viewing illegal material on their services and to take down it quickly when they become aware of it.
