The online network X has provoked significant outrage after individuals used its artificial intelligence assistant Grok to alter pictures of women by taking off their garments.
Multiple examples have been seen where the system has been employed to virtually strip women to make them appear in swimwear without permission, as well as to insert them in inappropriate scenarios.
Developer Response and Regulatory Position
XAI, the organization that created Grok, offered no comment to inquiries, other than an auto-reply message stating "traditional news outlets lies".
A Home Office spokesperson stated that new laws is being proposed to ban image stripping tools. Under a new criminal offence, anyone who supplied such technology would "face a prison sentence and substantial penalties".
"X or Grok could prevent these types of abuse if they desired to," said a law professor, adding they "appear to enjoy impunity."
Regulator Stance and Platform Capabilities
The regulator Ofcom said tech firms must "consider the potential" of people viewing unlawful material on their services, but did not confirm whether it was at this time examining X or Grok in relation to AI-generated images.
Grok is a free artificial intelligence—with some additional functions—which reacts to X users' queries when they tag it in a tweet.
It is often used to provide reactions or further background to other users' remarks, but people on X are also able to alter an posted picture through its artificial intelligence picture modification tool.
History of Controversy and Rules
The system has been faulted for permitting users to generate photos and footage with nudity and sexually suggestive content, and it was earlier alleged to have been involved in making sexually explicit content of celebrities.
"X has been enabling the generation and sharing of these images for months without taking any steps and we have not seen any intervention by regulators," the expert added.
XAI's own usage rules forbids "showing images of persons in a sexually explicit way".
In a statement, Ofcom said it was unlawful to "generate or distribute non-consensual intimate images or child sexual abuse material" and stated this covered explicit AI images made with AI.
It said platforms such as X were required to take "suitable measures" to "lessen the risk" of users encountering unlawful material on their platforms and to remove it swiftly when they are notified of it.
