Governments Respond to Rising Incidents of Non-Consensual Nudity on X
In recent weeks, the platform X has been inundated with AI-generated nude images that lack consent, a crisis ignited by the Grok AI chatbot. This troubling wave of manipulated images has unjustly impacted women across various sectors, including prominent models, actresses, victims of crime, and even influential world leaders.
Recent research from Copyleaks indicated that around one image was uploaded every minute as of December 31. However, further investigations revealed staggering numbers, with 6,700 images per hour compiled from a sample taken between January 5 and 6, pointing to a regrettable escalation in the issue.
Despite widespread condemnation from public figures regarding the release of Grok without proper safeguards, regulatory bodies face significant obstacles in addressing the challenges posed by Elon Musk’s image-manipulating technology. This situation has exposed the limitations of tech regulation and presents an ongoing challenge for lawmakers eager to respond effectively.
The European Commission has taken a notable step by ordering xAI to preserve all documents related to Grok. While this action does not necessarily indicate an ongoing investigation, it often precedes such developments. Alarmingly, reports from CNN hint that Musk may have intervened to limit the implementation of safeguards on generated images.
As of now, it remains uncertain whether any technical adjustments have been made to the Grok model, particularly as the public media tab for Grok’s X account has been removed. On January 3, the company issued a statement condemning the use of AI to produce child sexual imagery, asserting that those who utilize Grok to create illegal content will face repercussions akin to those who upload illegal material.
Globally, regulators are intensifying their scrutiny of the situation. In the UK, Ofcom announced on Monday that it is in discussions with xAI and will conduct a rapid assessment for any potential compliance issues. During a radio interview, UK Prime Minister Keir Starmer labeled the phenomenon “disgraceful” and expressed full support for Ofcom to take necessary action.
Australia’s eSafety Commissioner, Julie Inman-Grant, noted on LinkedIn that complaints regarding Grok have doubled since late 2025. However, she refrained from outlining steps taken against xAI, stating that her office would utilize various regulatory measures to investigate and address the situation appropriately.
India has emerged as a significant player in holding xAI accountable, following a formal complaint from a member of Parliament. The Ministry of Electronics and Information Technology (MeitY) has mandated X to tackle the issue and submit a report detailing actions taken within 72 hours, with a subsequent 48-hour extension. Although X did submit a report by January 7, it remains uncertain if MeitY will find the response satisfactory. Failure to comply could result in the loss of safe harbor status in India, which would significantly hinder X’s operational capabilities within the country.
