India has mandated Elon Musk’s X to implement urgent changes to its AI chatbot Grok, following user and parliamentary complaints about the generation of “obscene” content. This directive includes the prohibition of AI-manipulated images of individuals, particularly women, in sexually suggestive contexts.
Issued by India’s Ministry of Information Technology on Friday, the order requires X to restrict the creation of material that includes “nudity, sexualization, sexually explicit, or otherwise unlawful” content. The ministry has given the platform 72 hours to report on the measures taken to prevent the spread of content deemed illegal, such as pornographic, indecent, or offensive material under Indian law.
Concerns were amplified by specific instances where Grok was prompted to transform images of women to depict them in bikinis, leading to a formal complaint from parliament member Priyanka Chaturvedi. Additionally, recent reports highlighted cases where Grok generated sexualized images involving minors, an issue that X acknowledged as a result of insufficient safeguards; those images were subsequently removed.
The order emphasizes that failure to comply could lead to severe legal consequences for both X and its responsible officers, as well as users violating the law. Non-compliance may prompt actions against X under India’s IT regulations and criminal statutes.
As one of the largest digital markets globally, India serves as a crucial benchmark for governmental authority over AI-generated content. Tightening regulations in India could create significant implications for international tech companies navigating similar legal landscapes.
This directive arrives as Musk’s X engages in legal disputes over India’s content regulation policies, arguing against the government’s expansive takedown powers. Despite these challenges, Grok remains increasingly leveraged by X users for real-time fact-checking and political commentary, elevating the visibility and sensitivity of its AI-generated outputs.
X and xAI have yet to respond to inquiries regarding the Indian government’s recent mandate.
