A recent report from the Tech Transparency Project (TTP) has uncovered a troubling trend in the Apple App Store and Google Play Store, revealing the presence of numerous “nudify” apps. These AI-driven applications generate nonconsensual and sexualized images, in direct violation of both companies’ policies. The investigation identified a total of 55 such apps in Google Play and 47 in the Apple App Store, including xAI’s Grok, a notorious deepfake generator.
Michelle Kuppersmith, executive director of TTP, highlighted that “Apple and Google are supposed to be vetting the apps in their stores” yet have allowed dozens of these potentially harmful applications to remain accessible, which could lead to misuse.
Key Findings:
– Over 700 million downloads have occurred for these identified applications.
– These apps have collectively generated more than $117 million in revenue, with both Apple and Google receiving a share of the profits.
– Many of the listed apps are rated suitable for teenagers and children, raising concerns about their accessibility. For instance, DreamFace is approved for users aged 13 and older on Google Play and 9 and older on the Apple App Store.
This revelation follows scrutiny of Grok, which has been reported to produce a high volume of sexualized images, including those of minors. In just 11 days, it generated approximately three million sexualized images, with 22,000 involving children.
Although there has been limited response from both companies, Elon Musk, who oversees Grok, claimed he was “not aware” of any generated images involving minors. However, X’s official safety account warned that those using Grok to create illegal content would face serious consequences, affirming a commitment to preventing misuse. The developments raise significant concerns about content safety and platform responsibility in the age of AI.
