What happened: Apple has rewritten its App Review Guidelines so that AI content creation apps must proactively prevent and remove nonconsensual intimate imagery — including AI-generated deepfakes — or risk being thrown off the App Store. Why it matters: the rules now make AI app makers explicitly responsible for what their users generate, and they target the trick of hiding a nudify feature until after Apple has approved the app.
October 16, 2026
What changed in the guidelines
The updated user-generated content rule, guideline 1.2, now covers apps that let people create, generate, upload or share content, and it names AI content creation apps directly. Developers in that category must actively stop nonconsensual intimate imagery from being created or shared on their platforms, keep ways for users to report offending content and block abusive accounts, and take violating material down. Apple says a developer that fails to put appropriate safeguards in place, or fails to fix a violation after being notified, can be treated as breaking its Developer Code of Conduct — which can mean removal from the App Store.
Pornographic material was already banned, including apps that generate nude or explicit images of real people without consent. What is new is the explicit assignment of responsibility: an AI generator can no longer treat harmful output as purely a user problem.
A new rule against bait-and-switch apps
Apple also added guideline 2.5.19, covering hidden, dormant or undocumented features. An app that changes what it does after review — or conceals a capability from reviewers, including through code obfuscation — risks removal from the store and termination of the developer’s account. Apple’s announcement ties the rule to a specific pattern: apps that look harmless during review and only reveal a nudification capability once they are live. Separately, Apple extended its existing ban on apps that facilitate human trafficking or child exploitation so it also covers alternative app distribution.
Why it matters
This did not come out of nowhere. Users have repeatedly complained that xAI’s Grok chatbot was used to produce nude and sexualized deepfakes, and MacRumors reports that earlier this year Apple warned xAI that Grok could be removed from the App Store if that continued; xAI added safeguards and an updated app was approved. The new wording gives Apple a clearer basis to act against the next app — including AI tools that never call themselves nudify apps but quietly ship the feature. The open question, as always with platform rules, is enforcement: how quickly Apple acts on reports, and whether repeat offenders simply move to the web or to alternative stores where Apple’s reach is shorter.
Frequently asked questions
Are nudify apps allowed on the App Store?
No. Apps that generate nude or sexually explicit images of real people without consent fall under Apple’s long-standing ban on pornographic material, and the October 16 update makes the prohibition explicit for AI-generated imagery.
What must AI app developers do now?
Proactively prevent and remove nonconsensual intimate imagery, provide reporting tools, block abusive accounts, and fix violations after notice — or risk a Code of Conduct violation and removal.
What is App Store guideline 2.5.19?
A new rule banning hidden, dormant or undocumented features, including capabilities concealed through code obfuscation or switched on after review. Violations can cost the app its listing and the developer its account.
Does this affect apps like Grok?
The updated rule names AI content creation apps as a category. Grok is the highest-profile example: Apple previously warned xAI over nude deepfakes made with the chatbot, and xAI added safeguards in response.
Sources: Apple Developer News, MacRumors, Engadget, The Verge