Apple Tightens App Store Rules to Ban AI Nudify Apps and Offensive Content

Image: TechCrunch · Source

Apple updated its guidelines to prohibit AI apps that generate offensive content or secretly include nudify features, enhancing review measures against hidden harmful capabilities.

Apple has strengthened its App Store guidelines to specifically ban applications that use artificial intelligence to generate offensive or inappropriate content. This update targets apps that disguise their true functionality to bypass the App Store review process, particularly those that secretly enable “nudify” features—software that alters images to remove clothing—which Apple categorizes as a bait-and-switch tactic.

According to Apple’s announcement, apps hosting user-generated content must now implement effective content moderation measures. These include filtering objectionable material, providing users with tools to report offensive content, and allowing users to block abusive accounts. Moreover, any apps containing hidden or undocumented features—especially those that misrepresent their purpose during review and reveal harmful capabilities only after approval—are strictly forbidden.

Apple emphasized that it will remove any app that adds features not present in the version initially submitted for review. The company also updated its legal guidelines to reinforce its ban on apps promoting human trafficking or the exploitation of children.

This move follows increased scrutiny from regulators and advocacy groups. For instance, San Francisco authorities recently ordered both Apple and Google to remove nudify apps from their platforms, citing concerns over exploitation and inappropriate content accessibility. Previously, a Tech Transparency Project report highlighted that both tech giants’ app stores hosted multiple nudify applications, some accessible to minors.

Apple noted that its rigorous review process successfully blocked over 150,000 apps from reaching users last year and resulted in the removal of 193,000 developer accounts due to fraud and abuse. These updated policies aim to better safeguard users from deceptive and harmful applications, ensuring a safer and more transparent app marketplace.

By tightening the rules around AI-generated content and requiring developers to maintain clear, honest app functionalities, Apple is reinforcing its commitment to user safety and app quality on its platform.