Apple is trying to tighten its control of the iOS App Store, especially as it regards AI deepfake nude photos.
In a brief note on its developer website, Apple announced a change to its moderation tactics for the App Store. These new measures target apps capable of generating "nonconsensual intimate imagery" of real people using user-generated content tools.
Pornographic material is already banned on the App Store, and so are apps explicitly designed to do that, but apps that have the potential to do so are now also required to filter such content, provide a way to report it, prevent uploads, and remove anything that gets through all of that.
The change here, essentially, is that app makers are now required to self-police more thoroughly against AI nude photos. If any app is found to violate those rules, as well as a new one prohibiting "bait and switch" tactics (such as misrepresenting what the app can do during the submission review period), it can and will be pulled from the App Store. In addition, developers behind these apps can have their ability to submit to the App Store revoked.
Earlier this year, a study found dozens of apps that can create deepfake nudes of real people on both Apple's App Store and Google Play. Apple removed many of the offending apps at the time, but these new rules show there is still work to be done to prevent more from popping up in the App Store.
