San Francisco Demands Apple and Google Remove AI Nudity Apps

San Francisco’s attorney general, David Chiu, has taken a major step to stop the spread of harmful technology. This week, his office sent official letters to Apple and Google, ordering them to remove 13 specific mobile applications from their digital stores. These apps use artificial intelligence (AI) to create fake, sexualized images of real people. According to reports from Wired, these tools allow users to easily remove clothing from photos, change a person’s features, or place someone’s face onto a naked body without their consent.

This action follows recent efforts by the city to address the rise of what are often called “nudification” apps. These tools have become increasingly common, and officials are concerned about the speed at which they are spreading. In his letters to the tech companies, Chiu warned that the app stores are violating California laws. These laws prohibit services that help create deepfake pornography—a term used for realistic but fake sexual images or videos created by AI. According to Wired, Chiu expressed that his office was deeply disturbed by how these tools are used to target women and children.

For many victims, the impact is severe. Chiu explained to Wired that these images are used to bully, humiliate, and threaten people. The consequences go far beyond a simple digital prank; they can ruin a person’s reputation and cause serious damage to their mental health. In some cases, the harm is so great that victims have felt suicidal. Because of this, Chiu stated that allowing such apps to remain available for download is completely unacceptable. He further noted that Apple and Google have likely earned millions of dollars in fees by hosting these apps, suggesting that the companies have prioritized profit over public safety.

While the names of the 13 apps were not made public to prevent people from searching for them, the scale of the problem is clear. Wired reported that at least one of the apps had been downloaded over a million times. These apps often advertised features that allowed users to create “uncensored” sexual content. By hosting these programs, the city argues that the tech giants have failed to take enough action to protect users from a clear public nuisance.

In response to the city’s demands, tech companies have begun to take action. Ars Technica reported that Google spokesperson Dan Jackson confirmed the company has already suspended the five apps that Chiu flagged. Jackson stated that these apps violated Google’s policies against harmful content. He explained that Google Play does not allow apps with sexual material and that the company works to find and remove such content regularly. According to Jackson, Google has already removed hundreds of similar apps and has restricted search terms like “nudify” to prevent users from finding them.

This situation highlights a larger debate about the responsibility of major technology platforms. As AI technology becomes more powerful and easier to use, it is becoming harder for companies to monitor what is being created and shared. While Google has taken steps to remove the specific apps mentioned by the attorney general, the city’s move suggests that officials believe more needs to be done. The demand for better detection and stronger rules remains a priority for local governments trying to protect citizens from the dangers of AI-generated content.

As the situation develops, the focus will likely remain on how effectively these companies can police their own stores. For now, the move by San Francisco serves as a warning to the tech industry that the creation of non-consensual intimate images will not be ignored. Whether this leads to permanent changes in how app stores manage AI tools remains to be seen, but it is clear that the pressure on these companies to act is growing stronger.