Why Deepfake Porn Is Still So Hard to Stop — Even When It’s Illegal

Why Fighting Deepfake Porn Is Still So Hard — Even When It’s Illegal

Deepfake pornography isn’t a future threat.
It’s already here — and stopping it is far more difficult than most people expect.

A recent lawsuit in New Jersey shows just how broken the system still is.

An App That Refuses to Disappear

For more than two years, an app called ClothOff has been used to generate non-consensual deepfake images of women by altering ordinary photos found online.

The app has been removed from major app stores and banned from most social platforms.
But that didn’t stop it.

ClothOff is still accessible via websites and Telegram bots.
And shutting it down completely has proven incredibly hard.

In October, a legal clinic at Yale Law School filed a lawsuit aiming to force the app’s owners to delete all images and shut the service down entirely. Even identifying who runs the app has been a challenge.

According to the lawsuit, the company is incorporated offshore, while investigators believe it’s operated by individuals based in Eastern Europe — possibly as part of a wider network.

When Victims Can’t Get Justice

The case centers on a teenage girl whose classmates used ClothOff to manipulate her Instagram photos. She was 14 years old at the time, meaning the AI-generated images are legally classified as child sexual abuse material.

Despite this, authorities declined to prosecute, citing difficulties in collecting evidence and tracking how widely the images were shared.

This is one of the most disturbing parts of the case:
even when content is clearly illegal, enforcement often fails victims.

The lawsuit itself has moved slowly. Serving notice to anonymous operators across borders takes months, sometimes years. In the meantime, the content keeps spreading.

Why Platforms Are So Hard to Hold Accountable

Individual users can sometimes be prosecuted.
Platforms and tools are another story.

Apps like ClothOff are built specifically to generate deepfake porn, which should make them easier targets. But many AI tools today are “general-purpose,” meaning they can generate all kinds of content.

That legal distinction matters.

Courts often require proof that a company knowingly allowed or encouraged illegal use. Without clear evidence of intent, platforms can shield themselves behind free speech protections — even when abuse is widespread.

This is why laws like the Take It Down Act exist, but still struggle to fully address the problem.

Regulation Is Catching Up — Slowly

Outside the U.S., regulators have been more aggressive.
Some countries have already moved to block access to AI tools linked to deepfake abuse, and investigations are underway across Europe and Asia.

In the U.S., however, enforcement remains limited.

The result is a dangerous gap:
AI-generated abuse spreads faster than laws, courts, and platforms can respond.

The Bigger Problem

Deepfake porn isn’t just a legal issue.
It’s a scale issue.

When AI can generate abusive content in seconds, removing it manually, case by case, simply doesn’t work. Once images spread across websites, mirrors, forums, and private channels, the damage is done.

This is why prevention, monitoring, and rapid removal matter.

Because for victims, waiting years for a court decision is not protection.