Deepfake Pornography is Resilient to Regulatory and Platform Shocks

2026-02-02

AI Summary

This study investigates whether regulatory interventions—such as the U.S. TAKE IT DOWN Act—and platform shutdowns—exemplified by the closure of MrDeepfakes—effectively curb the dissemination of synthetically generated non-consensual explicit imagery (SNCEI) and mitigate its ongoing harm to victims. Employing a quasi-experimental design with synthetic control methods, the research analyzes shifts in activity within SNCEI subforums relative to other pornographic content across three online communities. It presents the first quantitative assessment of the combined impact of such interventions on SNCEI propagation, revealing that these measures did not reduce overall prevalence. Instead, they triggered cross-platform migration: sharing and solicitation behaviors increased rather than diminished, and new contributors were drawn into the ecosystem. These findings indicate that current governance strategies merely redistribute SNCEI activity without substantively alleviating its harms.

Technology Category

• Application Domains: Misinformation & Fake News
• Computer Vision: Computational Photography, Image & Video Synthesis
• Search and Optimization: Non-convex Optimization

Application Category

• Responsible Web: Mitigating online harms, including harassment, spam, and fake reviews
• Economics, Online Markets and Human Computation: The sharing economy
• Web Mining and Content Analysis: Web data quality in the era of algorithmically-generated content

Abstract

Generative artificial intelligence tools have made it easier to create realistic, synthetic non-consensual explicit imagery (popularly known as deepfake pornography; hereinafter SNCEI) of people. Once created, this SNCEI is often shared on various websites, causing significant harm to victims. This emerging form of sexual abuse was recently criminalized in the US at the federal level by S.146, the TAKE IT DOWN Act. A week after the bill's passage became effectively imminent, the MrDeepfakes website -- one of the most notorious facilitators of SNCEI creation and dissemination -- shut down. Here, we explore the impact of the bill's passage and the subsequent shutdown as a compound intervention on the dissemination of SNCEI. We select three online forums where sexually explicit content is shared, each containing dedicated subforums to organize various types of sexually explicit content. By leveraging each forum's design, we compare activity in subforums dedicated to SNCEI with that in other pornographic genres using a synthetic control, quasi-experimental approach. Across websites, we observed an increase in the sharing and requests for SNCEI, and, in some cases, in new contributors. These results indicate that the compound intervention did not suppress SNCEI activity overall but instead coincided with its redistribution across platforms, with substantial heterogeneity in timing and magnitude. Together, our findings suggest that deplatforming and regulatory signals alone may shift where and when SNCEI is produced and shared, rather than reducing its prevalence.

Problem

• deepfake pornography
• non-consensual explicit imagery
• online content regulation
• platform deplatforming
• synthetic media abuse

Innovation

• synthetic control method
• quasi-experimental design
• platform redistribution
• regulatory shock
• deepfake pornography