GitHub's Ongoing Challenges in Tackling Deepfake Pornography

In late November, a deepfake video featuring the face of TikTok influencer Charli D'Amelio placed onto another body surfaced on a popular deepfake porn site. The video, which D'Amelio did not authorize or participate in, gained over 8,200 views, highlighting the troubling reach and appeal of such content.

Persistent Challenges for GitHub

While commenting on the video, its creator "DeepWorld23" revealed that the software used to make the deepfake was developed with a model hosted on GitHub. Despite GitHub's policies against non-consensual sexual content, the code, which was starred by 46,300 users, remains accessible after being archived. This exposes gaps in GitHub's content moderation efforts.

"It's challenging to immediately eliminate content once it goes online," states Henry Ajder, an AI advisor working with tech firms like Meta and Adobe on online moderation challenges. "Still, there were evident warning signs."

Efforts and Limitations

GitHub introduced a policy in June 2024 banning projects aimed at creating non-consensual intimate imagery. Yet, investigations have found numerous projects linked to deepfake porn persisting on GitHub, undermining these efforts. GitHub has acted by disabling certain repositories but faces challenges with new versions appearing, often with subtle or blatant indications of being "NSFW" or "unlocked."

"The projects weren't discreet," says Ajder. "They were not particularly hidden." Despite actions taken, archived repositories and adapted versions maintain accessibility, with six such repositories found on GitHub by early January.

Community and Ethical Implications

The repositories unearthed were built on code associated with deepfake porn sites, forming a network of open-source tools that enable the creation of such content. This open-source nature, while promoting innovation, also complicates efforts to control misuse, as developers can freely "fork" and modify the code.

A major concern is the responsibility platforms like GitHub bear in regulating this domain. Despite proactive steps to incorporate policies against deepfake porn, the persistence of such projects underscores the need for continuous refinement of platform regulations and more robust monitoring mechanisms.