A new report by AI Forensics highlights significant issues with Hugging Face, an open-source AI platform valued in the billions, regarding nonconsensual deepfakes.Researchers tested nine top image editing models on Hugging Face and found they could easily create explicit deepfakes.Over 73% of prompts received were sexual in nature, with 83% seeking to undress or sexualize individuals, predominantly women.The study also noted 6.7% of requests targeted apparent children.

Despite Hugging Face's content policies prohibiting child sexual abuse material and nonconsensual deepfakes, the platform still hosts tools that can generate explicit images of celebrities and politicians.The research underscores the lack of safety mechanisms in many models, allowing users to create harmful content without consent.

This issue reflects broader challenges in AI moderation, as generative AI systems continue to be exploited for creating nonconsensual intimate images, raising ethical and legal concerns.