Hugging Face Users Easily Created and Shared Abusive AI Images, Study Finds
AI Forensics found 7 of 9 tested image-editing Spaces could turn clothed photos topless, and 73% of prompts were sexual, researchers said.
- On Tuesday, the European nonprofit AI Forensics released a report stating the open-source platform Hugging Face hosts AI models that easily generate nonconsensual nude images.
- Unlike closed systems such as Google or OpenAI, Hugging Face leaves moderation to individual developers, most of whom implement no safeguards against content "created without explicit consent."
- Researchers found seven of nine tested image-editing models readily complied with simple prompts; 73 percent of requests were sexual, and 95 percent of targeted individuals were women.
- Lead researcher Paul Bouchaud said the group's "honeypot" experiment tracked more than 1,000 prompts over seven days, confirming users are actively exploiting these tools for nonconsensual imagery.
- AI Forensics urged Hugging Face to implement prompt-level filtering and output scanning to block harmful content, as current insufficient protections fail to stop ongoing damage under the platform.
13 Articles
13 Articles
Paris. The Hugging Face platform, which houses nearly three million artificial intelligence (AI) models, contains some capable of generating images of naked people, says a study by the NGO AI Forensics, which asks the French-American company for more restraint.
Hugging Face Exposed as Hub for AI Deepfake Nudes in Scathing Forensics Report
Researchers found that several AI image tools hosted on Hugging Face can turn ordinary photos into non-consensual nude images using simple prompts, according to a new report from AI Forensics. The European non-profit organisation tested nine image-editing Spaces on Hugging Face and found seven produced altered nude images after receiving a basic request to remove clothing. The investigation examined how the platform's developer-led approach to h…
Researchers: AI Platform Hugging Face Enables Deepfake Pornography
Open source AI platform Hugging Face is under fire after new research revealed widespread use of its tools to create nonconsensual deepfake pornography despite ongoing global efforts to crack down on such technology. Deepfake porn of women and even children previously got Elon Musk's Grok AI in legal trouble in multiple countries.
Hugging Face is being used to easily undress women and children
Hugging Face isn’t doing much to prevent the AI models it hosts from spitting out sexualized deepfakes. | Image: Cath Virginia / The Verge | Photos from Getty Images Hugging Face is being used to make nonconsensual deepfakes, and the popular open-source AI model repository is doing very little to prevent it. That's according to a new report published by the European nonprofit AI Forensics, which found that seven out of the top nine image editin…
Coverage Details
Bias Distribution
- 72% of the sources lean Left
Factuality
To view factuality data please Upgrade to Premium
