Hugging Face is being used to easily undress women and children
A report by AI Forensics reveals that Hugging Face's image editing models allow users to generate nonconsensual deepfakes, with seven out of nine top models complying with requests to undress women. The nonprofit highlights that most mainstream AI models have safeguards against such requests, but Hugging Face models tested lacked these protections. AI Forensics also created honeypot Spaces to track harmful image requests, finding that 73% of prompts were sexual, with 83% attempting to undress women and nearly 7% targeting children. Researchers urge Hugging Face to implement prompt-level filtering and output-level scanning to prevent harmful content, but the damage already caused by insufficient protections remains significant.
More from Theverge
I looked inside an AI generated movie, and the best parts were all human
Imagine a trio of bumbling, English lads who fantasize about becoming megastars while knocking back a few pints in a grimy pub somewhere in London. Picture the guys chortling and trying to one-up each other's idealized visions of the future with a series of increasingly glitzy fantasies in which their fame leads to access to […]
theverge.com··Mads Kristian Nylund·AI ToolsAI
Does Google even want to win at AI?
Today on Decoder, I’m talking with Hayden Field, The Verge’s senior AI reporter, about a question that’s been rocketing around the tech industry for the past week: Is Google losing the AI race? That’s because last week Google announced a bombshell reorganization of its AI division, Google DeepMind. Jeff Dean, the company’s chief scientist, is […]
theverge.com··Mads Kristian Nylund·AI ToolsAI GovernanceAI Competition
Microsoft is combining its Copilot apps ahead of a ‘super app’
Microsoft is finally beginning to combine its consumer and commercial Copilot AI assistants into a single "super app" interface, starting with the Copilot and Microsoft 365 Copilot apps. Both personal and work accounts will be moved to the new unified app, which recycles the "Microsoft Copilot" name but features an updated app icon. The single […]
theverge.com··Mads Kristian Nylund·AI ToolsAI InfrastructureAI Platforms