Nonconsensual Nudes and the Imperfect Safety Net

The new law requiring tech platforms to provide a way for people to report nonconsensual intimate images and videos has been met with mixed results. The Take It Down Act, which went into effect on May 19, aims to make it easier for individuals to have explicit content removed from online platforms. However, the implementation is far from smooth.

One of the most significant challenges facing those who want to report nonconsensual nudes or deepfakes is navigating the complex reporting forms. These forms are often filled with legalese and technical jargon that can be a barrier to entry for teenagers and young adults, who are often victims of online harassment. According to Jennifer King, a fellow at the Stanford University Institute for Human-Centered Artificial Intelligence, companies tend to overlook the importance of user-friendly reporting forms.

“This is where the law falls short,” King says. “It’s not enough to simply provide a way for people to report nonconsensual content; we need to make sure that those who need help can actually use these systems.” The fact that some companies have yet to implement their takedown reporting forms, despite being given a year to do so, is concerning.

Companies like Proton AG and Verizon seem particularly uninterested in making changes. When WIRED reached out for comment, neither company responded. This lack of urgency surrounding online harassment is telling. Other companies, such as Reddit and TikTok, have implemented the StopNCII tool, which uses matching algorithms to identify nonconsensual content.

However, this approach raises questions about bias and accuracy. What happens when images are manipulated or edited in ways that the algorithm can’t detect? How do we ensure that these systems don’t perpetuate existing inequalities?

The tech industry’s response to this law has been inconsistent at best. While some companies have expressed support for it, others seem more interested in paying lip service than actually implementing change. This is a problem that requires more than just legislation; it also needs a cultural shift.

In the end, the Take It Down Act is just one small step towards addressing the complex issue of nonconsensual intimate images and videos online. To make real progress, we need to ensure that our reporting systems are accessible, user-friendly, and effective. We need to hold companies accountable for creating safe online environments. And we need to recognize that this problem requires a sustained effort from all parties involved.

As the law takes effect, it’s clear that the tech industry’s response will be telling. Will they use this opportunity to make real change, or will they continue to drag their feet? It’s up to us as users and advocates to hold them accountable for creating a safer online world.