Westfield High School in New Jersey is facing a backlash as police investigate an incident involving the creation and sharing of deepfake nude photos of female classmates. The boys responsible used AI image generators to produce and disseminate the fake images, leading to concerns about the safety and well-being of the targeted students. This incident has raised questions about the legality of such actions and the need for stronger legislation to address the issue.
The school initially believed that the images had been deleted and were no longer in circulation among students. However, police currently have no access to the images, making it difficult for them to trace the source and investigate the matter further. It remains unclear how many students were affected, and the school has not disclosed the number of students involved or whether any disciplinary actions have been taken.
Unfortunately, there is currently no federal law specifically prohibiting the creation of fake sexual images of real individuals. In June, child safety experts highlighted the challenge of preventing the spread of AI-generated fake child sex images online. This prompted President Joe Biden to issue an executive order urging lawmakers to pass protections against the production of non-consensual intimate imagery using generative AI.
While federal law is lacking, some states have taken action to combat this issue. Virginia, California, Minnesota, and New York have passed laws criminalizing the distribution of faked porn. New Jersey may soon follow suit, with State Senator Jon Bramnick expressing his intent to explore existing laws or draft new ones to prohibit the creation and sharing of AI-faked nudes.
The incident at Westfield High School has left the targeted students feeling uncomfortable and concerned about the potential long-term effects on their personal and professional lives. They worry that the images may resurface in the future, causing further harm. Some of the girls have also expressed a shift in their attitude towards online posting as a result of this experience.
The rise of AI image generators has made it easier than ever to create realistic deepfakes. Despite some image tools having moderation settings to prevent the creation of pornographic content, enforcing such measures is challenging, if not impossible. Technology exists to circumvent these filters, allowing individuals to combine different technologies to face-swap or remove clothing.
According to image-detection firm Sensity AI, more than 90 percent of fake images online are pornographic in nature. As image generators become more prevalent, there is a growing risk of increased circulation of fake images.
The incident at Westfield High School serves as a reminder of the potential harm that can be caused by misusing new technologies. Principal Mary Asfendis emphasized the need for students to understand the impact and damage that such actions can inflict on others. It is important for educational institutions to raise awareness and promote responsible use of technology among students.
As investigations continue, it is evident that there is a pressing need for comprehensive legislation to address the issue of deepfake pornography. The incident in New Jersey has highlighted the urgency for stronger laws to protect victims and deter individuals from engaging in such harmful behavior.
