What we are currently witnessing in schools is not new.
In 2003, Mark Zuckerberg launched Facemash, the predecessor to Facebook, which notoriously featured images of Harvard students posted without their consent, comparing them to barnyard animals to rate their attractiveness. This early instance of online objectification set a disturbing precedent for the misuse of personal images on the internet.
Enter Nudify apps. These have been on Safe on Social’s radar for some time. They are one of the many things that we never speak about with kids directly, so they don’t run out and look them up! We have quietly taught kids how to stay safe without mentioning specifics.
In the last hour, I have had multiple conversations with mothers who have contacted me, often in tears, of girls affected by the Deepfake Nudify app crime in Victoria, Australia. Fifty female students had fake, sexually explicit images created using AI shared on social media. Images of their faces were obtained from innocent social media accounts. These mothers are heartbroken because the perpetrator has been let off with a caution and is reportedly remorseful. The police have referred the platform to the Australian eSafety Commissioner. Our current legislation on teen-to-teen image-based abuse needs immediate change.
Did the investigation consider that the perpetrator may have used multiple Nudify platforms? On most Nudify apps, you get the first image for free and then have to pay through cryptocurrency subscriptions.
There are universal calls for age verification and bans until 16 years of age, but teens simply bypass age verifications in their countries with VPNs. I see this all the time as I work in Hong Kong often. This highlights the need for significant legislative changes….globally.
What Are Nudify Apps and Why Are They Problematic?
“Nudify Apps” are software applications that use artificial intelligence to create fake nude images of individuals without their consent. These apps manipulate existing photos by removing clothing and generating hyper-realistic images. This technology leverages machine learning algorithms and neural networks to analyze and alter the original images. The ease with which these apps operate makes it alarmingly simple for anyone to create and distribute these invasive images.
Nudify apps often operate by training their algorithms on large datasets of explicit images, which helps the AI understand and recreate human anatomy realistically. The use of such technology raises significant ethical and legal concerns, as these apps can cause severe privacy violations and psychological harm to victims. The ease of access to open-source AI models has further facilitated the development of these apps, making them more prevalent and disturbing.
Efforts to combat the spread and impact of Nudify apps include actions by major social media platforms to remove advertisements for these apps and block associated keywords. The legal framework in many regions struggles to keep up with these rapid technological advancements, leaving a gap in protection against such exploitation. Researchers at Graphika, a social network analysis firm, found that in September 2023 alone, over 24 million users engaged with “Nudify” apps. Search engines record over 200,000 searches per month for keywords related to undressing apps.
Fostering a Safe Space for Conversations
Creating a safe environment where kids feel empowered to speak up is crucial. Start by initiating conversations in a non-threatening way, such as saying, "I heard about this issue of apps that take your clothes off happening... has anything like that ever happened at your school? Remember, if anyone you know ever experiences this, you can come to me for help. They won't get in trouble; they are the victim, and it's important to get support."
Parents should foster an environment where children feel comfortable discussing their online experiences without fear of judgment or punishment. Honest conversations about the risks of sharing personal images online and the potential misuse using deepfake and Nudify tools are essential. Educate children using up-to-date resources on the importance of privacy and the long-term consequences of their digital footprint.
Encourage kids to ask questions and express their concerns about online safety. Do the research with them, making sure you are getting information from organizations that are working with kids face-to-face so you know what is actually happening. This way, adults can better understand the challenges children face online now and be able to provide timely guidance. Creating a supportive and open space to speak up and ask questions makes children more likely to share their concerns and experiences. This proactive approach helps build trust and equips young people with the knowledge and confidence to navigate online spaces responsibly, ultimately helping them navigate away from harmful technologies like Nudify apps.
Privacy Settings
Teaching children to use strong privacy settings on social media and other online platforms is crucial for preventing the misuse of their content. Privacy settings allow users to control who can see and interact with their posts, photos, and personal information. Parents should be able to guide children in configuring these settings to the highest level of security, limiting access to trusted friends and family members on every single app the child is using.
Encourage children to regularly review and update their privacy settings, especially when platforms introduce new features or policies, which is almost every month, but at least check in every school holiday for the new trends on each app. Educate them on the importance of being selective about friend requests and followers, as accepting unknown individuals can increase exposure to potential threats.
Digital Footprint Awareness
Educating children about their digital footprint is essential for long-term online safety. A digital footprint is the trail of data one leaves behind while using the internet, including social media posts, comments, and shared images. Parents and teachers should help children understand that everything they share online can be permanent and potentially accessible to a wide audience. Highlight the risks associated with oversharing and encourage thoughtful consideration before posting personal information or images. Explain that even content shared privately can be copied or misused by others.
Promoting Digital Literacy
Encouraging critical thinking about online content is essential. Teach children to question the authenticity of images and videos they encounter online. Explain how easily content can be manipulated and the importance of verifying information before accepting it as true.
Staying Informed
Staying updated on the latest developments in AI and digital manipulation technologies is crucial for understanding the evolving risks and protective measures. Parents should regularly educate themselves about new threats and the tools available to counteract them. By staying informed, adults can provide accurate and current advice to children, helping them stay safe online.
Emotional Support
Offering emotional support and understanding to victims is crucial. Emphasize that they are not at fault and connect them with counseling services if needed. Recognize the psychological impact of these violations and provide a safe space for victims to express their feelings and seek help.
By understanding these challenges and how to address them, we can better protect our children and ourselves from the evolving threats of online exploitation.
Kirra Pendergast is the Founder and CEO of Safe on Social. She is a renowned international expert in cyber safety with over 30 years of experience. Throughout her career, she has advised governments and businesses on cyber security, IT Business consulting and cyber safety. She has worked at the forefront of technology since 1991. Kirra's personal experience of enduring relentless online bullying and abuse at the age of 43 years by someone she trusted led her to establish the Safe on Social Group in 2014. Today, the private company is the leading provider of cyber safety education, training, and consulting services in the sector working with more than 800 schools and businesses across the globe.
As the Founder and CEO of Safe on Social Group, Kirra is a sought-after public speaker and media commentator. She passionately shares her knowledge, lived experience and insights at events and conferences of all sizes from sporting clubs, schools, professional learning sessions, parent seminars, legal events, government and business events, conferences, and staff well-being sessions.
Kirra's commitment to making a difference is evident in her ground-breaking initiative in 2020 of appointing a first of its kind youth advisory committee, consisting of young individuals aged 11 to 19, to give young people a voice on how they want to be educated on safe use of social media and online safety.
Your information will be subject to a different privacy policy that we recommend you review. FOSI has no control over the content of an external site.
.svg)
