Understanding current trends in AI child sexual abuse material (CSAM) offending, and the emergence of deepfakes in the school context

Join members of the Expert Network Addressing Child Sexual Abuse (ENACSA) online for a talk on their recent research into the expansion of AI child sexual abuse material (CSAM) and deepfakes in schools, and its policy implications.

In 2024, researchers at ARU's International Policing and Public Protection Research Institute (IPPPRI) conducted an exploratory study on current trends in AI CSAM offending. Qualitative analysis of Dark Web forum members’ discussions revealed that AI CSAM is increasing in popularity, with some forum members honing their skills in creating this illegal material.

There is also evidence of an expansion of offending in this area, with forum members viewing AI CSAM, then moving onto wanting to create and share their own AI CSAM. There is clear evidence of forum members supporting others to create AI CSAM, and overcome technological challenges. The study also revealed forum members’ aspirations for the future of AI CSAM, including the desire for more graphic and interactive material.

Prof Tanya Horeck is in the early stages of an impact and engagement project on the emergence of AI-facilitated deepfakes and image-based sexual abuse in the school context, which is a rapidly evolving area of concern across the online safety, violence against women and girls (VAWG), and education sectors.

This project builds on previous UKRI-funded research project on technology-facilitated gender-based violence amongst secondary school students, which focused on rising levels of tech-facilitated harm experienced by young people during and after COVID-19, with 59% of participants experiencing at least one form of technology-facilitated gender-based violence.

Dr Vasileios Karagiannopoulos (University of Portsmouth), Dr Deanna Davy (ARU), and Tanya will explore the findings of their research, as well as the policy implications for the expansion of AI CSAM and deepfakes in the school context.

The event will take the form of a discussion. Questions from the audience will be welcome.