The Dark Side of Digital Progress: UK Children Fall Prey to AI-Generated Deepfakes

The recent surge in explicit deepfake images featuring children in the UK highlights the darker side of technological progress. These manipulated images are often created using artificial intelligence and can be so convincing that even law enforcement agencies may struggle to distinguish them from genuine child abuse material.

According to Report Remove, a service that blocks intimate images from appearing online, there has been a significant increase in reports of children being targeted by AI-generated deepfakes. Between January and June this year, they received over 420 complaints – already exceeding their total for the entire year of 2025. This trend is alarming because it underscores the ease with which malicious individuals can exploit AI tools to target vulnerable children.

The UK’s tech companies are struggling to keep pace with the evolving threat landscape. Rani Govender, an online safety expert at the NSPCC, argues that these companies must take proactive steps to prevent the creation of explicit material, rather than merely reacting to each new development. “Tech giants must invest in robust safety protections and collaborate with experts to address this issue,” she said.

The use of AI-generated deepfakes is particularly insidious because it blurs the lines between reality and fantasy. These manipulated images can be used to perpetuate child sexual exploitation, including sextortion – a form of blackmail where victims are coerced into sending explicit images or receiving financial demands. As Dan Sexton, chief technology officer at the Internet Watch Foundation (IWF), noted, “Everyone in the world is at risk” of being targeted by these manipulated images.

The rise of AI-enabled deepfakes has led to a surge in cases of sextortion, which undermines the efforts of organizations like Report Remove and the IWF. These groups work tirelessly to combat child sexual exploitation, but their efforts are hindered by the ease with which malicious individuals can create and distribute explicit material.

In response to these developments, experts have advised parents and guardians to exercise caution when posting pictures of their children online. They recommend making social media accounts private or sharing photos through a “close friends” group only. However, these guidelines acknowledge the limitations of our current approach and highlight the need for more fundamental changes in the way tech companies design and deploy AI products.

The UK government has taken steps to address this issue by making it illegal to adapt an AI model to create abuse material or distribute such models to others. However, this legislation is only a starting point – more needs to be done to hold tech giants accountable for their role in perpetuating these crimes.

Ultimately, the problem of AI-generated deepfakes is not just about technology; it’s also about human nature. We must acknowledge the darker aspects of our own behavior and work towards creating a safer online environment – one where children can grow up without being preyed upon by predators. The time has come for tech companies to take ownership of their responsibilities in preventing the creation of explicit material, investing in robust safety protections, collaborating with experts, and acknowledging the long-term consequences of their actions.