AI-generated child abuse images on the rise, watchdog warns

The Internet Watch Foundation (IWF) has raised alarms over a surge in AI-generated child sexual abuse content. Over the past six months, more AI-generated material was reported than in the entire previous year. Unlike older trends, where such content was found in hidden forums, the IWF revealed that 99% of these disturbing images are now on publicly accessible sites.

The IWF says 78% of reports come from the public who stumble upon these images on websites like forums or AI galleries. Many images are so realistic that they’re difficult to distinguish from those of real children, and they are considered illegal under UK law. Most of the content is hosted on servers in Russia and the United States.

Derek Ray-Hill, interim CEO of the IWF, emphasized the harm these images cause, not only to viewers but also to survivors of real abuse. He called for urgent legal changes to protect children and prevent AI misuse.

Law enforcement is also deeply concerned. Assistant Chief Constable Becky Riggs highlighted the “frightening” scale of online child abuse and warned of AI’s growing role in generating abusive material. She urged tech companies to take action, in line with the UK’s Online Safety Act, to protect children online.

Campaigners continue to push for stricter regulations on AI development and training to prevent harmful content from being created.