AI-generated deepfakes drive rise in digital violence

The rapid advancement of artificial intelligence has led to an increase in digital violence, particularly through the creation of non-consensual sexual deepfakes. These AI-generated images and videos manipulate existing photographs to place individuals in fictitious, often sexualized, situations, causing significant psychological and social harm despite the content being fabricated.

Data from the Internet Watch Foundation highlights a concerning trend: during the first half of 2026, the organization detected 6,310 AI-generated child sexual abuse images, representing a 40% increase compared to the entirety of 2025. Among the records where age and sex could be determined, 98% depicted girls.

Experts emphasize that the responsibility for prevention lies with aggressors, technology developers, and digital platforms rather than the victims. Addressing this issue requires a combination of clearer legal regulations, improved detection and removal mechanisms, and enhanced education regarding consent, privacy, and digital ethics.