< Back to situations

We’ll email you as it develops, and you can follow the whole thread from day one.

[SITUATION] · [ACTIVE]

6 clusters · 19 sources · 21 days · First seen · Last updated

Categories: TECHNOLOGY · CRIME

AI-generated sexual deepfakes, legal actions and safety tool

Overview

Since late June 2026, a wave of AI‑generated intimate images of minors has triggered legal complaints, school investigations and policy criticism in Ireland, Brazil, Argentina, the United States and elsewhere. Court actions have targeted platforms such as xAI’s Grok and Stability AI for allegedly producing thousands of explicit deepfakes from childhood photos and failing to report CSAM. Schools in Buenos Aires and Argentina have invoked gender‑violence protocols, offered psychological support and taken disciplinary measures against students accused of circulating non‑consensual nude images. In response to a surge in AI‑generated CSAM reports to the U.S. National Center for Missing & Exploited Children—from 67,000 in 2024 to over 1.5 million in 2025—MIT researchers, in partnership with the nonprofit Thorn, released an auditing technique that can detect whether a generative‑AI model has been fine‑tuned for child sexual abuse material without generating illegal content, achieving 100 % accuracy in tests.

The same week, Google announced the addition of its SynthID watermarking system to the Gemini model, enabling invisible identifiers in AI‑generated images and video to aid detection of synthetic media. A survey of Japan’s online‑game industry reported universal adoption of generative AI, with 94 % of developers using Gemini, while industry analysts warned that many AI projects fall short of ROI expectations without proper governance and workflow redesign. These developments expand the technical countermeasures accompanying ongoing legal and policy responses worldwide.

Timeline

  1. 2 days ago

    [TECHNOLOGY] 7 sources
    AI safety tools and adoption surge worldwide, from MIT audit method to Google defenses and Japan's gaming sector

    MIT’s CSAM‑detection audit, Google’s Gemini watermarking, Japan’s 100 % AI‑using game developers, leadership gaps in AI ROI, a new Japanese AI awards, chip‑design AI challenges, and a cross‑agent MCP server all

  2. 3 days ago

    [CRIME] 2 sources
    Buenos Aires and Bogotá schools grapple with student harassment

    AI‑manipulated image abuse in a Buenos Aires high school and religious militia harassment at a Bogotá school spark calls for stronger protection of students.

  3. 7 days ago

    [CRIME] 4 sources
    Buenos Aires schools suspend students after AI‑generated fake nude photos circulated

    Students at two prestigious Buenos Aires schools were suspended after creating and selling AI‑generated fake nude images of peers, leading to activation of digital gender‑violence protocols.

  4. 8 days ago

    [CRIME] 2 sources
    xAI and Stability AI sued over AI‑generated child sexual abuse deepfakes

    A California class action accuses xAI and Stability AI of using AI to create and distribute deepfake child sexual abuse material, citing incomplete law‑enforcement reporting and unsafe model releases.

  5. 17 days ago

    [CRIME] 2 sources
    IFRJ Volta Redonda investigates AI‑generated sexualized images of teenage students

    A 17‑year‑old student at IFRJ’s Volta Redonda campus is accused of creating over 500 AI‑generated sexualized images of 16‑17‑year‑old girls; the institute has opened an investigation, formed a disciplinary body

  6. 22 days ago

    [TECHNOLOGY] 2 sources
    AI‑generated sexual deepfakes prompt school investigation and Meta policy overhaul

    AI‑generated sexual deepfakes have sparked a police investigation in an Irish school and prompted Meta’s Oversight Board to demand tighter safeguards and policy changes for non‑consensual content.

Sources

agazetarm.com.br · codezine.jp · contrahegemoniaweb.com.ar · dev.to · diarioelzondasj.com.ar · diarioestrategia.cl · digitado.com.br · elespectador.com · eurogamer.nl · folhadoaco.com.br · helmerlegal.com · lieffcabraser.com · lobosnews.com.ar · pcauthority.com.au · perfil.com · quilmespresente.com · semiengineering.com · sitiosargentina.com.ar · webstat.net