Get alerts on this situation

We’ll email you as it develops, and you can follow the whole thread from day one.

Unsubscribe anytime.

[SITUATION] · [ACTIVE]

2 clusters · 11 sources · 5 days · First seen 5 days ago · Last updated about 16 hours ago

AI child deepfake proliferation

Entities: Meta Platforms · school CCTV systems · U.S. public schools · Ministry of Electronics and Information Technology · AI-generated deepfake images

Overview

AI‑generated deepfake technology has increasingly been used to create non‑consensual sexual images of minors. In the United States, school surveillance footage became a target, with 40% of high‑school students reporting exposure to deepfakes in 2023-24 and incidents affecting over 600 students across 28 countries. By 2025, at least half of the states enacted legislation to curb fabricated images and urged tighter control of CCTV footage.

A similar surge was reported in the United Kingdom, where the Internet Watch Foundation recorded 420 child‑deepfake reports in the first half of 2024, surpassing the total for the previous year. The rapid rise prompted warnings about the ease of turning ordinary photos into child sexual abuse material.

In India, regulatory scrutiny has intensified. The Ministry of Electronics and Information Technology (MeitY) has directed Meta to overhaul its algorithms and provide a compliance roadmap to combat deepfakes, propaganda, and manipulated content. Meta's technical team has acknowledged existing gaps in its systems for handling harmful content.

Furthermore, Indian authorities are examining Meta's legal status under Section 79 of the Information Technology Act. Officials are investigating whether Meta's recommendation algorithms and content promotion mechanisms transition the platform from a neutral intermediary to a publisher. If deemed to have editorial control, Meta could lose its conditional immunity from liability for third-party content, potentially exposing the company and its executives to prosecution under the IT Act and the Bharatiya Nyaya Sanhita. The government also plans to consult other social media platforms regarding their distribution mechanisms.

Claims

What the coverage asserts, and how well corroborated each claim is across sources.

[● 6 SOURCES] The Centre is examining whether Meta's recommendation systems and paid content promotion are consistent with intermediary protections under Section 79 of the IT Act. (Government sources)
[● 3 SOURCES] The Indian government has directed Meta to revamp its algorithms to limit the spread of propaganda, deepfakes, and manipulated media. (Ministry of Electronics and Information Technology (MeitY))
[● 3 SOURCES] The Indian government plans to consult with other social media platforms regarding their algorithmic distribution mechanisms and intermediary status. (Government sources)
[● 2 SOURCES] Meta acknowledged gaps in its current systems for detecting and handling harmful content. (Meta)
[● 2 SOURCES] The government has requested Meta to comply with India's data-localisation requirements. (Ministry of Electronics and Information Technology (MeitY))

Timeline

about 16 hours ago

[TECHNOLOGY] 9 sources
India examines Meta's legal immunity amid deepfake and algorithm scrutiny
India's government has directed Meta to revamp its algorithms to curb deepfakes and is reviewing whether its recommendation systems disqualify the company from intermediary legal immunity.
5 days ago

[TECHNOLOGY] 2 sources
U.S. Schools Grapple with AI-Generated Deepfake Threats to CCTV Footage
AI‑generated deepfakes are compromising student privacy in U.S. schools, prompting new state laws and calls for tighter CCTV footage controls.

Sources

ciol.com · english.madhyamam.com · krdo.com · kvia.com · m.ibtimes.co.in · morungexpress.com · news18.com · odishabytes.com · socialnews.xyz · sundayguardianlive.com · yespunjab.com

This summary has been updated 1 time: see revision history