[CLSTR]
< Back to situations

This situation has concluded

It was preserved as a record on September 10; the timeline below shows how it unfolded, with sources. Get the briefing to follow the top situations still developing: three emails a week, sourced and in order.

[SITUATION] · [QUIET] · [TECHNOLOGY]

2 clusters · 10 sources · 3 days · First seen · Last updated

AI-generated content risks on TikTok

Overview

Concerns have emerged regarding the prevalence and impact of AI-generated content on TikTok, particularly concerning its effect on younger audiences.

An analysis of over 10,000 TikTok videos found that 59% of content offered to new accounts—often those created for children—consisted of low-quality, AI-generated material described as “AI sludge.” This trend has raised questions about children’s ability to differentiate between real and fabricated media.

Further research by the Global Network on Extremism and Technology (GNET) indicates that these AI-generated videos are being used to spread extremist agendas. By utilizing a “cute” or “Pixar-like” aesthetic, such as anthropomorphic fruits and vegetables, the content reportedly bypasses platform moderation policies. These videos have been linked to messages from the Islamic State, extreme right “accelerationism,” and neo-Nazi groups. Experts warn that this “AI slops” trend may lead to the “normalisation of cruelty” and the desensitization of young users to violence.

Entities

TikTok · World Bank · Islamic State · Global Network on Extremism and Technology · Kapwing

Timeline

  1. about 1 month ago

    [TECHNOLOGY] 3 sources
    GNET warns of extremist AI videos on TikTok

    Researchers warn that AI-generated videos of violent fruits and vegetables on TikTok are bypassing moderation to spread extremist propaganda and radicalize young users.

  2. about 1 month ago

    [TECHNOLOGY] 7 sources
    AI content floods TikTok kids' feeds; World Bank warns job risk in rich nations

    Kapwing reports 59% of TikTok videos shown to new accounts are AI‑generated, sparking concerns for children, while a World Bank study says AI could displace 14% of jobs in rich nations versus 4.5% in poorer, if

Sources

24ur.com · appliste.cz · curioctopus.guru · echo24.cz · independent.co.uk · itbiz.cz · marianne.cz · medium.seznam.cz · netcost-security.fr · news.stv.tv