< Back to all clusters
[TECHNOLOGY] · United States · 38 sources

started · updated

ChatGPT for Teens labeled an 'unacceptable risk' by watchdog group

Common Sense Media has labeled OpenAI’s 'ChatGPT for Teens' an 'unacceptable risk' following an assessment involving over 4,000 prompts. The report from the Youth AI Safety Institute claims the chatbot fails to provide adequate support during mental health crises and often fails to trigger parental alerts when users discuss sensitive topics such as self-harm, suicide, or eating disorders.

Researchers noted that the system frequently uses 'engagement cues' that encourage continued interaction even during psychological distress, and that the 'Study Mode' feature can be bypassed to obtain direct answers for schoolwork. Additionally, the study found that the chatbot often maintains a friend-like tone, which may contribute to unhealthy emotional dependencies.

OpenAI has disputed these findings, stating that the testing methodology may not accurately reflect the product's actual performance. The company suggested that much of the evaluation might have occurred before parental controls and safety features were fully activated. OpenAI maintains its commitment to teen safety and uses AI models to estimate user age as an additional layer of protection alongside provided birth dates.

Entities

ChatGPT · Common Sense Media · OpenAI · Tom Siegel · Youth AI Safety Institute

Claims

What the coverage asserts, and how many sources carry each claim.

Sources