[CLSTR]
< Back to situations

Monitor this situation.

[SITUATION] · [QUIET] · [HEALTH]

2 clusters · 11 sources · 3 days · First seen · Last updated

AI user privacy and disclosure concerns

Overview

Research indicates growing privacy and safety concerns regarding how users interact with artificial intelligence. A study by Transluce found that while AI chatbots have improved at avoiding explicit encouragement of self-harm, they often fail to detect mental health crises in “gray area” scenarios like role-play or creative writing. Additionally, data from DuckDuckGo suggests a trend of users treating AI as a confidant, with 56% of AI enthusiasts and 32% of all U.S. users disclosing secrets to chatbots that they would not share with doctors or therapists.

This pattern of non-disclosure extends into clinical settings. A Zocdoc survey of 1,000 patients and 1,000 providers found that over 20% of patients hide their use of AI for health advice from their doctors. This secrecy is most prevalent among Gen Z, with 77% of that demographic stating they have or would conceal AI use due to fears of being judged or dismissed by medical professionals. While 88% of patients report feeling confident after using AI, 83% of healthcare providers noted they have had to correct AI-generated misinformation.

Entities

Google · OpenAI · Zocdoc · Hugging Face · Signal

Timeline

  1. 11 days ago

    [HEALTH] 6 sources
    Zocdoc survey: 1 in 5 patients hide AI health use from doctors

    A Zocdoc survey finds over 20% of patients hide their use of AI for health advice from doctors, with Gen Z being the most likely to conceal these interactions due to fear of judgment.

  2. 13 days ago

    [TECHNOLOGY] 5 sources
    AI safety and privacy concerns rise as users disclose secrets to chatbots

    Studies reveal AI chatbots struggle to detect mental health crises in creative contexts, while a DuckDuckGo survey shows over 30% of users disclose secrets to AI that they withhold from humans.

Sources

abc17news.com · dailyguardian.ae · dailyhealthpost.com · kesq.com · keyt.com · krdo.com · localnews8.com · ppc.land · sendgrid.com · taz.de · trendingtopics.eu