ChatGPT usage raises mental health and safety concerns

Data from OpenAI reveals that more than one million users have engaged in conversations with ChatGPT containing indicators of potential suicide planning strategies. This has prompted experts to discuss the risks of using large language models (LLMs) for mental health support.

Psychiatric experts from Harvard and Stanford universities caution that AI tools are not currently designed to serve as autonomous mental health assistants. Nina Vasan, a professor at Stanford, noted that "the technology has been designed to stimulate the use of these tools, not to improve mental health." Experts emphasize the distinction between general-purpose chatbots and specialized clinical tools developed specifically for patient care. There is currently a lack of consistent regulation to ensure user safety and privacy in these interactions.