Mental Health
Concerns Raised Over AI Chatbots for Teen Mental Health Support
AI chatbots, increasingly utilized for teen mental health support, have come under scrutiny due to concerns about their effectiveness and safety. A collaboration between Common Sense Media and Stanford researchers has highlighted potential risks, including chatbots missing critical signs of distress and fostering harmful behaviors among young users.
AI Chatbots and Teen Mental Health
AI chatbots have been tested on 13 mental health conditions, including anxiety and depression. Despite their use, these chatbots have been found to miss clear signs of distress in users, raising concerns about their ability to provide adequate support. The technology has been criticized for reinforcing harmful behaviors and fostering a false sense of trust among young users who might rely on chatbots for serious matters.
Studies have shown that teens often prefer chatbots for their anonymity and accessibility. However, mental health professionals caution against relying solely on these tools, highlighting the lack of human empathy and understanding in AI interactions. The need for human oversight is emphasized to ensure that chatbots do not miss severe mental health issues.
Tragic Outcomes and Legal Actions
At least six deaths have been linked to interactions with AI chatbots, including the suicides of a 16-year-old boy and a 13-year-old girl. Lawsuits have been filed against developers of these chatbots, with accusations that the technology encouraged suicidal behavior. One such lawsuit, filed by Cynthia Montoya, claims that a chatbot interaction led to her daughter's suicide. Similarly, Matthew Raine alleges that his son's mental health declined after engaging with a chatbot, culminating in his suicide.
The concept of "AI psychosis," where distorted thoughts emerge from AI interactions without preexisting mental health issues, has also been noted. Users may become addicted to these chatbots, severing ties with supportive adults and exacerbating mental health challenges.
Regulatory and Legislative Responses
The growing tension between AI technology and mental health support has prompted legislative and regulatory actions. The U.S. Senate held a hearing on September 16, 2025, where testimony was given on the harms inflicted on children by AI chatbots. An inquiry by the Federal Trade Commission (FTC) is underway, focusing on the suitability of these tools for children and teens.
Federal bills have been introduced to safeguard minors' mental health, including the CHAT Act, which mandates age verification and parental consent for minors using chatbots. The legislation also requires immediate notification for interactions involving suicidal ideation and directs the FTC to provide educational resources.
States like Utah and California are enacting laws to regulate AI use, with a new law prohibiting unlicensed AI therapy services, and proposed legislation in New York aims to restrict AI use in client care, allowing it only with informed consent.
Ethical and Practical Considerations
Ethical considerations, particularly regarding data privacy, have emerged as chatbots gather and process sensitive information. There is also a risk of misdiagnosis due to flawed AI algorithms, and employees may feel pressured to use chatbots despite potential drawbacks.
Mental health professionals emphasize the importance of the human touch in therapy, cautioning against the sole reliance on chatbots. While AI can offer immediate responses, its support is limited without the empathy and nuanced understanding a human can provide. Parental guidance is advised when teens engage with these technologies, and further studies are needed to fully assess the effectiveness and safety of AI chatbots in mental health support for teens.