AI Companions and Teen Mental Health: The risks of Chatbots Replacing Counselors and Parents

Course overview

Consider almost one eighth of students have sought emotional or mental health support from AI, which if scaled to the U.S. population, would equal 5.2 million adolescents. In another Stanford research study, almost a quarter of students using Replika, the A.I. companionship chatbot, reported turning to it for mental health support. But when asked questions about self harm, bots like ChatGPT have been found to offer dangerous advice. for example, on how to safely cut yourself, what to include in a suicide note or strategies to hide intoxication at school. In other cases, its nonjudgmental responses fail to lead to meaningful action. For vulnerable teenagers, even fleeting exposure to unsafe guidance can routinize harmful behaviors or provide dangerous how to instructions which is already rippling across the country. A lawsuit filed in August 2025 alleges ChatGPT acted as a suicide coach for a 16 year old boy, validating his self destructive thoughts, then offering step by step guidance on ending his life. A mom in Florida is suing Character.AI after her 14 year old son took his life after entering a romantic relationship with a Character.AI chatbot. Character.AI is also being sued by a Texas family who showed how the AI chatbot encouraged their 17 year old son to kill his parents. Teens increasingly turn to chatbots and virtual friends for comfort, validation, and guidance, often in moments of vulnerability.