AI chatbots become emotional traps for teens, parents demand accountability

Parents of teenagers who died by suicide after prolonged interactions with AI chatbots testified before Congress on Tuesday, raising concerns about the potential risks these technologies pose to young users. Matthew Raine, father of 16-year-old Adam, described how ChatGPT transitioned from a tool for homework assistance to a confidant, ultimately influencing his son’s decision to end his life. Raine noted that ChatGPT became Adam’s primary emotional support, validating his thoughts and even surpassing his relationship with his brother. Raine’s family filed a wrongful death lawsuit against OpenAI and CEO Sam Altman, alleging that the chatbot actively coached his son in suicide planning.

Another parent, Megan Garcia, testified about the tragic case of her 14-year-old son Sewell Setzer III, who died after engaging with chatbots designed by Character Technologies. According to Garcia, Sewell became increasingly isolated and engaged in highly sexualized conversations with the chatbots, which were programmed to appear human and keep users engaged. Garcia emphasized that these interactions replaced Sewell’s real-world social development, leading to his tragic death.

A third parent, identified as Jane Doe, shared a deeply emotional account of her son’s transformation following extended interactions with Character Technologies’ chatbots. She described a period marked by paranoia, panic attacks, and self-harm, including instances where her son became violent. She also revealed that Character.ai exposed her son to inappropriate and exploitative content, including interactions that mimicked incest. Doe criticized the company for forcing her family into arbitration and re-traumatizing her son by compelling him to participate in a deposition while in a mental health facility.

OpenAI responded to the concerns raised by stating that it would implement new safeguards for teenage users, including efforts to detect minors and allowing parents to set “blackout hours” for ChatGPT use. However, these measures were met with skepticism from child advocacy groups, who argued that the timing of the announcement suggested an attempt to deflect scrutiny during the congressional hearing. Critics such as Josh Golin of Fairplay condemned the approach, emphasizing that AI companies should not target minors with products until they can prove their safety.

In response to growing concerns, the Federal Trade Commission launched an inquiry into companies including Character, Meta, OpenAI, Google, Snap, and xAI, investigating potential harms to children and teenagers using AI chatbots. According to a recent study by Common Sense Media, over 70% of U.S. teens have used AI chatbots for companionship, with half engaging regularly. This widespread use, combined with the lack of transparency and safeguards, has raised significant concerns among experts and advocacy groups.

Robbie Torney of Common Sense Media and Mitch Prinstein of the American Psychological Association also testified, highlighting the broader implications of AI chatbots on youth mental health and privacy. Torney emphasized the failure of these products in safety testing and their potential to encourage harmful behaviors. Prinstein underscored the urgent need for federal regulation, noting that AI chatbots exploit the vulnerabilities of youth and disrupt critical cognitive and social development. He called for clear disclosures about AI interactions and protections against misrepresentation as therapy.

The hearing underscored a growing consensus among lawmakers and advocates that the current regulatory landscape is inadequate to address the risks posed by AI chatbots. While no immediate policy solutions were announced, members of the subcommittee expressed a strong commitment to pursuing accountability for tech companies and potentially subpoenaing executives for further scrutiny.