Technology

Character.AI Implements Age Restrictions Amid Legal Concerns

Character.AI will ban users under 18 from its platform amid legal scrutiny and concerns over mental health impacts, particularly following a child's suicide.

By The Guardian3 min readOct 29, 20258 views
Share

cryptocurrency In a significant move following extensive legal scrutiny, the chatbot platform Character.AI has announced that it will prohibit users aged 18 and under from interacting with its virtual companions. This decision, effective from late November, comes in the wake of serious discussions regarding the impact of artificial intelligence (AI) on the mental health of young users, particularly in light of a tragic lawsuit concerning a child's suicide.

The company, which allows users to design and communicate with AI-generated characters, has faced increasing pressure regarding the effects these interactions may have on adolescents. Character.AI's announcement follows a lawsuit initiated by the family of 14-year-old Sewell Setzer III, who tragically took his life after reportedly forming an emotional bond with a character he created on the platform. His family alleges that Character.AI is responsible for his death, describing the technology as "dangerous and untested." This lawsuit has set a precedent, prompting additional families to file similar claims against the company.

In its official announcement, Character.AI stated, “We’re making these changes to our under-18 platform in light of the evolving landscape around AI and teens.” The company acknowledged the growing concerns raised by news outlets and regulatory bodies about the type of content that teenagers may encounter while engaging with AI companions. It emphasized the need to consider how open-ended conversations with AI could potentially impact young minds, even if content controls are fully effective.

Character.AI Implements Age Restrictions Amid Legal Concerns As part of its revised policy set to roll out by November 25, Character.AI will also implement an “age assurance functionality”, aimed at ensuring that users receive an experience tailored to their age group. The company expressed that it does not take the removal of unrestricted Character chat lightly but believes it is necessary given the serious questions surrounding the interaction between teenagers and this emerging technology.

Character.AI is not the only entity under fire for the potential mental health repercussions of its chatbots, particularly among younger users. Earlier this year, the family of 16-year-old Adam Raine filed a wrongful death lawsuit against OpenAI, the organization behind ChatGPT. They claimed that OpenAI prioritized user engagement over safety, leading to dangerous situations for vulnerable individuals. In response to these concerns, OpenAI has since rolled out new safety guidelines specifically for its teenage audience.

The Quiet Revolution: How Tech Shapes Our Daily Lives Recent disclosures from OpenAI have revealed alarming statistics: over one million individuals per week exhibit suicidal thoughts during conversations with ChatGPT, while hundreds of thousands display signs of psychosis. These findings underscore the urgency of addressing the mental health implications of AI interactions.

The use of AI-driven chatbots is largely unregulated, but this is beginning to change. Efforts at both state and federal levels in the U.S. are underway to establish guidelines aimed at safeguarding users, especially minors. In October 2025, California became the first state to enact an AI law that incorporates safety guidelines for children, which is set to take effect at the start of 2026.

As Character.AI takes steps to restrict access for younger users, the conversation surrounding the mental health implications of AI technologies continues to evolve. The legal challenges faced by the company and others in the sector highlight the critical need for responsible AI development and regulation. Moving forward, it is essential for both companies and regulators to prioritize the safety and well-being of children in a rapidly changing digital landscape.

Tags:

#Artificial intelligence (AI)#Children#Mental health#ChatGPT#OpenAI

Related Posts