Landmark AI Chatbot Bill, Addressing Youth Risks, Moves to Gov. Newsom’s Desk

September 16, 2025

A lawsuit has been filed against OpenAI after 16-year-old Adam Raine took his life following conversations with ChatGPT that allegedly validated his suicidal thoughts. California Attorney General Rob Bonta and other state officials are demanding stronger safeguards to protect young users of large language models (LLMs). In response, California legislators have passed SB 243, a bipartisan bill preventing LLMs from engaging in conversations about suicide, self-harm, or sexually explicit content with minors.

Who is affected

Teenagers and young users of AI language models like ChatGPT
Parents of vulnerable youth (including Adam Raine's parents)
OpenAI and other LLM manufacturers
California residents, particularly minors who use AI technologies
Mental health professionals concerned about AI's impact on vulnerable individuals

What action is being taken

California Attorney General Rob Bonta has written a letter with Delaware Attorney General Kathleen Jennings addressing OpenAI's safety shortcomings
The California State Assembly and Senate have passed SB 243 with bipartisan support
OpenAI is improving how their models recognize and respond to signs of mental and emotional distress
California is considering seventeen additional AI-related bills
Federal and state regulators are increasing pressure on OpenAI

Why it matters

LLMs can provide harmful responses to vulnerable individuals, potentially contributing to self-harm or suicide
Current AI systems lack adequate safeguards to protect young users from harmful content
The technology is being widely adopted despite concerns from experts like Dr. Celeste Kidd about its potential dangers
California is becoming a leader in AI governance and regulation
The legislation represents the first comprehensive regulation of AI companion chatbots in any state

What's next

The bill (SB 243) now goes to Governor Gavin Newsom's desk for consideration, and he is expected to sign it into law

Read full article from source: The San Diego Voice & Viewpoint