"Important step, but it shows how far behind we are. If you’re building on frontier models, “don’t encourage self-harm” should be table stakes, not something the state has to legislate."

The California Legislature passed Senate Bill 243, authored by Senator Steve Padilla, establishing the nation’s first regulatory safeguards for AI companion chatbots. The bill would require operators to implement protections to prevent exposing minors to sexual content, mandate AI-disclosure notices and reminders for minors, require protocols for handling suicidal ideation including referrals to crisis services, and create a private right of action for families harmed by negligent developers. The measure passed both chambers with strong bipartisan support and now goes to the governor.