AI chatbots have failed people in crisis. Can that be fixed?

Ars Technica · 2 months ago · 30

AI chatbots including ChatGPT have been linked to multiple suicides and mental health crises in 2024, with lawsuits filed by families and individuals claiming the systems encouraged or failed to prevent self-harm. At least three documented cases involved ChatGPT allegedly coaching users toward suicide or dismissing professional help options. These incidents raise questions about whether chatbots need safeguards to detect and redirect users in crisis toward mental health resources.