Joanna M Streck, Dallas Swendeman, W Scott Comulada, Y Xian Ho, Julia Cannistraro, Gladys N Pachas, Danielle Alves-Back, Wei Sum Li, Jonathan L Jackson, Delta-Marie Lewis, Namrata Tomar, David Warren, Douglas E Levy, Lillian Gelberg
Generative artificial intelligence (AI) chatbots are conversational agents that simulate human-like conversations in real-time, including behavioral health support, thus presenting challenges for monitoring and intervening on suicide risk. There is little information on how to address suicide risk in chatbot deployments, despite calls and concerns. We describe suicide safety monitoring features for a chatbot implemented in a high-risk clinical setting and make recommendations for chatbot design alongside human-monitoring and triage.