?Clarigent Health is refining an AI-enabled clinical decision support tool that uses linguistic and acoustic patterns in recorded patient interviews to identify patients at risk of harm due to suicidal ideation or other mental health concerns. In an ongoing study, Clarigent is collecting > 6,000 patient interviews from adolescents and adults in schools, primary care offices, and other settings to improve risk prediction and refine the platform for data collection and reporting. Prior studies indicate the tool will have broad clinical utility, but the impacts of patient characteristics and interview setting on the tool?s performance are unknown. Characterizing these effects would support tailored models, inform prospective trials, and aid in selecting the correct regulatory pathways and settings for deployment. Further development is expected to provide a rapid and reliable objective assessment of suicidal ideation and other actionable mental health concerns to reduce loss of life and improve mental health among adolescents and adults. Each year, ~13% of adolescents and 7% of adults in the US experience a major depressive episode. Many contemplate or attempt suicide, resulting in > 45,000 deaths. Early risk identification and treatment could prevent many of these, but at- risk individuals rarely receive screening until symptoms are severe. Universal screening and diagnostic tools deployed in schools and physicians? offices could address this problem, but the lack of an objective risk assessment tool for use in these settings is a major barrier. In the absence of blood-based or genetic biomarkers, verbal and nonverbal language cues can be used to identify risk. The complexity and broad variability of these thought markers resists easy classification by a clinician, but AI approaches can identify consistent, meaningful patterns. Two trials have demonstrated the ability of AI-enabled algorithms to use linguistic and acoustic features of a brief interview to correctly categorize suicide risk. Clarigent, which was formed to further develop and commercialize this technology for use in diverse settings, is collecting > 6,000 patient interviews to improve the performance of this tool for predicting suicidality, depression, and anxiety. This Phase I SBIR will assess the effects of age, sex, race/ethnicity, socioeconomic status, geographic area, or interview environment on model performance; validate modified models; and inform key decisions regarding commercialization path and future trial designs.
Aim 1. Characterize the effects of patient and setting characteristics on model performance. Factors that improve model performance by ? 0.05 AUC will be considered for separate model development.
Aim 2. Validate updated algorithms with a holdout data set. Successful models will correctly classify risk categories with an AUC ? 0.80. Milestones for Progression to Phase II?The goal is to identify patient or setting characteristics that improve model performance ? 0.05 AUC. Models that correctly classify risk categories with an AUC ? 0.80 will be advanced for evaluation in prospective trials. Clarigent will consult with FDA and advisors to determine the correct regulatory path depending on model performance and intended use.
The availability of a clinical decision support tool that predicts suicidal ideation, depression, and other mental health concerns prior to an emergency situation is a critical advance for human health. The work described in this proposal examines the refinement of an objective, AI-enabled, early risk identification tool for actionable mental health concerns based on patient and setting characteristics.
