key: cord-0295877-dof38rxq authors: OReilly, L. M.; Dalal, A. I.; Maag, S.; Perry, M. T.; Card, A.; Bohrer, M. B.; Hamersly, J.; Mohammad, S.; Peterson, K.; Beiser, D. G.; Gibbons, R. D.; DOnofrio, B. M.; Musey, P. I. title: Computer adaptive testing to assess impairing behavioral health problems in emergency department patients date: 2022-01-10 journal: nan DOI: 10.1101/2022.01.08.22268937 sha: 4e567afbdc44e3b89c4a6de2bcde16ddcb584306 doc_id: 295877 cord_uid: dof38rxq Study Objective: To assess the prevalence of several impairing behavioral health domains in stable patients presenting to the emergency department (ED) through the use of computer adaptive testing and the association among the domains, standard assessments, and ED utilization. Methods: This was a single-center observational study of 828 randomly selected adult patients presenting to the ED from May 2019 to March 2020. The main outcomes of interest were the self-administered, validated computer adaptive assessments of suicidality, depression, anxiety, PTSD, and substance abuse using computer adaptive testing, the CAT-MHTM. We estimated the association among the CAT-MHTM subscales, standard assessments, and the number of ED visits in the year prior and 30 days after enrollment. Results: The proportion of those who scored above the threshold of low/mild risk were: 24.1% (suicidality), 8.3% (depression), 16.5% (anxiety), 12.3% (PTSD), and 20.4% (substance use). While the CAT-MHTM subscales were highly correlated with other self-report assessments, they were not highly associated with standard ED assessments of suicidality. When examining associations with ED use, for example, individuals who had two or more ED visits in the prior year had 51% increased odds of being in the intermediate-high suicide risk category (95% Confidence Interval [CI], 1.03-2.23) compared to those with zero prior ED visits. Conclusion: The CAT-MHTM can document the high prevalence of mental health conditions in the ED, which were missed by standard ED practices. Mental health problems are associated with ED utilization in a population of patients presenting largely for somatic complaints. There are approximately 140 million visits to US Emergency Departments (ED) annually. 1 Visits for psychiatric or substance abuse account for approximately 10% of these visits. 2 Importantly, this represents a dramatic rise (approximately 30%) in the number of visits primarily for mental health complaints over the past two decades, which has outpaced the rise in overall ED visitation. 2-9 ED service delivery costs associated with the most prevalent mental health and substance abuse diagnoses are in excess of $3.5 billion, with anxiety and depression accounting for $1.7 billion annually. 10 The severity of mental health symptomology is positively correlated with rate of ED use. 11 , 12 Yet, most mental health problems are missed during ED encounters. [13] [14] [15] In fact, 45% of patients who are seen in the ED for non-psychiatric primary complaints have comorbid psychiatric disorders, including major depression, general anxiety, substance abuse, and suicidal ideation. The barriers to standard true universal mental health screening in the ED are many and include the competing priorities of ED providers providing care to critically ill patients in busy and crowded ED environments, limited access to adequate mental health resources for consultation and outpatient care, as well as the training and attitudes of ED clinicians. 16, 17 These same barriers have limited the approach to widespread mental health screening in the ED and represent a major missed opportunity to provide appropriate care as a significant proportion of ED patients presenting with non-psychiatric complaints have comorbid, unaddressed mental health issues as noted above. It is noteworthy that many patients who die by suicide often visit the ED or access the healthcare system shortly before their attempt for a non-psychiatric reason. 18, 19 In this study, we build and expand upon the work of Beiser et al. (2019) who demonstrated the feasibility of using a brief computer adaptive testing tool (the CAD-MDD 12 and the CAT-DI 20 ) for depression assessment in a broad sample of ED patients with nonpsychiatric primary complaints. Our objectives in this study were three-fold. First, we aimed to document the prevalence of suicidality, depression, anxiety, post-traumatic stress disorder (PTSD), and substance abuse in an ED population. Second, we compared the results of the All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. ; https://doi.org/10.1101/2022.01.08.22268937 doi: medRxiv preprint computer adaptive test-mental health (CAT-MH TM ) standardized screening to standard of care ED assessments for suicide, as well as to other validated self-report screening tools for anxiety and depression. Finally, we aimed to estimate the health care utilization of ED patients with mental health care problems. This was a single-center prospective observational sample of 828 randomly selected nonconsecutive patients presenting at a Midwestern emergency department (ED) over the course of 10 consecutive months. This study was approved by the Indiana University School of Medicine Institutional Review Board (protocol no.1904527368 ) and all participants gave their informed consent. Data collection began on May 24, 2019, and ceased on March 10, 2020 with the rapid increase of COVID-19 cases and resulting stay-at-home orders. Exclusion criteria for the study included: 1) age younger than 18 years, 2) being under involuntary detention, 3) lack of or impaired decisional capacity (e.g., active psychosis, dementia, developmental delay, intoxication), 4) hemodynamic instability according to the treating provider, 5) non-English speaking, and 6) those that may encounter issues with utilization review (e.g., prisoner, living out of the state). Therefore, the cross-section of included patients were relatively stable ED subjects without overt barriers to providing consent. Trained research personnel used the ED tracking system within the electronic medical record (EMR) system (Cerner Firstnet) to screen for potentially eligible subjects presenting to the ED primarily during weekday daytime hours. To reduce sampling bias, research personnel began each screening shift by selecting a random digit between 0 and 9 using an online random number generator. All subjects on the ED census at that time with the last digit of their age matching the selected number were deemed eligible. This random selection process was repeated each time the list of eligible subjects was exhausted. The treating providers for screened subjects were approached to confirm eligibility criteria. Those subjects meeting all enrollment criteria were approached for informed consent. Participants then completed a multidimensional psychological screening using the self-administered CAT-MH TM , which is described below. Additional data including medical comorbidity, past medical history, and chief complaint were All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. ; https://doi.org/10.1101/2022.01.08.22268937 doi: medRxiv preprint collected and supplemented by EMR review. Socio-demographic data was collected through patient self-report. Self-reported past medical history was assessed by asking the participant to indicate if a doctor or another health care worker had diagnosed or treated the participant for 13 medical items in the past three years (see Table 1 ). Subsequently, each participant underwent a self-administered unidimensional screening for anxiety, depression, physical symptoms, and pain via a secure tablet. Health care utilization data was obtained through the EMR and the Indiana Network for Patient Care (INPC) managed by the Indiana Health Information Exchange, the nation's largest inter-organizational clinical data repository, 21 to collect data regarding disposition (admit or discharge), medical history, discharge diagnoses, and ED utilization in the 12 months before and after enrollment. Note that while we intended to examine ED utilization 12 months before and after enrollment, we limited our analyses to 12 months prior and 30 days after enrollment. Research has demonstrated that the COVID-19 pandemic greatly affected health care use, particularly in EDs, 22 which would have systematically biased our long-term follow-up data. During the study period, standard of care universal suicide screening took place at the enrollment site ED for individuals not presenting with a chief complaint of suicidal ideation. The standard of care consisted of three questions closely aligned with the Columbia-Suicide Severity Rating Scale (C-SSRS): 1) "Have you wished you were dead or wished you could go to sleep and not wake up?"; 2) "Have you had thoughts of harming yourself?"; 3) "In the last three months have you done anything, started to do anything or proposed to anything to end your life?" Individuals answering "yes" to number two were asked the remaining three questions of the suicidal ideation section of the C-SSRS and the attending physician was notified. Additionally, the patient's provider was asked to quantify their concern for a future suicide attempt by marking a 100-millimeter visual analog scale (VAS) in response to the question: "What is your level of suspicion that this patient will attempt suicide in the next 30 days?". Finally, the CAT-MH TM , as described below, also screened for suicide risk. Treating clinicians were informed of anyone who screened in the high-risk category for suicide using this tool. The CAT-MH TM 20, 23 is a suite of mental health computerized adaptive tests (CATs), that can be self-administered via any internet capable device (computer, tablet, smartphone), either in the clinic, ED, or remotely via a secure patient portal. The CAT-MH TM is unique in that unlike All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. ; https://doi.org/10.1101/2022.01.08.22268937 doi: medRxiv preprint traditional CATs developed for educational assessments that are based on unidimensional item response theory (IRT) and are only appropriate for simple constructs such as mathematical ability, the CAT-MH TM is based on multidimensional item response theory and is suitable for the measurement of complex constructs such as depression, anxiety, and suicidality. For a given construct (e.g., depression) the CAT-MH TM draws symptom items from a large bank of potential items that completely covers the latent variable of interest from the lowest to the highest levels of severity. The CAT begins by selecting an item from the middle of the severity continuum. Based on the item response, typically on a 5-point Likert scale, a provisional severity score and its uncertainty are computed. Based on that score, the next maximally informative item is selected and administered. Based on the response to the second item, the severity score and uncertainty are recomputed. The process continues until the uncertainty in the estimated score falls below 5 points on a 100-point scale. In our study we included CATs for suicidality (CAT-SS 24 38, 39 it has cutoffs of 5, 10, and 15, corresponding to low, medium, and high somatic symptom severity. (4) The Pain Catastrophizing Score (PCS) is a 13-item self-administered tool used to quantify a person's thoughts and feelings when they have experienced pain. 40, 41 The maximum total score is 52 and total scores ≥ 30 are considered clinically significant. 40 All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. ; https://doi.org/10.1101/2022.01.08.22268937 doi: medRxiv preprint We documented the percentage of patients endorsing different categories (e.g., normal, mild, moderate, severe) of the five domains assessed by the CAT-MH TM . We present this for all the patients, as well as a subgroup of patients who scored in the intermediate to high categories of suicidal risk. We then compared the identification of patients at risk for suicide using the CAT-MH TM with the standard ED procedures. To further examine the assessment of mental health and substance problems via the CAT-MH TM , we correlated the CAT-MH TM scores with clinician-reported suspected suicide and self-reported measures. To determine the association between the number of ED visits in the year prior to enrollment and CAT-MH TM subscales, we conducted logistic regression analyses. The predictors, number of ED visits within the prior year, were dummy coded into three categories: 1) zero visits in the year prior, which served as the reference category, 2) one visit prior, and 3) two or more visits prior. We analyzed each CAT-MH TM subscale separately as a binary outcome, dichotomized suicide and substance use into low risk (0) and intermediate-high risk (1), depression and anxiety into normal/mild (0) and moderate/severe (1), and PTSD into no evidence (0) and possible/highly likely (1). We included the following demographic covariates: age, gender, ethnicity, race, marital status, and employment. In order to examine the association between the CAT-MH TM subscales and subsequent ED visits within 30 days of ED enrollment date, we conducted logistic regression analyses adjusting for demographics. The predictors were each of the categorical risk levels for the CAT-MH TM subscales, which we dummy coded such that the lowest level of risk served as the reference category. Given the reduced sample size in the high-risk categories, we combined all the categories above low risk. For depression and anxiety subscales, mild was also included in the reference category. We dichotomized the outcome into not present (0) or any ED visit (1) within 30 days. We conducted three sensitivity analyses to examine the potential impact of analytical decisions on the results and interpretation. First, we predicted the continuous CAT-MH TM subscales from ED visits in the year prior to enrollment. We included an unstandardized and standardized outcome to examine the magnitude of the effects in terms of a single point increase on the 100-point scale and in terms of standard deviation units, respectively. Second, when All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. ; https://doi.org/10.1101/2022.01.08.22268937 doi: medRxiv preprint assessing the associations with mental health problems with subsequent ED visits, we utilized continuous, standardized CAT-MH TM subscales rather than utilizing categorical CAT-MH TM predictors. Third, we conducted ordinal logistic regression to predict ED visits within 30 days after enrollment to examine the association with each CAT-MH TM category. In the study, 1,854 patients were screened and approached for enrollment. Of those subjects who were approached for enrollment in the study, 828 (44.7%) underwent informed consent and were enrolled. Of those who consented, 97.3% (n=806) completed the CAT-MH TM . Reasons for lack of completion in the remaining 22 subjects included study withdrawal, interruptions related to clinical care such as procedures, and completion times over one hour. In were Black/African American, 53% were single, 84% had a high school degree/GED or above, and 40% were employed full-time. The three most common chief complaints when participants presented in the ED were abdominal pain (21.0%), musculoskeletal pain (e.g., back, extremity, etc.) (13.2%), and chest pain (11.5%). The three most common health problems of which participants had a history included high blood pressure or hypertension (42.9%), anxiety (40.7%,), and depression (38.7%). The mean score of the GAD-7 was 5.3 (SD, 5.9), PHQ-8 was 6.4 (SD, 5.8), PCS-13 was 10.7 (SD, 12.8), and PHQ-15 was 9.6 (SD, 5.6). The average number of ED visits to the All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. ; https://doi.org/10.1101/2022.01.08.22268937 doi: medRxiv preprint Midwestern healthcare network in 12 months prior to the participant's enrollment date was 2.1 (SD, 4.7) and within 30 days since the participant enrollment date was 0.3 (SD, 0.8). Suicide risk severity was also assessed by the CAT-MH TM and the right-hand column in Table 1 presents the frequency distribution of demographic variables, chief complaint, medical history, self-report questionnaires, and admission information for those who screened Table 2 presents the frequency distribution of the CAT-MH TM subscales defined both categorically and continuously. The proportion of those who scored above the threshold of low risk/no evidence group for the following subscales were: 1) 24.1% for suicide, 2) 12.3% for PTSD, and 3) 20.4% for substance use. The proportion of those who scored above the threshold of normal/mild risk group for the following subscales were: 1) 8.3% for depression, and 2) 16 .5% for anxiety. Across all categories, approximately 31.9% (n=253) of the sample screened above the threshold for at least one CAT-MH TM subscale and 20.7% (n=164) for two or more CAT-MH TM subscales. See Supplementary Table 1 for the frequency distribution of use and abuse of specific substances. To examine the overlap between suicide screens, Table 3 presents the cross-tabulation between the CAT-MH TM positive suicide screen (i.e., those in the high-risk suicide severity category) and the ED's standard of care. Ten individuals screened positive on the CAT-MH TM suicide screen but only three of these screened positive by the standard of care ED screen. Thus, seven individuals were not identified via the standard of care screening. All seven identified participants were in the high-risk category on the CAT-MH TM suicide subscale. Table 4 presents the Pearson correlations between the CAT-MH TM subscales and the clinician-rated suspected suicide rating and self-reported questionnaires. Each CAT-MH TM subscale, including suicidality, was weakly correlated with the clinician rating of suspected suicide, and was strongly correlated with the self-reported questionnaires indexing of anxiety, depression, pain catastrophizing, and physical symptoms. All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. ; https://doi.org/10.1101/2022.01.08.22268937 doi: medRxiv preprint First, we predicted continuous CAT-MH TM subscales from visits to the ED within the 12 months prior to enrollment. The pattern of results was similar to the main analyses. For example, patients who visited the ED two or more times in the previous year scored 4.6 points higher on the continuous measure of suicide, which was a 0.25 standard deviation difference (Supplementary Table 2 ). Second, we predicted ED admissions 30 days after enrollment from standardized continuous CAT-MH TM subscales. The trend of results was similar to the main analyses (Supplementary Table 3 ). For suicide, each standard deviation increase in the suicide subscale was associated with a 19% increased odds of ED admission. Third, when conducting ordinal logistic regression to predict ED visits within 30 days after enrollment, the results followed a similar pattern as the main analyses, although the estimates were less statistically precise (Supplementary Table 4 ). This prospective observational study represents the most complete use of the validated computer adaptive tool (CAT-MH TM ) in the ED environment for multidomain mental health screening in a broad random sample of patients presenting to a large urban emergency All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. department. According to the results of the CAT-MH TM screening, approximately one-third of the sample population (31.9%) had at least one high CAT-MH TM subscale and 20% of the sample had at least two high subscales scores. For example, 16.5% and 8.3% screened positive for moderate/severe anxiety and depression, respectively. The prevalence of clinically significant depression in this population (8.3%) by CAT-MH TM screening is similar to the prevalence of moderate to severe depression noted (7%) in another ED sample using the CAT-MH TM . 42 Our population was primarily comprised of patients who presented without psychiatric complaint, and we know that a significant proportion of ED patients who are evaluated for non-psychiatric complaints (e.g., chest pain and abdominal pain) have comorbid mental health problems, which often remain undiagnosed during ED encounters. [13] [14] [15] 43 Estimates suggest that approximately 1% of all US ED visits are related to suicidal ideation. 9 In our enrolled sample, three participants screened positive for suicidal ideation according to standard ED screening procedures as described above. While the CAT-MH TM correctly identified each of these individuals and categorized them as high risk, this tool detected seven additional high-risk individuals not flagged by standard of care screening. Notably, clinician report of suspected suicide was only very weakly correlated (r=0.11) with the CAT-MH TM index of suicidality. It is possible that patients felt more at ease disclosing their feelings via the tablet administered CAT-MH TM rather than directly to the nurse at check in or during the evaluation by the doctor. The results illustrate that universal screening protocols are minimally time-intensive (i.e., the median response time was roughly 2 minutes per each of the five included domains) and effective at identifying patients at high risk who would have otherwise been missed due to the non-psychiatric nature of their chief complaint. 7, 44 This is important, as a significantly higher proportion of those who screened intermediate to high suicide risk via the CAT-MH TM also self-reported more problems with anxiety, depression, PTSD, and substance use compared to the rest of the sample. One of the aims of our study was to examine the relationship between mental illness and ED recidivism as mental illness has been shown to be a strong predictor of frequent ED use. 11, 12, 45 In our study, compared to those with no visits in the 12 months prior to enrollment, those with two or more ED visits were significantly more likely to score in the high ranges for suicide risk, PTSD, and substance use on the CAT-MH TM . With regard to subsequent ED use in the 30 days post-enrollment, suicide risk (intermediate-high on the CAT-MH TM ) was associated with an All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. ; https://doi.org/10.1101/2022.01.08.22268937 doi: medRxiv preprint increased likelihood of repeat ED utilization. Taken together, these results are consistent with prior literature showing that approximately 30% to 50% of these patients with frequent ED utilization have a mental health or substance use disorder. 11, [46] [47] [48] [49] There are several important limitations to mention. We attempted to obtain a random sample of ED patients within our inclusion criteria with the aid of a random number generator in addition to adding evening and weekend screening, but this is only quasi-randomization. Additionally, since this study depended upon voluntary participation, it is unclear if those with underlying psychological conditions were more or less likely to volunteer to participate given either a willingness to disclose and seek help or concern regarding persistent mental health stigmas. In any case, these represent a form of selection bias which may actually underestimate the magnitude of impairing behavioral health conditions. With regards to the chief complaint, the overwhelming majority of complaints were somatic in nature. While we did not overtly seek to exclude those with mental health presentations (complaints of anxiety and depression), these patients are often triaged to the psychiatric observation rooms for close behavioral assessment, which would have effectively excluded them until they were moved out of those areas. As such, the results of this study apply primarily to patients receiving care in the ED for non-psychiatric complaints. Finally, our overall enrollment goals (1,000 patients) and ED recidivism targets (12 months) were curtailed by the institution of COVID-19 precautions and stay-at-home orders. We had planned to collect and analyze ED recidivism data for the 12 months post enrollment, but due to the extraordinary environmental and societal pressures applied by the broad stay-at-home orders during the COVID-19 pandemic 22 , we believed this would confound these data. Nonetheless, it is clear that there is a strong association between mental health issues and ED recidivism, which may benefit from screening tools such as the CAT-MH TM . In the study we were able to demonstrate the use of the validated multidimensional CAT-MH TM to document the high rate of impairing mental health conditions and their associated ED utilization in a population of ED patients presenting largely for somatic complaints. Furthermore, in this population the CAT-MH TM performed superior to standard of care suicide screening in identifying more than three times the number of individuals at high risk for suicide. Future work should focus on assessing the ability of the multidomain CAT-MH TM in universal screening. All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. ; (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. ; https://doi.org/10.1101/2022.01.08.22268937 doi: medRxiv preprint All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. ; Derived from 794 unique individuals. CAT-MH suicide screen based on suicide severity. 1 Individuals who screened positive were in the high-risk suicide severity group. All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. ; https://doi.org/10.1101/2022.01.08.22268937 doi: medRxiv preprint 22 All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. ; Supplementary Figure 1 (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted January 10, 2022. ; https://doi.org/10.1101/2022.01.08.22268937 doi: medRxiv preprint National Hospital Ambulatory Medical Care Survey: 2017 emergency department summary tables. National Center for Health Statistics Epidemiology of Emergency Department Visits for Anxiety in the United States Emergency department visits for depression in the United States from National Trends in Emergency Department Visits by Adults With Mental Health Disorders Analysis of emergency department visits for all reasons by adults with depression in the United States Improving Suicide Risk Screening and Detection in the Emergency Department Trends in Emergency Department Visits Involving Mental and Substance Use Disorders Emergency Department Visits Related to Suicidal Ideation Costs of Emergency Department Visits for Mental and Substance Use Disorders in the United States Factors Associated With Emergency Department Use by Patients With and Without Mental Health Diagnoses Depression in Emergency Department Patients and Association with Healthcare Utilization Undiagnosed mental illness in the emergency department Occult suicidality in an emergency department population Recent suicidal ideation among patients in an inner city emergency department. Suicide Life Threat Behav Reducing Suicide Risk: Challenges and Opportunities in the Emergency Department Steps to Achieve Universal Suicide Screening in Emergency Departments: A Call to Action Health care contacts in the year before suicide death Attendance at the accident and emergency department in the year before suicide: retrospective study Development of a computerized adaptive test for depression. Arch Gen Psychiatry Effects of state COVID-19 closure policy on NON-COVID-19 health care utilization Computerized Adaptive Diagnosis and Testing of Mental Health Disorders Development of a Computerized Adaptive Test Suicide Scale-The CAT-SS Development of the CAT-ANX: a computerized adaptive test for anxiety The Posttraumatic Stress Disorder Checklist for DSM-5 (PCL-5): Development and Initial Psychometric Evaluation Development of a computerized adaptive substance use disorder scale for screening and measurement: the CAT-SUD. Addiction A brief measure for assessing generalized anxiety disorder: the GAD-7 Screening for anxiety disorders with the GAD-7 and GAD-2: a systematic review and diagnostic metaanalysis Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection Validity of the GAD-7 scale as an outcome measure of disability in patients with generalized anxiety disorders in primary care The PHQ-9: A new depression diagnostic and severity measure The PHQ-9: Validity of a brief depression severity measure Screening for depression in medical settings with the Patient Health Questionnaire (PHQ): a diagnostic meta-analysis Lower PHQ-9 cutpoint accurately diagnosed depression in people with long-term conditions attending the Accident and Emergency Department Depression is associated with repeat emergency department visits in patients with non-specific abdominal pain Prevalence and Overlap of Noncardiac Conditions in the Evaluation of Low-risk Acute Chest Pain Patients Standardization of a screening instrument (PHQ-15) for somatization syndromes in the general population The PHQ-15: validity of a new measure for evaluating the severity of somatic symptoms The Pain Catastrophizing Scale: Development and validation Screening for Depression in Emergency Department Patients and Relationship to Health Care Utilization Suicide Prevention in an Emergency Department Population: The ED-SAFE Study. JAMA psychiatry Risk Factors for Persistent Frequent Emergency Department Use in Medicare Beneficiaries Understanding Frequent Emergency Department Use Among Primary Care Patients Resource utilization and health care charges associated with the most frequent ED users