Skip to main content
Log in

Using Behavioral Measures to Assess Suicide Risk in the Psychiatric Emergency Department for Youth

  • Original Article
  • Published:
Child Psychiatry & Human Development Aims and scope Submit manuscript

Abstract

Suicide screening is critical in pediatric emergency departments (EDs). Behavioral measures of suicide risk may complement self-report measures. The current study examines suicide-specific behavioral measures and tests their potential short-term within-person effects among respondents, ability to discriminate future suicide attempt from suicidal ideation, and translation into interpretable categorical composite scores. The sample included 167 youth (10–17 years), presenting for suicide-related reasons to a pediatric psychiatric ED. During their ED visit, participants completed the Death/Life Implicit Association Test (IAT) and the Suicide Stroop Task. Recurrent suicidal thoughts and attempts were assessed within 6 months of the ED visit via medical records and email surveys. Youth displayed a decrease in the levels of distress and self-injurious desires (negative mood, desire to hurt themselves, and desire to die) after completing the behavioral tasks. The Death/Life IAT prospectively differentiated with 68% accuracy between youth who attempted suicide after their ED visit and those who had suicidal ideation but no attempt, p = 0.04, OR = 5.65, although this effect became marginally significant after controlling for self-report and demographic covariates. Neither the Suicide Stroop Task, nor the categorical composite scores predicted suicide attempts, ps = 0.08–0.87, ORs = 0.96–3.95. Behavioral measures of suicide risk administered in the ED do not appear to increase distress or self-injurious desires. They may be able to distinguish those who go on to attempt suicide (vs. consider suicide) within six months after discharge.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

Data Availability

Participant consent to data sharing in a public repository or upon request was not obtained for this research, so supporting data are not available.

Notes

  1. Because several demographic and self-report covariates predicted the 6-month outcomes at the level of p < .10, we ran supplemental analyses while including a broader range of covariates (age, gender, sexual orientation, HSC total score, lifetime suicide attempt presence, autism spectrum disorder diagnosis, and patient prediction of a future suicide attempt). The distinction between the suicide attempt group and the suicidal ideation-only group stayed marginally significant, p = .06, aOR = 6.64, 95% CI [0.94, 46.68]. Covariates did not have significant effects, ps = .08-.99. Relative to the univariate model, adding the demographic and self-report measure covariates did not significantly improve prediction accuracy, AUC = .74, 95% CI = [.62, .86].

References

  1. Centers for Disease Control and Prevention (2020) Web-based Injury Statistics Query and Reporting System (WISQARS). US Department of Health and Human Services, CDC, National Center for Injury Prevention and Control. https://www.cdc.gov/injury/wisqars/index.html Accessed 16 Sep 2020

  2. Burstein B, Agostino H, Greenfield B (2019) Suicidal attempts and ideation among children and adolescents in US emergency departments, 2007–2015. JAMA Pediatr 173(6):598–600. https://doi.org/10.1001/jamapediatrics.2019.0464

    Article  PubMed  PubMed Central  Google Scholar 

  3. Bridge JA, Marcus SC, Olfson M (2012) Outpatient care of young people after emergency treatment of deliberate self-harm. J Am Acad Child Adolesc Psychiatry 51(2):213–222. https://doi.org/10.1016/j.jaac.2011.11.002

    Article  PubMed  Google Scholar 

  4. Cree RA, So M, Franks J, Richards R, Leeb R, Hashikawa A, Krug S, Ludwig L, Olson LM (2019) Characteristics associated with presence of pediatric mental health care policies in emergency departments. Pediatr Emerg Care 37(12):e1116–e1121. https://doi.org/10.1097/PEC.0000000000001920

    Article  Google Scholar 

  5. Cervantes PE, Seag DEM, Baroni A, Gerson R, Knapp K, Tay ET, Wiener E, Horwitz SM (2022) Universal suicide risk screening for youths in the emergency department: a systematic review. Psychiatry Serv 73(1):53–63. https://doi.org/10.1176/appi.ps.202000881

    Article  Google Scholar 

  6. Chun TH, Mace SE, Katz ER, American Academy of Pediatrics, Committee on Pediatric Emergency Medicine, American College of Emergency Physicians, & Pediatric Emergency Medicine Committee (2016) Executive summary: evaluation and management of children and adolescents with acute mental health or behavioral problems part I: common clinical challenges of patients with mental health and/or behavioral emergencies. Pediatrics 138(3):e20161570. https://doi.org/10.1542/peds.2016-1570

    Article  PubMed  Google Scholar 

  7. Goldston DB, Daniel SS, Reboussin DM, Reboussin BA, Frazier PH, Kelley AE (1999) Suicide attempts among formerly hospitalized adolescents: a prospective naturalistic study of risk during the first 5 years after discharge. J Am Acad Child Adolesc Psychiatry 38(6):660–671. https://doi.org/10.1097/00004583-199906000-00012

    Article  PubMed  Google Scholar 

  8. Stewart SE, Manion IG, Davidson S, Cloutier P (2001) Suicidal children and adolescents with first emergency room presentations: predictors of six-month outcome. J Am Acad Child Adolesc Psychiatr 40(5):580–587. https://doi.org/10.1097/00004583-200105000-00018

    Article  Google Scholar 

  9. Yen S, Weinstock LM, Andover MS, Sheets ES, Selby EA, Spirito A (2013) Prospective predictors of adolescent suicidality: 6-month post-hospitalization follow-up. Psychol Med 43(5):983–993. https://doi.org/10.1017/S0033291712001912

    Article  PubMed  Google Scholar 

  10. The Joint Commission (2019) National patient safety goal for suicide prevention (R3 Report: Requirement, Rationale, Reference, Issue 18)

  11. National Action Alliance for Suicide Prevention: Research Prioritization Task Force (2014) A prioritized research agenda for suicide prevention: An action plan to save lives. Rockville, MD: National Institute of Mental Health and the Research Prioritization Task Force

  12. Ballard ED, Bosk A, Snyder D, Pao M, Bridge JA, Wharff EA, Teach SJ, Horowitz L (2012) Patients’ opinions about suicide screening in a pediatric emergency department. Pediatr Emerg Care 28(1):34–38. https://doi.org/10.1097/PEC.0b013e31823f2315

    Article  PubMed  PubMed Central  Google Scholar 

  13. Asarnow JR, Baraff LJ, Berk M, Grob C, Devich-Navarro M, Suddath R, Piacentini J, Tang L (2008) Pediatric emergency department suicidal patients: two-site evaluation of suicide ideators, single attempters, and repeat attempters. J Am Acad Child Adolesc Psychiatry 47(8):958–966. https://doi.org/10.1097/CHI.0b013e3181799ee8

    Article  PubMed  Google Scholar 

  14. Horowitz LM, Bridge JA, Teach SJ, Ballard E, Klima J, Rosenstein DL, Wharff EA, Ginnis K, Cannon E, Joshi P, Pao M (2012) Ask Suicide-Screening Questions (ASQ): a brief instrument for the pediatric emergency department. Arch Pediatr Adolesc Med 166(12):1170–1176. https://doi.org/10.1001/archpediatrics.2012.1276

    Article  PubMed  PubMed Central  Google Scholar 

  15. King CA, Brent D, Grupp-Phelan J, Casper TC, Dean JM, Chernick LS, Fein JA, Mahabee-Gittens EM, Patel SJ, Mistry RD, Duffy S, Melzer-Lange M, Rogers A, Cohen DM, Keller A, Shenoi R, Hickey RW, Rea M, Cwik M, Page K, McGuire TC, Wang J, Gibbons R, Network PECAR (2021) Prospective development and validation of the computerized adaptive screen for suicidal youth. JAMA Psychiat 78(5):540–549. https://doi.org/10.1001/jamapsychiatry.2020.4576

    Article  Google Scholar 

  16. Nock MK, Hwang I, Sampson NA, Kessler RC (2010) Mental disorders, comorbidity and suicidal behavior: results from the national comorbidity survey replication. Mol Psychiatry 15(8):868–876. https://doi.org/10.1038/mp.2009.29

    Article  PubMed  Google Scholar 

  17. Nock MK, Park JM, Finn CT, Deliberto TL, Dour HJ, Banaji MR (2010) Measuring the suicidal mind: implicit cognition predicts suicidal behavior. Psychol Sci 21(4):511–517. https://doi.org/10.1177/0956797610364762

    Article  PubMed  Google Scholar 

  18. Tello N, Harika-Germaneau G, Serra W, Jaafari N, Chatard A (2020) Forecasting a fatal decision: direct replication of the predictive validity of the suicide–implicit association test. Psychol Sci 31(1):65–74. https://doi.org/10.1177/0956797619893062

    Article  PubMed  Google Scholar 

  19. Cha CB, Najmi S, Park JM, Finn CT, Nock MK (2010) Attentional bias toward suicide-related stimuli predicts suicidal behavior. J Abnorm Psychol 119(3):616–622. https://doi.org/10.1037/a0019710

    Article  PubMed  PubMed Central  Google Scholar 

  20. Glenn CR, Kleiman EM, Coppersmith DDL, Santee AC, Esposito EC, Cha CB, Nock MK, Auerbach RP (2017) Implicit identification with death predicts change in suicide ideation during psychiatric treatment in adolescents. J Child Psychol Psychiatry 58(12):1319–1329. https://doi.org/10.1111/jcpp.12769

    Article  PubMed  PubMed Central  Google Scholar 

  21. Glenn CR, Millner AJ, Esposito EC, Porter AC, Nock MK (2019) Implicit identification with death predicts suicidal thoughts and behaviors in adolescents. J Clin Child Adolesc Psychol 48(2):263–272. https://doi.org/10.1080/15374416.2018.1528548

    Article  PubMed  PubMed Central  Google Scholar 

  22. Glenn JJ, Werntz AJ, Slama SJK, Steinman SA, Teachman BA, Nock MK (2017) Suicide and self-injury-related implicit cognition: a large-scale examination and replication. J Abnorm Psychol 126(2):199–211. https://doi.org/10.1037/abn0000230

    Article  PubMed  Google Scholar 

  23. Brent DA, Grupp-Phelan J, O’Shea BA, Patel SJ, Mahabee-Gittens EM, Rogers A, Duffy SJ, Shenoi RP, Chernick LS, Casper TC, Webb MW, Nock MK, King CA (2021) A comparison of self-reported risk and protective factors and the death implicit association test in the prediction of future suicide attempts in adolescent emergency department patients. Psychol Med. https://doi.org/10.1017/S0033291721001215

    Article  PubMed  PubMed Central  Google Scholar 

  24. Stewart JG, Glenn CR, Esposito EC, Cha CB, Nock MK, Auerbach RP (2017) Cognitive control deficits differentiate adolescent suicide ideators from attempters. J Clin Psychiatry 78(6):614–621

    Article  Google Scholar 

  25. Wilson KM, Millner AJ, Auerbach RP, Glenn CR, Kearns JC, Kirtley OJ, Najmi S, O’Connor RC, Stewart JG, Cha CB (2019) Investigating the psychometric properties of the suicide stroop task. Psychol Assess 31(8):1052–1061. https://doi.org/10.1037/pas0000723

    Article  PubMed  PubMed Central  Google Scholar 

  26. Ballard ED, Stanley IH, Horowitz LM, Pao M, Cannon EA, Bridge JA (2013) Asking youth questions about suicide risk in the pediatric emergency department: results from a qualitative analysis of patient opinions. Clin Pediatri Emerg Med 14(1):20–27. https://doi.org/10.1016/j.cpem.2013.01.001

    Article  Google Scholar 

  27. Gould MS, Marrocco FA, Kleinman M, Thomas JG, Mostkoff K, Cote J, Davies M (2005) Evaluating iatrogenic risk of youth suicide screening programs: a randomized controlled trial. JAMA 293(13):1635–1643. https://doi.org/10.1001/jama.293.13.1635

    Article  PubMed  Google Scholar 

  28. Whitlock J, Pietrusza C, Purington A (2013) Young adult respondent experiences of disclosing self-injury, suicide-related behavior, and psychological distress in a web-based survey. Arch Suicide Res 17(1):20–32. https://doi.org/10.1080/13811118.2013.748405

    Article  PubMed  Google Scholar 

  29. Cha CB, Augenstein TM, Frost KH, Gallagher K, D’Angelo EJ, Nock MK (2016) Using implicit and explicit measures to predict nonsuicidal self-injury among adolescent inpatients. J Am Acad Child Adolesc Psychiatry 55(1):62–68. https://doi.org/10.1016/j.jaac.2015.10.008

    Article  PubMed  Google Scholar 

  30. Cha CB, Glenn JJ, Deming CA, D’Angelo EJ, Hooley JM, Teachman BA, Nock MK (2016) Examining potential iatrogenic effects of viewing suicide and self-injury stimuli. Psychol Assess 28(11):1510–1515. https://doi.org/10.1037/pas0000280

    Article  PubMed  Google Scholar 

  31. Millner AJ, Augenstein TM, Visser KH, Gallagher K, Vergara GA, D’Angelo EJ, Nock MK (2019) Implicit cognitions as a behavioral marker of suicide attempts in adolescents. Arch Suicide Res 23(1):47–63. https://doi.org/10.1080/13811118.2017.1421488

    Article  PubMed  Google Scholar 

  32. Habis A, Tall L, Smith J, Guenther E (2007) Pediatric emergency medicine physicians’ current practices and beliefs regarding mental health screening. Pediatr Emerg Care 23(6):387–393. https://doi.org/10.1097/01.pec.0000278401.37697.79

    Article  PubMed  Google Scholar 

  33. Horowitz L, Ballard E, Teach SJ, Bosk A, Rosenstein DL, Joshi P, Dalton ME, Pao M (2010) Feasibility of screening patients with nonpsychiatric complaints for suicide risk in a pediatric emergency department: a good time to talk? Pediatr Emerg Care 26(11):787–792. https://doi.org/10.1097/PEC.0b013e3181fa8568

    Article  PubMed  PubMed Central  Google Scholar 

  34. King CA, Brent D, Grupp-Phelan J, Shenoi R, Page K, Mahabee-Gittens EM, Chernick LS, Melzer-Lange M, Rea M, McGuire TC, Littlefield A, Casper TC (2020) Five profiles of adolescents at elevated risk for suicide attempts: differences in mental health service use. J Am Acad Child Adolesc Psychiatry 59(9):1058–1068. https://doi.org/10.1016/j.jaac.2019.10.015

    Article  PubMed  Google Scholar 

  35. King CA, O’Mara RM, Hayward CN, Cunningham RM (2009) Adolescent suicide risk screening in the emergency department. Acad Emerg Med 16(11):1234–1241. https://doi.org/10.1111/j.1553-2712.2009.00500.x

    Article  PubMed  PubMed Central  Google Scholar 

  36. Balis T, Postolache TT (2008) Ethnic differences in adolescent suicide in the United States. Int J Child Health Hum Dev 1(3):281–296

    PubMed  PubMed Central  Google Scholar 

  37. Fox KR, Choukas-Bradley S, Salk RH, Marshal MP, Thoma BC (2020) Mental health among sexual and gender minority adolescents: examining interactions with race and ethnicity. J Consult Clin Psychol 88(5):402–415. https://doi.org/10.1037/ccp0000486

    Article  PubMed  PubMed Central  Google Scholar 

  38. Greenwald AG, Nosek BA, Banaji MR (2003) Understanding and using the implicit association test: I. An improved scoring algorithm. J Pers Soc Psychol 85(2):197–216. https://doi.org/10.1037/0022-3514.85.2.197

    Article  PubMed  Google Scholar 

  39. Nock MK, Holmberg EB, Photos VI, Michel BD (2007) Self-injurious thoughts and behaviors interview: development, reliability, and validity in an adolescent sample. Psychol Assess 19(3):309–317. https://doi.org/10.1037/1040-3590.19.3.309

    Article  PubMed  Google Scholar 

  40. Kazdin AE, Rodgers A, Colbus D (1986) The hopelessness scale for children: psychometric characteristics and concurrent validity. J Consult Clin Psychol 54(2):241–245. https://doi.org/10.1037/0022-006X.54.2.241

    Article  PubMed  Google Scholar 

  41. Spirito A, Williams CA, Stark LJ, Hart KJ (1988) The hopelessness scale for children: psychometric properties with normal and emotionally disturbed adolescents. J Abnorm Child Psychol 16(4):445–458. https://doi.org/10.1007/BF00914174

    Article  PubMed  Google Scholar 

  42. Tiihonen J, Lönnqvist J, Wahlbeck K, Klaukka T, Tanskanen A, Haukka J (2006) Antidepressants and the risk of suicide, attempted suicide, and overall mortality in a nationwide cohort. Arch Gen Psychiatry 63(12):1358–1367. https://doi.org/10.1001/archpsyc.63.12.1358

    Article  PubMed  Google Scholar 

  43. R Core Team (2021) R: A language and environment for statistical computing. In R Foundation for Statistical Computing. https://www.R-project.org/

  44. van Buuren S, Groothuis-Oudshoorn CGM (2011) mice: multivariate imputation by chained equations in R. J Stat Softw 45(3):1–67

    Article  Google Scholar 

  45. Rubin DB (2004) Multiple imputation for nonresponse in surveys (Vol. 81). John Wiley & Sons, Hoboken

    Google Scholar 

  46. Hand DJ, Till RJ (2001) A simple generalisation of the area under the ROC curve for multiple class classification problems. Mach Learn 45(2):171–186. https://doi.org/10.1023/A:1010920819831

    Article  Google Scholar 

  47. Greenfield B, Henry M, Weiss M, Tse SM, Guile JM, Dougherty G, Zhang X, Fombonne E, Lis E, Lapalme-Remis S, Harnden B (2008) Previously suicidal adolescents: predictors of six-month outcome. J Can Acad Child Adolesc Psychiatry 17(4):197–201

    PubMed  PubMed Central  Google Scholar 

  48. Rosenbaum Asarnow J, Berk M, Zhang L, Wang P, Tang L (2017) Emergency department youth patients with suicidal ideation or attempts: predicting suicide attempts through 18 months of follow-up. Suicide Life-Threat Behav 47(5):551–566. https://doi.org/10.1111/sltb.12309

    Article  PubMed  Google Scholar 

  49. Chan LF, Shamsul AS, Maniam T (2014) Are predictors of future suicide attempts and the transition from suicidal ideation to suicide attempts shared or distinct: a 12-month prospective study among patients with depressive disorders. Psychiatry Res 220(3):867–873. https://doi.org/10.1016/j.psychres.2014.08.055

    Article  PubMed  Google Scholar 

  50. Nock MK, Green JG, Hwang I, McLaughlin KA, Sampson NA, Zaslavsky AM, Kessler RC (2013) Prevalence, correlates, and treatment of lifetime suicidal behavior among adolescents: results from the national comorbidity survey replication adolescent supplement. JAMA Psychiat 70(3):300–310. https://doi.org/10.1001/2013.jamapsychiatry.55

    Article  Google Scholar 

  51. Gerson R, Havens J, Marr M, Storfer-Isser A, Lee M, Rojas Marcos C, Liu M, Horwitz SM (2017) Utilization patterns at a specialized children’s comprehensive psychiatric emergency program. Psychiatr Serv 68(11):1104–1111. https://doi.org/10.1176/appi.ps.201600436

    Article  PubMed  Google Scholar 

  52. Sohn MN, McMorris CA, Bray S, McGirr A (2021) The death-implicit association test and suicide attempts: a systematic review and meta-analysis of discriminative and prospective utility. Psychol Med 51:1789–1798. https://doi.org/10.1017/S0033291721002117

    Article  PubMed  Google Scholar 

  53. Goldman-Mellor S, Olfson M, Lidon-Moyano C, Schoenbaum M (2019) Association of suicide and other mortality with emergency department presentation. JAMA Netw Open 2(12):e1917571. https://doi.org/10.1001/jamanetworkopen.2019.17571

    Article  PubMed  PubMed Central  Google Scholar 

  54. Hawton K, Bale L, Brand F, Townsend E, Ness J, Waters K, Clements C, Kapur N, Geulayov G (2020) Mortality in children and adolescents following presentation to hospital after non-fatal self-harm in the multicentre study of self-harm: a prospective observational cohort study. Lancet Child Adolesc Health 4(2):111–120. https://doi.org/10.1016/S2352-4642(19)30373-6

    Article  PubMed  Google Scholar 

  55. Brent D (2018) Commentary: a time to reap and a time to sow: reducing the adolescent suicide rate now and in the future: commentary on Cha et al. (2018). J Child Psychol Psychiatry 59(4):483–485. https://doi.org/10.1111/jcpp.12903

    Article  PubMed  Google Scholar 

  56. Mars B, Heron J, Klonsky ED, Moran P, O'Connor RC, Tilling K, Wilkinson P, Gunnell D (2019) Predictors of future suicide attempt among adolescents with suicidal thoughts or non-suicidal self-harm: a population-based birth cohort study. Lancet Psychiatry 6(4):327–337. https://doi.org/10.1016/S2215-0366(19)30030-6

    Article  PubMed  PubMed Central  Google Scholar 

  57. Miranda A, Ortin A, Scott M, Schaffer D (2014) Characteristics of suicidal ideation that predict the transition to future suicide attempts in adolescents. J Child Psychol Psychiatry 55(11):1288–1296. https://doi.org/10.1111/jcpp.12245

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Funding

This study was supported by the Young Investigator Grant from the American Foundation for Suicide Prevention (YIG-2–026-16, PI: Cha).

Author information

Authors and Affiliations

Authors

Contributions

Conceptualization: CBC, AB, RSG; Methodology: CBC, AB, RSG, KB, OHP, KT, KS; Formal analysis and investigation: KS, OHP, KB; Writing—original draft preparation: KS, KB; Writing—review and editing: CBC, AB, RSG, OHP, KT, AS; Funding acquisition: CBC; Resources: CBC, AB, RSG; Supervision: AS.

Corresponding author

Correspondence to Christine B. Cha.

Ethics declarations

Conflict of interest

The authors have no relevant financial or non-financial interests to disclose.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Consent to Participate

Informed assent and consent were obtained from all individual participants and their parents included in the study.

Consent for Publication

All participants and their parents provided informed assent and consent for publication of their data.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 24 KB)

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shin, K.E., Baroni, A., Gerson, R.S. et al. Using Behavioral Measures to Assess Suicide Risk in the Psychiatric Emergency Department for Youth. Child Psychiatry Hum Dev (2023). https://doi.org/10.1007/s10578-023-01507-y

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10578-023-01507-y

Keywords

Navigation