Skip to main content
SpringerLink
Log in

Psychometric Properties of an Online Administered Version of the Suicide Stroop Task

  • Published:
Journal of Psychopathology and Behavioral Assessment Aims and scope Submit manuscript

Abstract

Attentional biases to suicide-related stimuli are thought to be related to suicidal thoughts and behaviors (STBs). The suicide Stroop task has been used to measure said attentional biases; however, recent investigations have introduced doubt regarding its psychometrics. This prospective study investigated the psychometric properties of a web-based version the suicide Stroop. Participants were N = 591 United States adults with a history of STBs recruited through an online survey recruitment platform. Participants responded to questionnaires and completed the suicide Stroop on their personal computers at two time points, one week apart. Results indicated that mean reaction times to suicide-related and negative stimuli demonstrated acceptable internal consistency reliability at both time points. In addition, evidence was provided for the temporal instability of these stimuli types over time. Neither stimuli type demonstrated evidence of convergent or predictive validity. These results suggest that adaptations to the suicide Stroop thereby improving its psychometric properties is warranted.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Adler, A., Jager-Hyman, S., Green, K. L., Brown, G. K., Beck, A. T., & Wenzel, A. (2015). Initial psychometric properties of the attentional fixation on suicide experiences questionnaire. Cognitive Therapy and Research, 39(4), 492–498.

    Article  Google Scholar 

  • Allison, S., Allison, S., Roeger, L., Martin, G., & Keeves, J. (2001). Gender differences in the relationship between depression and suicidal ideation in young adolescents. Australian & New Zealand Journal of Psychiatry, 35(4), 498–503.

    Article  Google Scholar 

  • Alvarez, R. M., Atkeson, L. R., Levin, I., & Li, Y. (2019). Paying attention to inattentive survey respondents. Political Analysis, 27(2), 145–162.

    Article  Google Scholar 

  • Beck, A. T., Brown, G. K., & Steer, R. A. (1997). Psychometric characteristics of the Scale for Suicide Ideation with psychiatric outpatients. Behaviour Research and Therapy, 35(11), 1039–1046.

    Article  PubMed  Google Scholar 

  • Beck, A. T., Brown, G. K., Steer, R. A., Dahlsgaard, K. K., & Grisham, J. R. (1999). Suicide ideation at its worst point: A predictor of eventual suicide in psychiatric outpatients. Suicide and Life-Threatening Behavior, 29(1), 1–9.

    PubMed  Google Scholar 

  • Beck, A. T., Kovacs, M., & Weissman, A. (1979). Assessment of suicidal intention: The Scale for Suicide Ideation. Journal of Consulting and Clinical Psychology, 47(2), 343.

    Article  PubMed  Google Scholar 

  • Ben-Haim, M. S., Williams, P., Howard, Z., Mama, Y., Eidels, A., & Algom, D. (2016). The emotional Stroop task: Assessing cognitive performance under exposure to emotional content. Journal of Visualized Experiments, 112. https://doi.org/10.3791/53720

  • Brown, G. K., Beck, A. T., Steer, R. A., & Grisham, J. R. (2000). Risk factors for suicide in psychiatric outpatients: A 20-year prospective study. Journal of Consulting and Clinical Psychology, 68(3), 371.

    Article  PubMed  Google Scholar 

  • Bryan, C. J., Butner, J. E., May, A. M., Rugo, K. F., Harris, J. A., Oakey, D. N., & Bryan, A. O. (2020). Nonlinear change processes and the emergence of suicidal behavior: A conceptual model based on the fluid vulnerability theory of suicide. New Ideas in Psychology, 57, 100758.

  • Bryan, C. J., Kanzler, K. E., Grieser, E., Martinez, A., Allison, S., & McGeary, D. (2017). A shortened version of the Suicide Cognitions Scale for identifying chronic pain patients at risk for suicide. Pain Practice, 17(3), 371–381.

    Article  PubMed  Google Scholar 

  • Bryan, C. J., Rudd, M. D., Wertenberger, E., Etienne, N., Ray-Sannerud, B. N., Morrow, C. E., & Young-McCaughon, S. (2014). Improving the detection and prediction of suicidal behavior among military personnel by measuring suicidal beliefs: An evaluation of the Suicide Cognitions Scale. Journal of Affective Disorders, 159, 15–22.

    Article  PubMed  Google Scholar 

  • Burton Denmark, A., Hess, E., & Becker, M. S. (2012). College students’ reasons for concealing suicidal ideation. Journal of College Student Psychotherapy, 26(2), 83–98.

    Google Scholar 

  • Cha, C. B., Najmi, S., Park, J. M., Finn, C. T., & Nock, M. K. (2010). Attentional bias toward suicide-related stimuli predicts suicidal behavior. Journal of Abnormal Psychology, 119(3), 616.

    Article  PubMed  PubMed Central  Google Scholar 

  • Cheng, P., Preston, S. D., Jonides, J., Mohr, A. H., Thummala, K., Casement, M., Hsing, P. J., & Deldin, P. J. (2015). Evidence against mood-congruent attentional bias in Major Depressive Disorder. Psychiatry Research, 230(2), 496–505.

    Article  PubMed  Google Scholar 

  • Chung, Y., & Jeglic, E. L. (2016). Use of the modified emotional Stroop task to detect suicidality in college population. Suicide and Life-Threatening Behavior, 46(1), 55–66.

    Article  PubMed  Google Scholar 

  • Chung, Y., & Jeglic, E. L. (2017). Detecting suicide risk among college students: A test of the predictive validity of the modified emotional Stroop task. Suicide and Life-Threatening Behavior, 47(4), 398–409.

    Article  PubMed  Google Scholar 

  • Curtin, S. C., Warner, M., & Hedegaard, H. (2016). Increase in suicide in the United States, 1999–2014 (No. 2016). US Department of Health and Human Services, Centers for Disease Control and Prevention, National Center for Health Statistics.

  • Der, G., & Deary, I. J. (2006). Age and sex differences in reaction time in adulthood: Results from the United Kingdom Health and Lifestyle Survey. Psychology and Aging, 21(1), 62.

    Article  PubMed  Google Scholar 

  • Derryberry, D., & Reed, M. A. (2002). Anxiety-related attentional biases and their regulation by attentional control. Journal of Abnormal Psychology, 111(2), 225.

    Article  PubMed  Google Scholar 

  • Egloff, B., Schwerdtfeger, A., & Schmukle, S. C. (2005). Temporal stability of the implicit association test-anxiety. Journal of Personality Assessment, 84(1), 82–88.

    Article  PubMed  Google Scholar 

  • Faul, F., Erdfelder, E., Buchner, A., & Lang, A. G. (2009). Statistical power analyses using G* Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods, 41(4), 1149–1160.

  • Gotlib, I. H., & McCann, C. D. (1984). Construct accessibility and depression: An examination of cognitive and affective factors. Journal of Personality and Social Psychology, 47(2), 427.

    Article  PubMed  Google Scholar 

  • Greenwald, A. G., & Farnham, S. D. (2000). Using the implicit association test to measure self esteem and self-concept. Journal of Personality and Social Psychology, 79(6), 1022.

    Article  PubMed  Google Scholar 

  • Hamedi, A., Colborn, V. A., Bell, M., Chalker, S. A., & Jobes, D. A. (2019). Attentional bias and the Suicide status form: Behavioral perseveration of written responses. Behaviour Research and Therapy, 120, 103403.

  • Hanna, D., White, R., Lyons, K., McParland, M. J., Shannon, C., & Mulholland, C. (2011). The structure of the Beck Hopelessness Scale: A confirmatory factor analysis in UK students. Personality and Individual Differences, 51(1), 17–22.

    Article  Google Scholar 

  • Heise, D. R. (1969). Separating reliability and stability in test-retest correlation. American Sociological Review, 93–101.

  • Holden, R. R., Mehta, K., Cunningham, E. J., & McLeod, L. D. (2001). Development and preliminary validation of a scale of psychache. Canadian Journal of Behavioural Science/revue Canadienne Des Sciences Du Comportement, 33(4), 224.

    Article  Google Scholar 

  • Inquisit 5 [Computer software]. (2016). Retrieved from https://www.millisecond.com

  • Johnson, D. R. (2009). Emotional attention set-shifting and its relationship to anxiety and emotion regulation. Emotion, 9(5), 681.

    Article  PubMed  Google Scholar 

  • Joyal, M., Wensing, T., Levasseur-Moreau, J., Leblond, J., Sack, T., & A., & Fecteau, S. (2019). Characterizing emotional Stroop interference in posttraumatic stress disorder, major depression and anxiety disorders: A systematic review and meta-analysis. PLoS ONE, 14(4), e0214998.

    Article  PubMed  PubMed Central  Google Scholar 

  • Kleiman, E. M., Turner, B. J., Fedor, S., Beale, E. E., Huffman, J. C., & Nock, M. K. (2017). Examination of real-time fluctuations in suicidal ideation and its risk factors: Results from two ecological momentary assessment studies. Journal of Abnormal Psychology, 126(6), 726.

    Article  PubMed  Google Scholar 

  • Kleiman, E. M., & Nock, M. K. (2018). Real-time assessment of suicidal thoughts and behaviors. Current Opinion in Psychology, 22, 33–37.

    Article  PubMed  Google Scholar 

  • Klonsky, E. D., & May, A. M. (2015). The three-step theory (3ST): A new theory of suicide rooted in the “ideation-to-action” framework. International Journal of Cognitive Therapy, 8(2), 114–129.

    Article  Google Scholar 

  • Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16(9), 606–613.

    Article  PubMed  PubMed Central  Google Scholar 

  • Kroenke, K., Strine, T. W., Spitzer, R. L., Williams, J. B., Berry, J. T., & Mokdad, A. H. (2009). The PHQ-8 as a measure of current depression in the general population. Journal of Affective Disorders, 114(1–3), 163–173.

    Article  PubMed  Google Scholar 

  • Moriarty, A. S., Gilbody, S., McMillan, D., & Manea, L. (2015). Screening and case finding for major depressive disorder using the Patient Health Questionnaire (PHQ-9): a meta-analysis. General Hospital Psychiatry, 37, 567–576.

    Article  PubMed  Google Scholar 

  • Moscardini, E. H., Aboussouan, A. B., Bryan, C. J., & Tucker, R. P. (2020). Suicide specific cognitions, attentional fixation, and worst-point suicidal ideation. Suicide and Life-Threatening Behavior, 50(4), 899.

    Article  PubMed  Google Scholar 

  • National Institute of Mental Health (NIMH). (2020). The National Institute of Mental Health strategic plan. Retrieved April 26, 2021 from http://www.nimh.nih.gov/about/strategic-planning-reports/index.shtml#strategic-objective1

  • O’Connor, R. C., & Nock, M. K. (2014). The psychology of suicidal behaviour. The Lancet Psychiatry, 1(1), 73–85.

    Article  PubMed  Google Scholar 

  • Osman, A., Bagge, C. L., Gutierrez, P. M., Konick, L. C., Kopper, B. A., & Barrios, F. X. (2001). The Suicidal Behaviors Questionnaire-Revised (SBQ-R): Validation with clinical and nonclinical samples. Assessment, 8(4), 443–454.

    Article  PubMed  Google Scholar 

  • Rogers, M. L., Stanley, I. H., Hom, M. A., Chiurliza, B., Podlogar, M. C., & Joiner, T. E. (2018). Conceptual and empirical scrutiny of covarying depression out of suicidal ideation. Assessment, 25(2), 159–172.

    Article  PubMed  Google Scholar 

  • Rudd, M. D. (2006). Fluid vulnerability theory: A cognitive approach to understanding the process of acute and chronic suicide risk. Cognition and Suicide: Theory, Research, and Therapy (pp. 355–368).

  • Smith, K. E., Mason, T. B., Juarascio, A., Weinbach, N., Dvorak, R., Crosby, R. D., & Wonderlich, S. A. (2020). The momentary interplay of affect, attention bias, and expectancies as predictors of binge eating in the natural environment. International Journal of Eating Disorders, 53(4), 586–594.

    Article  PubMed  Google Scholar 

  • Spanakis, P., Jones, A., Field, M., & Christiansen, P. (2019). A stroop in the hand is worth two on the laptop: Superior reliability of a smartphone based alcohol stroop in the real world. Substance Use & Misuse, 54(4), 692–698.

    Article  Google Scholar 

  • Stenzel, J. S., Höller, I., Rath, D., Hallensleben, N., Spangenberg, L., Glaesmer, H., & Forkmann, T. (2020). Do feelings of defeat and entrapment change over time? An investigation of the integrated motivational—Volitional model of suicidal behaviour using ecological momentary assessments. International Journal of Environmental Research and Public Health, 17(13), 4685.

    Article  PubMed  PubMed Central  Google Scholar 

  • Wenzel, A., & Beck, A. T. (2008). A cognitive model of suicidal behavior: Theory and treatment. Applied and Preventive Psychology, 12(4), 189–201.

    Article  Google Scholar 

  • Whelan, R. (2008). Effective analysis of reaction time data. The Psychological Record, 58(3), 475–482.

    Article  Google Scholar 

  • Williams, J. M. G., & Broadbent, K. (1986). Distraction by emotional stimuli: Use of a Stroop task with suicide attempters. British Journal of Clinical Psychology, 25(2), 101–110.

    Article  PubMed  Google Scholar 

  • Wilson, K. M., Millner, A. J., Auerbach, R. P., Glenn, C. R., Kearns, J. C., Kirtley, O. J., & Cha, C. B. (2019). Investigating the psychometric properties of the Suicide Stroop Task. Psychological Assessment, 31(8), 1052.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Louisiana State University, 70803, Baton Rouge, USA

    Emma H. Moscardini & Raymond P. Tucker

Authors
  1. Emma H. Moscardini
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Raymond P. Tucker
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Both EHM and RPT contributed to study concept and study design. EHM performed data analyses and interpretation and drafted the paper. RPT provided critical revisions.

Corresponding author

Correspondence to Raymond P. Tucker.

Ethics declarations

Ethical Approval

Approved by the Institutional Review Board at Louisiana State University (#4277).

Conflict of Interest

Emma H. Moscardini and Raymond P. Tucker declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Moscardini, E.H., Tucker, R.P. Psychometric Properties of an Online Administered Version of the Suicide Stroop Task. J Psychopathol Behav Assess 45, 122–135 (2023). https://doi.org/10.1007/s10862-022-09994-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10862-022-09994-4

Keywords

Search

Navigation