Reliability and Validity of a Brief Version of the Intolerance of Uncertainty Scale in Outpatients with Psychosis
Individual differences in intolerance of uncertainty are hypothesized to play a role in certain difficulties and distress in individuals with psychosis. However, the few studies that have directly explored this have yielded mixed results, which are difficult to interpret because measures of intolerance of uncertainty have not been formally validated for use with this population. To this end, the primary goal of the present study was to validate a brief (9-item) version of the Intolerance of Uncertainty Scale (Freeston et al. Personality and Individual Differences, 17, 791–802 1994) in an outpatient sample of 252 adults with psychosis. Results showed strong evidence for reliability (internal consistency and 6-month test-retest), as well as concurrent, predictive, and discriminant validity. Scores from the brief IUS were significantly correlated with emotional distress (e.g., anxiety, depression, hopelessness), quality of life, global functioning, and delusions, but not hallucinations. Further, these scores predicted changes in levels of general anxiety over time. Notably, intolerance of uncertainty was associated with symptoms/distress and functioning above and beyond pertinent cognitive variables (e.g., defeatist beliefs, asocial beliefs), suggesting this brief scale has incremental validity. Overall, results suggest it is a promising tool for future research on psychosis, and possibly clinical work with this population.
KeywordsIntolerance of uncertainty Psychosis Schizophrenia Validation Self-report
Preliminary results were presented at the Association for Behavioral and Cognitive Therapies 48th Annual Convention Philadelphia, PA. The authors would like to express their gratitude to the individuals who participated in this research project. We also thank Jason Cha, Ashley Chambers, Kara Devers, Sean Gallahger, Samantha Goodin, Gloria Huh, David Loeb, Michael Ovalle, Mary Tabit, Lucas Zullo, Marguerite Cruz, and Nina Bertolami for their assistance with this project.
This study was supported in part by a Distinguished Investigator Award (Dr. Beck) from the National Alliance for Research on Schizophrenia and Depression, the Fieldstone 1793 Foundation, and the Foundation for Cognitive Therapy.
Compliance with Ethical Standards
Informed consent was obtained from all individual participants included in the study.
Conflict of Interest
Keith Bredemeier, Kerry McCole, Lauren Luther, Aaron T. Beck, and Paul M. Grant declare that they have no conflict of interest to disclose.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
- American Psychiatric Association (2000). Diagnositc and statistical manual of mental disorders (4th ed.). Washington, D.C.Google Scholar
- Andreasen, N. C. (1984a). Scale for the assessment of negative symptoms (SANS). Iowa City: University of Iowa.Google Scholar
- Andreasen, N. C. (1984b). Scale for the assessment of positive symptoms (SAPS). Iowa City: University of Iowa.Google Scholar
- Andreasen, N., Flaum, M., Arndt, S., Alliger, R., & Swayze, V. W. (1991). Positive and negative symptoms: assessment and validity. In Negative versus positive schizophrenia (pp. 28–51). Berlin, Heidelberg: Springer.Google Scholar
- Beck, A. T., & Beck, J. (1991). The personality belief questionnaire. Bala Cynwyd, PA: The Beck Institute for Cognitive Therapy and Research.Google Scholar
- Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Beck depression inventory-II. San Antonio, 78(2), 490–498.Google Scholar
- Beck, A. T., Rector, N. A., Stolar, N., & Grant, P. M. (2009). Schizophrenia: Cognitive theory, research, and therapy. New York: Guilford Press.Google Scholar
- Berenbaum, H., Bredemeier, K., & Thompson, R. J. (2008). Intolerance of uncertainty: exploring its dimensionality and associations with need for cognitive closure, psychopathology, and personality. Journal of Anxiety Disorders, 22(1), 117–125. https://doi.org/10.1016/j.janxdis.2007.01.004.CrossRefPubMedGoogle Scholar
- Birchwood, M. J., Macmillan, F., & Smith, J. (1992). Early Intervention. In M. J. Birchwood & N. Tarrier (Eds.), Innovations in the psychological management of schizophrenia: Assessment, treatment, and services (pp. 115–145). Oxford, U.K.: Wiley.Google Scholar
- Birrell, J., Meares, K., Wilkinson, A., & Freeston, M. (2011). Toward a definition of intolerance of uncertainty: a review of factor analytical studies of the intolerance of uncertainty scale. Clinical Psychology Review, 31(7), 1198–1208. https://doi.org/10.1016/j.cpr.2011.07.009.CrossRefPubMedGoogle Scholar
- Broome, M. R., Johns, L. C., Valli, I., Woolley, J. B., Tabraham, P., Brett, C., ... McGuire, P. K. (2007). Delusion formation and reasoning biases in those at clinical high risk for psychosis. British Journal of Psychiatry. Supplement, 51, s38–s42. https://doi.org/10.1192/bjp.191.51.s38.
- Carleton, R. N., Mulvogue, M. K., Thibodeau, M. A., McCabe, R. E., Antony, M. M., & Asmundson, G. J. G. (2012). Increasingly certain about uncertainty: Intolerance of uncertainty across anxiety and depression. Journal of Anxiety Disorders, 26(3), 468–479. https://doi.org/10.1016/j.janxdis.2012.01.011.CrossRefPubMedGoogle Scholar
- Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale: Lawrence Erlbaum Associates.Google Scholar
- Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10(7).Google Scholar
- Cougle, J. R., Fitch, K. E., Fincham, F. D., Riccardi, C. J., Keough, M. E., & Timpano, K. R. (2012). Excessive reassurance seeking and anxiety pathology: tests of incremental associations and directionality. Journal of Anxiety Disorders, 26(1), 117–125. https://doi.org/10.1016/j.janxdis.2011.10.001.CrossRefPubMedGoogle Scholar
- Debbane, M., Van der Linden, M., Balanzin, D., Billieux, J., & Eliez, S. (2012). Associations among metacognitive beliefs, anxiety and positive schizotypy during adolescence. Journal of Nervous and Mental Disease, 200(7), 620–626. https://doi.org/10.1097/NMD.0b013e31825bfc1a.CrossRefPubMedGoogle Scholar
- Dugas, M. J., Ladouceur, R., Leger, E., Freeston, M. H., Langlois, F., Provencher, M. D., & Boisvert, J. M. (2003). Group cognitive-behavioral therapy for generalized anxiety disorder: treatment outcome and long-term follow-up. Journal of Consulting and Clinical Psychology, 71(4), 821–825.CrossRefGoogle Scholar
- Dugas, M. J., Hedayati, M., Karavidas, A., Buhr, K., Francis, K., & Phillips, N. A. (2005a). Intolerance of uncertainty and information processing: evidence of biased recall and interpretations. Cognitive Therapy and Research, 29(1), 57–70. https://doi.org/10.1007/s10608-005-1648-9.CrossRefGoogle Scholar
- Eckblad, M. L., Chapman, L. J., Chapman, J. P., & Mishlove, M. (1982). The revised social anhedonia scale. Unpublished test. University of Wisconsin, Madison.Google Scholar
- Endicott, J., Spitzer, R. L., Fleiss, J. L., & Cohen, J. (1976). The global assessment scale: a procedure for measuring overall severity of psychiatric disturbance. Archives of General Psychiatry, 33(6), 766–771. https://doi.org/10.1001/archpsyc.1976.01770060086012.CrossRefPubMedGoogle Scholar
- Fergus, T. A. (2013). Cyberchondria and intolerance of uncertainty: examining when individuals experience health anxiety in response to internet searches for medical information. Cyberpsychology, Behavior and Social Networking, 16(10), 735–739. https://doi.org/10.1089/cyber.2012.0671.CrossRefPubMedGoogle Scholar
- Fetzner, M. G., Horswill, S. C., Boelen, P. A., & Carleton, R. N. (2013). Intolerance of uncertainty and PTSD symptoms: exploring the construct relationship in a community sample with a heterogeneous trauma history. Cognitive Therapy and Research, 37(4), 725–734. https://doi.org/10.1007/s10608-013-9531-6.CrossRefGoogle Scholar
- Freeman, D., & Garety, P. A. (1999). Worry, worry processes and dimensions of delusions: an exploratory investigation of a role for anxiety processes in the maintenance of delusional distress. Behavioral Cognitive Psychopathology, 27, 47–62.Google Scholar
- Freeman, D., Startup, H., Dunn, G., Cernis, E., Wingham, G., Pugh, K., ... Kingdon, D. (2014). Understanding jumping to conclusions in patients with persecutory delusions: working memory and intolerance of uncertainty. Psychological Medicine, 44(14), 3017–3024. https://doi.org/10.1017/S0033291714000592.
- Fresco, D. M., Coles, M. E., Heimberg, R. G., Liebowitz, M. R., Hami, S., Stein, M. B., & Goetz, D. (2001). The Liebowitz social anxiety scale: a comparison of the psychometric properties of self-report and clinician-administered formats. Psychological Medicine, 31(6), 1025–1035.CrossRefGoogle Scholar
- Frisch, M. B. (2014). Quality-of-life-inventory. In Encyclopedia of quality of life and well-being research (pp. 5374–5377). Dordrecht: Springer.Google Scholar
- Gentes, E. L., & Ruscio, A. M. (2011). A meta-analysis of the relation of intolerance of uncertainty to symptoms of generalized anxiety disorder, major depressive disorder, and obsessive-compulsive disorder. Clinical Psychology Review, 31(6), 923–933. https://doi.org/10.1016/j.cpr.2011.05.001.CrossRefPubMedGoogle Scholar
- Grant, P. M., Huh, G. A., Perivoliotis, D., Stolar, N. M., & Beck, A. T. (2012). Randomized trial to evaluate the efficacy of cognitive therapy for low-functioning patients with schizophrenia. Archives of General Psychiatry, 69(2), 121–127. https://doi.org/10.1001/archgenpsychiatry.2011.129.CrossRefPubMedGoogle Scholar
- Horan, W. P., Rassovsky, Y., Kern, R. S., Lee, J., Wynn, J. K., & Green, M. F. (2010). Further support for the role of dysfunctional attitudes in models of real-world functioning in schizophrenia. Journal of Psychiatric Research, 44(8), 499–505. https://doi.org/10.1016/j.jpsychires.2009.11.001.CrossRefPubMedGoogle Scholar
- Ladouceur, R., Dugas, M. J., Freeston, M. H., Leger, E., Gagnon, F., & Thibodeau, N. (2000a). Efficacy of a cognitive-behavioral treatment for generalized anxiety disorder: evaluation in a controlled clinical trial. Journal of Consulting and Clinical Psychology, 68(6), 957–964.CrossRefGoogle Scholar
- Lee, J. K., Orsillo, S. M., Roemer, L., & Allen, L. B. (2010). Distress and avoidance in generalized anxiety disorder: exploring the relationships with intolerance of uncertainty and worry. Cognitive Behaviour Therapy, 39(2), 126–136. https://doi.org/10.1080/16506070902966918.CrossRefPubMedPubMedCentralGoogle Scholar
- Martin, J. M., Warman, D. M., & Lysaker, P. H. (2010). Cognitive insight in non-psychiatric individuals and individuals with psychosis: an examination using the Beck cognitive insight scale. Schizophrenia Research, 121(1–3), 39–45. https://doi.org/10.1016/j.schres.2010.03.028.CrossRefPubMedGoogle Scholar
- McKay, R., Langdon, R., & Coltheart, M. (2006). Need for closure, jumping to conclusions, and decisiveness in delusion-prone individuals. Journal of Nervous and Mental Disease, 194(6), 422–426. https://doi.org/10.1097/01.nmd.0000221353.44132.25.CrossRefPubMedGoogle Scholar
- Pedrelli, P., McQuaid, J. R., Granholm, E., Patterson, T. L., McClure, F., Beck, A. T., & Jeste, D. V. (2004). Measuring cognitive insight in middle-aged and older patients with psychotic disorders. Schizophrenia Research, 71(2–3), 297–305. https://doi.org/10.1016/j.schres.2004.02.019.CrossRefPubMedGoogle Scholar
- Rytwinski, N. K., Fresco, D. M., Heimberg, R. G., Coles, M. E., Liebowitz, M. R., Cissell, S., ... Hofmann, S. G. (2009). Screening for social anxiety disorder with the self-report version of the Liebowitz social anxiety scale. Depression and Anxiety, 26(1), 34–38. https://doi.org/10.1002/da.20503.
- Startup, H., Pugh, K., Dunn, G., Cordwell, J., Mander, H., Cernis, E., ... Freeman, D. (2016). Worry processes in patients with persecutory delusions. British Journal of Clinical Psychology, 55(4), 387–400. https://doi.org/10.1111/bjc.12109.
- Sternheim, L., Startup, H., & Schmidt, U. (2011). An experimental exploration of behavioral and cognitive-emotional aspects of intolerance of uncertainty in eating disorder patients. Journal of Anxiety Disorders, 25(6), 806–812. https://doi.org/10.1016/j.janxdis.2011.03.020.CrossRefPubMedGoogle Scholar
- Thomas, E. C., Luther, L., Zullo, L., Beck, A. T., & Grant, P. M. (2017). From neurocognition to community participation in serious mental illness: the intermediary role of dysfunctional attitudes and motivation. Psychological Medicine, 47(5), 822–836. https://doi.org/10.1017/S0033291716003019.CrossRefPubMedGoogle Scholar
- van Dam, D. S., van Nierop, M., Viechtbauer, W., Velthorst, E., van Winkel, R., Bruggeman, R., & Wiersma, D. (2014). Childhood abuse and neglect in relation to the presence and persistence of psychotic and depressive symptomatology.Google Scholar
- Weissman, A. N., & Beck, A. T. (1978). Development and validation of the dysfunctional attitude scale: A preliminary investigation. Paper presented at the Association for the Advancement of Behavior Therapy, Chicago.Google Scholar