Advertisement

A Systematic Review of the Psychometric Properties of Trait Social Anxiety Self-Report Measures

  • Matthew Modini
  • Maree J. Abbott
  • Caroline Hunt
Article

Abstract

Since the inclusion of social anxiety disorder in DSM-III, a number of self-report measures have been developed in order to detect and measure aspects of trait social anxiety. The present systematic review examined evidence supporting the psychometric properties of trait social anxiety self-report measures. Relevant studies were identified via a comprehensive detailed systematic search of academic databases. The psychometric properties reported in the included studies were subjected to an appraisal of their adequacy using an established quality assessment tool. Of the 3172 studies identified, 72 studies met the inclusion criteria. Included studies indicated that a number of measures had evidence of some adequate psychometric properties, though none demonstrated criteria for all relevant psychometric properties according to the appraisal of adequacy tool utilised in this study. Overall the findings demonstrate that further research is needed to establish the psychometric properties of trait social anxiety self-report measures before their results can be interpreted as robust indices of this important construct.

Keywords

Social anxiety Social phobia Measures Questionnaires Psychometric 

Notes

Conflict of interest

Matthew Modini, Maree J. Abbott, and Caroline Hunt declare that they have no conflict of interest.

References

  1. Aderka, I. M., Pollack, M. H., Simon, N. M., Smits, J. A., Van Ameringen, M., Stein, M. B., & Hofmann, S. G. (2013). Development of a brief version of the social phobia inventory using item response theory: the mini-SPIN-R. Behavior Therapy, 44(4), 651–661.PubMedCrossRefGoogle Scholar
  2. American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorder (5th ed.). Arlington: American Psychiatric Publishing.Google Scholar
  3. Antony, M. M. (1997). Assessment and treatment of social phobia. Canadian Journal of Psychiatry, 42(8), 826–834.Google Scholar
  4. Antony, M. M., Coons, M. J., McCabe, R. E., Ashbaugh, A., & Swinson, R. P. (2006). Psychometric properties of the social phobia inventory: further evaluation. Behaviour Research and Therapy, 44(8), 1177–1185.PubMedCrossRefGoogle Scholar
  5. Baker, S. L., Heinrichs, N., Kim, H.-J., & Hofmann, S. G. (2002). The Liebowitz social anxiety scale as a self-report instrument: a preliminary psychometric analysis. Behaviour Research and Therapy, 40(6), 701–715.PubMedCrossRefGoogle Scholar
  6. Beesdo, K., Bittner, A., Pine, D. S., Stein, M. B., Hofler, M., Lieb, R., & Wittchen, H. U. (2007). Incidence of social anxiety disorder and the consistent risk for secondary depression in the first three decades of life. Archives of General Psychiatry, 64(8), 903–912.PubMedCrossRefGoogle Scholar
  7. Beidel, D. C., Borden, J. W., Turner, S. M., & Jacob, R. G. (1989a). The social phobia and anxiety inventory: concurrent validity with a clinic sample. Behaviour Research and Therapy, 27(5), 573–576.PubMedCrossRefGoogle Scholar
  8. Beidel, D. C., Turner, S. M., Stanley, M. A., & Dancu, C. V. (1989b). The social phobia and anxiety inventory: concurrent and external validity. Behavior Therapy, 20(3), 417–427.CrossRefGoogle Scholar
  9. Beidel, D. C., Turner, S. M., & Cooley, M. R. (1993). Assessing reliable and clinically significant change in social phobia: validity of the social phobia and anxiety inventory. Behaviour Research and Therapy, 31(3), 331–337.PubMedCrossRefGoogle Scholar
  10. Bernstein, I. H., Teng, G., & Garbin, C. P. (1986). A confirmatory factoring of the self-consciousness scale. Multivariate Behavioral Research, 21(4), 459–475.CrossRefGoogle Scholar
  11. Brown, E. J., Turovsky, J., Heimberg, R. G., Juster, H. R., Brown, T. A., & Barlow, D. H. (1997). Validation of the social interaction anxiety scale and the social phobia scale across the anxiety disorders. Psychological Assessment, 9(1), 21–27.CrossRefGoogle Scholar
  12. Bunnell, B. E., Joseph, D. L., & Beidel, D. C. (2013). Measurement invariance of the social phobia and anxiety inventory. Journal of Anxiety Disorders, 27(1), 84–91.PubMedCentralPubMedCrossRefGoogle Scholar
  13. Carleton, R., McCreary, D. R., Norton, P. J., & Asmundson, G. J. (2006). Brief fear of negative evaluation scale-revised. Depression and Anxiety, 23(5), 297–303.PubMedCrossRefGoogle Scholar
  14. Carleton, R. N., Collimore, K. C., & Asmundson, G. J. G. (2007). Social anxiety and fear of negative evaluation: construct validity of the BFNE-II. Journal of Anxiety Disorders, 21(1), 131–141.PubMedCrossRefGoogle Scholar
  15. Carleton, R. N., Collimore, K. C., Asmundson, G. J., McCabe, R. E., Rowa, K., & Antony, M. M. (2009). Refining and validating the social interaction anxiety scale and the social phobia scale. Depression & Anxiety, 26(2), E71–81.CrossRefGoogle Scholar
  16. Carleton, R., Collimore, K. C., Asmundson, G. J., McCabe, R. E., Rowa, K., & Antony, M. M. (2010). SPINning factors: factor analytic evaluation of the social phobia inventory in clinical and nonclinical undergraduate samples. Journal of Anxiety Disorders, 24(1), 94–101.PubMedCrossRefGoogle Scholar
  17. Carleton, R., Collimore, K. C., McCabe, R. E., & Antony, M. M. (2011). Addressing revisions to the brief fear of negative evaluation scale: measuring fear of negative evaluation across anxiety and mood disorders. Journal of Anxiety Disorders, 25(6), 822–828.PubMedCrossRefGoogle Scholar
  18. Carver, C. S., & Glass, D. C. (1976). The self-consciousness scale: a discriminant validity study. Journal of Personality Assessment, 40(2), 169–172.PubMedCrossRefGoogle Scholar
  19. Collins, K. A., Westra, H. A., Dozois, D. J., & Stewart, S. H. (2005). The validity of the brief version of the fear of negative evaluation scale. Journal of Anxiety Disorders, 19(3), 345–359.PubMedCrossRefGoogle Scholar
  20. Connor, K. M., Davidson, J. R., Churchill, L. E., Sherwood, A., Foa, E., & Weisler, R. H. (2000). Psychometric properties of the social phobia inventory (SPIN) New self-rating scale. British Journal of Psychiatry, 176, 379–386.PubMedCrossRefGoogle Scholar
  21. Connor, K. M., Kobak, K. A., Churchill, L. E., Katzelnick, D., & Davidson, J. R. T. (2001). Mini-SPIN: a brief screening assessment for generalized social anxiety disorder. Depression and Anxiety, 14(2), 137–140.PubMedCrossRefGoogle Scholar
  22. Cox, B. J., Swinson, R. P., & Shaw, B. F. (1991). Value of the fear questionnaire in differentiating agoraphobia and social phobia. British Journal of Psychiatry, 159, 842–845.PubMedCrossRefGoogle Scholar
  23. Cox, B. J., Parker, J. D., & Swinson, R. P. (1996). Confirmatory factor analysis of the fear questionnaire with social phobia patients. British Journal of Psychiatry, 168(4), 497–499.PubMedCrossRefGoogle Scholar
  24. Cox, B. J., Ross, L., Swinson, R. P., & Direnfeld, D. M. (1998). A comparison of social phobia outcome measures in cognitive-behavioral group therapy. Behavior Modification, 22(3), 285–297.PubMedCrossRefGoogle Scholar
  25. Cramer, K. M. (2000). Comparing the relative fit of various factor models of the self-consciousness scale in two independent samples. Journal of Personality Assessment, 75(2), 295–307.PubMedCrossRefGoogle Scholar
  26. Dalrymple, K., Martinez, J., Tepe, E., Young, D., Chelminski, I., Morgan, T., & Zimmerman, M. (2013). A clinically useful social anxiety disorder outcome scale. Comprehensive Psychiatry, 54(7), 758–765.PubMedCentralPubMedCrossRefGoogle Scholar
  27. Duke, D., Krishnan, M., Faith, M., & Storch, E. A. (2006). The psychometric properties of the brief fear of negative evaluation scale. Journal of Anxiety Disorders, 20(6), 807–817.PubMedCrossRefGoogle Scholar
  28. Fenigstein, A., Scheier, M. F., & Buss, A. H. (1975). Public and private self-consciousness: assessment and theory. Journal of Consulting and Clinical Psychology, 43(4), 522–527.CrossRefGoogle Scholar
  29. Fergus, T. A., Valentiner, D. P., McGrath, P. B., Gier-Lonsway, S. L., & Kim, H.-S. (2012). Short forms of the social interaction anxiety scale and the social phobia scale. Journal of Personality Assessment, 94(3), 310–320.PubMedCrossRefGoogle Scholar
  30. Fernandez, K. C., Piccirillo, M. L., & Rodebaugh, T. L. (2014). Self-report assessment: The status of the field and room for improvement. In J. W. Weeks (Ed.), The Wiley Blackwell handbook of social anxiety disorder. Hoboken: Wiley.Google Scholar
  31. Fresco, D., Coles, M., Heimberg, R. G., Leibowitz, M., Hami, S., Stein, M., & Goetz, D. (2001). The Liebowitz social anxiety scale: a comparison of the psychometric properties of self-report and clinician-administered formats. Psychological Medicine, 31(6), 1025–1035.PubMedCrossRefGoogle Scholar
  32. Gore, K., Carter, M., & Parker, S. (2002). Predicting anxious response to a social challenge: the predictive utility of the social interaction anxiety scale and the social phobia scale in a college population. Behaviour Research and Therapy, 40(6), 689–700.PubMedCrossRefGoogle Scholar
  33. Gould, C. E., Gerolimatos, L. A., Ciliberti, C. M., Edelstein, B. A., & Smith, M. D. (2012). Initial evaluation of the older adult social-evaluative situations questionnaire: a measure of social anxiety in older adults. International Psychogeriatrics, 24(12), 2009–2018.PubMedCrossRefGoogle Scholar
  34. Hambrick, J. P., Turk, C. L., Heimberg, R. G., Schneier, F. R., & Liebowitz, M. R. (2003). The experience of disability and quality of life in social anxiety disorder. Depression & Anxiety, 18(1), 46–50.CrossRefGoogle Scholar
  35. Heidenreich, T., Schermelleh-Engel, K., Schramm, E., Hofmann, S. G., & Stangier, U. (2011). The factor structure of the social interaction anxiety scale and the social phobia scale. Journal of Anxiety Disorders, 25(4), 579–583.PubMedCrossRefGoogle Scholar
  36. Heimberg, R. G., Mueller, G. P., Holt, C. S., Hope, D. A., & Liebowitz, M. R. (1992). Assessment of anxiety in social interaction and being observed by others: the social interaction anxiety scale and the social phobia scale. Behavior Therapy, 23(1), 53–73.CrossRefGoogle Scholar
  37. Herbert, J. D., Bellack, A. S., & Hope, D. A. (1991). Concurrent validity of the social phobia and anxiety inventory. Journal of Psychopathology and Behavioral Assessment, 13(4), 357–368.CrossRefGoogle Scholar
  38. Hope, D. A., & Heimberg, R. G. (1988). Public and private self-consciousness and social phobia. Journal of Personality Assessment, 52(4), 626–639.PubMedCrossRefGoogle Scholar
  39. Hope, D. A., Laguna, L. B., Heimberg, R. G., & Barlow, D. H. (1996). Relationship between ADIS clinician’s severity rating and self-report measures among social phobics. Depression & Anxiety, 4(3), 120–125.CrossRefGoogle Scholar
  40. Ishiyama, F. (1999). Development and validation of a situational social avoidance scale. Psychological Reports, 85(1), 114–120.CrossRefGoogle Scholar
  41. Le Blanc, A. L., Bruce, L. C., Heimberg, R. G., Hope, D. A., Blanco, C., Schneier, F. R., & Liebowitz, M. R. (2014). Evaluation of the psychometric properties of two short forms of the social interaction anxiety scale and the social phobia scale. Assessment, 21(3), 312–323.PubMedCrossRefGoogle Scholar
  42. Leary, M. R. (1983a). A brief version of the fear of negative evaluation scale. Personality and Social Psychology Bulletin, 9, 371–375.CrossRefGoogle Scholar
  43. Leary, M. R. (1983b). Social anxiousness: the construct and its measurement. Journal of Personality Assessment, 47(1), 66–75.PubMedCrossRefGoogle Scholar
  44. Leary, M. R., & Kowalski, R. M. (1993). The interaction anxiousness scale: construct and criterion-related validity. Journal of Personality Assessment, 61(1), 136–146.PubMedCrossRefGoogle Scholar
  45. Letamendi, A. M., Chavira, D. A., & Stein, M. B. (2009). Issues in the assessment of social phobia: a review. Israeli Journal of Psychiatry and Related Sciences, 46(1), 13–24.Google Scholar
  46. Marks, I. M., & Mathews, A. M. (1979). Brief standard self-rating for phobic patients. Behaviour Research and Therapy, 17(3), 263–267.PubMedCrossRefGoogle Scholar
  47. Mattick, R. P., & Clarke, J. (1998). Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behaviour Research and Therapy, 36(4), 455–470.PubMedCrossRefGoogle Scholar
  48. Mittal, B., & Balasubramanian, S. K. (1987). Testing the dimensionality of the self-consciousness scales. Journal of Personality Assessment, 51(1), 53–68.PubMedCrossRefGoogle Scholar
  49. Mokkink, L. B., Terwee, C. B., Knol, D. L., Stratford, P. W., Alonso, J., Patrick, D. L., Bouter, L. M., & de Vet, H. C. (2010a). The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Medical Reseatch Methodology, 10, 22.CrossRefGoogle Scholar
  50. Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. (2010b). The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. Journal of Clinical Epidemiology, 63(7), 737–745.PubMedCrossRefGoogle Scholar
  51. Moore, K. A., & Gee, D. L. (2003). The reliability, validity, discriminant and predictive properties of the social phobia inventory (SoPhI). Anxiety, Stress & Coping: An International Journal, 16(1), 109–117.CrossRefGoogle Scholar
  52. Newman, M. G., Kachin, K., Zuellig, A., Constantino, M., & Cashman-McGrath, L. (2003). The social phobia diagnostic questionnaire: preliminary validation of a new self-report diagnostic measure of social phobia. Psychological Medicine, 33(4), 623–635.PubMedCrossRefGoogle Scholar
  53. Oakman, J., Van Ameringen, M., Mancini, C., & Farvolden, P. (2003). A confirmatory factor analysis of a self-report version of the Liebowitz social anxiety scale. Journal of Clinical Psychology, 59(1), 149–161.PubMedCrossRefGoogle Scholar
  54. Oei, T. P., Moylan, A., & Evans, L. (1991). Validity and clinical utility of the fear questionnaire for anxiety-disorder patients. Psychological Assessment: A Journal of Consulting and Clinical Psychology, 3(3), 391–397.CrossRefGoogle Scholar
  55. Osman, A., Barrios, F. X., Osman, J. R., & Markway, K. (1993). Further psychometric evaluation of the fear questionnaire: responses of college students. Psychological Reports, 73(3 Pt 2), 1259–1266.PubMedCrossRefGoogle Scholar
  56. Osman, A., Barrios, F. X., Aukes, D., & Osman, J. R. (1995). Psychometric evaluation of the social phobia and anxiety inventory in college students. Journal of Clinical Psychology, 51(2), 235–243.PubMedCrossRefGoogle Scholar
  57. Osman, A., Barrios, F. X., Haupt, D., King, K., Osman, J. R., & Slavens, S. (1996). The social phobia and anxiety inventory: further validation in two nonclinical samples. Journal of Psychopathology and Behavioral Assessment, 18(1), 35–47.CrossRefGoogle Scholar
  58. Osman, A., Gutierrez, P. M., Barrios, F. X., Kopper, B. A., & Chiros, C. E. (1998). The social phobia and social interaction anxiety scales: evaluation of psychometric properties. Journal of Psychopathology and Behavioral Assessment, 20(3), 249–264.CrossRefGoogle Scholar
  59. Patel, A., Knapp, M., Henderson, J., & Baldwin, D. (2002). The economic consequences of social phobia. Journal of Affective Disorders, 68(2–3), 221–233.PubMedCrossRefGoogle Scholar
  60. Peters, L. (2000). Discriminant validity of the social phobia and anxiety inventory (SPAI), the social phobia scale (SPS) and the social interaction anxiety scale (SIAS). Behaviour Research and Therapy, 38(9), 943–950.PubMedCrossRefGoogle Scholar
  61. Peters, L., Sunderland, M., Andrews, G., Rapee, R. M., & Mattick, R. P. (2012). Development of a short form social interaction anxiety (SIAS) and social phobia scale (SPS) using nonparametric item response theory: the SIAS-6 and the SPS-6. Psychological Assessment, 24(1), 66–76.PubMedCrossRefGoogle Scholar
  62. Radomsky, A. S., Ashbaugh, A. R., Saxe, M. L., Ouimet, A. J., Golden, E. R., Lavoie, S. L., & O’Connor, K. P. (2006). Psychometric properties of the french and english versions of the social phobia inventory. Canadian Journal of Behavioural Science/Revue canadienne des sciences du comportement, 38(4), 354–360.CrossRefGoogle Scholar
  63. Reilly, A. R., Carleton, R., & Weeks, J. W. (2012). Psychometric evaluation of the social interaction phobia scale. Anxiety, Stress & Coping: An International Journal, 25(5), 529–542.CrossRefGoogle Scholar
  64. Reneman, M. F., Dijkstra, A., Geertzen, J. H., & Dijkstra, P. U. (2010). Psychometric properties of chronic pain acceptance questionnaires: a systematic review. Euripean Journal of Pain, 14(5), 457–465.CrossRefGoogle Scholar
  65. Roberson-Nay, R., Strong, D. R., Nay, W. T., Beidel, D. C., & Turner, S. M. (2007). Development of an abbreviated social phobia and anxiety inventory (SPAI) using item response theory: the SPAI-23. Psychological Assessment, 19(1), 133–145.PubMedCrossRefGoogle Scholar
  66. Rodebaugh, T. L., Chambless, D. L., Terrill, D. R., Floyd, M., & Uhde, T. (2000). Convergent, discriminant, and criterion-related validity of the social phobia and anxiety inventory. Depression & Anxiety, 11(1), 10–14.CrossRefGoogle Scholar
  67. Rodebaugh, T. L., Holaway, R. M., & Heimberg, R. G. (2004a). The treatment of social anxiety disorder. Clinical Psychology Review, 24(7), 883–908.PubMedCrossRefGoogle Scholar
  68. Rodebaugh, T. L., Woods, C. M., Thissen, D. M., Heimberg, R. G., Chambless, D. L., & Rapee, R. M. (2004b). More information from fewer questions: the factor structure and item properties of the original and brief fear of negative evaluation scale. Psychological Assessment, 16(2), 169–181.PubMedCrossRefGoogle Scholar
  69. Rodebaugh, T. L., Woods, C. M., Heimberg, R. G., Liebowitz, M. R., & Schneier, F. R. (2006). The factor structure and screening utility of the social interaction anxiety scale. Psychological Assessment, 18(2), 231–237.PubMedCrossRefGoogle Scholar
  70. Rodebaugh, T. L., Woods, C. M., & Heimberg, R. G. (2007). The reverse of social anxiety is not always the opposite: the reverse-scored items of the social interaction anxiety scale do not belong. Behavior Therapy, 38(2), 192–206.PubMedCrossRefGoogle Scholar
  71. Rodebaugh, T. L., Heimberg, R. G., Brown, P. J., Fernandez, K. C., Blanco, C., Schneier, F. R., & Liebowitz, M. R. (2011). More reasons to be straightforward: findings and norms for two scales relevant to social anxiety. Journal of Anxiety Disorders, 25(5), 623–630.PubMedCentralPubMedCrossRefGoogle Scholar
  72. Rytwinski, N. K., Fresco, D. M., Heimberg, R. G., Coles, M. E., Liebowitz, M. R., Cissell, S., Stein, M. B., & Hofmann, S. G. (2009). Screening for social anxiety disorder with the self-report version of the Liebowitz social anxiety scale. Depression & Anxiety, 26(1), 34–38.PubMedCrossRefGoogle Scholar
  73. Safren, S. A., Turk, C. L., & Heimberg, R. G. (1998). Factor structure of the social interaction anxiety scale and the social phobia scale. Behaviour Research & Therapy, 36(4), 443–453.CrossRefGoogle Scholar
  74. Schry, A. R., Roberson-Nay, R., & White, S. W. (2012). Measuring social anxiety in college students: a comprehensive evaluation of the psychometric properties of the SPAI-23. Psychological Assessment, 24(4), 846–854.PubMedCrossRefGoogle Scholar
  75. Seeley-Wait, E., Abbott, M. J., & Rapee, R. M. (2009). Psychometric properties of the mini-social phobia inventory. Primary Care Companion Journal of Clincical Psychiatry, 11(5), 231–236.CrossRefGoogle Scholar
  76. Spielberger, C. D. (1983). Manual for the state-trait anxiety inventory (STAI). Palo Alto: Consulting Psychologists Press.Google Scholar
  77. Terwee, C. B., Bot, S. D., de Boer, M. R., van der Windt, D. A., Knol, D. L., Dekker, J., Bouter, L. M., & de Vet, H. C. (2007). Quality criteria were proposed for measurement properties of health status questionnaires. Journal of Clinical Epidemiology, 60(1), 34–42.PubMedCrossRefGoogle Scholar
  78. Trull, T. J., & Hillerbrand, E. (1990). Psychometric properties and factor structure of the fear questionnaire phobia subscale items in two normative samples. Journal of Psychopathology and Behavioral Assessment, 12(4), 285–297.CrossRefGoogle Scholar
  79. Turner, R. G., Scheier, M. F., Carver, C. S., & Ickes, W. (1978). Correlates of self-consciousness. Journal of Personality Assessment, 42(3), 285–289.PubMedCrossRefGoogle Scholar
  80. Turner, S. M., McCanna, M., & Beidel, D. C. (1987). Validity of the social avoidance and distress and fear of negative evaluation scales. Behaviour Research & Therapy, 25(2), 113–115.CrossRefGoogle Scholar
  81. Turner, S. M., Beidel, D. C., Dancu, C. V., & Stanley, M. A. (1989a). An empirically derived inventory to measure social fears and anxiety: the social phobia and anxiety inventory. Psychological Assessment: A Journal of Consulting and Clinical Psychology, 1(1), 35–40.CrossRefGoogle Scholar
  82. Turner, S. M., Stanley, M. A., Beidel, D. C., & Bond, L. (1989b). The social phobia and anxiety inventory: construct validity. Journal of Psychopathology and Behavioral Assessment, 11(3), 221–234.CrossRefGoogle Scholar
  83. Turner, S. M., Johnson, M. R., Beidel, D. C., Heiser, N. A., & Lydiard, R. B. (2003). The social thoughts and beliefs scale: a new inventory for assessing cognitions in social phobia. Psychological Assessment, 15(3), 384–391.PubMedCrossRefGoogle Scholar
  84. Watson, D., & Friend, R. (1969). Measurement of social-evaluative anxiety. Journal of Consulting and Clinical Psychology, 33(4), 448–457.PubMedCrossRefGoogle Scholar
  85. Weeks, J. W., Heimberg, R. G., Fresco, D. M., Hart, T. A., Turk, C. L., Schneier, F. R., & Liebowitz, M. R. (2005). Empirical validation and psychometric evaluation of the brief fear of negative evaluation scale in patients with social anxiety disorder. Psychological Assessment, 17(2), 179–190.PubMedCrossRefGoogle Scholar
  86. Weeks, J. W., Spokas, M. E., & Heimberg, R. G. (2007). Psychometric evaluation of the mini-social phobia inventory (mini-SPIN) in a treatment-seeking sample. Depression & Anxiety, 24(6), 382–391.PubMedCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2015

Authors and Affiliations

  • Matthew Modini
    • 1
  • Maree J. Abbott
    • 1
  • Caroline Hunt
    • 1
  1. 1.School of PsychologyThe University of SydneySydneyAustralia

Personalised recommendations