Skip to main content
Log in

Measures of Anxiety Disorder Symptoms in Adolescents

  • Research
  • Published:
Child Psychiatry & Human Development Aims and scope Submit manuscript

Abstract

This study examines select psychometric properties (i.e., internal reliability, and factorial, convergent, discriminant, and criterion validity) of three commonly-used measures of anxiety disorder symptoms in adolescents in the context of multi-trait, multi-method matrix analyses. A sample of 331 adolescents (age M = 17.1; 75.3% white; 71.0% female) completed three self-report scales that assess symptoms of separation anxiety, social anxiety, panic, and generalized anxiety, as well as measures of depression, experiential avoidance, and intolerance of uncertainty. Measures of panic disorder symptoms showed poor factorial, convergent, and discriminant validity. A multi-trait, multi-method matrix model to understand the relationships among the measures of separation anxiety, social anxiety, and generalized anxiety symptoms provided a reasonable fit to the data. Measures of separation anxiety showed poor discriminant and criterion validity, suggesting limited relevance of separation anxiety in this adolescent sample. Measures of social anxiety generally showed evidence of adequate-to-good factorial, convergent, and discriminant validity. Measures of generalized anxiety showed adequate –to-good factorial and convergent validity, and poor-to-adequate discriminant validity. The associations of measures of social and generalized anxiety with measures of depression, experiential avoidance, and intolerance of uncertainty were at least partially independent of method variance. The findings of this study add to the growing literature that evaluates the strengths and limitations of these scales for clinical practice and research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

Data Availability

Contact the second author, David Valentiner (dvalentiner@niu.edu) for access to the data.

References

  1. Polanczyk GV, Salum GA, Sugaya LS, Caye A, Rohde LA (2015) Annual research review: a meta-analysis of the worldwide prevalence of mental disorders in children and adolescents. J Child Psychol Psychiatry 56(3):345–365. https://doi.org/10.1111/jcpp.12381

    Article  PubMed  Google Scholar 

  2. Kessler RC, Avenevoli S, Costello EJ, Georgiades K, Green JG, Gruber MJ, Sampson NA (2012) Prevalence, persistence, and sociodemographic correlates of DSM-IV disorders in the national comorbidity survey replication adolescent supplement. Arch Gen Psychiatry 69(4):372–380. https://doi.org/10.1001/archgenpsychiatry.2011.160

    Article  PubMed  Google Scholar 

  3. Essau CA, Olaya B, Ollendick TH (2013) Classification of anxiety disorders in children and adolescents. In: Essau CA, Ollendick TH (eds) The Wiley-Blackwell handbook of the treatment of childhood and adolescent anxiety. Wiley, Hoboken, pp 1–21

    Chapter  Google Scholar 

  4. Essau CA, Lewinsohn PM, Olaya B, Seeley JR (2014) Anxiety disorders in adolescents and psychosocial outcomes at age 30. J Affect Disord 163:125–132. https://doi.org/10.1016/j.jad.2013.12.033

    Article  PubMed  PubMed Central  Google Scholar 

  5. Pella JE, Slade EP, Pikulski PJ, Ginsburg GS (2020) Pediatric anxiety disorders: a cost of illness analysis. J Abnorm Child Psychol 48(4):551–559. https://doi.org/10.1007/s10802-020-00626-7

    Article  PubMed  Google Scholar 

  6. Hunsley J, Mash EJ (2018) Developing criteria for evidence-based assessment: an introduction to assessments that work. In: Hunsley J, Mash EJ (eds) A guide to assessments that work, 2nd edn. Oxford University Press, New York, pp 3–16

    Chapter  Google Scholar 

  7. Birmaher B, Khetarpal S, Brent D, Cully M, Balach L, Kaufman J, Neer SM (1997) The screen for child anxiety related emotional disorders (SCARED): scale construction and psychometric characteristics. J Am Acad Child Adolesc Psychiatry 36(4):545–553. https://doi.org/10.1097/00004583-199704000-00018

    Article  PubMed  Google Scholar 

  8. Spence SH (1998) A measure of anxiety symptoms among children. Behav Res Ther 36(5):545–566. https://doi.org/10.1016/S0005-7967(98)00034-5

    Article  PubMed  Google Scholar 

  9. Muris P, Simon E, Lijphart H, Bos A, Hale W, Schmeitz K (2017) The youth anxiety measure for DSM-5 (YAM-5): development and first psychometric evidence of a new scale for assessing anxiety disorders symptoms of children and adolescents. Child Psychiatry Hum Dev 48(1):1–17. https://doi.org/10.1007/s10578-016-0648-1

    Article  PubMed  Google Scholar 

  10. American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders: DSM-5. American Psychiatric Association, Arlington

    Book  Google Scholar 

  11. Foster SL, Cone JD (1995) Validity issues in clinical assessment. Psychol Assess 7(3):248–260. https://doi.org/10.1037/1040-3590.7.3.248

    Article  Google Scholar 

  12. Birmaher B, Brent DA, Chiappetta L, Bridge J, Monga S, Baugher M (1999) Psychometric properties of the screen for child anxiety related emotional disorders (SCARED): a replication study. J Am Acad Child Adolesc Psychiatry 38(10):1230–1236. https://doi.org/10.1097/00004583-199910000-00011

    Article  PubMed  Google Scholar 

  13. Bowers ME, Reider LB, Morales S, Buzzell GA, Miller N, Troller-Renfree SV, Fox NA (2020) Differences in parent and child report on the screen for child anxiety-related emotional disorders (SCARED): implications for investigations of social anxiety in adolescents. J Abnorm Child Psychol 48(4):561–571. https://doi.org/10.1007/s10802-019-00609-3

    Article  PubMed  PubMed Central  Google Scholar 

  14. Boyd RC, Ginsburg GS, Lambert SF, Cooley MR, Campbell KD (2003) Screen for child anxiety related emotional disorders (SCARED): psychometric properties in an African-American parochial high school sample. J Am Acad Child Adolesc Psychiatry 42(10):1188–1196. https://doi.org/10.1097/01.chi.0000082033.88099.8d

    Article  PubMed  Google Scholar 

  15. Rappaport BI, Pagliaccio D, Pine DS, Klein DN, Jarcho JM (2017) Discriminant validity, diagnostic utility, and parent-child agreement on the screen for child anxiety related emotional disorders (SCARED) in treatment-and non-treatment-seeking youth. J Anxiety Disord 51:22–31. https://doi.org/10.1016/j.janxdis.2017.08.006

    Article  PubMed  PubMed Central  Google Scholar 

  16. Runyon K, Chesnut SR, Burley H (2018) Screening for childhood anxiety: a meta-analysis of the screen for child anxiety related emotional disorders. J Affect Disord 240:220–229. https://doi.org/10.1016/j.jad.2018.07.049

    Article  PubMed  Google Scholar 

  17. Wren FJ, Berg EA, Heiden LA, Kinnamon CJ, Ohlson LA, Bridge JA, Bernal MP (2007) Childhood anxiety in a diverse primary care population: parent-child reports, ethnicity and SCARED factor structure. J Am Acad Child Adolesc Psychiatry 46(3):332–340. https://doi.org/10.1097/chi.0b013e31802f1267

    Article  PubMed  Google Scholar 

  18. Brown-Jacobsen AM, Wallace DP, Whiteside SP (2011) Multimethod, multi-informant agreement, and positive predictive value in the identification of child anxiety disorders using the SCAS and ADIS-C. Assessment 18(3):382–392. https://doi.org/10.1177/1073191110375792

    Article  PubMed  Google Scholar 

  19. Orgiles M, Fernández-Martínez I, Guillen-Riquelme A, Espada JP, Essau CA (2016) A systematic review of the factor structure and reliability of the spence children’s anxiety scale. J Affect Disord 190:333–340. https://doi.org/10.1016/j.jad.2015.09.055

    Article  PubMed  Google Scholar 

  20. Ramme R (n.d.) Spence children’s anxiety scale: an overview of psychometric findings. Spence Children’s Anxiety Scale. https://www.scaswebsite.com/docs/Ramme%20SCAS%20Psychomet%20evidence.pdf

  21. Spence SH (n.d.) The child report version of the spence children’s anxiety scale. Spence Children’s Anxiety Scale. https://www.scaswebsite.com/1_2_.html

  22. Spence SH (1997) Structure of anxiety symptoms among children: a confirmatory factor-analytic study. J Abnorm Psychol 106(2):280. https://doi.org/10.1037/0021-843X.106.2.280

    Article  PubMed  Google Scholar 

  23. Spence SH, Barrett PM, Turner CM (2003) Psychometric properties of the spence children’s anxiety scale with young adolescents. J Anxiety Disord 17(6):605–625. https://doi.org/10.1016/S0887-6185(02)00236-0

    Article  PubMed  Google Scholar 

  24. Whiteside SP, Brown AM (2008) Exploring the utility of the spence children’s anxiety scales parent-and child-report forms in a North American sample. J Anxiety Disord 22(8):1440–1446. https://doi.org/10.1016/j.janxdis.2008.02.006

    Article  PubMed  Google Scholar 

  25. Garcia-Lopez LJ, Saez-Castillo AJ, Fuentes-Rodriguez G (2017) Psychometric properties of the youth anxiety measure for DSM-5, Part I (YAM-5-I) in a community sample of Spanish-speaking adolescents. J Affect Disord 208:455–459. https://doi.org/10.1016/j.jad.2016.10.045

    Article  PubMed  Google Scholar 

  26. Muris P, Mannens J, Peters L, Meesters C (2017) The youth anxiety measure for DSM-5 (YAM-5): correlations with anxiety, fear, and depression scales in non-clinical children. J Anxiety Disord 51:72–78. https://doi.org/10.1016/j.janxdis.2017.06.001

    Article  PubMed  Google Scholar 

  27. Simon E, Bos AE, Verboon P, Smeekens S, Muris P (2017) Psychometric properties of the youth anxiety measure for DSM-5 (YAM-5) in a community sample. Personal Individ Differ 116:258–264. https://doi.org/10.1016/j.paid.2017.04.058

    Article  Google Scholar 

  28. Hayes SC, Wilson KG, Gifford EV, Follette VM, Strosahl K (1996) Experiential avoidance and behavioral disorders: a functional dimensional approach to diagnosis and treatment. J Consult Clin Psychol 64(6):1152–1168. https://doi.org/10.1037/0022-006X.64.6.1152

    Article  PubMed  Google Scholar 

  29. Hayes-Skelton SA, Eustis EH (2020) Experiential avoidance. In: Abramowitz JS, Blakey SM (eds) Clinical handbook of fear and anxiety: maintenance processes and treatment mechanisms. American Psychological Association, Washington, pp 115–131. https://doi.org/10.1037/0000150-007

    Chapter  Google Scholar 

  30. Papachristou H, Theodorou M, Neophytou K, Panayiotou G (2018) Community sample evidence on the relations among behavioural inhibition system, anxiety sensitivity, experiential avoidance, and social anxiety in adolescents. J Contextual Behav Sci 8:36–43. https://doi.org/10.1016/j.jcbs.2018.03.001

    Article  Google Scholar 

  31. Venta A, Sharp C, Hart J (2012) The relation between anxiety disorder and experiential avoidance in inpatient adolescents. Psychol Assess 24(1):240–248. https://doi.org/10.1037/a0025362

    Article  PubMed  Google Scholar 

  32. Shimoda Y, Ishizu K, Ohtsuki T (2018) The reciprocal relations between experiential avoidance and social anxiety among early adolescents: a prospective cohort study. J Contextual Behav Sci 10:115–119. https://doi.org/10.1016/j.jcbs.2018.10.001

    Article  Google Scholar 

  33. Carleton RN (2016) Into the unknown: a review and synthesis of contemporary models involving uncertainty. J Anxiety Disord 39:30–43. https://doi.org/10.1016/j.janxdis.2016.02.007

    Article  PubMed  Google Scholar 

  34. McEvoy PM, Hyett MP, Shihata S, Price JE, Strachan L (2019) The impact of methodological and measurement factors on transdiagnostic associations with intolerance of uncertainty: a meta-analysis. Clin Psychol Rev 73:101778. https://doi.org/10.1016/j.cpr.2019.101778

    Article  PubMed  Google Scholar 

  35. Osmanağaoğlu N, Creswell C, Dodd HF (2018) Intolerance of uncertainty, anxiety, and worry in children and adolescents: a meta-analysis. J Affect Disord 225:80–90. https://doi.org/10.1016/j.jad.2017.07.035

    Article  PubMed  Google Scholar 

  36. Laugesen N, Dugas MJ, Bukowski WM (2003) Understanding adolescent worry: the application of a cognitive model. J Abnorm Child Psychol 31(1):55–64. https://doi.org/10.1023/a:1021721332181

    Article  PubMed  Google Scholar 

  37. Boelen PA, Vrinssen I, van Tulder F (2010) Intolerance of uncertainty in adolescents: correlations with worry, social anxiety, and depression. J Nerv Ment Dis 198(3):194–200. https://doi.org/10.1097/NMD.0b013e3181d143de

    Article  PubMed  Google Scholar 

  38. Angold A, Costello EJ, Messer SC, Pickles A, Winder F, Silver D (1995) The development of a short questionnaire for use in epidemiological studies of depression in children and adolescents. Int J Methods Psychiatr Res 5:237–249

    Google Scholar 

  39. Greco LA, Lambert W, Baer RA (2008) Psychological inflexibility in childhood and adolescence: development and evaluation of the avoidance and fusion questionnaire for youth. Psychol Assess 20(2):93–102. https://doi.org/10.1037/1040-3590.20.2.93

    Article  PubMed  Google Scholar 

  40. Comer JS, Roy AK, Furr JM, Gotimer K, Beidas RS, Dugas MJ, Kendall PC (2009) The intolerance of uncertainty scale for children: a psychometric evaluation. Psychol Assess 21(3):402–411. https://doi.org/10.1037/a0016719

    Article  PubMed  PubMed Central  Google Scholar 

  41. Costello AB, Osborne J (2005) Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract Assess Res Eval 10:1–9. https://doi.org/10.7275/jyj1-4868

    Article  Google Scholar 

  42. De Beer LT, Van Zyl LE (2019) ESEM code generator for Mplus. https://www.surveyhost.co.za/esem/. 10.6084/m9.figshare.8320250

  43. Muthén LK, Muthén BO (1998–2017) Mplus User’s Guide. Eighth Edition. Los Angeles, CA: Muthén & Muthén

  44. Browne MW, Cudeck R (1992) Alternative ways of assessing model fit. Sociol Methods Res 21(2):230–258. https://doi.org/10.1177/0049124192021002005

    Article  Google Scholar 

  45. Hu LT, Bentler PM (1999) Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model 6(1):1–55. https://doi.org/10.1080/10705519909540118

    Article  Google Scholar 

  46. Tabachnick BG, Fidell LS (2013) Using multivariate statistics, 6th edn. Allyn and Bacon, Needham Heights

    Google Scholar 

  47. Clark LA, Watson D (1995) Constructing validity: basic issues in objective scale development. Psychol Assess 7(3):309–319. https://doi.org/10.1037/1040-3590.7.3.309

    Article  Google Scholar 

Download references

Funding

None.

Author information

Authors and Affiliations

Authors

Contributions

AMS and DV made substantial contributions to the conception or design of the work, and to the analysis and interpretation of data. AMS acquired the data. AMS, DV, and CM drafted the work or revised it critically for important intellectual content; approved the version to be published; and agree to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Corresponding author

Correspondence to David P. Valentiner.

Ethics declarations

Competing Interests

None.

Ethical Approval

These data were collected as part of an educational module. They were subsequently deidentified and made available to the researchers for secondary analysis. Because the research involved the analysis of existing data, it was exempt from review by the authors’ institution’s Institutional Review Board.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This study was conducted as a doctoral dissertation of the first author under the supervision of the second author. An earlier version of the analyses was presented at the 57th Annual Convention of the Association for Behavioral and Cognitive Therapies in Seattle.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 51 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Martinez-Snyder, A.E., Valentiner, D.P. & Mick, C.R. Measures of Anxiety Disorder Symptoms in Adolescents. Child Psychiatry Hum Dev (2023). https://doi.org/10.1007/s10578-023-01618-6

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10578-023-01618-6

Keywords

Navigation