Abstract
This study examines select psychometric properties (i.e., internal reliability, and factorial, convergent, discriminant, and criterion validity) of three commonly-used measures of anxiety disorder symptoms in adolescents in the context of multi-trait, multi-method matrix analyses. A sample of 331 adolescents (age M = 17.1; 75.3% white; 71.0% female) completed three self-report scales that assess symptoms of separation anxiety, social anxiety, panic, and generalized anxiety, as well as measures of depression, experiential avoidance, and intolerance of uncertainty. Measures of panic disorder symptoms showed poor factorial, convergent, and discriminant validity. A multi-trait, multi-method matrix model to understand the relationships among the measures of separation anxiety, social anxiety, and generalized anxiety symptoms provided a reasonable fit to the data. Measures of separation anxiety showed poor discriminant and criterion validity, suggesting limited relevance of separation anxiety in this adolescent sample. Measures of social anxiety generally showed evidence of adequate-to-good factorial, convergent, and discriminant validity. Measures of generalized anxiety showed adequate –to-good factorial and convergent validity, and poor-to-adequate discriminant validity. The associations of measures of social and generalized anxiety with measures of depression, experiential avoidance, and intolerance of uncertainty were at least partially independent of method variance. The findings of this study add to the growing literature that evaluates the strengths and limitations of these scales for clinical practice and research.
Similar content being viewed by others
Data Availability
Contact the second author, David Valentiner (dvalentiner@niu.edu) for access to the data.
References
Polanczyk GV, Salum GA, Sugaya LS, Caye A, Rohde LA (2015) Annual research review: a meta-analysis of the worldwide prevalence of mental disorders in children and adolescents. J Child Psychol Psychiatry 56(3):345–365. https://doi.org/10.1111/jcpp.12381
Kessler RC, Avenevoli S, Costello EJ, Georgiades K, Green JG, Gruber MJ, Sampson NA (2012) Prevalence, persistence, and sociodemographic correlates of DSM-IV disorders in the national comorbidity survey replication adolescent supplement. Arch Gen Psychiatry 69(4):372–380. https://doi.org/10.1001/archgenpsychiatry.2011.160
Essau CA, Olaya B, Ollendick TH (2013) Classification of anxiety disorders in children and adolescents. In: Essau CA, Ollendick TH (eds) The Wiley-Blackwell handbook of the treatment of childhood and adolescent anxiety. Wiley, Hoboken, pp 1–21
Essau CA, Lewinsohn PM, Olaya B, Seeley JR (2014) Anxiety disorders in adolescents and psychosocial outcomes at age 30. J Affect Disord 163:125–132. https://doi.org/10.1016/j.jad.2013.12.033
Pella JE, Slade EP, Pikulski PJ, Ginsburg GS (2020) Pediatric anxiety disorders: a cost of illness analysis. J Abnorm Child Psychol 48(4):551–559. https://doi.org/10.1007/s10802-020-00626-7
Hunsley J, Mash EJ (2018) Developing criteria for evidence-based assessment: an introduction to assessments that work. In: Hunsley J, Mash EJ (eds) A guide to assessments that work, 2nd edn. Oxford University Press, New York, pp 3–16
Birmaher B, Khetarpal S, Brent D, Cully M, Balach L, Kaufman J, Neer SM (1997) The screen for child anxiety related emotional disorders (SCARED): scale construction and psychometric characteristics. J Am Acad Child Adolesc Psychiatry 36(4):545–553. https://doi.org/10.1097/00004583-199704000-00018
Spence SH (1998) A measure of anxiety symptoms among children. Behav Res Ther 36(5):545–566. https://doi.org/10.1016/S0005-7967(98)00034-5
Muris P, Simon E, Lijphart H, Bos A, Hale W, Schmeitz K (2017) The youth anxiety measure for DSM-5 (YAM-5): development and first psychometric evidence of a new scale for assessing anxiety disorders symptoms of children and adolescents. Child Psychiatry Hum Dev 48(1):1–17. https://doi.org/10.1007/s10578-016-0648-1
American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders: DSM-5. American Psychiatric Association, Arlington
Foster SL, Cone JD (1995) Validity issues in clinical assessment. Psychol Assess 7(3):248–260. https://doi.org/10.1037/1040-3590.7.3.248
Birmaher B, Brent DA, Chiappetta L, Bridge J, Monga S, Baugher M (1999) Psychometric properties of the screen for child anxiety related emotional disorders (SCARED): a replication study. J Am Acad Child Adolesc Psychiatry 38(10):1230–1236. https://doi.org/10.1097/00004583-199910000-00011
Bowers ME, Reider LB, Morales S, Buzzell GA, Miller N, Troller-Renfree SV, Fox NA (2020) Differences in parent and child report on the screen for child anxiety-related emotional disorders (SCARED): implications for investigations of social anxiety in adolescents. J Abnorm Child Psychol 48(4):561–571. https://doi.org/10.1007/s10802-019-00609-3
Boyd RC, Ginsburg GS, Lambert SF, Cooley MR, Campbell KD (2003) Screen for child anxiety related emotional disorders (SCARED): psychometric properties in an African-American parochial high school sample. J Am Acad Child Adolesc Psychiatry 42(10):1188–1196. https://doi.org/10.1097/01.chi.0000082033.88099.8d
Rappaport BI, Pagliaccio D, Pine DS, Klein DN, Jarcho JM (2017) Discriminant validity, diagnostic utility, and parent-child agreement on the screen for child anxiety related emotional disorders (SCARED) in treatment-and non-treatment-seeking youth. J Anxiety Disord 51:22–31. https://doi.org/10.1016/j.janxdis.2017.08.006
Runyon K, Chesnut SR, Burley H (2018) Screening for childhood anxiety: a meta-analysis of the screen for child anxiety related emotional disorders. J Affect Disord 240:220–229. https://doi.org/10.1016/j.jad.2018.07.049
Wren FJ, Berg EA, Heiden LA, Kinnamon CJ, Ohlson LA, Bridge JA, Bernal MP (2007) Childhood anxiety in a diverse primary care population: parent-child reports, ethnicity and SCARED factor structure. J Am Acad Child Adolesc Psychiatry 46(3):332–340. https://doi.org/10.1097/chi.0b013e31802f1267
Brown-Jacobsen AM, Wallace DP, Whiteside SP (2011) Multimethod, multi-informant agreement, and positive predictive value in the identification of child anxiety disorders using the SCAS and ADIS-C. Assessment 18(3):382–392. https://doi.org/10.1177/1073191110375792
Orgiles M, Fernández-Martínez I, Guillen-Riquelme A, Espada JP, Essau CA (2016) A systematic review of the factor structure and reliability of the spence children’s anxiety scale. J Affect Disord 190:333–340. https://doi.org/10.1016/j.jad.2015.09.055
Ramme R (n.d.) Spence children’s anxiety scale: an overview of psychometric findings. Spence Children’s Anxiety Scale. https://www.scaswebsite.com/docs/Ramme%20SCAS%20Psychomet%20evidence.pdf
Spence SH (n.d.) The child report version of the spence children’s anxiety scale. Spence Children’s Anxiety Scale. https://www.scaswebsite.com/1_2_.html
Spence SH (1997) Structure of anxiety symptoms among children: a confirmatory factor-analytic study. J Abnorm Psychol 106(2):280. https://doi.org/10.1037/0021-843X.106.2.280
Spence SH, Barrett PM, Turner CM (2003) Psychometric properties of the spence children’s anxiety scale with young adolescents. J Anxiety Disord 17(6):605–625. https://doi.org/10.1016/S0887-6185(02)00236-0
Whiteside SP, Brown AM (2008) Exploring the utility of the spence children’s anxiety scales parent-and child-report forms in a North American sample. J Anxiety Disord 22(8):1440–1446. https://doi.org/10.1016/j.janxdis.2008.02.006
Garcia-Lopez LJ, Saez-Castillo AJ, Fuentes-Rodriguez G (2017) Psychometric properties of the youth anxiety measure for DSM-5, Part I (YAM-5-I) in a community sample of Spanish-speaking adolescents. J Affect Disord 208:455–459. https://doi.org/10.1016/j.jad.2016.10.045
Muris P, Mannens J, Peters L, Meesters C (2017) The youth anxiety measure for DSM-5 (YAM-5): correlations with anxiety, fear, and depression scales in non-clinical children. J Anxiety Disord 51:72–78. https://doi.org/10.1016/j.janxdis.2017.06.001
Simon E, Bos AE, Verboon P, Smeekens S, Muris P (2017) Psychometric properties of the youth anxiety measure for DSM-5 (YAM-5) in a community sample. Personal Individ Differ 116:258–264. https://doi.org/10.1016/j.paid.2017.04.058
Hayes SC, Wilson KG, Gifford EV, Follette VM, Strosahl K (1996) Experiential avoidance and behavioral disorders: a functional dimensional approach to diagnosis and treatment. J Consult Clin Psychol 64(6):1152–1168. https://doi.org/10.1037/0022-006X.64.6.1152
Hayes-Skelton SA, Eustis EH (2020) Experiential avoidance. In: Abramowitz JS, Blakey SM (eds) Clinical handbook of fear and anxiety: maintenance processes and treatment mechanisms. American Psychological Association, Washington, pp 115–131. https://doi.org/10.1037/0000150-007
Papachristou H, Theodorou M, Neophytou K, Panayiotou G (2018) Community sample evidence on the relations among behavioural inhibition system, anxiety sensitivity, experiential avoidance, and social anxiety in adolescents. J Contextual Behav Sci 8:36–43. https://doi.org/10.1016/j.jcbs.2018.03.001
Venta A, Sharp C, Hart J (2012) The relation between anxiety disorder and experiential avoidance in inpatient adolescents. Psychol Assess 24(1):240–248. https://doi.org/10.1037/a0025362
Shimoda Y, Ishizu K, Ohtsuki T (2018) The reciprocal relations between experiential avoidance and social anxiety among early adolescents: a prospective cohort study. J Contextual Behav Sci 10:115–119. https://doi.org/10.1016/j.jcbs.2018.10.001
Carleton RN (2016) Into the unknown: a review and synthesis of contemporary models involving uncertainty. J Anxiety Disord 39:30–43. https://doi.org/10.1016/j.janxdis.2016.02.007
McEvoy PM, Hyett MP, Shihata S, Price JE, Strachan L (2019) The impact of methodological and measurement factors on transdiagnostic associations with intolerance of uncertainty: a meta-analysis. Clin Psychol Rev 73:101778. https://doi.org/10.1016/j.cpr.2019.101778
Osmanağaoğlu N, Creswell C, Dodd HF (2018) Intolerance of uncertainty, anxiety, and worry in children and adolescents: a meta-analysis. J Affect Disord 225:80–90. https://doi.org/10.1016/j.jad.2017.07.035
Laugesen N, Dugas MJ, Bukowski WM (2003) Understanding adolescent worry: the application of a cognitive model. J Abnorm Child Psychol 31(1):55–64. https://doi.org/10.1023/a:1021721332181
Boelen PA, Vrinssen I, van Tulder F (2010) Intolerance of uncertainty in adolescents: correlations with worry, social anxiety, and depression. J Nerv Ment Dis 198(3):194–200. https://doi.org/10.1097/NMD.0b013e3181d143de
Angold A, Costello EJ, Messer SC, Pickles A, Winder F, Silver D (1995) The development of a short questionnaire for use in epidemiological studies of depression in children and adolescents. Int J Methods Psychiatr Res 5:237–249
Greco LA, Lambert W, Baer RA (2008) Psychological inflexibility in childhood and adolescence: development and evaluation of the avoidance and fusion questionnaire for youth. Psychol Assess 20(2):93–102. https://doi.org/10.1037/1040-3590.20.2.93
Comer JS, Roy AK, Furr JM, Gotimer K, Beidas RS, Dugas MJ, Kendall PC (2009) The intolerance of uncertainty scale for children: a psychometric evaluation. Psychol Assess 21(3):402–411. https://doi.org/10.1037/a0016719
Costello AB, Osborne J (2005) Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract Assess Res Eval 10:1–9. https://doi.org/10.7275/jyj1-4868
De Beer LT, Van Zyl LE (2019) ESEM code generator for Mplus. https://www.surveyhost.co.za/esem/. 10.6084/m9.figshare.8320250
Muthén LK, Muthén BO (1998–2017) Mplus User’s Guide. Eighth Edition. Los Angeles, CA: Muthén & Muthén
Browne MW, Cudeck R (1992) Alternative ways of assessing model fit. Sociol Methods Res 21(2):230–258. https://doi.org/10.1177/0049124192021002005
Hu LT, Bentler PM (1999) Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model 6(1):1–55. https://doi.org/10.1080/10705519909540118
Tabachnick BG, Fidell LS (2013) Using multivariate statistics, 6th edn. Allyn and Bacon, Needham Heights
Clark LA, Watson D (1995) Constructing validity: basic issues in objective scale development. Psychol Assess 7(3):309–319. https://doi.org/10.1037/1040-3590.7.3.309
Funding
None.
Author information
Authors and Affiliations
Contributions
AMS and DV made substantial contributions to the conception or design of the work, and to the analysis and interpretation of data. AMS acquired the data. AMS, DV, and CM drafted the work or revised it critically for important intellectual content; approved the version to be published; and agree to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.
Corresponding author
Ethics declarations
Competing Interests
None.
Ethical Approval
These data were collected as part of an educational module. They were subsequently deidentified and made available to the researchers for secondary analysis. Because the research involved the analysis of existing data, it was exempt from review by the authors’ institution’s Institutional Review Board.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This study was conducted as a doctoral dissertation of the first author under the supervision of the second author. An earlier version of the analyses was presented at the 57th Annual Convention of the Association for Behavioral and Cognitive Therapies in Seattle.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Martinez-Snyder, A.E., Valentiner, D.P. & Mick, C.R. Measures of Anxiety Disorder Symptoms in Adolescents. Child Psychiatry Hum Dev (2023). https://doi.org/10.1007/s10578-023-01618-6
Accepted:
Published:
DOI: https://doi.org/10.1007/s10578-023-01618-6