Adolescent Self-Reports of Social Anxiety: Can They Disagree with Objective Psychophysiological Measures and Still Be Valid?

  • Andres De Los Reyes
  • Amelia Aldao
  • Sarah A. Thomas
  • Samantha Daruwala
  • Anna J. Swan
  • Michael Van Wie
  • Katherine Goepel
  • William V. Lechner
Article

Abstract

We examined self-reported and parent-reported adolescent social anxiety symptoms and objective baseline measures of psychophysiological flexibility in 62 families. Measures completed by 31 adolescents referred for a clinical screening evaluation for social anxiety were compared to an age- and gender-matched community control sample of 31 adolescents (total sample: age range 14 to 17 years; 22 boys and 40 girls; M = 15.32 years; SD = 1.1). Clinic referred adolescents reported significantly fewer social anxiety symptoms than parents reported about adolescents. Further, for all adolescents, self-reported social anxiety symptoms exhibited low correspondence with objective psychophysiological measures. Yet, both measures uniquely discriminated between adolescents on whether they were clinic referred for a social anxiety screening. Further, adolescent self-reported social anxiety symptoms exhibited high levels of internal consistency and convergent validity. Findings indicate that researchers and practitioners should refrain from using disagreements between adolescent self-reports and other measures (e.g., parent report, objective measures) as indicators of the veracity of adolescent self-reports.

Keywords

Correspondence Disagreement Informant discrepancies Multiple informants Social anxiety 

Notes

Acknowledgment

This work was supported, in part, by an internal grant from the University of Maryland (College of Behavioral and Social Sciences Dean’s Research Initiative) awarded to Andres De Los Reyes. We are grateful to Ho-Man Yeung for his assistance with data collection and administration of training protocols for this study.

References

  1. Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213–232.PubMedCrossRefGoogle Scholar
  2. Allen, J. J. B., Chambers, A. S., & Towers, D. N. (2007). The many metrics of cardiac chronotropy: A pragmatic primer and a brief comparison of metrics. Biological Psychology, 74, 243–262.PubMedCrossRefGoogle Scholar
  3. Anderson, E. R., & Hope, D. A. (2009). The relationship among social phobia, objective and perceived physiological reactivity, and anxiety sensitivity in an adolescent population. Journal of Anxiety Disorders, 23, 18–26.PubMedCrossRefGoogle Scholar
  4. Anderson, E. R., Jordan, J. A., Smith, A. J., & Inderbitzen-Nolan, H. M. (2009). An examination of the MASC social anxiety scale in a non-referred sample of adolescents. Journal of Anxiety Disorders, 23, 1098–1105.PubMedCrossRefGoogle Scholar
  5. Baldwin, J. S., & Dadds, M. R. (2007). Reliability and validity of parent and child versions of the Multidimensional Anxiety Scale for Children in community samples. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 252–260.PubMedCrossRefGoogle Scholar
  6. Barlow, D. H. (2002). Anxiety and its disorders: The nature and treatment of anxiety and panic (2nd ed.). New York, NY US: Guilford Press.Google Scholar
  7. Bidaut-Russell, M., Reich, W., Cottler, L. B., Robins, L. N., Compton, W. M., & Mattison, R. E. (1995). The Diagnostic Interview Schedule for Children (PC-DISC v.3.0): Parents and adolescents suggest reasons for expecting discrepant answers. Journal of Abnormal Child Psychology, 23, 641–659.PubMedCrossRefGoogle Scholar
  8. Blom, E. H., Olsson, E. M., Serlachius, E., Ericson, M., & Ingvar, M. (2010). Heart rate variability (HRV) in adolescent females with anxiety disorders and major depressive disorder. Acta Pediatrica: Nurturing the Child, 99, 604–611.Google Scholar
  9. Choudhury, M. S., Pimentel, S. S., & Kendall, P. C. (2003). Childhood anxiety disorders: Parent–child (dis)agreement using a structured interview for the DSM–IV. Journal of the American Academy of Child and Adolescent Psychiatry, 42, 957–964.PubMedCrossRefGoogle Scholar
  10. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Mahwah, NJ: Erlbaum.Google Scholar
  11. Comer, J. S., & Kendall, P. C. (2004). A symptom-level examination of parent–child agreement in the diagnosis of anxious youth. Journal of the American Academy of Child and Adolescent Psychiatry, 43, 878–886.PubMedCrossRefGoogle Scholar
  12. Davis, T. E., III, & Ollendick, T. H. (2005). A critical review of empirically supported treatments for specific phobia in children: Do efficacious treatments address the components of a phobic response? Clinical Psychology: Science and Practice, 12, 144–160.CrossRefGoogle Scholar
  13. Davis, T. E., May, A., & Whiting, S. E. (2011). Evidence-based treatment of anxiety and phobia in children and adolescents: Current status and effects on the emotional response. Clinical Psychology Review, 31, 592–602.PubMedCrossRefGoogle Scholar
  14. De Los Reyes, A. (2011). Introduction to the special section: More than measurement error: Discovering meaning behind informant discrepancies in clinical assessments of children and adolescents. Journal of Clinical Child and Adolescent Psychology, 40, 1–9.PubMedCrossRefGoogle Scholar
  15. De Los Reyes, A., & Kazdin, A. E. (2004). Measuring informant discrepancies in clinical child research. Psychological Assessment, 16, 330–334.PubMedCrossRefGoogle Scholar
  16. De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131, 483–509.PubMedCrossRefGoogle Scholar
  17. De Los Reyes, A., & Kazdin, A. E. (2006). Conceptualizing changes in behavior in intervention research: The range of possible changes model. Psychological Review, 113, 554–583.PubMedCrossRefGoogle Scholar
  18. De Los Reyes, A., & Kazdin, A. E. (2008). When the evidence says, “Yes, no, and maybe so”: Attending to and interpreting inconsistent findings among evidence-based interventions. Current Directions in Psychological Science, 17, 47–51.PubMedCrossRefGoogle Scholar
  19. De Los Reyes, A., & Kazdin, A. E. (2009). Identifying evidence-based interventions for children and adolescents using the range of possible changes model: A meta-analytic illustration. Behavior Modification, 33, 583–617.Google Scholar
  20. De Los Reyes, A., & Keeton, C. P. (2011). Assessment of social anxiety. In C. A. Alfano & D. C. Beidel (Eds.), Social anxiety in adolescents and young adults: Translating developmental science into practice (pp. 225–244). Washington: American Psychological Association.CrossRefGoogle Scholar
  21. De Los Reyes, A., Henry, D. B., Tolan, P. H., & Wakschlag, L. S. (2009). Linking informant discrepancies to observed variations in young children’s disruptive behavior. Journal of Abnormal Child Psychology, 37, 637–652.PubMedCrossRefGoogle Scholar
  22. De Los Reyes, A., Alfano, C. A., & Beidel, D. C. (2010a). The relations among measurements of informant discrepancies within a multisite trial of treatments for childhood social phobia. Journal of Abnormal Child Psychology, 38, 395–404.PubMedCrossRefGoogle Scholar
  23. De Los Reyes, A., Goodman, K. L., Kliewer, W., & Reid-Quiñones, K. R. (2010b). The longitudinal consistency of mother-child reporting discrepancies of parental monitoring and their ability to predict child delinquent behaviors two years later. Journal of Youth and Adolescence, 39, 1417–1430.PubMedCrossRefGoogle Scholar
  24. De Los Reyes, A., Alfano, C. A., & Beidel, D. C. (2011a). Are clinicians’ assessments of improvements in children’s functioning “global”? Journal of Clinical Child and Adolescent Psychology, 40, 281–294.PubMedCrossRefGoogle Scholar
  25. De Los Reyes, A., Kundey, S. M. A., & Wang, M. (2011b). The end of the primary outcome measure: A research agenda for constructing its replacement. Clinical Psychology Review, 31, 829–838.PubMedCrossRefGoogle Scholar
  26. De Los Reyes, A., Youngstrom, E. A., Swan, A. J., Youngstrom, J. K., Feeny, N. C., & Findling, R. L. (2011c). Informant discrepancies in clinical reports of youths and interviewers’ impressions of the reliability of informants. Journal of Child and Adolescent Psychopharmacology, 21, 417–424.PubMedCrossRefGoogle Scholar
  27. DiBartolo, P. M., Albano, A. M., Barlow, D. H., & Heimberg, R. G. (1998). Cross-informant agreement in the assessment of social phobia in youth. Journal of Abnormal Child Psychology, 26, 213–220.PubMedCrossRefGoogle Scholar
  28. Dirks, M. A., De Los Reyes, A., Briggs-Gowan, M. J., Cella, D., & Wakschlag, L. S. (2012). Embracing not erasing contextual variability in children’s behavior: Theory and utility in the selection and use of measures and informants in the assessment of developmental psychopathology. Journal of Child Psychology and Psychiatry, 53, 558–574.Google Scholar
  29. Dozois, D. A., Dobson, K. S., & Ahnberg, J. L. (1998). A psychometric evaluation of the Beck Depression Inventory–II. Psychological Assessment, 10, 83–89.CrossRefGoogle Scholar
  30. Ewing, D. J., Neilson, J. M. M., & Travis, P. (1984). New method for assessing cardiac parasympathetic activity using 24-hour electrocardiograms. British Heart Journal, 52, 396–402.PubMedCrossRefGoogle Scholar
  31. Farrell, A. D., Kung, E. M., White, K. S., & Valois, R. (2000). The structure of self-reported aggression, drug use, and delinquent behaviors during early adolescence. Journal of Clinical Child Psychology, 29, 282–292.PubMedCrossRefGoogle Scholar
  32. First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (2002). Structured Clinical Interview for DSM-IV-TR Axis I Disorders, Research Version, Non-patient Edition (SCID-I/NP). New York: Biometrics Research, New York State Psychiatric Institute.Google Scholar
  33. Friedman, B. H. (2007). An autonomic flexibility-neurovisceral integration model of anxiety and cardiac vagal tone. Biological Psychology, 74, 185–199.PubMedCrossRefGoogle Scholar
  34. Greaves-Lord, K., Tulen, J., Dietrich, A., Sondeijker, F., van Roon, A., Oldehinkel, A., Ormel, J., Verhulst, F. & Huizink, A. (2009). Reduced autonomic flexibility as a predictor for future anxiety in girls from the general population: The TRAILS study. Psychiatry Research, 179, 187–193.CrossRefGoogle Scholar
  35. Grills, A. E., & Ollendick, T. H. (2003). Multiple informant agreement and the Anxiety Disorders Interview Schedule for Parents and Children. Journal of the American Academy of Child and Adolescent Psychiatry, 42, 30–40.PubMedCrossRefGoogle Scholar
  36. Hane, A., & Barrios. E.S. (2011). Mother and child interpretations of threat in ambiguous situations: Relations with child anxiety and automatic responding. Journal of Family Psychology, 25, 644–652.Google Scholar
  37. Hanley, J. A., & McNeil, B. J. (1983). A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology, 148, 839–843.PubMedGoogle Scholar
  38. Hartley, A. G., Zakriski, A. L., & Wright, J. C. (2011). Probing the depths of informant discrepancies: Contextual influences on divergence and convergence. Journal of Clinical Child and Adolescent Psychology, 40, 54–66.PubMedCrossRefGoogle Scholar
  39. Hastings, P. D., Nuselovici, J. N., Klimes-Dougan, B., Kendziora, K. T., Usher, B. A., Ho, M. R., & Zahn-Waxler, C. (2009). Dysregulated coherence of subjective and cardiac emotional activation in adolescents with internalizing and externalizing problems. Journal of Child Psychology and Psychiatry, 50, 1348–1356.PubMedCrossRefGoogle Scholar
  40. Hawley, K. M., & Weisz, J. R. (2003). Child, parent, and therapist (dis)agreement on target problems in outpatient therapy: The therapist’s dilemma and its implications. Journal of Consulting and Clinical Psychology, 71, 62–70.PubMedCrossRefGoogle Scholar
  41. Hodgson, R., & Rachman, S. (1974). Desynchrony in measures of fear. Behaviour Research and Therapy, 12, 319–326.PubMedCrossRefGoogle Scholar
  42. Hunsley, J., & Lee, C. M. (2010). Introduction to clinical psychology. Hoboken: Wiley & Sons.Google Scholar
  43. Hunsley, J., & Mash, E. J. (2007). Evidence-based assessment. Annual Review of Clinical Psychology, 3, 29–51.PubMedCrossRefGoogle Scholar
  44. IBM Corporation. (2009). IBM SPSS Data Collection (Version 5.6) [Computer Software]. Somers, NY: IBM Corporation.Google Scholar
  45. Jansen, R. G., Wiertz, L. F., Meyer, E. S., & Noldus, L. P. J. J. (2003). Reliability analysis of observational data: Problems, solutions, and software implementation. Behavior Research Methods, Instruments, & Computers, 35, 391–399.CrossRefGoogle Scholar
  46. Kessler, R. C., Adler, L. A., Gruber, M. J., Sarawate, C. A., Spencer, T., & van Brunt, D. L. (2007). Validity of the World Health Organization Adult ADHD Self-Report Scale (ASRS) screener in a representative sample of health plan members. International Journal of Methods in Psychiatric Research, 16, 52–65.PubMedCrossRefGoogle Scholar
  47. Kraemer, H. C., Measelle, J. R., Ablow, J. C., Essex, M. J., Boyce, W. T., & Kupfer, D. J. (2003). A new approach to integrating data from multiple informants in psychiatric assessment and research: Mixing and matching contexts and perspectives. The American Journal of Psychiatry, 160, 1566–1577.PubMedCrossRefGoogle Scholar
  48. Kramer, T. L., Phillips, S. D., Hargis, M. B., Miller, T. L., Burns, B. J., & Robbins, J. M. (2004). Disagreement between parent and adolescent reports of functional impairment. Journal of Child Psychology and Psychiatry, 45, 248–259.PubMedCrossRefGoogle Scholar
  49. Laird, R. D., & Weems, C. F. (2011). The equivalence of regression models using difference scores and models using separate scores for each informant: Implications for the study of informant discrepancies. Psychological Assessment, 23, 388–397.PubMedCrossRefGoogle Scholar
  50. Loeber, R., Green, S. M., & Lahey, B. B. (1990). Mental health professionals’ perception of the utility of children, mothers, and teachers as informants of childhood psychopathology. Journal of Clinical Child Psychology, 19, 136–143.CrossRefGoogle Scholar
  51. March, J. S. (1997). Manual for the Multidimensional Anxiety Scale for Children (MASC). Toronto: Multi-Health Systems.Google Scholar
  52. Masia-Warner, C., Storch, E. A., Pincus, D. B., Klein, R. G., Heimberg, R. G., & Liebowitz, M. R. (2003). The Liebowitz Social Anxiety Scale for Children and Adolescents: An Initial psychometric investigation. Journal of American Academy of Child and Adolescence Psychiatry, 42, 1076–1084.CrossRefGoogle Scholar
  53. Mauss, I. B., Levenson, R. W., McCarter, L., Wilherlm, F. H., & Gross, J. J. (2005). The tie that binds? Coherence among emotion experience, behavior, and physiology. Emotion, 5, 175–190.PubMedCrossRefGoogle Scholar
  54. Monk, C., Kovelenko, P., Ellman, L. M., Sloan, R. P., Bagiella, E., Gorman, J. M., & Pine, D. S. (2001). Enhanced stress reactivity in pediatric anxiety disorders: Implications for future cardiovascular health. The International Journal of Neuropsychopharmacology, 4, 199–206.PubMedCrossRefGoogle Scholar
  55. Muris, P., Merckelbach, H., Ollendick, T. H., King, N. J., & Bogie, N. (2001). Children’s nighttime fears: parent–child ratings of frequency, content, origins, coping behaviors and severity. Behaviour Research and Therapy, 39, 13–28.PubMedCrossRefGoogle Scholar
  56. Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.Google Scholar
  57. Pelham, W. E., Fabiano, G. A., & Massetti, G. M. (2005). Evidence-based assessment of attention deficit hyperactivity disorder in children and adolescents. Journal of Clinical Child and Adolescent Psychology, 34, 449–476.PubMedCrossRefGoogle Scholar
  58. Porges, S. W. (2007). The Polyvagal perspective. Biological Psychology, 74, 116–143.PubMedCrossRefGoogle Scholar
  59. Schniering, C. A., Hudson, J. L., & Rapee, R. M. (2000). Issues in the diagnosis and assessment of anxiety disorders in children and adolescents. Clinical Psychology Review, 20, 453–478.PubMedCrossRefGoogle Scholar
  60. Silverman, W. K., & Ollendick, T. H. (2005). Evidence-based assessment of anxiety and its disorders in children and adolescents. Journal of Clinical Child and Adolescent Psychology, 34, 380–411.PubMedCrossRefGoogle Scholar
  61. Swets, J. A. (1988). Measuring the accuracy of diagnostic systems. Science, 240, 1285–1293.PubMedCrossRefGoogle Scholar
  62. Tabachnick, B., & Fidell, L. S. (2001). Using multivariate statistics (4th ed.). Boston: Allyn and Bacon.Google Scholar
  63. Thayer, J. F., Friedman, B. H., & Borkovec, T. D. (1996). Autonomic characteristics of generalized anxiety disorder and worry. Biological Psychiatry, 39, 255–266.PubMedCrossRefGoogle Scholar
  64. U.S. Census Bureau. (2010). State and county quickfacts: Washington, DC. Retrieved June 28, 2011, from http://quickfacts.census.gov/qfd/states/11000.html
  65. van Gastel, W., & Ferdinand, R. F. (2008). Screening capacity of the Multidimensional Anxiety Scale for Children (MASC) for DSM-IV anxiety disorders. Depression and Anxiety, 25, 1046–1052.PubMedCrossRefGoogle Scholar
  66. Weisz, J. R., Jensen Doss, A., & Hawley, K. M. (2005). Youth psychotherapy outcome research: A review and critique of the evidence base. Annual Review of Psychology, 56, 337–363.PubMedCrossRefGoogle Scholar
  67. Yeragani, V. K., Pohl, R., Berger, R., Balon, R., Ramesh, C., Glitz, D. G., Srinivasan, P., & Weinberg, P. (1993). Decreased heart rate variability in panic disorder patients: A study of power spectral analysis of heart rate. Psychiatry Research, 46, 89–103.PubMedCrossRefGoogle Scholar
  68. Zweig, M. H., & Campbell, G. (1993). Receiver-operating characteristic (ROC) plots: A fundamental evaluation tool in clinical medicine. Clinical Chemistry, 39, 561–577.PubMedGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2012

Authors and Affiliations

  • Andres De Los Reyes
    • 1
  • Amelia Aldao
    • 2
  • Sarah A. Thomas
    • 1
  • Samantha Daruwala
    • 1
  • Anna J. Swan
    • 1
  • Michael Van Wie
    • 1
  • Katherine Goepel
    • 1
  • William V. Lechner
    • 3
  1. 1.Comprehensive Assessment and Intervention Program, Department of PsychologyUniversity of Maryland at College ParkCollege ParkUSA
  2. 2.Department of PsychologyYale UniversityNew HavenUSA
  3. 3.Department of PsychologyOklahoma State UniversityStillwaterUSA

Personalised recommendations