Abstract
Discrepancies between informants’ reports of children’s behavior are robustly observed in clinical child research and have important implications for interpreting the outcomes of controlled treatment trials. However, little is known about the basic psychometric properties of these discrepancies. This study examined the relation between parent-child reporting discrepancies on measures of child social phobia symptoms, administered before and after treatment for social phobia. Participants included a clinic sample of 81 children (7–16 years old [M = 11.75, SD = 2.57]; 39 girls, 42 boys) and their parents receiving treatment as part of a multisite controlled trial. Pretreatment parent-child reporting discrepancies predicted parent-child discrepancies at posttreatment, and these relations were not better accounted for by the severity of the child’s pretreatment primary diagnosis. Further, treatment responder status moderated this relation: Significant relations were identified for treatment non-responders and not for treatment responders. Overall, findings suggest that informant discrepancies can be reliably employed to measure individual differences over the course of controlled treatment trials. These data provide additional empirical support for recent work suggesting that informant discrepancies can meaningfully inform understanding of treatment response as well as variability in treatment outcomes.
Similar content being viewed by others
Notes
We conducted exploratory analyses to examine whether the 81 parents and children examined in this study differed from the rest of the sample at pretreatment as a function of demographic (e.g., child age, gender, ethnicity, socioeconomic status), pretreatment functioning (e.g., primary diagnosis type, clinical severity of primary diagnosis, broadband internalizing and externalizing problems [Child Behavior Checklist; Achenbach 1991], SPAIC scores), or treatment characteristics (e.g., treatment condition, treatment site). We conducted a large number of tests (n = 13) and did not have a priori hypotheses to advance. Thus, we set a pre-defined bonferroni-corrected p-value threshold for these tests of 0.004 (i.e., .05/13). Across these 13 tests, none of these factors evidenced a significant relation to inclusion/exclusion into this study.
We conducted exploratory analyses to examine whether measures of parent-child reporting discrepancies at either pre- or posttreatment varied as a function of demographic (e.g., child age, gender, ethnicity, socioeconomic status), pretreatment functioning (e.g., primary diagnosis type, clinical severity of primary diagnosis, broadband internalizing and externalizing problems [Child Behavior Checklist; Achenbach 1991]), or treatment characteristics (e.g., treatment condition, treatment site, treatment attrition, treatment response status). We conducted a large number of tests (n = 30) and did not have a priori hypotheses to advance. Thus, we set a pre-defined bonferroni-corrected p-value threshold of 0.001 (i.e., .05/30). Across these 30 tests, none of these factors had a significant relationship to either pre- or posttreatment reporting discrepancies.
References
Achenbach, T. M. (1991). Manual for the Child Behavior Checklist 14–18 and 1991 profile. Burlington: University of Vermont.
Achenbach, T. M. (2006). As others see us: Clinical and research implications of cross-informant correlations for psychopathology. Current Directions in Psychological Science, 15, 94–98.
Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213–232.
American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed.), text revision (DSM-IV-TR). Washington, DC: Author.
Beidel, D. C., Turner, S. M., & Morris, T. L. (1995). A new inventory to assess childhood social anxiety and phobia: The Social Phobia and Anxiety Inventory for Children. Psychological Assessment, 7, 73–79.
Beidel, D. C., Turner, S. M., & Morris, T. L. (2000). Behavioral treatment of childhood social phobia. Journal of Consulting and Clinical Psychology, 68, 1072–1080.
Beidel, D. C., Turner, S. M., Sallee, F. R., Ammerman, R. T., Crosby, L. A., & Pathak, S. (2007). SET-C versus fluoxetine in the treatment of childhood social phobia. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 1622–1632.
Birmaher, B., Axelson, D. A., Monk, K., Kalas, C., Clark, D. B., Ehmann, M., et al. (2003). Fluoxetine for the treatment of childhood anxiety disorders. Journal of the American Academy of Child and Adolescent Psychiatry, 42, 415–423.
Choudhury, M. S., Pimentel, S. S., & Kendall, P. C. (2003). Childhood anxiety disorders: Parent- child (dis)agreement using a structured interview for the DSM-IV. Journal of the American Academy of Child & Adolescent Psychiatry, 42, 957–964.
Clancy, C. A., McGrath, P. J., & Oddson, B. E. (2005). Pain in children and adolescents with spina bifida. Developmental Medicine and Child Neurology, 47, 27–34.
Comer, J. S., & Kendall, P. C. (2004). A symptom-level examination of parent-child agreement in the diagnosis of anxious youth. Journal of the American Academy of Child and Adolescent Psychiatry, 43, 878–886.
De Los Reyes, A., & Kazdin, A. E. (2004). Measuring informant discrepancies in clinical child research. Psychological Assessment, 16, 330–334.
De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131, 483–509.
De Los Reyes, A., & Kazdin, A. E. (2006a). Conceptualizing changes in behavior in intervention research: The range of possible changes model. Psychological Review, 113, 554–583.
De Los Reyes, A., & Kazdin, A. E. (2006b). Informant discrepancies in assessing child dysfunction relate to dysfunction within mother-child interactions. Journal of Child and Family Studies, 15, 643–661.
De Los Reyes, A., & Kazdin, A. E. (2008). When the evidence says, “Yes, no, and maybe so”: Attending to and interpreting inconsistent findings among evidence-based interventions. Current Directions in Psychological Science, 17, 47–51.
De Los Reyes, A., & Kazdin, A.E. (2009). Identifying evidence-based interventions for children and adolescents using the range of possible changes model: A meta-analytic illustration. Behavior Modification, 33, 583–617.
De Los Reyes, A., & Prinstein, M. J. (2004). Applying depression-distortion hypotheses to the assessment of peer victimization in adolescents. Journal of Clinical Child and Adolescent Psychology, 33, 325–335.
De Los Reyes, A., Goodman, K. L., Kliewer, W., & Reid-Quiñones, K. R. (2008). Whose depression relates to discrepancies? Testing relations between informant characteristics and informant discrepancies from both informants’ perspectives. Psychological Assessment, 20, 139–149.
De Los Reyes, A., Henry, D. B., Tolan, P. H., & Wakschlag, L. S. (2009a). Linking informant discrepancies to observed variations in young children’s disruptive behavior. Journal of Abnormal Child Psychology, 37, 637–652.
De Los Reyes, A., Youngstrom, E. A., Pabon, S. C., Youngstrom, J. K., Feeny, N. C., & Findling, R. L. (invited submission, 2009b). Testing consistencies across and correlates of multiple informant discrepancies in clinical assessments of youths age 11 to 17 years. Manuscript submitted for special section for the Journal of Clinical Child and Adolescent Psychology.
Ferdinand, R. F., van der Ende, J., & Verhulst, F. C. (2004). Parent-adolescent disagreement regarding psychopathology in adolescents from the general population as a risk factor for adverse outcome. Journal of Abnormal Psychology, 113, 198–206.
Grills, A. E., & Ollendick, T. H. (2003). Multiple informant agreement and the Anxiety Disorders Interview Schedule for Parents and Children. Journal of the American Academy of Child & Adolescent Psychiatry, 42, 30–40.
Guion, K., Mrug, S., & Windle, M. (2009). Predictive value of informant discrepancies in reports of parenting: Relations to early adolescents’ adjustment. Journal of Abnormal Child Psychology, 37, 17–30.
Guy, W. (1976). ECDEU Assessment Manual for Psychopharmacology. Washington, DC: DHEW.
Hawley, K. M., & Weisz, J. R. (2003). Child, parent, and therapist (dis)agreement on target problems in outpatient therapy: The therapist’s dilemma and its implications. Journal of Consulting and Clinical Psychology, 71, 62–70.
Holmbeck, G. N. (2002). Post-hoc probing of significant moderational and mediational effects in studies of pediatric populations. Journal of Pediatric Psychology, 27, 87–96.
Israel, P., Thomsen, P. H., Langeveld, J. H., & Stormark, K. M. (2007). Parent-youth discrepancy in the assessment and treatment of youth in usual clinical care setting: Consequences to parent involvement. European Child & Adolescent Psychiatry, 16, 138–148.
Johnson, M. K., Hashtroudi, S., & Lindsay, D. S. (1993). Source monitoring. Psychological Bulletin, 114, 3–28.
Jones, E. E., & Nisbett, R. E. (1972). The actor and the observer: Divergent perceptions of the causes of behavior. In E. E. Jones, D. E. Kanouse, H. H. Kelly, R. E. Nisbett, S. Valins, & B. Weiner (Eds.), Attribution: Perceiving the causes of behavior (pp. 79–94). Morristown, NJ: General Learning Press.
Kazdin, A. E. (2003). Research design in clinical psychology (4th ed.). Boston: Allyn & Bacon.
Kendall, P. C. (1994). Treating anxiety disorders in children: Results of a randomized clinical trial. Journal of Consulting and Clinical Psychology, 62, 100–110.
Koenig, K., De Los Reyes, A., Cicchetti, D., Scahill, L., & Klin, A. (2009). Group intervention to promote social skills in school-age children with pervasive developmental disorders: Reconsidering efficacy. Journal of Autism and Developmental Disorders, 39, 1163–1172.
Malle, B. F. (2006). The actor-observer asymmetry in attribution: A (surprising) meta-analysis. Psychological Bulletin, 132, 895–919.
Mash, E. J., & Terdal, L. G. (1988). Behavioral assessment of child and family disturbance. In E. J. Mash and L. G. Terdal (Eds.), Behavioral assessment of childhood disorders (2nd ed., pp. 3–65). New York: Guilford.
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.
Owens, J. S., Goldfine, M. E., Evangelista, N. M., Hoza, B., & Kaiser, N. M. (2007). A critical review of self-perceptions and the positive illusory bias in children with ADHD. Clinical Child and Family Psychology Review, 10, 335–351.
Panichelli-Mindel, S. M., Flannery-Schroader, E., Kendall, P. C., & Angelosante, A. G. (2005). Disclosure of distress among anxiety-disordered youth: Differences in treatment outcome. Journal of Anxiety Disorders, 19, 403–422.
Pasupathi, M. (2001). The social construction of the personal past and its implications for adult development. Psychological Bulletin, 127, 651–672.
Pelton, J., & Forehand, R. (2001). Discrepancy between mother and child perceptions of their relationship: I. Consequences for adolescents considered within the context of parental divorce. Journal of Family Violence, 16, 1–15.
Pelton, J., Steele, R. G., Chance, M. W., & Forehand, R. (2001). Discrepancy between mother and child perceptions of their relationship: II. Consequences for children considered within the context of maternal physical illness. Journal of Family Violence, 16, 17–35.
Rapee, R. M., Barrett, P. M., Dadds, M. R., & Evans, L. (1994). Reliability of the DSM-III-R childhood anxiety disorders using structured interview: Interrater and parent-child agreement. Journal of the American Academy of Child & Adolescent Psychiatry, 33, 984–992.
Rogosa, D., Brandt, D., & Zimowski, M. (1982). A growth curve approach to the measurement of change. Psychological Bulletin, 92, 726–748.
Rogosa, D. R., & Willett, J. B. (1983). Demonstrating the reliability of the difference score in the measurement of change. Journal of Educational Measurement, 20, 335–343.
Safford, S. M., Kendall, P. C., Flannery-Schroeder, E., Webb, A., & Sommer, H. (2005). A longitudinal look at parent-child diagnostic agreement in youth treated for anxiety disorders. Journal of Clinical Child and Adolescent Psychology, 34, 747–757.
Shaffer, D., Gould, M. S., Brasic, J., Ambrosini, P., Fisher, P., Bird, H., et al. (1983). A children’s global assessment scale (CGAS). Archives of General Psychiatry, 40, 1228–1231.
Silverman, W. K., & Albano, A. M. (1996). The Anxiety Disorders Interview Schedule for Children (ADIS-C/P). San Antonio, TX: Psychological Corporation.
Silverman, W. K., Kurtines, W. M., Ginsburg, G. S., Weems, C. F., Lumpkin, P. W., & Carmichael, D. H. (1999a). Treating anxiety disorders in children with group cognitive-behavioral therapy: A randomized clinical trial. Journal of Consulting and Clinical Psychology, 67, 995–1003.
Silverman, W. K., Kurtines, W. M., Ginsburg, G. S., Weems, C. F., Rabian, B., & Serafini, L. T. (1999b). Contingency management, self-control, and education support in the treatment of childhood phobic disorders: A randomized clinical trial. Journal of Consulting and Clinical Psychology, 67, 675–687.
Silverman, W. K., & Ollendick, T. H. (2005). Evidence-based assessment of anxiety and its disorders in children and adolescents. Journal of Clinical Child and Adolescent Psychology, 34, 380–411.
Treutler, C. M., & Epkins, C. C. (2003). Are discrepancies among child, mother, and father reports on children’s behavior related to parents’ psychological symptoms and aspects of parent-child relationships? Journal of Abnormal Child Psychology, 31, 13–27.
Wagner, K. D., Berard, R., Stein, M. B., Wetherhold, E., Carpenter, D. J., Perera, P., et al. (2004). A multicenter, randomized, double-blind, placebo-controlled trial of paroxetine in children and adolescents with social anxiety disorder. Archives of General Psychiatry, 61, 1153–1162.
Weems, C. F., Costa, N. M., Watts, S. E., Taylor, L. K., & Cannon, M. F. (2007). Cognitive errors, anxiety sensitivity, and anxiety control beliefs: Their unique and specific associations with childhood anxiety symptoms. Behavior Modification, 31, 174–201.
Weems, C. F., Taylor, L. K., Marks, A. B., & Varela, R. E. (in press). Anxiety sensitivity in childhood and adolescence: Parent reports and factors that influence associations with child reports. Cognitive Therapy and Research.
Weisz, J. R., Jensen Doss, A., & Hawley, K. M. (2005). Youth psychotherapy outcome research: A review and critique of the evidence base. Annual Review of Psychology, 56, 337–363.
Weisz, J. R., McCarty, C. A., & Valeri, S. M. (2006). Effects of psychotherapy for depression in children and adolescents: A meta-analysis. Psychological Bulletin, 132, 132–149.
Weisz, J. R., Weiss, B., Alicke, M. D., & Klotz, M. L. (1987). Effectiveness of psychotherapy with children and adolescents: A meta-analysis for clinicians. Journal of Consulting and Clinical Psychology, 55, 542–549.
Acknowledgement
The authors acknowledge the efforts of Patricia Rao, Ph.D., Project Coordinator, Richard Gross, M.D., and Stephen Kwass, M.D., psychiatrists.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported in part by NIMH grant R01MH53703 to the third author. Lilly Corporation supplied the fluoxetine and matching placebo capsules. Clinical trial registration information-URL: http://www.clinicaltrials.gov; Unique identifier: NCT00043537.
Rights and permissions
About this article
Cite this article
De Los Reyes, A., Alfano, C.A. & Beidel, D.C. The Relations among Measurements of Informant Discrepancies within a Multisite Trial of Treatments for Childhood Social Phobia. J Abnorm Child Psychol 38, 395–404 (2010). https://doi.org/10.1007/s10802-009-9373-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10802-009-9373-6