Abstract
The prevalence and severity of behavioral problems in youth with autism spectrum disorders (ASD) may be context dependent leading to discrepant informants’ reports and complicating case conceptualizations and treatment goals. This study examines the inter-rater agreement of parents and teachers on behavioral problems of 58 youth with ASD and 42 youth without an ASD diagnosis. Parents and teachers of 26 youth with ASD (M = 4.08, SD = 1.02) and 21 youth with non-ASD diagnoses (M = 4.38, SD = 0.80), ages 2–5 years, and 32 youth with ASD (M = 7.47, SD = 1.44), and 21 youth with non-ASD diagnoses (M = 7.71, SD = 1.23), ages 6–10, completed the Child Behavior Checklist and Teacher Report Form. Compared to youth with a non-ASD diagnosis (ages 2–5 years), youth with ASD also had poor to moderate agreement across subscales with the exception of comparable substantial agreement on Externalizing Behavior (ICC = 0.73 and ICC = 0.63, respectively) and Aggressive Behavior subscales (ICC = 0.72 and ICC = 0.69, respectively). Compared to youth with a non-ASD diagnosis (ages 6–10 years), youth with ASD similarly had poor agreement across subscales with the exception of moderate agreement on Anxious/Depressed subscale (ICC = 0.41 and ICC = 0.06, respectively). These results suggest that the severity and prevalence of behavior problems in youth may depend on the context and reporter of the symptoms.
Similar content being viewed by others
References
Achenbach, T. M. (1991). Manual for the Teacher Report Form and 1991 Profile. Burlington: University of Vermont.
Achenbach, T. M. (2001). Manual for ASEBA school-age forms & profiles. Burlington: University of Vermont.
Achenbach, T. M. (2011). Commentary: Definitely more than measurement error: But how should we understand and deal with informant discrepancies? Journal of Clinical Child & Adolescent Psychology, 40, 80–86.
Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213–232.
Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA School-Age Forms & Profiles. Burlington, VT: University of Vermont, Research Center for Children, Youth, & Families.
Davis, S. D., Young, E. L., Hardman, S., & Winters, R. (2011). Screening for emotional and behavioral disorders. Principal Leadership, 11(9), 12–17.
De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: a critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131, 483–509.
Farrugia, S., & Hudson, J. (2006). Anxiety in adolescents with Asperger syndrome: Negative thoughts, behavioral problems, and life interference. Focus on Autism and Other Developmental Disabilities, 21, 25–35.
Fleiss, J. L. (1981). Statistical Methods for Rates and Proportions (2nd ed.). New York: Wiley.
Frick, P. J., Barry, C. T., & Kamphaus, R. W. (2010). Clinical Assessment of Child and Adolescent Personality and Behavior (3rd ed.). New York: Springer Science and Business Media.
Hurtig, T., Kuusikko, S., Mattila, M. L., Haapsamo, H., Ebeling, H., Jussila, K., & Moilanen, I. (2009). Multi-informant reports of psychiatric symptoms among high-functioning adolescents with Asperger syndrome or autism. Autism, 13, 583–598.
Iovannone, R. (2003). Effective educational practices for students with Autism Spectrum Disorders. Focus on Autism and Other Developmental Disabilities, 18, 150–165.
Jepsen, M. I., Gray, K. M., & Taffe, J. R. (2012). Agreement in multi-informant assessment of behaviour and emotional problems and social functioning in adolescents with Autistic and Asperger’s Disorder. Research in Autism Spectrum Disorders, 6, 1091–1098.
Kanne, S. M., Abbacchi, A. M., & Constantino, J. N. (2009). Multi-informant ratings of psychiatric symptom severity in children with autism spectrum disorders: The importance of environmental context. Journal of Autism and Developmental Disorders, 39, 856–864.
Kerns, C. M., & Kendall, P. C. (2012). The presentation and classification of anxiety in autism spectrum disorder. Clinical Psychology: Science and Practice, 19, 323–347.
Kerr, D. C., Lunkenheimer, E. S., & Olson, S. L. (2007). Assessment of child problem behaviors by multiple informants: A longitudinal study from preschool to school entry. Journal of Child Psychology and Psychiatry, 48, 967–975.
Kim, J. A., Szatmari, P., Bryson, S. E., Streiner, D. L., & Wilson, F. J. (2000). The prevalence of anxiety and mood problems among children with autism and Asperger syndrome. Autism, 4, 117–132.
Konold, T. R., Walthall, J. C., & Pianta, R. C. (2004). The behavior of child behavior ratings: Measurement structure of the Child Behavior Checklist across time, informants, and child gender. Behavioral Disorders, 29, 372–383.
Kuhlthau, K., Orlich, F., Hall, T. A., Sikora, D., Kovacs, E. A., Delahaye, J., & Clemons, T. E. (2010). Health-related quality of life in children with Autism Spectrum Disorders: Results from the Autism treatment network. Journal of Autism and Developmental Disorders, 40, 721–729.
Leyfer, O. T., Folstein, S. E., Bacalman, S., Davis, N. O., Dinh, E., Morgan, J., & Lainhart, J. E. (2006). Comorbid psychiatric disorders in children with autism: Interview development and rates of disorders. Journal of Autism and Developmental Disorders, 36, 849–861.
Lord, C., Risi, S., Lambrecht, L., Cook, Jr, E. H., Leventhal, B. L., DiLavore, P. C., & Rutter, M. (2000). The Autism diagnostic observation schedule—Generic: A standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders, 30, 205–223.
Lord, C., Rutter, M., DiLavore, P., & Risi, S. (1999). Autism diagnostic observation schedule-WPS edition. Los Angeles, CA: Western Psychological Services.
Matson, J. L., Turygin, N. C., Beighley, J., Rieske, R., Tureck, K., & Matson, M. L. (2012). Applied behavior analysis in Autism spectrum disorders: Recent developments, strengths, and pitfalls. Research in Autism Spectrum Disorders, 6, 144–150.
O’Reilly, M., Rispoli, M., Davis, T., Machalicek, W., Lang, R., Sigafoos, J., & Didden, R. (2010). Functional analysis of challenging behavior in children with autism spectrum disorders: A summary of 10 cases. Research in Autism Spectrum Disorders, 4, 1–10.
Pandolfi, V., Magyar, C. I., & Dill, C. A. (2009). Confirmatory factor analysis of the child behavior checklist 1.5–5 in a sample of children with autism spectrum disorders. Journal of Autism and Developmental Disorders, 39, 986–995.
Pandolfi, V., Magyar, C. I., & Dill, C. A. (2012). An initial psychometric evaluation of the CBCL 6–18 in a sample of youth with autism spectrum disorders. Research in Autism Spectrum Disorders, 6, 96–108.
Reed, P., & Osborne, L. A. (2013). The role of parenting stress in discrepancies between parent and teacher ratings of behavior problems in young children with autism spectrum disorder. Journal of Autism and Developmental Disorders, 43, 471–477.
Renk, K. (2005). Cross-informant ratings of the behavior of children and adolescents: The “gold standard”. Journal of Child and Family Studies, 14, 457–468.
Richardson, G. A., & Day, N. L. (2000). Epidemiologic considerations (2nd ed.). Mahwah: Lawrence Erlbaum Associates Publishers. Published in Advanced abnormal child psychology.
Ritakallio, M., Koivisto, A. M., von der Pahlen, B., Pelkonen, M., Marttunen, M., & Kaltiala-Heino, R. (2008). Continuity, comorbidity and longitudinal associations between depression and antisocial behaviour in middle adolescence: A 2-year prospective follow-up study. Journal of adolescence, 31(3), 355–370.
Rutter, M., Bailey, A., & Lord, C. (2003). Social communication questionnaire. Los Angeles: Western Psychological Services.
Rutter, M., DiLavore, P. C., Risi, S., Gotham, K., & Bishop, S. (2012). Autism diagnostic observation schedule: ADOS-2. Torrance, CA: Western Psychological Services.
Salbach-Andrae, H., Lenz, K., & Lehmkuhl, U. (2009). Patterns of agreement among parent, teacher and youth ratings in a referred sample. European Psychiatry, 24, 345–351.
Schopler, E., Reichler, R., & Renner, B. R. (1986). The Childhood Autism Scale (CARS) for diagnostic screening and classification of autism. New York: Irvington.
Schopler, E., Van Bourgondien, M. E., Wellman, G. J., & Love, S. R. (2010). Childhood autism rating scale, second edition (CARS2). Los Angeles: Western Psychological Corporation.
Silverman, W., & Ollendick, T. H. (2008). Child and adolescent anxiety disorders. In J. Hunsley, & E. J. Mash (Eds.), A guide to assessments that work (pp. 181–206). New York: Oxford University Press.
Simonoff, E., Pickles, A., Charman, T., Chandler, S., Loucas, T., & Baird, G. (2008). Psychiatric disorders in children with autism spectrum disorders: prevalence, comorbidity, and associated factors in a population-derived sample. Journal of the American Academy of Child & Adolescent Psychiatry, 47, 921–929.
So, P., Greaves-Lord, K., van der Ende, J., Verhulst, F. C., Rescorla, L., & Fa de Nijs, P. (2013). Using the Child Behavior Checklist and the Teacher’s Report Form for identification of children with autism spectrum disorders. Autism, 17, 595–607.
SPSS. (2008). SPSS for windows (version 22) [computer software]. Chicago, IL: SPSS Inc.
Stratis, E. A., & Lecavalier, L. (2014). Informant Agreement for Youth with Autism Spectrum Disorder or Intellectual Disability: A Meta-analysis. Journal of Autism and Developmental Disorders, 1–16.
Tassé, M. J., & Lecavalier, L. (2000). Comparing parent and teacher ratings of social competence and problem behaviors. American Journal on Mental Retardation, 105, 252–259.
Tureck, K., Matson, J. L., May, A., Whiting, S. E., & Davis, T. E. (2014). Comorbid symptoms in children with anxiety disorders compared to children with autism spectrum disorders. Journal of Developmental & Physical Disabilities, 26, 23–33.
Ung, D., Wood, J. J., Ehrenreich-May, J., Arnold, E. B., Fujii, C., Renno, P., & Storch, E. A. (2013). Clinical characteristics of high-functioning youth with autism spectrum disorder and anxiety. Neuropsychiatry, 3, 147–157.
Van den Akker, A. L., Prinzie, P., Dekovic, M., De Haan, A., Asscher, J. J., & Widiger, T. (2013). The development of personality extremity from childhood to adolescence: Relations to internalizing and externalizing problems. Journal of Personality and Social Psychology, 6, 1038–1048.
van der Ende, J., & Verhulst, F. C. (2005). Informant, gender and age differences in ratings of adolescent problem behaviour. European child & adolescent psychiatry, 14, 117–126.
van der Ende, J., Verhulst, F. C., & Tiemeier, H. (2012). Agreement of informants on emotional and behavioral problems from childhood to adulthood. Psychological assessment, 24, 293.
Vitaro, F., Gagnon, C., & Tremblay, R. (1991). Teachers’ and mothers’ assessment of children’s behaviors from kindergarten to grade two: Stability and change within and across informants. Journal of Psychopathology and Behavioral Assessment, 13, 325–343.
Will, M. N., & Wilson, B. J. (2014). A longitudinal analysis of parent and teacher ratings of problem behavior in boys with and without developmental delays. Journal of Intellectual Disabilities, 1–12.
Winsler, A., & Wallace, G. L. (2002). Behavior problems and social skills in preschool children: Parent-teacher agreement and relations with classroom observations. Early Education and Development, 13, 41–58.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no competing interests.
Ethical approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. For this type of study formal consent is not required.
Rights and permissions
About this article
Cite this article
Ung, D., Boone, D.M., McBride, N. et al. Parent and Teacher Agreement of Behavior Problems in Youth Diagnosed With and Without Autism Spectrum Disorders. J Child Fam Stud 26, 370–380 (2017). https://doi.org/10.1007/s10826-016-0566-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10826-016-0566-7