Skip to main content
Log in

Parent and Teacher Agreement of Behavior Problems in Youth Diagnosed With and Without Autism Spectrum Disorders

  • Original Paper
  • Published:
Journal of Child and Family Studies Aims and scope Submit manuscript

Abstract

The prevalence and severity of behavioral problems in youth with autism spectrum disorders (ASD) may be context dependent leading to discrepant informants’ reports and complicating case conceptualizations and treatment goals. This study examines the inter-rater agreement of parents and teachers on behavioral problems of 58 youth with ASD and 42 youth without an ASD diagnosis. Parents and teachers of 26 youth with ASD (M = 4.08, SD = 1.02) and 21 youth with non-ASD diagnoses (M = 4.38, SD = 0.80), ages 2–5 years, and 32 youth with ASD (M = 7.47, SD = 1.44), and 21 youth with non-ASD diagnoses (M = 7.71, SD = 1.23), ages 6–10, completed the Child Behavior Checklist and Teacher Report Form. Compared to youth with a non-ASD diagnosis (ages 2–5 years), youth with ASD also had poor to moderate agreement across subscales with the exception of comparable substantial agreement on Externalizing Behavior (ICC = 0.73 and ICC = 0.63, respectively) and Aggressive Behavior subscales (ICC = 0.72 and ICC = 0.69, respectively). Compared to youth with a non-ASD diagnosis (ages 6–10 years), youth with ASD similarly had poor agreement across subscales with the exception of moderate agreement on Anxious/Depressed subscale (ICC = 0.41 and ICC = 0.06, respectively). These results suggest that the severity and prevalence of behavior problems in youth may depend on the context and reporter of the symptoms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Achenbach, T. M. (1991). Manual for the Teacher Report Form and 1991 Profile. Burlington: University of Vermont.

    Google Scholar 

  • Achenbach, T. M. (2001). Manual for ASEBA school-age forms & profiles. Burlington: University of Vermont.

    Google Scholar 

  • Achenbach, T. M. (2011). Commentary: Definitely more than measurement error: But how should we understand and deal with informant discrepancies? Journal of Clinical Child & Adolescent Psychology, 40, 80–86.

    Article  Google Scholar 

  • Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213–232.

    Article  PubMed  Google Scholar 

  • Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA School-Age Forms & Profiles. Burlington, VT: University of Vermont, Research Center for Children, Youth, & Families.

    Google Scholar 

  • Davis, S. D., Young, E. L., Hardman, S., & Winters, R. (2011). Screening for emotional and behavioral disorders. Principal Leadership, 11(9), 12–17.

    Google Scholar 

  • De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: a critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131, 483–509.

    Article  PubMed  Google Scholar 

  • Farrugia, S., & Hudson, J. (2006). Anxiety in adolescents with Asperger syndrome: Negative thoughts, behavioral problems, and life interference. Focus on Autism and Other Developmental Disabilities, 21, 25–35.

    Article  Google Scholar 

  • Fleiss, J. L. (1981). Statistical Methods for Rates and Proportions (2nd ed.). New York: Wiley.

    Google Scholar 

  • Frick, P. J., Barry, C. T., & Kamphaus, R. W. (2010). Clinical Assessment of Child and Adolescent Personality and Behavior (3rd ed.). New York: Springer Science and Business Media.

    Book  Google Scholar 

  • Hurtig, T., Kuusikko, S., Mattila, M. L., Haapsamo, H., Ebeling, H., Jussila, K., & Moilanen, I. (2009). Multi-informant reports of psychiatric symptoms among high-functioning adolescents with Asperger syndrome or autism. Autism, 13, 583–598.

    Article  PubMed  Google Scholar 

  • Iovannone, R. (2003). Effective educational practices for students with Autism Spectrum Disorders. Focus on Autism and Other Developmental Disabilities, 18, 150–165.

    Article  Google Scholar 

  • Jepsen, M. I., Gray, K. M., & Taffe, J. R. (2012). Agreement in multi-informant assessment of behaviour and emotional problems and social functioning in adolescents with Autistic and Asperger’s Disorder. Research in Autism Spectrum Disorders, 6, 1091–1098.

    Article  Google Scholar 

  • Kanne, S. M., Abbacchi, A. M., & Constantino, J. N. (2009). Multi-informant ratings of psychiatric symptom severity in children with autism spectrum disorders: The importance of environmental context. Journal of Autism and Developmental Disorders, 39, 856–864.

    Article  PubMed  PubMed Central  Google Scholar 

  • Kerns, C. M., & Kendall, P. C. (2012). The presentation and classification of anxiety in autism spectrum disorder. Clinical Psychology: Science and Practice, 19, 323–347.

    Google Scholar 

  • Kerr, D. C., Lunkenheimer, E. S., & Olson, S. L. (2007). Assessment of child problem behaviors by multiple informants: A longitudinal study from preschool to school entry. Journal of Child Psychology and Psychiatry, 48, 967–975.

    Article  PubMed  Google Scholar 

  • Kim, J. A., Szatmari, P., Bryson, S. E., Streiner, D. L., & Wilson, F. J. (2000). The prevalence of anxiety and mood problems among children with autism and Asperger syndrome. Autism, 4, 117–132.

    Article  Google Scholar 

  • Konold, T. R., Walthall, J. C., & Pianta, R. C. (2004). The behavior of child behavior ratings: Measurement structure of the Child Behavior Checklist across time, informants, and child gender. Behavioral Disorders, 29, 372–383.

    Google Scholar 

  • Kuhlthau, K., Orlich, F., Hall, T. A., Sikora, D., Kovacs, E. A., Delahaye, J., & Clemons, T. E. (2010). Health-related quality of life in children with Autism Spectrum Disorders: Results from the Autism treatment network. Journal of Autism and Developmental Disorders, 40, 721–729.

    Article  PubMed  Google Scholar 

  • Leyfer, O. T., Folstein, S. E., Bacalman, S., Davis, N. O., Dinh, E., Morgan, J., & Lainhart, J. E. (2006). Comorbid psychiatric disorders in children with autism: Interview development and rates of disorders. Journal of Autism and Developmental Disorders, 36, 849–861.

    Article  PubMed  Google Scholar 

  • Lord, C., Risi, S., Lambrecht, L., Cook, Jr, E. H., Leventhal, B. L., DiLavore, P. C., & Rutter, M. (2000). The Autism diagnostic observation schedule—Generic: A standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders, 30, 205–223.

    Article  PubMed  Google Scholar 

  • Lord, C., Rutter, M., DiLavore, P., & Risi, S. (1999). Autism diagnostic observation schedule-WPS edition. Los Angeles, CA: Western Psychological Services.

    Google Scholar 

  • Matson, J. L., Turygin, N. C., Beighley, J., Rieske, R., Tureck, K., & Matson, M. L. (2012). Applied behavior analysis in Autism spectrum disorders: Recent developments, strengths, and pitfalls. Research in Autism Spectrum Disorders, 6, 144–150.

    Article  Google Scholar 

  • O’Reilly, M., Rispoli, M., Davis, T., Machalicek, W., Lang, R., Sigafoos, J., & Didden, R. (2010). Functional analysis of challenging behavior in children with autism spectrum disorders: A summary of 10 cases. Research in Autism Spectrum Disorders, 4, 1–10.

    Article  Google Scholar 

  • Pandolfi, V., Magyar, C. I., & Dill, C. A. (2009). Confirmatory factor analysis of the child behavior checklist 1.5–5 in a sample of children with autism spectrum disorders. Journal of Autism and Developmental Disorders, 39, 986–995.

    Article  PubMed  PubMed Central  Google Scholar 

  • Pandolfi, V., Magyar, C. I., & Dill, C. A. (2012). An initial psychometric evaluation of the CBCL 6–18 in a sample of youth with autism spectrum disorders. Research in Autism Spectrum Disorders, 6, 96–108.

    Article  PubMed  PubMed Central  Google Scholar 

  • Reed, P., & Osborne, L. A. (2013). The role of parenting stress in discrepancies between parent and teacher ratings of behavior problems in young children with autism spectrum disorder. Journal of Autism and Developmental Disorders, 43, 471–477.

    Article  PubMed  Google Scholar 

  • Renk, K. (2005). Cross-informant ratings of the behavior of children and adolescents: The “gold standard”. Journal of Child and Family Studies, 14, 457–468.

    Article  Google Scholar 

  • Richardson, G. A., & Day, N. L. (2000). Epidemiologic considerations (2nd ed.). Mahwah: Lawrence Erlbaum Associates Publishers. Published in Advanced abnormal child psychology.

    Google Scholar 

  • Ritakallio, M., Koivisto, A. M., von der Pahlen, B., Pelkonen, M., Marttunen, M., & Kaltiala-Heino, R. (2008). Continuity, comorbidity and longitudinal associations between depression and antisocial behaviour in middle adolescence: A 2-year prospective follow-up study. Journal of adolescence, 31(3), 355–370.

    Article  PubMed  Google Scholar 

  • Rutter, M., Bailey, A., & Lord, C. (2003). Social communication questionnaire. Los Angeles: Western Psychological Services.

    Google Scholar 

  • Rutter, M., DiLavore, P. C., Risi, S., Gotham, K., & Bishop, S. (2012). Autism diagnostic observation schedule: ADOS-2. Torrance, CA: Western Psychological Services.

    Google Scholar 

  • Salbach-Andrae, H., Lenz, K., & Lehmkuhl, U. (2009). Patterns of agreement among parent, teacher and youth ratings in a referred sample. European Psychiatry, 24, 345–351.

    Article  PubMed  Google Scholar 

  • Schopler, E., Reichler, R., & Renner, B. R. (1986). The Childhood Autism Scale (CARS) for diagnostic screening and classification of autism. New York: Irvington.

    Google Scholar 

  • Schopler, E., Van Bourgondien, M. E., Wellman, G. J., & Love, S. R. (2010). Childhood autism rating scale, second edition (CARS2). Los Angeles: Western Psychological Corporation.

    Google Scholar 

  • Silverman, W., & Ollendick, T. H. (2008). Child and adolescent anxiety disorders. In J. Hunsley, & E. J. Mash (Eds.), A guide to assessments that work (pp. 181–206). New York: Oxford University Press.

    Chapter  Google Scholar 

  • Simonoff, E., Pickles, A., Charman, T., Chandler, S., Loucas, T., & Baird, G. (2008). Psychiatric disorders in children with autism spectrum disorders: prevalence, comorbidity, and associated factors in a population-derived sample. Journal of the American Academy of Child & Adolescent Psychiatry, 47, 921–929.

    Article  Google Scholar 

  • So, P., Greaves-Lord, K., van der Ende, J., Verhulst, F. C., Rescorla, L., & Fa de Nijs, P. (2013). Using the Child Behavior Checklist and the Teacher’s Report Form for identification of children with autism spectrum disorders. Autism, 17, 595–607.

    Article  PubMed  Google Scholar 

  • SPSS. (2008). SPSS for windows (version 22) [computer software]. Chicago, IL: SPSS Inc.

    Google Scholar 

  • Stratis, E. A., & Lecavalier, L. (2014). Informant Agreement for Youth with Autism Spectrum Disorder or Intellectual Disability: A Meta-analysis. Journal of Autism and Developmental Disorders, 1–16.

  • Tassé, M. J., & Lecavalier, L. (2000). Comparing parent and teacher ratings of social competence and problem behaviors. American Journal on Mental Retardation, 105, 252–259.

    Article  PubMed  Google Scholar 

  • Tureck, K., Matson, J. L., May, A., Whiting, S. E., & Davis, T. E. (2014). Comorbid symptoms in children with anxiety disorders compared to children with autism spectrum disorders. Journal of Developmental & Physical Disabilities, 26, 23–33.

    Article  Google Scholar 

  • Ung, D., Wood, J. J., Ehrenreich-May, J., Arnold, E. B., Fujii, C., Renno, P., & Storch, E. A. (2013). Clinical characteristics of high-functioning youth with autism spectrum disorder and anxiety. Neuropsychiatry, 3, 147–157.

    Article  Google Scholar 

  • Van den Akker, A. L., Prinzie, P., Dekovic, M., De Haan, A., Asscher, J. J., & Widiger, T. (2013). The development of personality extremity from childhood to adolescence: Relations to internalizing and externalizing problems. Journal of Personality and Social Psychology, 6, 1038–1048.

    Article  Google Scholar 

  • van der Ende, J., & Verhulst, F. C. (2005). Informant, gender and age differences in ratings of adolescent problem behaviour. European child & adolescent psychiatry, 14, 117–126.

    Article  Google Scholar 

  • van der Ende, J., Verhulst, F. C., & Tiemeier, H. (2012). Agreement of informants on emotional and behavioral problems from childhood to adulthood. Psychological assessment, 24, 293.

    Article  PubMed  Google Scholar 

  • Vitaro, F., Gagnon, C., & Tremblay, R. (1991). Teachers’ and mothers’ assessment of children’s behaviors from kindergarten to grade two: Stability and change within and across informants. Journal of Psychopathology and Behavioral Assessment, 13, 325–343.

    Article  Google Scholar 

  • Will, M. N., & Wilson, B. J. (2014). A longitudinal analysis of parent and teacher ratings of problem behavior in boys with and without developmental delays. Journal of Intellectual Disabilities, 1–12.

  • Winsler, A., & Wallace, G. L. (2002). Behavior problems and social skills in preschool children: Parent-teacher agreement and relations with classroom observations. Early Education and Development, 13, 41–58.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Danielle Ung.

Ethics declarations

Conflict of interest

The authors declare that they have no competing interests.

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. For this type of study formal consent is not required.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ung, D., Boone, D.M., McBride, N. et al. Parent and Teacher Agreement of Behavior Problems in Youth Diagnosed With and Without Autism Spectrum Disorders. J Child Fam Stud 26, 370–380 (2017). https://doi.org/10.1007/s10826-016-0566-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10826-016-0566-7

Keywords

Navigation