Skip to main content

Evaluation of the ADHD Rating Scale in Youth with Autism

Journal of Autism and Developmental Disorders volume 47, pages 90–100 (2017)Cite this article

Abstract

Scientists and clinicians regularly use clinical screening tools for attention deficit/hyperactivity disorder (ADHD) to assess comorbidity without empirical evidence that these measures are valid in youth with autism spectrum disorder (ASD). We examined the prevalence of youth meeting ADHD criteria on the ADHD rating scale fourth edition (ADHD-RS-IV), the relationship of ADHD-RS-IV ratings with participant characteristics and behaviors, and its underlying factor structure in 386, 7–17 year olds with ASD without intellectual disability. Expected parent prevalence rates, relationships with age and externalizing behaviors were observed, but confirmatory factor analyses revealed unsatisfactory fits for one-, two-, three-factor models. Exploratory analyses revealed several items cross-loading on multiple factors. Implications of screening ADHD in youth with ASD using current diagnostic criteria are discussed.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Notes

  1. A total of 9 children had IQ scores below 70, the traditional cut-off for establishing an Intellectual Disability diagnosis. Excluding these children had no significant effect on our results. For example, on all confirmatory factor analyses changes in fit indices was 0.002 or less. For this reason, we elected to include these children in our final sample.

References

  • American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders DSM-IV-TR fourth edition (4th ed.). Arlington, VA: American Psychiatric Publishing, Inc.

    Google Scholar 

  • Andersen, P. N., Hovik, K. T., Skogli, E. W., Egeland, J., & Oie, M. (2013). Symptoms of ADHD in children with high-functioning autism are related to impaired verbal working memory and verbal delayed recall. PLoS One, 8(5), e64842. doi:10.1371/journal.pone.0064842.

  • Antezana, L., Mosner, M. G., Troiani, V., & Yerys, B. E. (2016). Social-emotional inhibition of return in children with autism spectrum disorder versus typical development. Journal of Autism and Developmental Disorders, 46(4), 1236–1246.

  • Baumgaertel, A., Wolariach, M. L., & Dietrich, M. (1995). Comparison of diagnostic criteria for attention deficit disorders in a German elementary school sample. Journal of the American Academy of Child and Adolescent Psychiatry, 34(5), 629–638.

    Article  PubMed  Google Scholar 

  • Bentler, P. M., & Wu, E. J. C. (2002). EQS for Windows user’s guide. Encino, CA: Multivariate Software, Inc.

    Google Scholar 

  • Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). New York, NY: Guilford Press.

    Google Scholar 

  • Chevallier, C., Parish-Morris, J., Tonge, N., Le, L., Miller, J., & Schultz, R. T. (2014). Susceptibility to the audience effect explains performance gap between children with and without autism in a theory of mind task. Journal of Experimental Psychology: General, 143(3), 972–979.

  • Chevallier, C., Parish-Morris, J., McVey, A., Rump, K. M., Sasson, N. J., Herrington, J. D., & Schultz, R. T. (2015). Measuring social attention and motivation in autism spectrum disorder using eye-tracking: Stimulus type matters. Autism Research, 8(5), 620–628.

  • Child, D. (2006). The Essentials of factor analysis. London: A&C Black.

  • Corbett, B. A., Constantine, L. J., Hendren, R., Rocke, D., & Ozonoff, S. (2009). Examining executive functioning in children with autism spectrum disorder, attention deficit hyperactivity disorder and typical development. Psychiatry Research, 166(2–3), 210–222. doi:10.1016/j.psychres.2008.02.005.

  • Doyle, A. E., Faraone, S. V., Seidman, L. J., Willcutt, E. G., Nigg, J. T., Waldman, I. D., et al. (2005). Are endophenotypes based on measures of executive functions useful for molecular genetic studies of ADHD?. Journal of Child Psychology and Psychiatry, 46(7), 774–803. doi:10.1111/j.1469-7610.2005.01476.x.

  • DuPaul, G. J., Power, T. J., Anastopoulos, A. D., & Reid, R. (1998). ADHD rating scale-IV: Checklists, norms, and clinical interpretation. New York, NY: Guilford Press.

    Google Scholar 

  • DuPaul, G. J., Power, T. J., Anastopoulos, A. D., & Reid, R. (2016). ADHD rating scale-5 for children and adolescents: Checklists, norms, and clinical interpretation. New York, NY: Guilford Press.

    Google Scholar 

  • DuPaul, G. J., Reid, R., Anastopoulos, A. D., Lambert, M. C., Watkins, M. W., & Power, T. J. (2016). Parent and teacher ratings of attention-deficit/hyperactivity disorder symptoms: Factor structure and normative data. Psychological Assessment, 28(2), 214–225. doi:10.1037/pas0000166.

    Article  PubMed  Google Scholar 

  • DuPaul, G. J., Reid, R., Anastopoulos, A. D., & Power, T. J. (2014). Assessing ADHD symptomatic behaviors and functional impairment in school settings: Impact of student and teacher characteristics. School Psychology Quarterly, 29(4), 409–421. doi:10.1037/spq0000095.

    Article  PubMed  Google Scholar 

  • Elliott, C. D. (2007). Differential ability scales-II (DAS-II). San Antonio, TX: Pearson Assessments.

    Google Scholar 

  • Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9(4), 466–491. doi:10.1037/1082-989X.9.4.466.

    Article  PubMed  PubMed Central  Google Scholar 

  • Gioia, G. A., Isquith, P. K., Guy, S., & Kenworthy, L. (2000). BRIEF: Behavior rating inventory of executive function. Odessa, FL: Psychological Assessment Resources.

    Google Scholar 

  • Goldberg, L. R., & Velicer, W. F. (2006). Principles of exploratory factor analysis. In S. Strack (Ed.), Differentiating normal and abnormal personality (2nd ed., pp. 209–237). New York, NY: Springer.

    Google Scholar 

  • Gorsuch, R. L. (1997). Exploratory factor analysis: Its role in item analysis. Journal of Personality Assessment, 68(3), 532–560. doi:10.1207/s15327752jpa6803_5.

    Article  PubMed  Google Scholar 

  • Gotham, K., Risi, S., Pickles, A., & Lord, C. (2007). The autism diagnostic observation schedule: Revised algorithms for improved diagnostic validity. Journal of Autism and Developmental Disorders, 37(4), 613–627.

  • Granader, Y., Wallace, G. L., Hardy, K. K., Yerys, B. E., Lawson, R. A., Rosenthal, M., et al. (2014). Characterizing the factor structure of parent reported executive function in autism spectrum disorders: The Impact of cognitive Inflexibility. Journal of Autism and Developmental Disorders, 44(12), 3056–3062.

  • Herrington, J. D., Miller, J., Pandey, J., & Schultz, R. T. (2016). Anxiety and social deficits have distinct relationships with amygdala function in autism spectrum disorder. Social Cognitive and Affective Neuroscience, 11(6), 907–914.

  • Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. doi:10.1080/10705519909540118.

    Article  Google Scholar 

  • Humphreys, K. L., Mehta, N., & Lee, S. S. (2012). Association of parental ADHD and depression with externalizing and internalizing dimensions of child psychopathology. Journal of Attention Disorders, 16(4), 267–275. doi:10.1177/1087054710387264.

    Article  PubMed  Google Scholar 

  • Johnston, K., Dittner, A., Bramham, J., Murphy, C., Knight, A., & Russell, A. (2013). Attention deficit hyperactivity disorder symptoms in adults with autism spectrum disorders. Autism Research. doi:10.1002/aur.1283.

    PubMed  Google Scholar 

  • Lahey, B. B., Applegate, B., McBurnett, K., Biederman, J., Greenhill, L., Hynd, G. W., et al. (1994). DSM-IV field trials for attention deficit hyperactivity disorder in children and adolescents. The American Journal of Psychiatry, 151(11), 1673–1685.

    Article  PubMed  Google Scholar 

  • Leyfer, O. T., Folstein, S. E., Bacalman, S., Davis, N. O., Dinh, E., Morgan, J., et al. (2006). Comorbid psychiatric disorders in children with autism: Interview development and rates of disorders. Journal of Autism and Developmental Disorders, 36(7), 849–861. doi:10.1007/s10803-006-0123-0.

    Article  PubMed  Google Scholar 

  • Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Leventhal, B. L., DiLavore, P. C., et al. (2000). The autism diagnostic observation schedule-generic: A standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders, 30(3), 205–223.

    Article  PubMed  Google Scholar 

  • Lord, C., Rutter, M., & Le Couteur, A. (1994). Autism Diagnostic interview-revised: A revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. Journal of Autism and Developmental Disorders, 24(5), 659–685.

    Article  PubMed  Google Scholar 

  • Mahone, E. M., Cirino, P. T., Cutting, L. E., Cerrone, P. M., Hagelthorn, K. M., Hiemenz, J. R., et al. (2002). Validity of the behavior rating inventory of executive function in children with ADHD and/or Tourette syndrome. Archives of Clinical Neuropsychology, 17(7), 643–662.

    Article  PubMed  Google Scholar 

  • McCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130–149.

    Article  Google Scholar 

  • Muthén, L. K., & Muthén, B. O. (2015). Mplus user’s guide (7nd ed.). Los Angeles, CA

  • Parish-Morris, J., Chevallier, C., Tonge, N., Letzen, J., Pandey, J., & Schultz, R. T. (2013). Visual attention to dynamic faces and objects is linked to face processing skills: A combined study of children with autism and controls. Frontiers in Psychology, 4.

  • Pillow, D. R., Pelham, W. E. J., & Hoza, B. (1998). Confirmatory factor analyses examining attention deficit hyperactivity disorder symptoms and other childhood disruptive behaviors. Journal of Abnormal Child Psychology, 26(4), 293–309.

    Article  PubMed  Google Scholar 

  • Pugliese, C. E., Kenworthy, L., Bal, V. H., Wallace, G. L., Yerys, B. E., Maddox, B. B., et al. (2015). Replication and comparison of the newly proposed ADOS-2, module 4 algorithm in ASD without ID: A multi-site study. Journal of Autism and Developmental Disorders, 45(12), 3919–3931.

  • Reiersen, A. M., & Todorov, A. A. (2013). Exploration of ADHD subtype definitions and co-occurring psychopathology in a Missouri population-based large sibship sample. Scandinavian Journal of Child and Adolescent Psychiatry and Psychology, 1(1), 3.

    Article  PubMed  PubMed Central  Google Scholar 

  • Revelle, W. (2015). psych: Procedures for personality and psychological research. Evanston, IL: Northwestern University. Retrieved from http://CRAN.R-project.org/package=psych.

  • Reynolds, C., & Kamphaus, R. (2004). BASC-2: Behavior assessment systerm for children (2nd edn). Odessa, FL: Psychological Assessment Resources.

    Google Scholar 

  • Schwarz, N. (2010). Measurement as a cooperative communication: What research participants learn from questionnaires. In G. Walford, E. Tucker & M. Viswanathan (Eds.), The SAGE handbook of measurement (pp. 43–59). Thousand Oaks, CA: Sage Publications, Inc.

    Chapter  Google Scholar 

  • Sikora, D. M., Vora, P., Coury, D. L., & Rosenberg, D. (2012). Attention-deficit/hyperactivity disorder symptoms, adaptive functioning, and quality of life in children with autism spectrum disorder. Pediatrics, 130(Suppl 2), S91–S97. doi:10.1542/peds.2012-0900G.

    Article  PubMed  Google Scholar 

  • Sinzig, J., Walter, D., & Doepfner, M. (2009). Attention deficit/hyperactivity disorder in children and adolescents with autism spectrum disorder: Symptom or syndrome? Journal of Attention Disorders, 13(2), 117–126. doi:10.1177/1087054708326261.

    Article  PubMed  Google Scholar 

  • Velicer, W. F., Eaton, C. A., & Fava, J. L. (2000). Construct explication through factor or component analysis: A review and evaluation of alternative procedures for determining the number of factors or components. In R. D. Goffin & E. Helmes (Eds.), Problems and solutions in human assessment (pp. 41–71). New York, NY: Springer. Retrieved from http://link.springer.com/chapter/10.1007/978-1-4615-4397-8_3.

  • Wegener, D. T., & Fabrigar, L. R. (2000). Analysis and design for nonexperimental data. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social and personality psychology (pp. 412–450). New York, NY: Cambridge University Press.

    Google Scholar 

  • Willcutt, E. G., Chhabildas, N., Kinnear, M., DeFries, J. C., Olson, R. K., Leopold, D. R., et al. (2014). The internal and external validity of sluggish cognitive tempo and its relation with DSM–IV ADHD. Journal of Abnormal Child Psychology, 42(1), 21–35. doi:10.1007/s10802-013-9800-6.

    Article  PubMed  PubMed Central  Google Scholar 

  • Willcutt, E. G., Doyle, A. E., Nigg, J. T., Faraone, S. V., & Pennington, B. F. (2005). Validity of the executive function theory of attention-deficit/hyperactivity disorder: A meta-analytic review. Biological Psychiatry, 57(11), 1336–1346. doi:10.1016/j.biopsych.2005.02.006.

    Article  PubMed  Google Scholar 

  • Yerys, B. E., Kenworthy, L., Jankowski, K. F., Strang, J., & Wallace, G. L. (2013). Separate components of emotional go/no-go performance relate to autism versus attention symptoms in children with autism. Neuropsychology, 27(5), 537–545. doi:10.1037/a0033615.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgments

We would like to thank the youth and family members who gave their time and energy to participate in this study. The study was sponsored by grants from the National Institute of Mental Health (K23MH086111; PI: B.E. Yerys, R21MH092615; PI: B.E. Yerys, RC1MH088791; R.T. Schultz), and a New Program Development Award to B.E. Yerys through the Intellectual and Developmental Disabilities Research Center funded by the Eunice Kennedy Shriver National Institute of Child and Human Development (P30HD026979; PI: M. Yudkoff), a grant from the Philadelphia Foundation, a grant from the Pennsylvania Department of Health (SAP #4100042728) to R.T. Schultz, a grant from the Pennsylvania Department of Health (SAP #4100047863) to R.T. Schultz, a grant from Pfizer to R.T. Schultz, and a grant from the Robert Wood Johnson Foundation, #6672 to R.T. Schultz. T.J. Power receives compensation for the ADHD-IV rating scale.

Author Contributions

BEY, JNT, AdM, TJP, and RTS conceived the study’s key aims and objectives. LA contributed to data collection, data cleaning, and preliminary analyses. MWW conducted factor analyses, interpretation, and drafting of factor analyses. BEY drafted the initial manuscript with significant revisions from all authors.

Author information

Author notes

  1. Ligia Antezana

    Present address: Department of Psychology, Virginia Polytechnic Institute and State University, Blacksburg, VA, USA

  2. Ashley de Marchena

    Present address: Department of Behavioral and Social Sciences, University of the Sciences in Philadelphia, Philadelphia, PA, USA

Authors and Affiliations

  1. Center for Autism Research, The Children’s Hospital of Philadelphia, 3535 Market Street, Ste 860, Philadelphia, PA, 19104, USA

    Benjamin E. Yerys, Ashley de Marchena, Ligia Antezana & Robert T. Schultz

  2. Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA

    Benjamin E. Yerys, Thomas J. Power & Robert T. Schultz

  3. Center for the Management of ADHD, The Children’s Hospital of Philadelphia, Philadelphia, PA, USA

    Jenelle Nissley-Tsiopinis & Thomas J. Power

  4. Intellectual and Developmental Disabilities Research Center, The Children’s Hospital of Philadelphia, Philadelphia, PA, USA

    Ashley de Marchena

  5. Department of Educational Psychology, Baylor University, Waco, TX, USA

    Marley W. Watkins

  6. Department of Pediatrics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA

    Thomas J. Power & Robert T. Schultz

Authors
  1. Benjamin E. Yerys
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jenelle Nissley-Tsiopinis
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ashley de Marchena
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Marley W. Watkins
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ligia Antezana
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Thomas J. Power
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Robert T. Schultz
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Benjamin E. Yerys.

Ethics declarations

Conflict of Interest

Thomas J. Power receives financial compensation for the ADHD rating scale 4th edition. Benjamin E. Yerys declares that he has no conflict of interest. Jenelle Nissley-Tsiopinis declares that she has no conflict of interest. Ashley de Marchena declares that she has no conflict of interest. Marley W. Watkins declares that he has no conflict of interest. Ligia Antezana declares that she has no conflict of interest. Robert T. Schultz declares that he has no conflict of interest.

Ethical Approval

All procedures performed in this study with human participants were in accordance with the ethical standards of the institutional research board committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. This included obtaining informed parental consent and child assent for all participants.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOCX 2308 KB)

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Yerys, B.E., Nissley-Tsiopinis, J., de Marchena, A. et al. Evaluation of the ADHD Rating Scale in Youth with Autism. J Autism Dev Disord 47, 90–100 (2017). https://doi.org/10.1007/s10803-016-2933-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10803-016-2933-z

Keywords

  • Autism
  • Attention deficit/hyperactivity disorder
  • Comorbidity
  • Screening
  • Factor analysis