Abstract
There is limited research regarding the Gilliam Autism Rating Scales-3rd Edition (GARS-3) despite its extensive use. A comprehensive diagnostic evaluation, including the Autism Diagnostic Observation Schedule-2nd Edition (ADOS-2) was provided to 186 clinically referred children suspected of autism (\(\overline{X }\) age = 8.98; Autism [AUT] n = 87; Not Autism [NOT] n = 99). Mean difference analyses, Logistic Regressions, and ROC analyses were non-significant for both Autism Index scores. The author-suggested cutoff score of 70 correctly classified approximately 47% of participants, with false positive rates = 82.83–87.88%. ADOS-2 correlations were significantly lower vis-à-vis the standardization sample. The Social Interaction subscale demonstrated weak, marginal results, and sensitivity/specificity could not be optimized. In its current form, the GARS-3 does not demonstrate adequate criterion validity for use in assessment of complex community samples.
Similar content being viewed by others
References
Aiello, R., Ruble, L., & Esler, A. (2017). National study of school psychologists’ use of evidence-based assessment in autism spectrum disorder. Journal of Applied School Psychology, 33(1), 67–88. https://doi.org/10.1080/15377903.2016.1236307
Akmatov, M. K., Ermakova, T., & Bätzing, J. (2021). Psychiatric and nonpsychiatric comorbidities among children with ADHD: An exploratory analysis of nationwide claims data in Germany. Journal of Attention Disorders, 25(6), 874–884. https://doi.org/10.1177/1087054719865779
Alsaedi, R. H., Carrington, S., & Watters, J. J. (2020). Behavioral and neuropsychological evaluation of executive functions in children with autism spectrum disorder in the Gulf region. Brain Sciences, 10(2), 120. https://doi.org/10.3390/brainsci10020120
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Publishing.
Ashwood, K. L., Gillan, N., Horder, J., Hayward, H., Woodhouse, E., McEwen, F. S., Findon, J., Eklund, H., Spain, D., Wilson, C. E., Cadman, T., Young, S., Stoencheva, V., Murphy, C. M., Robertson, D., Charman, T., Bolton, P., Glaser, K., Asherson, P., Simonoff, E., & Murphy, D. G. (2016). Predicting the diagnosis of autism in adults using the autism-spectrum quotient (AQ) questionnaire. Psychological Medicine, 46(12), 2595–2604. https://doi.org/10.1017/S0033291716001082
Austin, C. A., Gerstle, M., Baum, K. T., Bradley, A., LeJeune, B., Peugh, J., & Beebe, D. W. (2019). Evolution of parental knowledge and efficacy across the pediatric neuropsychological evaluation process. Clinical Neuropsychologist, 33(4), 743–759. https://doi.org/10.1080/13854046.2018.1497206
Avni, E., Ben-Itzchak, E., & Zachor, D. A. (2018). The presence of comorbid ADHD and anxiety symptoms in autism spectrum disorder: Clinical presentation and predictors. Frontiers in Psychiatry, 9, 717–717. https://doi.org/10.3389/fpsyt.2018.00717
Basiru, T., Adereti, I., Olanipekun, A., & Ravenscroft, S. (2021). Trend in age at first diagnosis of autism spectrum disorder (ASD): Analysis of the 2012–2019 national survey of children’s health (NSCH) data. Annals of Epidemiology, 61, 20–20. https://doi.org/10.1016/j.annepidem.2021.05.017
Benson, N. F., Floyd, R. G., Kranzler, J. H., Eckert, T. L., Fefer, S. A., & Morgan, G. B. (2019). Test use and assessment practices of school psychologists in the united states: Findings from the 2017 national survey. Journal of School Psychology, 72, 29–48. https://doi.org/10.1016/j.jsp.2018.12.004
Bora, E., & Pantelis, C. (2016). Meta-analysis of social cognition in attention-deficit/hyperactivity disorder (ADHD): Comparison with healthy controls and autistic spectrum disorder. Psychological Medicine, 46(4), 699–716. https://doi.org/10.1017/S0033291715002573
Camodeca, A. (2019). Description of criterion validity of the autism spectrum rating scales 6–18 parent report: Initial exploration in a large community sample. Child Psychiatry & Human Development, 50(6), 987–1001. https://doi.org/10.1007/s10578-019-00899-0
Camodeca, A., Todd, K., & Croyle, J. (2019 online, 2020). Utility of the Asperger Syndrome Diagnostic Scale in the assessment of autism spectrum disorders. Journal of Autism and Developmental Disorders, 50, 513–523. https://doi.org/10.1007/s10803-019-04272-x
Camodeca, A., & Walcott, K. (2021). Criterion validity of the autism spectrum rating scales 2–5 parent report. Research in Autism Spectrum Disorders, 86, 101820. https://doi.org/10.1016/j.rasd.2021.101820
Cardon, T., Wangsgard, N., & Dobson, N. (2019). Video modeling using classroom peers as models to increase social communication skills in children with ASD in an integrated preschool. Education & Treatment of Children, 42(4), 515–536. https://doi.org/10.1353/etc.2019.0024
Charman, T., & Gotham, K. (2013). Measurement issues: Screening and diagnostic instruments for autism spectrum disorders—Lessons from research and practise. Child and Adolescent Mental Health, 18(1), 52–63. https://doi.org/10.1111/j.1475-3588.2012.00664.x
Chojnicka, I., & Pisula, E. (2017). Adaptation and validation of the ADOS-2, Polish version. Frontiers in Psychology, 8, 1916–1916. https://doi.org/10.3389/fpsyg.2017.01916
Constantino, J. N., & Gruber, C. P. (2012). Social Responsiveness Scale–Second Edition (SRS-2). Western Psychological Services.
Cook, J. R., Hausman, E. M., Jensen-Doss, A., & Hawley, K. M. (2017). Assessment practices of child clinicians: Results from a national survey. Assessment, 24(2), 210–221. https://doi.org/10.1177/1073191115604353
Crisci, G., Caviola, S., Cardillo, R., & Mammarella, I. C. (2021). Executive functions in neurodevelopmental disorders: Comorbidity overlaps between attention deficit and hyperactivity disorder and specific learning disorders. Frontiers in Human Neuroscience, 15, 594234. https://doi.org/10.3389/fnhum.2021.594234
Davidovitch, M., Slobodin, O., Weisskopf, M. G., & Rotem, R. S. (2020). Age-specific time trends in incidence rates of autism spectrum disorder following adaptation of DSM-5 and other ASD-related regulatory changes in Israel. Autism Research, 13(11), 1893–1901. https://doi.org/10.1002/aur.2420
Dolan, B. K., Van Hecke, A. V., Carson, A. M., Karst, J. S., Stevens, S., Schohl, K. A., Potts, S., Kahne, J., Linneman, N., Remmel, R., & Hummel, E. (2016). Brief report: Assessment of intervention effects on in-vivo peer interactions in adolescents with autism spectrum disorder (ASD). Journal of Autism and Developmental Disorders, 46(6), 2251–2259. https://doi.org/10.1007/s10803-016-2738-0
Dudas, R. B., Lovejoy, C., Cassidy, S., Allison, C., Smith, P., & Baron-Cohen, S. (2017). The overlap between autistic spectrum conditions and borderline personality disorder. PLoS ONE, 12(9), e0184447. https://doi.org/10.1371/journal.pone.0184447
Efron, D., Bryson, H., Lycett, K., & Sciberras, E. (2016). Children referred for evaluation for ADHD: Comorbidity profiles and characteristics associated with a positive diagnosis. Child: Care, Health & Development, 42(5), 718–724. https://doi.org/10.1111/cch.12364
Espelöer, J., Hellmich, M., Vogeley, K., & Falter-Wagner, C. M. (2021). Brief report: Social anxiety in autism spectrum disorder is based on deficits in social competence. Journal of Autism and Developmental Disorders, 51(1), 315–322. https://doi.org/10.1007/s10803-020-04529-w
Fusar-Poli, L., Brondino, N., Rocchetti, M., Panisi, C., Provenzani, U., Damiani, S., & Politi, P. (2017). Diagnosing ASD in adults without ID: Accuracy of the ADOS-2 and the ADI-R. Journal of Autism and Developmental Disorders, 47(11), 3370–3379. https://doi.org/10.1007/s10803-017-3258-2
Gilliam, J. (2006). Gilliam autism rating scales (2nd ed.). Pearson.
Gilliam, J. (2014). Gilliam autism rating scales (3rd ed.). Pearson.
Goldstein, S., & Naglieri, J. A. (2013). Autism Spectrum Rating Scales (ASRS): Technical manual. Multi-Health Systems, Inc.
Hamad, A. F., Alessi-Severini, S., Mahmud, S. M., Brownell, M., & Kuo, I. F. (2019). Annual trends in prevalence and incidence of autism spectrum disorders in Manitoba preschoolers and toddlers: 2004–2015. Canadian Journal of Public Health, 110(4), 476–484. https://doi.org/10.17269/s41997-019-00181-9
Hampton, J., & Strand, P. S. (2015). A review of level 2 parent-report instruments used to screen children aged 1.5–5 for autism: A meta-analytic update. Journal of Autism and Developmental Disorders, 45(8), 2519–2530. https://doi.org/10.1007/s10803-015-2419-4
Jensen-Doss, A., & Hawley, K. M. (2010). Understanding barriers to evidence-based assessment: Clinician attitudes toward standardized assessment tools. Journal of Clinical Child and Adolescent Psychology, 39(6), 885–896. https://doi.org/10.1080/15374416.2010.517169
Joshi, G., Petty, C., Wozniak, J., Henin, A., Fried, R., Galdo, M., Kotarski, M., Walls, S., & Biederman, J. (2010). The heavy burden of psychiatric comorbidity in youth with autism spectrum disorders: A large comparative study of a psychiatrically referred population. Journal of Autism and Developmental Disorders, 40(11), 1361–1370. https://doi.org/10.1007/s10803-010-0996-9
Kamp-Becker, I., Albertowski, K., Becker, J., Ghahreman, M., Langmann, A., Mingebach, T., Poustka, L., Weber, L., Schmidt, H., Smidt, J., Stehr, T., Roessner, V., Kucharczyk, K., Wolff, N., & Stroth, S. (2018). Diagnostic accuracy of the ADOS and ADOS-2 in clinical practice. European Child & Adolescent Psychiatry, 27(9), 1193–1207. https://doi.org/10.1007/s00787-018-1143-y
Knowland, V. C. P., Fletcher, F., Henderson, L., Walker, S., Norbury, C. F., & Gaskell, M. G. (2019). Sleep promotes phonological learning in children across language and autism spectra. Journal of Speech, Language, and Hearing Research, 62(12), 4235–4255. https://doi.org/10.1044/2019_JSLHR-S-19-0098
Lai, M., & Szatmari, P. (2020). Sex and gender impacts on the behavioural presentation and recognition of autism. Current Opinion in Psychiatry, 33(2), 117–123. https://doi.org/10.1097/YCO.0000000000000575
Langmann, A., Becker, J., Poustka, L., Becker, K., & Kamp-Becker, I. (2017). Diagnostic utility of the autism diagnostic observation schedule in a clinical sample of adolescents and adults. Research in Autism Spectrum Disorders, 34, 34–43. https://doi.org/10.1016/j.rasd.2016.11.012
Lord, C., Rutter, M., DiLavore, P. C., & Risi, S. (1999). Autism Diagnostic Observation Schedule. Western Psychological Services.
Lord, C., Rutter, M., DiLavore, P. C., Risi, S., Gotham, K., & Bishop, S. L. (2012). ADOS-2. Autism diagnostic observation schedule 2nd edition manual (Part I): Modules 1–4. Western Psychological Services.
Lordo, D., Bertolin, M., Sudikoff, E., Keith, C., Braddock, B., & Kaufman, D. A. S. (2017). Parents perceive improvements in socio-emotional functioning in adolescents with ASD following social skills treatment. Journal of Autism and Developmental Disorders, 47(1), 203–214. https://doi.org/10.1007/s10803-016-2969-0
Magyar, C. I., & Pandolfi, V. (2017). Utility of the CBCL DSM-oriented scales in assessing emotional disorders in youth with autism. Research in Autism Spectrum Disorders, 37, 11–20. https://doi.org/10.1016/j.rasd.2017.01.009
Manohar, H., Kuppili, P. P., Kandasamy, P., Chandrasekaran, V., & Rajkumar, R. P. (2018). Implications of comorbid ADHD in ASD interventions and outcome: Results from a naturalistic follow up study from south India. Asian Journal of Psychiatry, 33, 68–73. https://doi.org/10.1016/j.ajp.2018.03.009
Medda, J. E., Cholemkery, H., & Freitag, C. M. (2019). Sensitivity and specificity of the ADOS-2 algorithm in a large German sample. Journal of Autism and Developmental Disorders, 49(2), 750–761. https://doi.org/10.1007/s10803-018-3750-3
Norris, M., & Lecavalier, L. (2010). Screening accuracy of level 2 autism spectrum disorder rating scales. Autism, 14(4), 263–284. https://doi.org/10.1177/1362361309348071
Pandolfi, V., Magyar, C. I., & Dill, C. A. (2010). Constructs assessed by the GARS-2: Factor analysis of data from the standardization sample. Journal of Autism and Developmental Disorders, 40(9), 1118–1130. https://doi.org/10.1007/s10803-010-0967-1
Pfeiffer, B., Piller, A., Slugg, L., & Shiu, C. (2018). Brief report: Reliability of the participation and sensory environment questionnaire: Home scales. Journal of Autism and Developmental Disorders, 48(7), 2567–2576. https://doi.org/10.1007/s10803-018-3499-8
Ramsey, R. K., Nichols, L., Ludwig, N. N., Fein, D., Adamson, L. B., & Robins, D. L. (2018). Brief report: Sex differences in parental concerns for toddlers with autism risk. Journal of Autism and Developmental Disorders, 48(12), 4063–4069. https://doi.org/10.1007/s10803-018-3583-0
Reale, L., Bartoli, B., Cartabia, M., Zanetti, M., Costantino, M. A., Canevini, M. P., Termine, C., Bonati, M., & Lombardy ADHD Group. (2017). Comorbidity prevalence and treatment outcome in children and adolescents with ADHD. European Child & Adolescent Psychiatry, 26(12), 1443–1457. https://doi.org/10.1007/s00787-017-1005-z
Reynolds, C. R., & Kamphaus, R. W. (2003). Handbook of psychological and educational assessment of children: Intelligence, aptitude, and achievement (2nd ed.). Guilford Press.
Riccio, C. A., Sullivan, J. R., & Cohen, M. J. (2010). Neuropsychological assessment and intervention for childhood and adolescent disorders. Wiley.
Richey, J. A., Rittenberg, A., Hughes, L., Damiano, C. R., Sabatino, A., Miller, S., Hanna, E., Bodfish, J. W., & Dichter, G. S. (2014). Common and distinct neural features of social and non-social reward processing in autism and social anxiety disorder. Social Cognitive and Affective Neuroscience, 9(3), 367–377. https://doi.org/10.1093/scan/nss146
Rieske, R. D., Matson, J. L., Beighley, J. S., Cervantes, P. E., Goldin, R. L., & Jang, J. (2015). Comorbid psychopathology rates in children diagnosed with autism spectrum disorders according to the DSM-IV-TR and the proposed DSM-5. Developmental Neurorehabilitation, 18(4), 218–223. https://doi.org/10.3109/17518423.2013.790519
Rosenbaum, M., & Gabrielsen, T. P. (2019). Decision factors for community providers when referring very young children for autism evaluation. Research in Autism Spectrum Disorders, 57, 87–96. https://doi.org/10.1016/j.rasd.2018.09.009
Salley, B., Gabrielli, J., Smith, C. M., & Braun, M. (2015). Do communication and social interaction skills differ across youth diagnosed with autism spectrum disorder, attention-deficit/hyperactivity disorder, or dual diagnosis? Research in Autism Spectrum Disorders, 20, 58–66. https://doi.org/10.1016/j.rasd.2015.08.006
Sattler, J. (2018). Assessment of children: Cognitive foundations and applications (2nd ed.). Jerome Sattler Publications.
Shepherd, D., Landon, J., Goedeke, S., Ty, K., & Csako, R. (2018). Parents’ assessments of their child’s autism-related interventions. Research in Autism Spectrum Disorders, 50, 1–10. https://doi.org/10.1016/j.rasd.2018.02.005
Stevens, T., Peng, L., & Barnard-Brak, L. (2016). The comorbidity of ADHD in children diagnosed with autism spectrum disorder. Research in Autism Spectrum Disorders, 31, 11–18. https://doi.org/10.1016/j.rasd.2016.07.003
Tabachnick, B. G., & Fidell, L. S. (2012). Using multivariate statistics (6th ed.). Pearson.
Tse, C. Y. A., Pang, C. L., & Lee, P. H. (2018). Choosing an appropriate physical exercise to reduce stereotypic behavior in children with autism spectrum disorders: A non-randomized crossover study. Journal of Autism and Developmental Disorders, 48(5), 1666–1672. https://doi.org/10.1007/s10803-017-3419-3
Wagner, J., Luyster, R. J., Moustapha, H., Tager-Flusberg, H., & Nelson, C. A. (2018). Differential attention to faces in infant siblings of children with autism spectrum disorder and associations with later social and language ability. International Journal of Behavioral Development, 42(1), 83–92. https://doi.org/10.1177/0165025416673475
Wechsler, D. (2012). Technical and interpretative manual of the Wechsler preschool and primary scale of intelligence 2nd edition. PsychCorp.
Wechsler, D. (2014). Technical and interpretative manual of the Wechsler intelligence scale for children 5th edition. PsychCorp.
Wigham, S., Rodgers, J., Berney, T., Le Couteur, A., Ingham, B., & Parr, J. R. (2019). Psychometric properties of questionnaires and diagnostic measures for autism spectrum disorders in adults: A systematic review. Autism, 23(2), 287–305. https://doi.org/10.1177/1362361317748245
Williams, M. E., Williams, M. E., Atkins, M., Atkins, M., Soles, T., & Soles, T. (2009). Assessment of autism in community settings: Discrepancies in classification. Journal of Autism and Developmental Disorders, 39(4), 660–669. https://doi.org/10.1007/s10803-008-0668-1
Yamawaki, K., Ishitsuka, K., Suyama, S., Suzumura, S., Yamashita, H., & Kanba, S. (2020). Clinical characteristics of boys with comorbid autism spectrum disorder and attention deficit/hyperactivity disorder. Pediatrics International, 62(2), 151–157. https://doi.org/10.1111/ped.14105
Young, H., Oreve, M. J., & Speranza, M. (2018). Clinical characteristics and problems diagnosing autism spectrum disorder in girls. Archives De Pédiatrie: Organe Officiel De La Société Française De Pédiatrie, 25(6), 399–403. https://doi.org/10.1016/j.arcped.2018.06.008
Youngstrom, E. A. (2014). A primer on receiver operating characteristic analysis and diagnostic efficiency statistics for pediatric psychology: We are ready to ROC. Journal of Pediatric Psychology, 39(2), 204–221. https://doi.org/10.1093/jpepsy/jst062
Zander, E., Willfors, C., Berggren, S., Choque-Olsson, N., Coco, C., Elmund, A., Moretti, Å. H., Holm, A., Jifält, I., Kosieradzki, R., Linder, J., Nordin, V., Olafsdottir, K., Poltrago, L., & Bölte, S. (2016). The objectivity of the autism diagnostic observation schedule (ADOS) in naturalistic clinical settings. European Child & Adolescent Psychiatry, 25(7), 769–780. https://doi.org/10.1007/s00787-015-0793-2
Acknowledgments
This study did not receive funding. Limited preliminary data on the ROCs were presented as part of a larger presentation at the Center for Autism and Related Disorders conference.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors have no conflicts of interest to declare.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants prior to participation in this study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Camodeca, A. Diagnostic Utility of the Gilliam Autism Rating Scales-3rd Edition Parent Report in Clinically Referred Children. J Autism Dev Disord 53, 2112–2126 (2023). https://doi.org/10.1007/s10803-022-05483-5
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10803-022-05483-5