Advertisement

Utility of the Asperger Syndrome Diagnostic Scale in the Assessment of Autism Spectrum Disorders

  • Amy CamodecaEmail author
  • Kylie Q. Todd
  • Jennifer Croyle
Original Paper

Abstract

Investigated internal consistency reliability and criterion validity of the Asperger Syndrome Diagnostic Scale (ASDS) in a well-characterized sample of 120 children (\(\bar{X}_{\text{age}}\) = 9.91; autism [AUT] n = 54; non-autism [NOT] n = 66) who completed comprehensive outpatient evaluations with a gold-standard measure, the Autism Diagnostic Observation Schedule-2. With the exception of a low Cognitive alpha in the AUT group, internal consistency reliabilities ranged from moderate to high. Significant between-group mean differences were observed for all scores. Receiver operating characteristic analyses indicated Area Under the Curve in the fair range (.71). Cutoff points and interpretation are discussed. The ASDS appears most useful in cases of either low or high scores or as an adjuvant to gold-standard measures.

Keywords

Autism Questionnaires Reliability Criterion validity ROC AUC 

Notes

Acknowledgments

These findings were presented as part of a larger presentation at the 2019 Center for Autism and Related Disorders (CARD) Conference in Orlando, FL, USA.

Compliance with Ethical Standards

Conflict of interest

The author has no conflict of interests of any kind to declare. Data may be obtained upon request of the first author.

References

  1. Aiello, R., Ruble, L., & Esler, A. (2017). National study of school psychologists’ use of evidence-based assessment in autism spectrum disorder. Journal of Applied School Psychology, 33(1), 67–88.  https://doi.org/10.1080/15377903.2016.1236307.CrossRefGoogle Scholar
  2. American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders: DSM-IV. Washington, D.C: American Psychiatric Association.Google Scholar
  3. American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders: DSM-5. Washington, D.C: American Psychiatric Association.CrossRefGoogle Scholar
  4. American Psychiatric Association, Task Force on DSM-IV. (2000). Diagnostic and statistical manual of mental disorders: DSM-IV-TR (4th, text, revision, ed.). Washington, DC: American Psychiatric Association.Google Scholar
  5. Azad, G. F., Reisinger, E., Xie, M., & Mandell, D. S. (2016). Parent and teacher concordance on the social responsiveness scale for children with autism. School Mental Health, 8(3), 368–376.CrossRefPubMedGoogle Scholar
  6. Beggiato, A., Peyre, H., Maruani, A., Scheid, I., Rastam, M., Amsellem, F., et al. (2017). Gender differences in autism spectrum disorders: Divergence among specific core symptoms. Autism Research, 10(4), 680–689.  https://doi.org/10.1002/aur.1715.CrossRefPubMedGoogle Scholar
  7. Bent, C. A., Barbaro, J., & Dissanayake, C. (2017). Change in autism diagnoses prior to and following the introduction of DSM-5. Journal of Autism and Developmental Disorders, 47(1), 163–171.  https://doi.org/10.1007/s10803-016-2942-y.CrossRefPubMedGoogle Scholar
  8. Berenguer, C., Miranda, A., Colomer, C., Baixauli, I., & Roselló, B. (2018). Contribution of theory of mind, executive functioning, and pragmatics to socialization behaviors of children with high-functioning autism. Journal of Autism and Developmental Disorders, 48(2), 430–441.  https://doi.org/10.1007/s10803-017-3349-0.CrossRefPubMedGoogle Scholar
  9. Boggs, K. M., Gross, A. M., & Gohm, C. L. (2006). Validity of the Asperger syndrome diagnostic scale. Journal of Developmental and Physical Disabilities, 18(2), 163–182.  https://doi.org/10.1007/s10882-006-9008-6.CrossRefGoogle Scholar
  10. Burns, C. O., Dixon, D. R., Novack, M., & Granpeesheh, D. (2017). A systematic review of assessments for sensory processing abnormalities in autism spectrum disorder. Review Journal of Autism and Developmental Disorders, 4(3), 209–224.  https://doi.org/10.1007/s40489-017-0109-1.CrossRefGoogle Scholar
  11. Camodeca, A. (2019). Description of criterion validity of the autism spectrum rating scales 6-18 parent report: Initial exploration in a large community sample. Child Psychiatry and Human Development.  https://doi.org/10.1007/s10578-019-00899-0.CrossRefPubMedGoogle Scholar
  12. Camodeca, A., & Croyle, J. (2019). Interpretation of parent/teacher questionnaires in autism diagnostic assessment. Paper presented at the 26th Center for Autism and Related Disabilities (CARD) Conference, Orlando, FL.Google Scholar
  13. Campbell, J. (2005). Diagnostic assessment of asperger’s disorder: A review of five third-party rating scales. Journal of Autism and Developmental Disorders, 35(1), 25–35.  https://doi.org/10.1007/s10803-004-1028-4.CrossRefPubMedGoogle Scholar
  14. Carpenter, L. A., Soorya, L., & Halpern, D. (2009). Aspergers Syndrome and high functioning autism. Pediatric Annals, 38(1), 30–35.CrossRefPubMedGoogle Scholar
  15. Cheng, D., Branscum, A. J., & Johnson, W. O. (2012). Sample size calculations for ROC studies: Parametric robustness and bayesian nonparametrics. Statistics in Medicine, 31(2), 131–142.  https://doi.org/10.1002/sim.4396.CrossRefPubMedGoogle Scholar
  16. Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6, 284–290.  https://doi.org/10.1037/1040-3590.6.4.284.CrossRefGoogle Scholar
  17. Cook, J. R., Hausman, E. M., Jensen-Doss, A., & Hawley, K. M. (2017). Assessment practices of child clinicians: Results from a national survey. Assessment, 24(2), 210–221.  https://doi.org/10.1177/1073191115604353.CrossRefPubMedGoogle Scholar
  18. Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and application. Journal of Applied Psychology, 78, 98–104.  https://doi.org/10.1037/0021-9010.78.1.98.CrossRefGoogle Scholar
  19. Demopoulos, C., Hopkins, J., & Lewine, J. D. (2016). Relations between nonverbal and verbal social cognitive skills and complex social behavior in children and adolescents with autism. Journal of Abnormal Child Psychology, 44(5), 913–921.  https://doi.org/10.1007/s10802-015-0082-z.CrossRefPubMedGoogle Scholar
  20. Falkmer, T., Anderson, K., Falkmer, M., & Horlin, C. (2013). Diagnostic procedures in autism spectrum disorders: A systematic literature review. European Child and Adolescent Psychiatry, 22(6), 329–340.  https://doi.org/10.1007/s00787-013-0375-0.CrossRefPubMedGoogle Scholar
  21. Field, A. (2013). Discovering statistics using SPSS (4th ed.). London: Sage.Google Scholar
  22. Gilliam, J. E. (2014). Gilliam autism rating scale (3rd ed.). Austin, TX: Pro-Ed.Google Scholar
  23. Glascoe, F. P. (2005). Screening for developmental and behavioral problems. Mental Retardation and Developmental Disabilities Research Reviews, 11(3), 173–179.  https://doi.org/10.1002/mrdd.20068.CrossRefPubMedGoogle Scholar
  24. Goldstein, S. (2002). Review of the Asperger syndrome diagnostic scale. Journal of Autism and Developmental Disorders, 32(6), 611–614.  https://doi.org/10.1023/A:1021215300163.CrossRefPubMedGoogle Scholar
  25. Goldstein, S., & Naglieri, J. A. (2013). Autism spectrum rating scales (ASRS) technical manual. New York: Multi-Health Systems.Google Scholar
  26. Goldstein, S., & Naglieri, J. A. (2014). Autism spectrum rating scales (ASRS) technical report #2. New York: Multi-Health Systems.Google Scholar
  27. Hampton, J., & Strand, P. S. (2015). A review of level 2 parent-report instruments used to screen children aged 1.5–5 for autism: A meta-analytic update. Journal of Autism and Developmental Disorders, 45(8), 2519–2530.  https://doi.org/10.1007/s10803-015-2419-4.CrossRefPubMedGoogle Scholar
  28. Hathorn, C., Alateeqi, N., Graham, C., & O’Hare, A. (2014). Impact of adherence to best practice guidelines on the diagnostic and assessment services for autism spectrum disorder. Journal of Autism and Developmental Disorders, 44(8), 1859–1866.  https://doi.org/10.1007/s10803-014-2057-2.CrossRefPubMedGoogle Scholar
  29. Hellman, C. M., Fuqua, D. R., & Worley, J. (2006). A reliability generalization study on the survey of perceived organizational support: The effects of mean age and number of items on score reliability. Educational and Psychological Measurement, 66(4), 631–642.  https://doi.org/10.1177/0013164406288158.CrossRefGoogle Scholar
  30. Hinshaw, S. P., Carte, E. T., Sami, N., Treuting, J. J., & Zupan, B. A. (2002). Preadolescent girls with attention-deficit/hyperactivity disorder—II: Neuropsychological performance in relation to subtypes and individual classification. Journal of Consulting and Clinical Psychology, 70(5), 1099–1111.  https://doi.org/10.1037//0022-006X.70.5.1099.CrossRefPubMedGoogle Scholar
  31. Hirota, T., So, R., Kim, Y. S., Leventhal, B., & Epstein, R. A. (2018). A systematic review of screening tools in non-young children and adults for autism spectrum disorder. Research in Developmental Disabilities, 80, 1–12.  https://doi.org/10.1016/j.ridd.2018.05.017.CrossRefPubMedGoogle Scholar
  32. Hus, V., Bishop, S., Gotham, K., Heurta, M., & Lord, C. (2013). Factors influencing scores on the social responsiveness scale. Journal of Child Psychology and Psychiatry, 54(2), 216–224.  https://doi.org/10.1111/j.1469-7610.2012.02589.x.CrossRefPubMedGoogle Scholar
  33. Joshi, G., Petty, C., Wozniak, J., Henin, A., Fried, R., Galdo, M., et al. (2010). The heavy burden of psychiatric comorbidity in youth with autism spectrum disorders: A large comparative study of a psychiatrically referred population. Journal of Autism and Developmental Disorders, 40(11), 1361–1370.  https://doi.org/10.1007/s10803-010-0996-9.CrossRefPubMedGoogle Scholar
  34. Kaufman, A. S., & Kaufman, N. L. (2004). Kaufman assessment battery for children: Technical manual (2nd ed.). Circle Pines, MN: American Guidance Service.Google Scholar
  35. Keith, J. M., Jamieson, J. P., & Bennetto, L. (2019). The importance of adolescent self-report in autism spectrum disorder: Integration of questionnaire and autonomic measures. Journal of Abnormal Child Psychology, 47(4), 741–754.  https://doi.org/10.1007/s10802-018-0455-1.CrossRefPubMedGoogle Scholar
  36. Kessel, J. B., & Zimmerman, M. (1993). Reporting errors in studies of the diagnostic performance of self-administered questionnaires: Extent of the problem, recommendations for standardized presentation of results, and implications for the peer review process. Psychological Assessment, 5(4), 395–399.  https://doi.org/10.1037/1040-3590.5.4.395.CrossRefGoogle Scholar
  37. Kim, S., & Feldt, L. S. (2008). A comparison of tests for equality of two or more independent alpha coefficients. Journal of Educational Measurement, 45(2), 179–193.  https://doi.org/10.1111/j.1745-3984.2008.00059.x.CrossRefGoogle Scholar
  38. Klose, L. M., Plotts, C., Kozeneski, N., & Skinner-Foster, J. (2012). A review of assessment tools for diagnosis of autism spectrum disorders: Implications for school practice. Assessment for Effective Intervention, 37(4), 236–242.  https://doi.org/10.1177/1534508411415090.CrossRefGoogle Scholar
  39. Langmann, A., Becker, J., Poustka, L., Becker, K., & Kamp-Becker, I. (2017). Diagnostic utility of the autism diagnostic observation schedule in a clinical sample of adolescents and adults. Research in Autism Spectrum Disorders, 34, 34–43.  https://doi.org/10.1016/j.rasd.2016.11.012.CrossRefGoogle Scholar
  40. Lord, C., & Bishop, S. L. (2015). Recent advances in autism research as reflected in DSM-5 criteria for autism spectrum disorder. Annual Review of Clinical Psychology, 11, 53–70.  https://doi.org/10.1146/annurev-clinpsy-032814-112745.CrossRefPubMedGoogle Scholar
  41. Lord, C., Rutter, M., DiLavore, P. C., Risi, S., Gotham, K., & Bishop, S. L. (2012). ADOS-2: Autism diagnostic observation schedule, second edition (ADOS-2) manual (Part I): Modules 1-4. Torrance, CA: Western Psychological Services.Google Scholar
  42. Macintosh, K., & Dissanayake, C. (2006). Social skills and problem behaviours in school aged children with high-functioning autism and asperger’s disorder. Journal of Autism and Developmental Disorders, 36, 1065–1076.CrossRefPubMedGoogle Scholar
  43. Manjiviona, J., & Prior, M. (1995). Comparison of Asperger syndrome and high functioning autistic children on a test of motor impairment. Journal of Autism and Developmental Disorders, 25(1), 23–39.  https://doi.org/10.1007/BF02178165.CrossRefPubMedGoogle Scholar
  44. Mckenney, E. L. W., Dorencz, J., Bristol, R. M., & Hall, L. P. (2015). Publishing about autism spectrum disorder in six school psychology journals: 2002–2012. Psychology in the Schools, 52(3), 265–283.  https://doi.org/10.1002/pits.21820.CrossRefGoogle Scholar
  45. McPartland, J. C., Reichow, B., & Volkmar, F. R. (2012). Sensitivity and specificity of proposed DSM-5 diagnostic criteria for autism spectrum disorder. Journal of the American Academy of Child and Adolescent Psychiatry, 51(4), 368–383.  https://doi.org/10.1016/j.jaac.2012.01.007.CrossRefPubMedPubMedCentralGoogle Scholar
  46. Molloy, C. A., Murray, D. S., Akers, R., Mitchell, T., & Manning-Courtney, P. (2011). Use of the autism diagnostic observation schedule (ADOS) in a clinical setting. Autism, 15(2), 143–162.  https://doi.org/10.1177/1362361310379241.CrossRefPubMedGoogle Scholar
  47. Myers, C. L., Gross, A. D., & McReynolds, B. M. (2014). Broadband behavior rating scales as screeners for autism? Journal of Autism and Developmental Disorders, 44(6), 1403–1413.  https://doi.org/10.1007/s10803-013-2004-7.CrossRefPubMedGoogle Scholar
  48. Myles, B., Bock, S., & Simpson, R. (2001). Asperger Syndrome Diagnostic Scale Manual. North Tonawanda, NY: MHS.Google Scholar
  49. Neely, R. J., Green, J. L., Sciberras, E., Hazell, P., & Anderson, V. (2016). Relationship between executive functioning and symptoms of attention-deficit/hyperactivity disorder and autism spectrum disorder in 6–8 year old children. Journal of Autism and Developmental Disorders, 46(10), 3270–3280.  https://doi.org/10.1007/s10803-016-2874-6.CrossRefPubMedGoogle Scholar
  50. Norris, M., & Lecavalier, L. (2010). Screening accuracy of Level 2 autism spectrum disorder rating scales. Autism, 14(4), 263–284.  https://doi.org/10.1177/1362361309348071.CrossRefPubMedGoogle Scholar
  51. Ozonoff, S., South, M., & Miller, J. N. (2000). DSM-IV TR-defined Asperger syndrome: Cognitive, behavioral, and early history differentiation from high functioning autism. Autism, 4(1), 29–46.Google Scholar
  52. Perugini, E. M., Harvey, E. A., Lovejoy, D. W., Sandstrom, K., & Webb, A. H. (2000). The predictive power of combined neuropsychological measures for attention-Deficit/Hyperactivity disorder in children. Child Neuropsychology, 6(2), 101–114.  https://doi.org/10.1076/chin.6.2.101.7059.CrossRefPubMedGoogle Scholar
  53. Pugliese, C. E., Kenworthy, L., Bal, V. H., Wallace, G. L., Yerys, B. E., Maddox, B. B., et al. (2015). Replication and comparison of the newly proposed ADOS-2, module 4 algorithm in ASD without ID: A multi-site study. Journal of Autism and Developmental Disorders, 45(12), 3919–3931.  https://doi.org/10.1007/s10803-015-2586-3.CrossRefPubMedPubMedCentralGoogle Scholar
  54. Rankin, J. A., Weber, R. J., Kang, E., & Lerner, M. D. (2016). Parent- and self-reported social skills importance in autism spectrum disorder. Journal of Autism and Developmental Disorders, 46(1), 273–286.  https://doi.org/10.1007/s10803-015-2574-7.CrossRefPubMedGoogle Scholar
  55. Reszka, S. S., Boyd, B. A., McBee, M., Hume, K. A., & Odom, S. L. (2014). Brief report: Concurrent validity of autism symptom severity measures. Journal of Autism and Developmental Disorders, 44(2), 466–470.  https://doi.org/10.1007/s10803-013-1879-7.CrossRefPubMedGoogle Scholar
  56. Reynolds, C. R., & Kamphaus, R. W. (2003). Handbook of psychological and educational assessment of children: Intelligence, aptitude, and achievement (2nd ed.). New York: Guilford Press.Google Scholar
  57. Riccio, C. A., Sullivan, J. R., & Cohen, M. J. (2010). Neuropsychological assessment and intervention for childhood and adolescent disorders. Hoboken, N.J: Wiley.CrossRefGoogle Scholar
  58. Rieske, R. D., Matson, J. L., Beighley, J. S., Cervantes, P. E., Goldin, R. L., & Jang, J. (2015). Comorbid psychopathology rates in children diagnosed with autism spectrum disorders according to the DSM-IV-TR and the proposed DSM-5. Developmental Neurorehabilitation, 18(4), 218.  https://doi.org/10.3109/17518423.2013.790519.CrossRefPubMedGoogle Scholar
  59. Rogers, C. L., Goddard, L., Hill, E. L., Henry, L. A., & Crane, L. (2016). Experiences of diagnosing autism spectrum disorder: A survey of professionals in the united kingdom. Autism, 20(7), 820–831.  https://doi.org/10.1177/1362361315611109.CrossRefPubMedGoogle Scholar
  60. Roid, G. H. (2003). Stanford-Binet Intelligence Scales (5th ed.). Itasca, IL: Riverside Publishing.Google Scholar
  61. Rutter, M., LeCouteur, A., & Lord, C. (2003). Autism diagnostic interview-revised. Los Angeles: Western Psychological Services.Google Scholar
  62. Sattler, J. M. (2001). Assessment of children: Cognitive applications. La Mesa, CA: Jerome M. Sattler Publications Inc.Google Scholar
  63. Schaller, T. K., Patil, A., & Malhotra, N. K. (2015). Alternative techniques for assessing common method variance: An analysis of the theory of planned behavior research. Organizational Research Methods, 18(2), 177–206.  https://doi.org/10.1177/1094428114554398.CrossRefGoogle Scholar
  64. Sturm, A., Kuhfeld, M., Kasari, C., & McCracken, J. T. (2017). Development and validation of an item response theory-based social responsiveness scale short form. Journal of Child Psychology and Psychiatry, 58(9), 1053–1061.  https://doi.org/10.1111/jcpp.12731.CrossRefPubMedGoogle Scholar
  65. Swets, J. A., Dawes, R. M., Monahan, J., & Bjork, R. A. (2000). Psychological science can improve diagnostic decisions. Psychological Science in the Public Interest, 1(1), 1–26.  https://doi.org/10.1111/1529-1006.001.CrossRefPubMedGoogle Scholar
  66. Tabachnick, B. G., & Fidell, L. S. (2012). Using multivariate statistics (6th ed.). London: Pearson.Google Scholar
  67. Taylor, L. J., Eapen, V., Maybery, M. T., Midford, S., Paynter, J., Quarmby, L., et al. (2016). Diagnostic evaluation for autism spectrum disorder: A survey of health professionals in Australia. British Medical Journal Open, 6(9), e012517.  https://doi.org/10.1136/bmjopen-2016-012517.CrossRefGoogle Scholar
  68. Thede, L. L., & Coolidge, F. L. (2007). Psychological and neurobehavioral comparisons of children with asperger’s disorder versus high-functioning autism. Journal of Autism and Developmental Disorders, 37(5), 847–854.  https://doi.org/10.1007/s10803-006-0212-0.CrossRefPubMedGoogle Scholar
  69. Tsai, L. Y. (2013). Asperger’s disorder will be back. Journal of Autism and Developmental Disorders, 43(12), 2914.  https://doi.org/10.1007/sl0803-013-1839-2.CrossRefPubMedGoogle Scholar
  70. Volkmar, F. R., & Reichow, B. (2013). Autism in DSM-5: Progress and challenges. Molecular Autism, 4(1), 13.  https://doi.org/10.1186/2040-2392-4-13.CrossRefPubMedPubMedCentralGoogle Scholar
  71. Wechsler, D. (2003). Wechsler Intelligence Scale for Children (4th Ed.)—Technical and interpretative manual. San Antonio, TX: PsychCorp.Google Scholar
  72. Wechsler, D. (2008). Wechsler Adult Intelligence Scale (4th Ed.)—Technical and interpretative manual. San Antonio, TX: PsychCorp.Google Scholar
  73. Wechsler, D. (2011). Wechsler Abbreviated Scale of Intelligence (2nd Ed.)—Technical and interpretative manual. San Antonio, TX: PsychCorp.Google Scholar
  74. Wechsler, D. (2012). Wechsler Preschool and Primary Scale of Intelligence (2nd Ed.)—Technical and interpretative manual. San Antonio, TX: PsychCorp.Google Scholar
  75. Wechsler, D. (2014). Wechsler Intelligence Scale for Children (5th Ed.)—Technical and interpretative manual. San Antonio, TX: PsychCorp.Google Scholar
  76. Wing, L., Gould, J., & Gillberg, C. (2011). Autism spectrum disorders in the DSM-V: Better or worse than the DSM-IV? Research in Developmental Disabilities, 32, 768–773.  https://doi.org/10.1016/j.ridd.2010.11.003.CrossRefPubMedGoogle Scholar
  77. Woodbury-Smith, M., Klin, A., & Volkmar, F. (2005). Asperger’s syndrome: A comparison of clinical diagnoses and those made according to the ICD-10 and DSM-IV. Journal of Autism and Developmental Disorders, 35(2), 235–240.  https://doi.org/10.1007/s10803-004-2002-x.CrossRefPubMedGoogle Scholar
  78. World Health Organization. (1993). International classification of diseases for mortality and morbidity statistics (10th Revision). Retrieved October 21, 2019 from https://www.who.int/classifications/icd/en/GRNBOOK.pdf.
  79. World Health Organization. (2018). International classification of diseases for mortality and morbidity statistics (11th Revision). Retrieved October 21, 2019 from https://icd.who.int/browse11/l-m/en.
  80. Worley, J. A., & Matson, J. L. (2012). Comparing symptoms of autism spectrum disorders using the current DSM-IV-TR diagnostic criteria and the proposed DSM-V diagnostic criteria. Research in Autism Spectrum Disorders, 6(2), 965–970.  https://doi.org/10.1016/j.rasd.2011.12.012.CrossRefGoogle Scholar
  81. Youngstrom, E. A. (2014). A primer on receiver operating characteristic analysis and diagnostic efficiency statistics for pediatric psychology: We are ready to ROC. Journal of Pediatric Psychology, 39(2), 204–221.  https://doi.org/10.1093/jpepsy/jst062.CrossRefPubMedGoogle Scholar
  82. Zander, E., Willfors, C., Berggren, S., Choque-Olsson, N., Coco, C., Elmund, A., et al. (2016). The objectivity of the autism diagnostic observation schedule (ADOS) in naturalistic clinical settings. European Child and Adolescent Psychiatry, 25(7), 769–780.  https://doi.org/10.1007/s00787-015-0793-2.CrossRefPubMedGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.The Pennsylvania State UniversityMonacaUSA
  2. 2.The Pennsylvania State UniversityWhite OakUSA

Personalised recommendations