Advertisement

European Child & Adolescent Psychiatry

, Volume 27, Issue 9, pp 1193–1207 | Cite as

Diagnostic accuracy of the ADOS and ADOS-2 in clinical practice

  • I. Kamp-BeckerEmail author
  • K. Albertowski
  • J. Becker
  • M. Ghahreman
  • A. Langmann
  • T. Mingebach
  • L. Poustka
  • L. Weber
  • H. Schmidt
  • J. Smidt
  • T. Stehr
  • V. Roessner
  • K. Kucharczyk
  • N. Wolff
  • S. Stroth
Original Contribution

Abstract

The Autism Diagnostic Observation Schedule is a semi-structured, standardized assessment tool for individuals with suspected autism spectrum disorders (ASD) and is deemed to be part of the gold standard for diagnostic evaluation. Good diagnostic accuracy and interpersonal objectivity have been demonstrated for the ADOS in research setting. The question arises whether this is also true for daily clinical practice and whether diagnostic accuracy depends on specialized experience in the diagnostic evaluation. The present study explores the diagnostic accuracy of the original and the revised version of the ADOS for Modules 1 through 4. Thus, seven cases of ADOS executions were recorded and coded by a group of experts of specialized outpatient clinics for ASD. In an extensive consensus process, including video analysis of every minute of the ADOS executions, a “gold standard” coding for every case was defined. The videos of the ADOS administration were presented to a large group of clinicians (from daily clinical routine care) and their codings (n = 189) were obtained and analysed. Variance of coding and congruence with the expert coding were determined. High variance was found in the codings. The accuracy of the coding depends on the experience of the coder with the ADOS as well as on characteristics of the cases and the quality of the administration of the ADOS. Specialization in the diagnostic of ASD has to be claimed. Specialized outpatient clinics for ASD are required which guarantee a qualified diagnostic/differential diagnostic and case management with the aim of demand-oriented supply of individual cases.

Keywords

Autism spectrum disorder Diagnosis Diagnostic accuracy Inter-rater agreement 

Notes

Compliance with ethical standards

Conflict of interest

The authors declare that they have no conflict of interest.

References

  1. 1.
    Constantino JN, Charman T (2016) Diagnosis of autism spectrum disorder: reconciling the syndrome, its diverse origins, and variation in expression. Lancet Neuol 15(3):279–291CrossRefGoogle Scholar
  2. 2.
    Lai M-C, Lombardo MV, Baron-Cohen S (2014) Autism. Lancet 383(9920):896–910CrossRefPubMedGoogle Scholar
  3. 3.
    APA (2013) Diagnostic and statistical manual of mental disorders, 5th edn. American Psychiatric Publishing, ArlingtonGoogle Scholar
  4. 4.
    Howlin P, Moss P, Savage S, Rutter M (2013) Social outcomes in mid- to later adulthood among individuals diagnosed with autism and average nonverbal IQ as children. J Am Acad Child Adolesc Psychiatry 52(6):572–581CrossRefPubMedGoogle Scholar
  5. 5.
    Schmidt L, Kirchner J, Strunz S, Brozus J, Ritter K, Roepke S, Dziobek I (2015) Psychosocial functioning and life satisfaction in adults with autism spectrum disorder without intellectual impairment. J Clin Psychol 71(12):1259–1268CrossRefPubMedGoogle Scholar
  6. 6.
    Grzadzinski R, Huerta M, Lord C (2013) DSM-5 and autism spectrum disorders (ASDs): an opportunity for identifying ASD subtypes. Mol Autism 4(1):12CrossRefPubMedPubMedCentralGoogle Scholar
  7. 7.
    Veenstra-VanderWeele J, Blakely RD (2012) Networking in autism: leveraging genetic, biomarker and model system findings in the search for new treatments. Neuropsychopharmacology 37(1):196–212CrossRefPubMedGoogle Scholar
  8. 8.
    Steinhausen HC, Mohr Jensen C, Lauritsen MB (2016) A systematic review and meta-analysis of the long-term overall outcome of autism spectrum disorders in adolescence and adulthood. Acta Psychiat Scand 133(6):445–452CrossRefPubMedGoogle Scholar
  9. 9.
    Jensen CM, Martens CS, Nikolajsen ND, Skytt Gregersen T et al (2016) What do the general population know, believe and feel about individuals with autism and schizophrenia: results from a comparative survey in Denmark. Autism 20(4):496–508CrossRefPubMedGoogle Scholar
  10. 10.
    Gillespie-Lynch K, Kapp SK, Brooks PJ, Pickens J, Schwartzman B (2017) Whose expertise is it? Evidence for autistic adults as critical autism experts. Front psychol 8:438CrossRefPubMedPubMedCentralGoogle Scholar
  11. 11.
    Russell G, Norwich B (2012) Dilemmas, diagnosis and de-stigmatization: parental perspectives on the diagnosis of autism spectrum disorders. Clin child psychol psychiatry 17(2):229–245CrossRefPubMedGoogle Scholar
  12. 12.
    Durand-Zaleski I, Scott J, Rouillon F, Leboyer M (2012) A first national survey of knowledge, attitudes and behaviours towards schizophrenia, bipolar disorders and autism in France. BMC Psychiatry 12:128CrossRefPubMedPubMedCentralGoogle Scholar
  13. 13.
    Farrugia D (2009) Exploring stigma: medical knowledge and the stigmatisation of parents of children diagnosed with autism spectrum disorder. Social Health Ill 31(7):1011–1027CrossRefGoogle Scholar
  14. 14.
    Norris M, Lecavalier L (2010) Screening accuracy of Level 2 autism spectrum disorder rating scales: a review of selected instruments. Autism 14(4):263–284CrossRefPubMedGoogle Scholar
  15. 15.
    Hus V, Bishop S, Gotham K, Huerta M, Lord C (2013) Factors influencing scores on the social responsiveness scale. J Child Psychol Psy 54(2):216–224CrossRefGoogle Scholar
  16. 16.
    Collin L, Bindra J, Raju M, Gillberg C, Minnis H (2013) Facial emotion recognition in child psychiatry: a systematic review. Res Dev Dis Abil Res Rev 34(5):1505–1520CrossRefGoogle Scholar
  17. 17.
    Reiersen AM (2011) Links between autism spectrum disorder and ADHD symptom trajectories: important findings and unanswered questions. J Am Acad Child Adolesc Psychiatry 50(9):857–859CrossRefPubMedGoogle Scholar
  18. 18.
    Rommelse NNJ, Franke B, Geurts HM, Hartman CA, Buitelaar JK (2010) Shared heritability of attention-deficit/hyperactivity disorder and autism spectrum disorder. Eur Child Adoles Psy 19(3):281–295CrossRefGoogle Scholar
  19. 19.
    Rommelse NNJ, Geurts HM, Franke B, Buitelaar JK, Hartman CA (2011) A review on cognitive and brain endophenotypes that may be common in autism spectrum disorder and attention-deficit/hyperactivity disorder and facilitate the search for pleiotropic genes. Neurosci Biobehav R 35(6):1363–1396CrossRefGoogle Scholar
  20. 20.
    Pasalich DS, Dadds MR, Hawes DJ (2014) Cognitive and affective empathy in children with conduct problems: additive and interactive effects of callous-unemotional traits and autism spectrum disorders symptoms. Psychiat Res 219(3):625–630CrossRefGoogle Scholar
  21. 21.
    O’Nions E, Sebastian CL, McCrory E, Chantiluke K, Happe F, Viding E (2014) Neural bases of Theory of Mind in children with autism spectrum disorders and children with conduct problems and callous-unemotional traits. Dev Sci 17(5):786–796CrossRefPubMedPubMedCentralGoogle Scholar
  22. 22.
    Schwenck C, Gensthaler A, Romanos M, Freitag CM, Schneider W, Taurines R (2014) Emotion recognition in girls with conduct problems. Eur Child Adoles Psy 23(1):13–22CrossRefGoogle Scholar
  23. 23.
    Cath DC, Ran N, Smit JH, van Balkom AJLM, Comijs HC (2008) Symptom overlap between autism spectrum disorder, generalized social anxiety disorder and obsessive-compulsive disorder in adults: a preliminary case-controlled study. Psychopathology 41(2):101–110CrossRefPubMedGoogle Scholar
  24. 24.
    Tyson KE, Cruess DG (2012) Differentiating high-functioning autism and social phobia. J Autism Dev Disord 42(7):1477–1490CrossRefPubMedGoogle Scholar
  25. 25.
    Ronald A, Happe F, Price TS, Baron-Cohen S, Plomin R (2006) Phenotypic and genetic overlap between autistic traits at the extremes of the general population. J Am Acad Child Adolesc Psychiatry 45(10):1206–1214CrossRefPubMedGoogle Scholar
  26. 26.
    Rutter M, Le Couteur A, Lord C (2003) Autism diagnostic interview-revised (ADI-R). Western Psychological Services, Los AngelesGoogle Scholar
  27. 27.
    Lord C, Risi S, Lambrecht L, Cook EH, Leventhal B et al (2000) The ADOS-G (Autism Diagnostic Observation Schedule-Generic): a standard measure of social-communication deficits associated with autism spectrum disorders. J Autism Dev Disord 30:205–223CrossRefPubMedGoogle Scholar
  28. 28.
    Lord C, Rutter M, Dilavore PC, Risi S, Gotham K, Bishop SL (2012) Autism diagnostic observation schedule, second edition (ADOS-2) manual (Part 1) modules 1-4. Western Psychological Services, Torrance, CAGoogle Scholar
  29. 29.
    National Institute for Health and Clinical Excellence (2011) Autism: recognition, referral and diagnosis of children and young people on the autism spectrum (NICE guideline). National Collaborating Centre for Womens and Childrens Health, LondonGoogle Scholar
  30. 30.
    DGKJP, DGPPN (2016) Autismus-Spektrum-Störungen im Kindes-, Jugend- und Erwachsenenalter - Teil 1: Diagnostik. Interdisziplinäre S3-Leitlinie der DGKJP und der DGPPN sowie der beteiligten Fachgesellschaften, Berufsverbände und Patientenorganisationen. http://www.awmf.org/-leitlinien/detail/ll/028-018.html
  31. 31.
    de Bildt A, Sytema S, Ketelaars C, Kraijer D et al (2004) Interrelationship between autism diagnostic observation schedule-generic (ADOS-G), autism diagnostic interview-revised (ADI-R), and the diagnostic and statistical manual of mental disorders (DSM-IV-TR) classification in children and adolescents with mental retardation. J Autism Dev Disord 34(2):129–137CrossRefPubMedGoogle Scholar
  32. 32.
    de Bildt A, Sytema S, van Lang NDJ, Minderaa RB, van Engeland H, de Jonge MV (2009) Evaluation of the ADOS revised algorithm: the applicability in 558 Dutch children and adolescents. J Autism Dev Disord 39(9):1350–1358CrossRefPubMedPubMedCentralGoogle Scholar
  33. 33.
    Gotham K, Pickles A, Lord C (2009) Standardizing ADOS scores for a measure of severity in autism spectrum disorders. J Autism Dev Disord 39(5):693–705CrossRefPubMedGoogle Scholar
  34. 34.
    Gotham K, Risi S, Dawson G, Tager-Flusberg H, Joseph R et al (2008) A replication of the autism diagnostic observation schedule (ADOS) revised algorithms. J Am Acad Child Adolesc Psychiatry 47(6):642–651CrossRefPubMedPubMedCentralGoogle Scholar
  35. 35.
    Kamp-Becker I, Ghahreman M, Heinzel-Gutenbrunner M, Peters M, Remschmidt H, Becker K (2013) Evaluation of the revised algorithm of autism diagnostic observation schedule (ADOS) in the diagnostic investigation of high-functioning children and adolescents with autism spectrum disorders. Autism 17(1):87–102CrossRefPubMedGoogle Scholar
  36. 36.
    Le Couteur A, Haden G, Hammal D, McConachie H (2008) Diagnosing autism spectrum disorders in pre-school children using two standardised assessment instruments: the ADI-R and the ADOS. J Autism Dev Disord 38(2):362–372CrossRefPubMedGoogle Scholar
  37. 37.
    Mazefsky CA, Oswald DP (2006) The discriminative ability and diagnostic utility of the ADOS-G, ADI-R, and GARS for children in a clinical setting. Autism 10(6):533–549CrossRefPubMedGoogle Scholar
  38. 38.
    Molloy CA, Murray DS, Akers R, Mitchell T, Manning-Courtney P (2013) Use of the autism diagnostic observation schedule (ADOS) in a clinical setting. Autism 15(2):143–162CrossRefGoogle Scholar
  39. 39.
    Oosterling I, Roos S, de Bildt A, Rommelse N, de Jonge M et al (2010) Improved diagnostic validity of the ADOS revised algorithms: a replication study in an independent sample. J Autism Dev Disord 40(6):689–703CrossRefPubMedPubMedCentralGoogle Scholar
  40. 40.
    Overton T, Fielding C, de Alba RG (2008) Brief report: exploratory analysis of the ADOS revised algorithm: specificity and predictive value with Hispanic children referred for autism spectrum disorders. J Autism Dev Disord 38(6):1166–1169CrossRefPubMedGoogle Scholar
  41. 41.
    Gray KM, Tonge BJ, Sweeney DJ (2008) Using the autism diagnostic interview-revised and the autism diagnostic observation schedule with young children with developmental delay: evaluating diagnostic validity. J Autism Dev Disord 38(4):657–667CrossRefPubMedGoogle Scholar
  42. 42.
    Papanikolaou K, Paliokosta E, Houliaras G, Vgenopoulou S, Giouroukou E et al (2009) Using the autism diagnostic interview-revised and the autism diagnostic observation schedule-generic for the diagnosis of autism spectrum disorders in a Greek sample with a wide range of intellectual abilities. J Autism Dev Disord 39(3):414–420CrossRefPubMedGoogle Scholar
  43. 43.
    Bastiaansen JA, Meffert H, Hein S, Huizinga P, Ketelaars C et al (2011) Diagnosing autism spectrum disorders in adults: the use of Autism diagnostic observation schedule (ADOS) module 4. J Autism Dev Disord 41(9):1256–1266CrossRefPubMedGoogle Scholar
  44. 44.
    Brugha TS, McManus S, Smith J, Scott FJ, Meltzer H et al (2012) Validating two survey methods for identifying cases of autism spectrum disorder among adults in the community. Psychol Med 42(3):647–656CrossRefPubMedGoogle Scholar
  45. 45.
    Hus V, Lord C (2014) The autism diagnostic observation schedule, module 4: revised algorithm and standardized severity scores. J Autism Dev Disord 44(8):1996–2012CrossRefPubMedPubMedCentralGoogle Scholar
  46. 46.
    Langmann A, Becker J, Poustka L, Becker K, Kamp-Becker I (2017) Diagnostic utility of the autism diagnostic observation schedule in a clinical sample of adolescents and adults. Res Autism Spectr Disord 34:34–43CrossRefGoogle Scholar
  47. 47.
    Falkmer T, Anderson K, Falkmer M, Horlin C (2013) Diagnostic procedures in autism spectrum disorders: a systematic literature review. Eur Child Adoles Psy 22(6):329–340CrossRefGoogle Scholar
  48. 48.
    Zander E, Willfors C, Berggren S, Choque-Olsson N, Coco C et al (2016) The objectivity of the autism diagnostic observation schedule (ADOS) in naturalistic clinical settings. Eur Child Adoles Psy 25(7):769–780CrossRefGoogle Scholar
  49. 49.
    Lord C, Rutter M, DiLavore PS, Risi S (1999) Autism diagnostic observation schedule: Manual. Western Psychological Services, Los AngelesGoogle Scholar
  50. 50.
    Lord C, Risi S, Lambrecht L, Cook EH Jr, Leventhal BL et al (2000) The autism diagnostic observation schedule-generic: a standard measure of social and communication deficits associated with the spectrum of autism. J Autism Dev Disord 30(3):205–223CrossRefPubMedGoogle Scholar
  51. 51.
    Bolte S, Poustka F (2004) Diagnostic observation scale for autistic disorders: initial results of reliability and validity. Z Kinder Jug-Psych 32(1):45–50CrossRefGoogle Scholar
  52. 52.
    Guttmann-Steinmetz S, Gadow KD, DeVincent CJ, Crowell J (2010) Anxiety symptoms in boys with autism spectrum disorder, attention-deficit hyperactivity disorder, or chronic multiple tic disorder and community controls. J Autism Dev Disord 40(8):1006–1016CrossRefPubMedGoogle Scholar
  53. 53.
    Pine DS, Guyer AE, Goldwin M, Towbin KA, Leibenluft E (2008) Autism spectrum disorder scale scores in pediatric mood and anxiety disorders. J Am Acad Child Adolesc Psychiatry 47:652–661CrossRefPubMedPubMedCentralGoogle Scholar
  54. 54.
    Renno P, Wood JJ (2013) Discriminant and convergent validity of the anxiety construct in children with autism spectrum disorders. J Autism Dev Disord 43(9):2135–2146CrossRefPubMedPubMedCentralGoogle Scholar
  55. 55.
    Towbin KE, Pradella A, Gorrindo T, Pine DS, Leibenluft E (2005) Autism spectrum traits in children with mood and anxiety disorders. J Child Adol Psychop 15(3):452–464CrossRefGoogle Scholar
  56. 56.
    Dissanayake C (2012) Children with social phobia have distinct social skills deficit and vocal characteristics to children with Asperger’s disorder and typically developing children. Evid-Based Ment Health 15(2):37CrossRefPubMedGoogle Scholar
  57. 57.
    van Steensel FJA, Bogels SM, Wood JJ (2013) Autism spectrum traits in children with anxiety disorders. J Autism Dev Disord 43(2):361–370CrossRefPubMedGoogle Scholar
  58. 58.
    Kamp-Becker I, Langmann A, Stehr T, Custodis K, Poustka L, Becker K (2017) Diagnostic accuracy of the ADOS-2 taking account of gender effects. Z Kinder Jugendpsychiatr Psychother 44:1–15Google Scholar
  59. 59.
    Maddox BB, Brodkin ES, Calkins ME, Shea K, Mullan K, Hostager J, Mandell DS, Miller JS (2017) The accuracy of the ADOS-2 in identifying autism among adults with complex psychiatric conditions. J Autism Dev Disord.  https://doi.org/10.1007/s10803-10017-13188-z CrossRefPubMedCentralPubMedGoogle Scholar
  60. 60.
    Brenner H, Gefeller O (1997) Variation of sensitivity, specificity, likelihood ratios and predictive values with disease prevalence. Stat Med 16(9):981–991CrossRefPubMedGoogle Scholar
  61. 61.
    Attia J (2003) Moving beyond sensitivity and specificity: using likelihood ratios to help interpret diagnostic tests. Aust Prescr 26:111–113CrossRefGoogle Scholar
  62. 62.
    Ecker C, Murphy D (2014) Neuroimaging in autism–from basic science to translational research. Nat Rev Neurol 10(2):82–91CrossRefPubMedGoogle Scholar
  63. 63.
    Pierce K, Marinero S, Hazin R, McKenna B, Barnes CC, Malige A (2016) Eye tracking reveals abnormal visual preference for geometric images as an early biomarker of an autism spectrum disorder subtype associated with increased symptom severity. Biol Psychiat 79(8):657–666CrossRefPubMedGoogle Scholar
  64. 64.
    Jones RM, Lord C (2013) Diagnosing autism in neurobiological research studies. Behav Brain Res 251:113–124CrossRefPubMedGoogle Scholar
  65. 65.
    Lord C, Jones RM (2012) Annual research review: re-thinking the classification of autism spectrum disorders. J Child Psychol Psy 53(5):490–509CrossRefGoogle Scholar
  66. 66.
    Varcin KJ, Nelson CA 3rd (2016) A developmental neuroscience approach to the search for biomarkers in autism spectrum disorder. Curr Opin Neurol 29(2):123–129CrossRefPubMedPubMedCentralGoogle Scholar
  67. 67.
    Bachmann C, Gerste B, Hoffmann F (2016) Diagnoses of autism spectrum disorders in Germany: time trends in administrative prevalence and diagnostic stability. Autism.  https://doi.org/10.1177/1362361316673977 CrossRefPubMedGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  • I. Kamp-Becker
    • 1
    • 7
    Email author
  • K. Albertowski
    • 2
  • J. Becker
    • 3
  • M. Ghahreman
    • 4
  • A. Langmann
    • 1
  • T. Mingebach
    • 1
  • L. Poustka
    • 5
    • 6
  • L. Weber
    • 1
  • H. Schmidt
    • 1
  • J. Smidt
    • 1
  • T. Stehr
    • 1
  • V. Roessner
    • 2
  • K. Kucharczyk
    • 2
  • N. Wolff
    • 2
  • S. Stroth
    • 1
  1. 1.Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Medical ClinicPhilipps-University MarburgMarburgGermany
  2. 2.Department of Child and Adolescent Psychiatry, Faculty of MedicineTechnical University DresdenDresdenGermany
  3. 3.Practice for Psychosomatic Medicine and Psychotherapy for AdultsGießenGermany
  4. 4.Department of Child and Adolescent Psychiatry, Psychosomatics and PsychotherapyHerz-Jesu-Hospital FuldaFuldaGermany
  5. 5.Department of Child and Adolescent PsychiatryMedical University of ViennaViennaAustria
  6. 6.Department of Child and Adolescent Psychiatry/PsychotherapyUniversity Medical Center GöttingenGöttingenGermany
  7. 7.Department of Child and Adolescent Psychiatry, Psychosomatics and PsychotherapyUniversity Hospital of Marburg & Philipps-University MarburgMarburgGermany

Personalised recommendations