Advertisement

When Are We Sure? Predictors of Clinician Certainty in the Diagnosis of Autism Spectrum Disorder

  • Christina G. McDonnellEmail author
  • Catherine C. Bradley
  • Stephen M. Kanne
  • Clara Lajonchere
  • Zachary Warren
  • Laura A. Carpenter
Original Paper

Abstract

Differential diagnosis of autism spectrum disorder (ASD) is challenging, and uncertainty regarding a child’s diagnosis may result in under-identification or prolonged diagnostic pathways. The current study examined diagnostic certainty, or how sure clinicians were that their diagnosis was accurate, among 478 toddler and preschool-aged children referred for possible ASD to academic medical specialty clinics. Overall, 60 percent of diagnoses were made with complete certainty. Clinicians were more certain when positively identifying ASD than ruling it out. Children presenting with a moderate (vs high or low) level of observable ASD symptoms were less likely to have a certain diagnosis. Further, clinicians rated less diagnostic certainty for older children, those with public insurance, and those with higher IQ and adaptive behavior abilities.

Keywords

Autism spectrum disorder Diagnostic certainty Differential diagnosis 

Notes

Acknowledgments

This research was supported by a Grant from Cognoa, Inc. The authors would like to thank the project coordinators, research staff, and clinicians at each site for their assistance (i.e., Rebecca Brewster, Connie Brooks, Heather Dyer, Casey Irwin, Kristy Jackson, Melissa Mahurin, Amy Nicholson, Justine Park, Madeline Santulli, Amanda Shocklee, Nicole Takahashi, and Alison Vehorn). We are very grateful to the families and participants who made this study possible.

Author Contributions

CGM conceived and drafted the manuscript and performed statistical analyses. CCB, LAC, SMK, ZW, and CL participated in the design and coordination of the study, and assisted with preparation of the draft. All authors read and approved the final manuscript.

Compliance with Ethical Standards

Conflict of interest

The authors declare that they have no conflict of interest.

Informed Consent

Informed consent was obtained from all caregivers who participated in the study.

References

  1. Achenbach, T. M., & Rescorla, L. (2000). Child behavior checklist. Burlington.Google Scholar
  2. Akshoomoff, N., Corsello, C., & Schmidt, H. (2006). The role of the autism diagnostic observation schedule in the assessment of autism spectrum disorders in school and community settings. The California School Psychologist, 11(1), 7–19.PubMedCrossRefGoogle Scholar
  3. American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Pub.CrossRefGoogle Scholar
  4. Bradshaw, J., Steiner, A. M., Gengoux, G., & Koegel, L. K. (2015). Feasibility and effectiveness of very early intervention for infants at-risk for autism spectrum disorder: A systematic review. Journal of Autism and Developmental Disorders, 45(3), 778–794.PubMedCrossRefGoogle Scholar
  5. Brett, D., Warnell, F., McConachie, H., & Parr, J. R. (2016). Factors affecting age at ASD diagnosis in UK: No evidence that diagnosis age has decreased between 2004 and 2014. Journal of Autism and Developmental Disorders, 46(6), 1974–1984.PubMedPubMedCentralCrossRefGoogle Scholar
  6. Brewer, N. (2006). Uses and abuses of eyewitness confidence. Legal and Criminological Psychology, 11, 3–23.CrossRefGoogle Scholar
  7. Brogan, C. A., & Knussen, C. (2003). The disclosure of a diagnosis of an autistic spectrum disorder: Determinants of satisfaction in a sample of Scottish parents. Autism, 7(1), 31–46.PubMedCrossRefGoogle Scholar
  8. Charman, T., & Baird, G. (2002). Practitioner review: Diagnosis of autism spectrum disorder in 2-and 3-year-old children. Journal of Child Psychology and Psychiatry, 43(3), 289–305.PubMedCrossRefGoogle Scholar
  9. Constantino, J. N., & Gruber, C. P. (2012). Social responsiveness scale, Second Edition (SRS-2). Torrance: Western Psychological Services.Google Scholar
  10. Corsello, C. M., Akshoomoff, N., & Stahmer, A. C. (2013). Diagnosis of autism spectrum disorders in 2-year-olds: A study of community practice. Journal of Child Psychology and Psychiatry, 54(2), 178–185.PubMedCrossRefGoogle Scholar
  11. Crane, L., Chester, J. W., Goddard, L., Henry, L. A., & Hill, E. (2016). Experiences of autism diagnosis: A survey of over 1000 parents in the United Kingdom. Autism, 20(2), 153–162.PubMedCrossRefGoogle Scholar
  12. de Marchena, A., & Miller, J. (2017). “Frank” presentations as a novel research construct and element of diagnostic decision-making in autism spectrum disorder. Autism Research, 10(4), 653–662.PubMedCrossRefGoogle Scholar
  13. Eaves, L. C., & Ho, H. H. (2004). The very early identification of autism: Outcome to age 41/2–5. Journal of Autism and Developmental Disorders, 34(4), 367–378.PubMedCrossRefGoogle Scholar
  14. Elliot, C. (2007). Differential abilities scale – 2nd edition (DAS-II) manual. San Antonio: Harcourt Assessment, Inc.Google Scholar
  15. Esler, A. N., Bal, V. H., Guthrie, W., Wetherby, A., Weismer, S. E., & Lord, C. (2015). The autism diagnostic observation schedule, toddler module: Standardized severity scores. Journal of Autism and Developmental Disorders, 45(9), 2704–2720.PubMedPubMedCentralCrossRefGoogle Scholar
  16. Estes, A., Zwaigenbaum, L., Gu, H., John, T. S., Paterson, S., Elison, J. T., Kostopoulos, P. (2015). Behavioral, cognitive, and adaptive development in infants with autism spectrum disorder in the first 2 years of life. Journal of Neurodevelopmental Disorders, 7(1), 24.PubMedPubMedCentralCrossRefGoogle Scholar
  17. Fountain, C., King, M. D., & Bearman, P. S. (2011). Age of diagnosis for autism: Individual and community factors across 10 birth cohorts. Journal of Epidemiology & Community Health, 65(6), 503–510.CrossRefGoogle Scholar
  18. Fountain, C., Winter, A. S., & Bearman, P. S. (2012). Six developmental trajectories characterize children with autism. Pediatrics, 129(5), e1112–e1120.PubMedPubMedCentralCrossRefGoogle Scholar
  19. Garb, H. N. (2005). Clinical judgment and decision making. Annual Review of Clinical Psychology 2005, 1, 67–89.CrossRefGoogle Scholar
  20. Gebauer, L., Foster, N. E., Vuust, P., & Hyde, K. L. (2015). Is there a bit of autism in all of us? Autism spectrum traits are related to cortical thickness differences in both autism and typical development. Research in Autism Spectrum Disorders, 13, 8–14.CrossRefGoogle Scholar
  21. Goin-Kochel, R. P., Mackintosh, V. H., & Myers, B. J. (2006). How many doctors does it take to make an autism spectrum diagnosis? Autism, 10(5), 439–451.PubMedCrossRefGoogle Scholar
  22. Granpeesheh, D., Dixon, D. R., Tarbox, J., Kaplan, A. M., & Wilke, A. E. (2009). The effects of age and treatment intensity on behavioral intervention outcomes for children with autism spectrum disorders. Research in Autism Spectrum Disorders, 3(4), 1014–1022.CrossRefGoogle Scholar
  23. Guthrie, W., Swineford, L. B., Nottke, C., & Wetherby, A. M. (2013). Early diagnosis of autism spectrum disorder: Stability and change in clinical diagnosis and symptom presentation. Journal of Child Psychology and Psychiatry, 54(5), 582–590.PubMedCrossRefGoogle Scholar
  24. Halladay, A. K., Bishop, S., Constantino, J. N., Daniels, A. M., Koenig, K., Palmer, K., Taylor, J. L. (2015). Sex and gender differences in autism spectrum disorder: Summarizing evidence gaps and identifying emerging areas of priority. Molecular Autism, 6(1), 36.PubMedPubMedCentralCrossRefGoogle Scholar
  25. Happé, F. G., Mansour, H., Barrett, P., Brown, T., Abbott, P., & Charlton, R. A. (2016). Demographic and cognitive profile of individuals seeking a diagnosis of autism spectrum disorder in adulthood. Journal of Autism and Developmental Disorders, 46(11), 3469–3480.PubMedCrossRefGoogle Scholar
  26. Hedley, D., Brewer, N., Nevill, R., Uljarević, M., Butter, E., & Mulick, J. A. (2016). The relationship between clinicians’ certainty and accuracy, and the influence of child characteristics, in the screening of autism spectrum disorder. Journal of Autism and Developmental Disorders, 46(7), 2340–2348.PubMedCrossRefGoogle Scholar
  27. Howlin, P., & Moore, A. (1997). Diagnosis in autism: A survey of over 1200 patients in the UK. Autism, 1(2), 135–162.CrossRefGoogle Scholar
  28. Hus, V., Gotham, K., & Lord, C. (2014). Standardizing ADOS domain scores: Separating severity of social affect and restricted and repetitive behaviors. Journal of Autism and Developmental Disorders, 44(10), 2400–2412.PubMedPubMedCentralCrossRefGoogle Scholar
  29. Kaboski, J., McDonnell, C. G., & Valentino, K. (2017). Resilience and Autism Spectrum Disorder: Applying Developmental Psychopathology to Optimal Outcome. Review Journal of Autism and Developmental Disorders, 4(3), 175–189.CrossRefGoogle Scholar
  30. Kanne, S. M., Carpenter, L. A., & Warren, Z. (2018). Screening in toddlers and preschoolers at risk for autism spectrum disorder: Evaluating a novel mobile-health screening tool. Autism Research;, 11(7), 1038–1049.PubMedCrossRefGoogle Scholar
  31. Kim, S. H., & Lord, C. (2012). Combining information from multiple sources for the diagnosis of autism spectrum disorders for toddlers and young preschoolers from 12 to 47 months of age. Journal of Child Psychology and Psychiatry, 53(2), 143–151.PubMedCrossRefGoogle Scholar
  32. Kotov, R., Krueger, R. F., Watson, D., Achenbach, T. M., Althoff, R. R., Bagby, R. M., … Eaton, N. R. (2017). The Hierarchical Taxonomy of Psychopathology (HiTOP): A dimensional alternative to traditional nosologies. Journal of Abnormal Psychology, 126(4), 454.PubMedCrossRefGoogle Scholar
  33. Lai, M. C., Lombardo, M. V., Auyeung, B., Chakrabarti, B., & Baron-Cohen, S. (2015). Sex/gender differences and autism: Setting the scene for future research. Journal of the American Academy of Child & Adolescent Psychiatry, 54(1), 11–24.CrossRefGoogle Scholar
  34. Lai, M. C., Lombardo, M. V., Ruigrok, A. N., Chakrabarti, B., Auyeung, B., & Szatmari, P., MRC AIMS Consortium. (2017). Quantifying and exploring camouflaging in men and women with autism. Autism, 21(6), 690–702.PubMedCrossRefGoogle Scholar
  35. Lenhard, W., Breitenbach, E., Ebert, H., Schindelhauer-Deutscher, H. J., & Henn, W. (2005). Psychological benefit of diagnostic certainty for mothers of children with disabilities: Lessons from down syndrome. American Journal of Medical Genetics Part A, 133(2), 170–175.CrossRefGoogle Scholar
  36. Lord, C., & Jones, R. M. (2012). Annual research review: Re-thinking the classification of autism spectrum disorders. Journal of Child Psychology and Psychiatry, 53(5), 490–509.PubMedCrossRefGoogle Scholar
  37. Lord, C., Luyster, R., Gotham, K., & Guthrie, W. J. (2012a). Autism diagnostic observation schedule, second edition (ADOS-2) Manual (Part II): –Toddler Module. Los Angeles: Western Psychological Services.Google Scholar
  38. Lord, C., Rutter, M., DiLavore, P. C., Risi, S., Gotham, K., & Bishop, S. L. (2012b). Autism diagnostic observation schedule, second edition (ADOS-2) Manual (Part 1); Modules 1–4. Torrance: Western Psychological Services.Google Scholar
  39. Mandell, D. S., Novak, M. M., & Zubritsky, C. D. (2005). Factors associated with age of diagnosis among children with autism spectrum disorders. Pediatrics, 116(6), 1480–1486.PubMedPubMedCentralCrossRefGoogle Scholar
  40. Mandell, D. S., Wiggins, L. D., Carpenter, L. A., Daniels, J., DiGuiseppi, C., Durkin, M. S., … Shattuck, P. T. (2009). Racial/ethnic disparities in the identification of children with autism spectrum disorders. American Journal of Public Health, 99(3), 493–498.PubMedPubMedCentralCrossRefGoogle Scholar
  41. Matson, J. L., Beighley, J., & Turygin, N. (2012). Autism diagnosis and screening: Factors to consider in differential diagnosis. Research in Autism Spectrum Disorders, 6(1), 19–24.CrossRefGoogle Scholar
  42. Matson, J. L., Nebel-Schwalm, M., & Matson, M. L. (2007). A review of methodological issues in the differential diagnosis of autism spectrum disorders in children. Research in Autism Spectrum Disorders, 1(1), 38–54.CrossRefGoogle Scholar
  43. Matson, J. L., Wilkins, J., & Gonzalez, M. (2008). Early identification and diagnosis in autism spectrum disorders in young children and infants: How early is too early? Research in Autism Spectrum Disorders, 2(1), 75–84.CrossRefGoogle Scholar
  44. Miller, D. J., Spengler, E. S., & Spengler, P. M. (2015). A meta-analysis of certainty and judgment accuracy in clinical decision making. Journal of Counseling Psychology, 62(4), 553.PubMedCrossRefGoogle Scholar
  45. Moh, T. A., & Magiati, I. (2012). Factors associated with parental stress and satisfaction during the process of diagnosis of children with autism spectrum disorders. Research in Autism Spectrum Disorders, 6(1), 293–303.CrossRefGoogle Scholar
  46. Mullen, E. M. (1995). Mullen scales of early learning (AGS ed.). Circle Pines: American Guidance Service, Inc.Google Scholar
  47. Osterling, J., & Dawson, G. (1994). Early recognition of children with autism: A study of first birthday home videotapes. Journal of Autism and Developmental Disorders, 24(3), 247–257.PubMedCrossRefGoogle Scholar
  48. Ozonoff, S., Young, G. S., Steinfeld, M. B., Hill, M. M., Cook, I., Hutman, T., … Sigman, M. (2009). How early do parent concerns predict later autism diagnosis? Journal of Developmental and Behavioral Pediatrics, 30(5), 367.PubMedPubMedCentralCrossRefGoogle Scholar
  49. Penner, M., King, G. A., Hartman, L., Anagnostou, E., Shouldice, M., & Hepburn, C. M. (2017). Community general pediatricians’ perspectives on providing autism diagnoses in Ontario, Canada: a qualitative study. Journal of Developmental and Behavioral Pediatrics, 38(8), 593.PubMedPubMedCentralCrossRefGoogle Scholar
  50. Regier, D. A., Narrow, W. E., Clarke, D. E., Kraemer, H. C., Kuramoto, S. J., Kuhl, E. A., & Kupfer, D. J. (2013). DSM-5 field trials in the United States and Canada, Part II: Test-retest reliability of selected categorical diagnoses. American Journal of Psychiatry, 170(1), 59–70.PubMedCrossRefGoogle Scholar
  51. Rescorla, L. A., Winder-Patel, B. M., Paterson, S. J., Pandey, J., Wolff, J. J., Schultz, R. T., & Piven, J. (2017). Autism spectrum disorder screening with the CBCL/1½–5: Findings for young children at high risk for autism spectrum disorder. Autism.  https://doi.org/10.1177/1362361317718482.PubMedCrossRefGoogle Scholar
  52. Risi, S., Lord, C., Gotham, K., Corsello, C., Chrysler, C., Szatmari, P., & Pickles, A. (2006). Combining information from multiple sources in the diagnosis of autism spectrum disorders. Journal of the American Academy of Child & Adolescent Psychiatry, 45(9), 1094–1103.CrossRefGoogle Scholar
  53. Robins, D. L., Casagrande, K., Barton, M., Chen, C. M. A., Dumont-Mathieu, T., & Fein, D. (2014). Validation of the modified checklist for autism in toddlers, revised with follow-up (M-CHAT-R/F). Pediatrics, 133(1), 37–45.PubMedPubMedCentralCrossRefGoogle Scholar
  54. Rogers, C. L., Goddard, L., Hill, E. L., Henry, L. A., & Crane, L. (2016). Experiences of diagnosing autism spectrum disorder: A survey of professionals in the United Kingdom. Autism, 20(7), 820–831.PubMedCrossRefGoogle Scholar
  55. Rutherford, M., Burns, M., Gray, D., Bremner, L., Clegg, S., Russell, L., O’Hare, A. (2018). Improving efficiency and quality of the children’s ASD diagnostic pathway: Lessons learned from practice. Journal of Autism and Developmental Disorders, 48(5), 1579–1595.PubMedCrossRefGoogle Scholar
  56. Rutherford, M., McKenzie, K., Forsyth, K., McCartney, D., O’Hare, A., McClure, I., & Irvine, L. (2016). Why are they waiting? Exploring professional perspectives and developing solutions to delayed diagnosis of autism spectrum disorder in adults and children. Research in Autism Spectrum Disorders, 31, 53–65.CrossRefGoogle Scholar
  57. Rutter, M., Bailey, A., & Lord, C. (2003). The social communication questionnaire: Manual. Western Psychological Services.Google Scholar
  58. Ruzich, E., Allison, C., Smith, P., Watson, P., Auyeung, B., Ring, H., & Baron-Cohen, S. (2015). Measuring autistic traits in the general population: A systematic review of the Autism-Spectrum Quotient (AQ) in a nonclinical population sample of 6,900 typical adult males and females. Molecular Autism, 6(1), 2.PubMedPubMedCentralCrossRefGoogle Scholar
  59. Rynkiewicz, A., Schuller, B., Marchi, E., Piana, S., Camurri, A., Lassalle, A., & Baron-Cohen, S. (2016). An investigation of the ‘female camouflage effect’in autism using a computerized ADOS-2 and a test of sex/gender differences. Molecular Autism, 7(1), 10.PubMedPubMedCentralCrossRefGoogle Scholar
  60. Sacrey, L. A. R., Bennett, J. A., & Zwaigenbaum, L. (2015). Early infant development and intervention for autism spectrum disorder. Journal of Child Neurology, 30(14), 1921–1929.PubMedCrossRefGoogle Scholar
  61. Shattuck, P. T., Durkin, M., Maenner, M., Newschaffer, C., Mandell, D. S., Wiggins, L., … Baio, J. (2009). Timing of identification among children with an autism spectrum disorder: Findings from a population-based surveillance study. Journal of the American Academy of Child & Adolescent Psychiatry, 48(5), 474–483.CrossRefGoogle Scholar
  62. Sparrow, S. S., Cicchetti, D., & Balla, D. A. (2005). Vineland adaptive behavior scales – 2nd edition manual. Minneapolis: NCS Pearson, Inc.Google Scholar
  63. Stadnick, N., Brookman-Frazee, L., Williams, K. N., Cerda, G., & Akshoomoff, N. (2015). A pilot study examining the use of the autism diagnostic observation schedule in community-based mental health clinics. Research in Autism Spectrum Disorders, 20, 39–46.PubMedPubMedCentralCrossRefGoogle Scholar
  64. Turner, L. M., Stone, W. L., Pozdol, S. L., & Coonrod, E. E. (2006). Follow-up of children with autism spectrum disorders from age 2 to age 9. Autism, 10(3), 243–265.PubMedCrossRefGoogle Scholar
  65. Unigwe, S., Buckley, C., Crane, L., Kenny, L., Remington, A., & Pellicano, E. (2017). GPs’ certainty in caring for their patients on the autism spectrum: An online self-report study. British Journal of General Practice, 67(659), e445–e452.PubMedCrossRefGoogle Scholar
  66. Williams, M. E., Atkins, M., & Soles, T. (2009). Assessment of autism in community settings: Discrepancies in classification. Journal of Autism and Developmental Disorders, 39(4), 660–669.PubMedCrossRefGoogle Scholar
  67. Zwaigenbaum, L., Bauman, M. L., Choueiri, R., Kasari, C., Carter, A., Granpeesheh, D., Pierce, K. (2015). Early intervention for children with autism spectrum disorder under 3 years of age: Recommendations for practice and research. Pediatrics, 136(Supplement 1), S60–S81.PubMedCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Christina G. McDonnell
    • 1
    Email author
  • Catherine C. Bradley
    • 2
  • Stephen M. Kanne
    • 3
  • Clara Lajonchere
    • 4
  • Zachary Warren
    • 5
  • Laura A. Carpenter
    • 2
  1. 1.University of Western OntarioLondonCanada
  2. 2.Department of PediatricsMedical University of South CarolinaCharlestonUSA
  3. 3.Department of Health Psychology and Thompson Center for Autism and Neurodevelopmental DisordersUniversity of MissouriColumbiaUSA
  4. 4.UCLA Institute for Precision HealthLos AngelesUSA
  5. 5.Department of Pediatrics, Vanderbilt Kennedy CenterVanderbilt University Medical CenterNashvilleUSA

Personalised recommendations