The Relationship Between Clinicians’ Confidence and Accuracy, and the Influence of Child Characteristics, in the Screening of Autism Spectrum Disorder
- 711 Downloads
The study examined the confidence accuracy relationship, and the influence of child characteristics on clinician confidence, when predicting a diagnosis of Autism Spectrum Disorder during screening of 125 referred children aged under 3.5 years. The diagnostic process included observation, interview, language and developmental testing. Clinical judgement accuracy was compared against final diagnosis for high and low confidence levels (with confidence assessed on a 0–100 % scale). We identified a significant CA relationship with predictive accuracy highest at confidence levels of 90–100 %. Parent report of unusual behaviors was the only significant independent predictor of confidence. Clinicians’ confidence may be important when evaluating decisions to refer, or not to refer, children for further diagnostic assessment.
KeywordsAutism Spectrum Disorder Screening Diagnosis Clinical judgement Confidence Accuracy Assessment
This research was supported by Nationwide Children’s Hospital Clinical and Translational Intramural Grant #203213 awarded to Darren Hedley. We would like to thank the staff and families who participated in the study. We also thank Sarah Beinkampen, Natalie Fields, Mark Jones, Emily Mariotti, Yessica Monroy Moreno and Brianna Murphy for their assistance with data collection, and Dr. Elizabeth Kryszak and Dr. Nathan Weber for their contributions to the study design.
DH, NB and JAM conceived and designed the study. DH and RN collected the data. DH, NB, RN and MU performed the analysis. All authors contributed to the writing and review of the manuscript. All authors approved the final version.
Compliance with Ethical Standards
Conflict of interest
The authors confirm that there are no conflict of interest to declare.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent was obtained from all individual participants included in the study where required to do so by the Institutional Review Board.
- Achenbach, T. M., & Rescorla, L. A. (2000). Manual for the ASEBA Preschool forms and profiles. Burlington, VT: University of Vermont Department of Psychiatry.Google Scholar
- American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: American Psychiatric Publishing.Google Scholar
- Barbaro, J., Ridgway, L., & Dissanayake, C. (2011). Developmental surveillance of infants and toddlers by maternal and child health nurses in an Australian community-based setting: Promoting the early identification of Autism Spectrum Disorders. Journal of Pediatric Nursing, 26, 334–347.CrossRefPubMedGoogle Scholar
- Centers for Disease Control and Prevention. (2012). Prevalence of autism spectrum disorders—Autism and Developmental Disabilities Monitoring Network, 14 sites, United States, 2008. MMWR 2012; 61 (No. SS-3).Google Scholar
- Dawson, G., Jones, E. J. H., Merkle, K., Venema, K., Lowy, R., Faja, S., & Webb, S. J. (2012). Early behavioral intervention is associated with normalized brain activity in young children with autism. Journal of the American Academy of Child and Adolescent Psychiatry, 51, 1150–1159.CrossRefPubMedPubMedCentralGoogle Scholar
- Goldstein, S., & Naglieri, J. A. (2010). Autism Spectrum Rating Scales. North Tonawanda, NY: Multi Health Systems.Google Scholar
- Hedley, D., Nevill, R. E., Monroy Moreno, Y., Fields, N., Wilkins, J., Butter, E., & Mulick, J. A. (2015). Efficacy of the ADEC in identifying Autism Spectrum Disorder in clinically referred toddlers in the US. Journal of Autism and Developmental Disorders, 45, 2337–2348.CrossRefPubMedGoogle Scholar
- Levy, S. E., Giarelli, E., Lee, L. C., Schieve, L. A., Kirby, R. S., Cunniff, C., & Rice, C. E. (2010). Autism spectrum disorder and co-occurring developmental, psychiatric, and medical conditions among children in multiple populations of the United States. Journal of Developmental and Behavioral Pediatrics, 31, 267–275.CrossRefPubMedGoogle Scholar
- Lichtenstein, S., Fischhoff, B., & Phillips, L. (1982). Calibration of probabilities: The state of the art to 1980. In D. Kahneman, P. Slavic, & A. Tversky (Eds.), Judgment under uncertainty: Heuristics and biases. New York: Cambridge University Press.Google Scholar
- Lord, C., Luyster, R. J., Gotham, K., & Guthrie, W. (2012a). Autism diagnostic observation schedule, Second Edition (ADOS-2) Manual (Part II): Toddler Module. Torrance, CA: Western Psychological Services.Google Scholar
- Lord, C., Rutter, M., DiLavore, P. C., Risi, S., Gotham, K., & Bishop, S. L. (2012b). Autism diagnostic observation schedule, Second Edition (ADOS-2) Manual (Part I): Modules 1–4. Torrance, CA: Western Psychological Services.Google Scholar
- Messinger, D., Young, G. S., Ozonoff, S., Dobkins, K., Carter, A., Zwaigenbaum, L., & Sigman, M. (2013). Beyond autism: A baby siblings research consortium study of high-risk children at three years of age. Journal of the American Academy of Child and Adolescent Psychiatry, 52, 300–308.CrossRefPubMedPubMedCentralGoogle Scholar
- Mullen, E. M. (1995). Mullen scales of early learning (AGS ed.). Circle Pines, MN: American Guidance Service Inc.Google Scholar
- National Autism Center. (2015). Findings and conclusions: National Standard Project, Phase 2: Addressing the need for evidence-based practice guidelines for Autism Spectrum Disorder. Randolph, MA: National Autism Center.Google Scholar
- Simonoff, E., Pickles, A., Charman, T., Chandler, S., Loucas, T., & Baird, G. (2008). Psychiatric disorders in children with autism spectrum disorders: Prevalence, comorbidity, and associated factors in a population-derived sample. Journal of the American Academy of Child and Adolescent Psychiatry, 47, 921–929.CrossRefPubMedGoogle Scholar
- Sparrow, S., Cicchetti, D., & Balla, D. (2005). Vineland adaptive behavior scales (2nd ed.). Minneapolis, MN: Pearson Assessment.Google Scholar
- Young, R. (2007). Autism detection in early childhood: ADEC. Camberwell, VIC: ACER Press.Google Scholar