Abstract
An independent validation was conducted of the Utah Autism and Developmental Disabilities Monitoring Network’s (UT-ADDM) classification of children with autism spectrum disorder (ASD). UT-ADDM final case status (n = 90) was compared with final case status as determined by independent external expert reviewers (EERs). Inter-rater reliability (ICC = 0.84), specificity [0.83 (95 % CI 0.74–0.90)], and sensitivity [0.99 (95 % CI 0.96–1.00)] were high for ASD case versus non-case classification between UT-ADDM and EER. At least one EER disagreed with UT-ADDM on ASD final case status on nine out of 30 records; however, all three EERs disagreed with UT-ADDM for only one record. Findings based on limited data suggest that children with ASD as identified by UT-ADDM are consistently classified as ASD cases by independent autism experts.
References
American Psychiatric Association. (2000). Diagnostic criteria from DSM-IV-TR. Washington, DC: American Psychiatric Association.
American Psychiatric Association. (2013). Diagnostic criteria from DSM-5. Washington, DC: American Psychiatric Association.
Avchen, R. N., Wiggins, L. D., Devine, O., Van Naarden Braun, K., Rice, C., Hobson, N. C., et al. (2011). Evaluation of a records-review surveillance system used to determine the prevalence of autism spectrum disorders. Journal of Autism and Developmental Disorders, 41(2), 227–236.
Bishop, D. V., Whitehouse, A. J., Watt, H. J., & Line, E. A. (2008). Autism and diagnostic substitution: Evidence from a study of adults with a history of developmental language disorder. Developmental Medicine and Child Neurology, 50(5), 341–345.
Centers for Disease Control and Prevention. (2007a). Prevalence of autism spectrum disorders: Autism and Developmental Disabilities Monitoring Network, six sites, United States, 2000. MMWR Surveillance Summaries, 56(1), 1–11.
Centers for Disease Control and Prevention. (2007b). Prevalence of autism spectrum disorders: Autism and Developmental Disabilities Monitoring Network, 14 sites, United States, 2002. MMWR Surveillance Summaries, 56(1), 12–28.
Centers for Disease Control and Prevention. (2009). Prevalence of autism spectrum disorders: Autism and Developmental Disabilities Monitoring Network, United States, 2006. MMWR Surveillance Summaries, 58(10), 1–20.
Centers for Disease Control and Prevention. (2012). Prevalence of autism spectrum disorders: Autism and Developmental Disabilities Monitoring Network, 14 sites, United States, 2008. MMWR Surveillance Summaries, 61(3), 1–21.
Centers for Disease Control and Prevention. (2014). Prevalence of autism spectrum disorders among children aged 8 years: Autism and Developmental Disabilities Monitoring Network, 11 sites, United States, 2010. MMWR Surveillance Summaries, 63(2), 1–19.
Fombonne, E. (2009). Epidemiology of pervasive developmental disorders. Pediatric Research, 65(6), 591–598.
King, M., & Bearman, P. (2009). Diagnostic change and the increased prevalence of autism. International Journal of Epidemiology, 38(5), 1224–1234.
Liptak, G. S., Benzoni, L. B., Mruzek, D. W., Nolan, K. W., Thingvoll, M. A., Wade, C. M., et al. (2008). Disparities in diagnosis and access to health services for children with autism: Data from the National Survey of Children’s Health. Journal of Developmental and Behavioral Pediatrics, 29(3), 152–160.
Lord, C., Petkova, E., Hus, V., Gan, W., Lu, F., Martin, D. M., et al. (2012). A multisite study of the clinical diagnosis of different autism spectrum disorders. Archives of General Psychiatry, 69(3), 306–313.
R Core Team. (2011). A language and environment for statistical computing. Viena, Austria: R Foundation for Statistical Computing. ISBN 3-900051-07-0.
Rice, C. E., Baio, J., Van Naarden Braun, K., Doernberg, N., Meaney, F. J., & Kirby, R. S. (2007). A public health collaboration for the surveillance of autism spectrum disorders. Paediatric and Perinatal Epidemiology, 21(2), 179–190.
Rice, C. E., Nicholas, J., Baio, J., Pettygrove, S., Lee, L., Van Naarden Braun, K., et al. (2010). Changes in autism spectrum disorder prevalence in 4 areas of the United States. Disability and Health Journal, 3(3), 186–201.
Risi, S., Lord, C., Gotham, K., Corsello, C., Chrysler, C., Szatmari, P., et al. (2006). Combining information from multiple sources in the diagnosis of autism spectrum disorders. Journal of the American Academy of Child and Adolescent Psychiatry, 45(9), 1094–1103.
Shattuck, P. T. (2006a). The contribution of diagnostic substitution to the growing administrative prevalence of autism in US special education. Pediatrics, 117(4), 1028–1037.
Shattuck, P. T. (2006b). Diagnostic substitution and changing autism prevalence. Pediatrics, 117(4), 1438–1439.
Van Naarden Braun, K., Pettygrove, S., Daniels, J., Miller, L., Nicholas, J., Baio, J., et al. (2007). Evaluation of a methodology for a collaborative multiple source surveillance network for autism spectrum disorders: Autism and Developmental Disabilities Monitoring Network, 14 sites, United States, 2002. MMWR Surveillance Summaries, 56(1), 29–40.
Yeargin-Allsopp, M., Rice, C., Karapurkar, T., Doernberg, N., Boyle, C., & Murphy, C. (2003). Prevalence of autism in a US metropolitan area. JAMA, 289(1), 49–55.
Acknowledgments
Surveillance data used for this study were collected under the Grant/Cooperative Agreement UR3DD000685 from the Centers for Disease Control and Prevention. The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.
Author information
Authors and Affiliations
Corresponding author
Additional information
This study is dedicated to our friend and co-author, Dr. Brent Petersen who passed away prior to the completion of this manuscript. Brent dedicated his life to serving others including children with autism and their families.
Brent Petersen: Deceased.
Appendix: ASD Independent External Expert Review Summary Coding Form
Appendix: ASD Independent External Expert Review Summary Coding Form
Rights and permissions
About this article
Cite this article
Bakian, A.V., Bilder, D.A., Carbone, P.S. et al. Brief Report: Independent Validation of Autism Spectrum Disorder Case Status in the Utah Autism and Developmental Disabilities Monitoring (ADDM) Network Site. J Autism Dev Disord 45, 873–880 (2015). https://doi.org/10.1007/s10803-014-2187-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10803-014-2187-6