World Journal of Pediatrics

, Volume 6, Issue 2, pp 141–147 | Cite as

Diagnostic accuracy, reliability and validity of Childhood Autism Rating Scale in India

  • Paul SS Russell
  • Anna Daniel
  • Sushila Russell
  • Priya Mammen
  • Julie S. Abel
  • Lydia E. Raj
  • Satya Raj Shankar
  • Naveen Thomas
Original Article

Abstract

Background

Since there is no established measure for autism in India, we evaluated the diagnostic accuracy, reliability and validity of Childhood Autism Rating Scale (CARS).

Methods

Children and adolescents suspected of having autism were identified from the unit’s database. Scale and item level scores of CARS were collected and analyzed. Sensitivity, specificity, likelihood ratios and predictive values for various CARS cut-off scores were calculated. Test-retest reliability and inter-rater reliability of CARS were examined. The dichotomized CARS score was correlated with the ICD-10 clinical diagnosis of autism to establish the criterion validity of CARS as a measure of autism. Convergent and divergent validity was calculated. The factor structure of CARS was demonstrated by principal components analysis.

Results

A CARS score of ≥33 (sensitivity = 81.4%, specificity = 78.6%; area under the curve = 81%) was suggested for diagnostic use in Indian populations. The inter-rater reliability (ICC=0.74) and test-retest reliability (ICC=0.81) for CARS were good. Besides the adequate face and content validity, CARS demonstrated good internal consistency (Cronbach’s α=0.79) and item-total correlation. There was moderate convergent validity with Binet-Kamat Test of Intelligence or Gessell’s Developmental Schedule (r=0.42; P=0.01), divergent validity (r=−0.18; P=0.4) with ADD-H Comprehensive Teacher Rating Scale, and high concordance rate with the reference standard, ICD-10 diagnosis (82.52%; Cohen’s κ=0.40, P=0.001) in classifying autism. A 5-factor structure explained 65.34% of variance.

Conclusion

The CARS has strong psychometric properties and is now available for clinical and research work in India.

Key words

autism diagnostic accuracy India reliability validation 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Wing L, Potter D. The epidemiology of autistic spectrum disorders: is the prevalence rising? Ment Retard Dev Disabil Res Rev 2002;8:151–161.CrossRefPubMedGoogle Scholar
  2. 2.
    Prior M. Is there an increase in the prevalence of autism spectrum disorders? J Paediatr Child Health 2003;39:81–82.CrossRefPubMedGoogle Scholar
  3. 3.
    Thacker N. Indian pediatrics and child survival. Indian Pediatr 2007;44:647–648.PubMedGoogle Scholar
  4. 4.
    Elliman DA, Dezateux C, Bedford HE. Newborn and childhood screening programmes: criteria, evidence, and current policy. Arch Dis Child 2002;87:6–9.CrossRefPubMedGoogle Scholar
  5. 5.
    Baird G, Charman T, Cox A, Baron-Cohen S, Swettenham J, Wheelwright S, et al. Current topic: screening and surveillance for autism and pervasive developmental disorders. Arch Dis Child 2001;84:468–475.CrossRefPubMedGoogle Scholar
  6. 6.
    Ozonoff S, Goodlin-Jones BL, Solomon M. Evidence-based assessment of autism spectrum disorders in children and adolescents. J Clin Child Adolesc Psychol 2005;34:523–540.CrossRefPubMedGoogle Scholar
  7. 7.
    Schopler E, Reichler RJ, Renner BR. Childhood Autism Rating Scale. Los Angeles: Western Psychological Services, 1988.Google Scholar
  8. 8.
    DiLalla DL, Rogers SJ. Domains of the Childhood Autism Rating Scale: relevance for diagnosis and treatment. J Autism Dev Disord 1994;24:115–128.CrossRefPubMedGoogle Scholar
  9. 9.
    Nordin V, Gillberg C, Nyden A. The Swedish version of the Childhood Autism Rating Scale in a clinical setting. J Autism Dev Disord 1998;28:69–75.CrossRefPubMedGoogle Scholar
  10. 10.
    Rellini E, Tortolani D, Trillo S, Carbone S, Montecchi F. Childhood Autism Rating Scale (CARS) and Autism Behavior Checklist (ABC) correspondence and conflicts with DSM-IV criteria in diagnosis of autism. J Autism Dev Disord 2004;34: 703–708.CrossRefPubMedGoogle Scholar
  11. 11.
    Perry A, Condillac RA, Freeman NL, Dunn-Geier J, Belair J. Multi-site study of the Childhood Autism Rating Scale (CARS) in five clinical groups of young children. J Autism Dev Disord 2005;35:625–634.CrossRefPubMedGoogle Scholar
  12. 12.
    Magyar CI, Pandolfi V. Factor structure evaluation of the childhood autism rating scale. J Autism Dev Disord 2007;37:1787–1794.CrossRefPubMedGoogle Scholar
  13. 13.
    Kurita H, Miyake Y, Katsuno K. Reliability and validity of the Childhood Autism Rating Scale—Tokyo version (CARS-TV). J Autism Dev Disord 1989;19:389–396.CrossRefPubMedGoogle Scholar
  14. 14.
    Tachimori H, Osada H, Kurita H. Childhood autism rating scale—Tokyo version for screening pervasive developmental disorders. Psychiatry Clin Neurosci 2003;57:113–118.CrossRefPubMedGoogle Scholar
  15. 15.
    Cochrane AL, Holland WW. Validation of screening procedures. Br Med Bull 1971;27:3–8.PubMedGoogle Scholar
  16. 16.
    Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, et al. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Standards for Reporting of Diagnostic Accuracy. Clin Chem 2003;49:1–6.CrossRefPubMedGoogle Scholar
  17. 17.
    Sponheim E. Changing criteria of autistic disorders: a comparison of the ICD-10 research criteria and DSM-IV with DSM-III-R, CARS, and ABC. J Autism Dev Disord 1996;26:513–525.CrossRefPubMedGoogle Scholar
  18. 18.
    World Health Organization. The International Classification of Disease (ICD-10) Classification of Mental and Behavioral Disorders: Clinical Descriptions and Diagnostic Guidelines. Delhi: Oxford University Press, 1992.Google Scholar
  19. 19.
    Kamat VV. Measuring intelligence of Indian Children. Bombay: Oxford University Press, 1967.Google Scholar
  20. 20.
    Gesell A. The first five years of life: the preschool years. New York: Harper and Brothers Publishers, 1940.Google Scholar
  21. 21.
    Ullmann RK. ACTeRS useful in screening learning disabled from attention deficit disordered (ADD-H) children. Psychopharmacol Bull 1985;21:339–344.PubMedGoogle Scholar
  22. 22.
    Raubenheimer JE. An item selection procedure to maximize scale reliability and validity. SA Journal of Industrial Psychology 2004;30:59–64.Google Scholar
  23. 23.
    Garfin DG, McCallon D, Cox R. Validity and reliability of the Childhood Autism Rating Scale with autistic adolescents. J Autism Dev Disord 1988;18:367–378.CrossRefPubMedGoogle Scholar
  24. 24.
    Mesibov GB, Schopler E, Schaffer B, Michal N. Use of the childhood autism rating scale with autistic adolescents and adults. J Am Acad Child Adolesc Psychiatry 1989;28:538–541.CrossRefPubMedGoogle Scholar
  25. 25.
    Sturmey P, Matson JL, Sevin JA. Brief report: analysis of the internal consistency of three autism scales. J Autism Dev Disord 1992;22:321–328.CrossRefPubMedGoogle Scholar
  26. 26.
    Schopler E, Reichler RJ, DeVellis RF, Daly K. Toward objective classification of childhood autism: Childhood Autism Rating Scale (CARS). J Autism Dev Disord 1980;10:91–103.CrossRefPubMedGoogle Scholar
  27. 27.
    Sevin JA, Matson JL, Coe DA, Fee VE, Sevin BM. A comparison and evaluation of three commonly used autism scales. J Autism Dev Disord 1991;21:417–432.CrossRefPubMedGoogle Scholar
  28. 28.
    Saemundsen E, Magnusson P, Smari J, Sigurdardottir S. Autism Diagnostic Interview-Revised and the Childhood Autism Rating Scale: convergence and discrepancy in diagnosing autism. J Autism Dev Disord 2003;33:319–328.CrossRefPubMedGoogle Scholar
  29. 29.
    Volkmar FR, Klin A, Siegel B, Szatmari P, Lord C, Campbell M, et al. Field trial for autistic disorder in DSM-IV. Am J Psychiatry 1994;151:1361–1367.PubMedGoogle Scholar
  30. 30.
    Kalra V, Seth R, Sapra S. Autism—experiences in a tertiary care hospital. Indian J Pediatr 2005;72:227–230.CrossRefPubMedGoogle Scholar
  31. 31.
    Eaves RC, Milner B. The criterion-related validity of the Childhood Autism Rating Scale and the Autism Behavior Checklist. J Abnorm Child Psychol 1993;21:481–491.CrossRefPubMedGoogle Scholar
  32. 32.
    Stella J, Mundy P, Tuchman R. Social and nonsocial factors in the Childhood Autism Rating Scale. J Autism Dev Disord 1999;29:307–317.CrossRefPubMedGoogle Scholar
  33. 33.
    Szatmari P, Merette C, Bryson SE, Thivierge J, Roy MA, Cayer M, et al. Quantifying dimensions in autism: a factor-analytic study. J Am Acad Child Adolesc Psychiatry 2002;41:467–474.CrossRefPubMedGoogle Scholar

Copyright information

© Children's Hospital, Zhejiang University School of Medicine and Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Paul SS Russell
    • 1
  • Anna Daniel
    • 1
  • Sushila Russell
    • 1
  • Priya Mammen
    • 1
  • Julie S. Abel
    • 1
  • Lydia E. Raj
    • 1
  • Satya Raj Shankar
    • 1
  • Naveen Thomas
    • 1
  1. 1.Autism Clinic, Child & Adolescent Psychiatry Unit, Department of PsychiatryChristian Medical CollegeVelloreSouthern India

Personalised recommendations