Skip to main content

Examination of the Korean Modified Checklist of Autism in Toddlers: Item Response Theory

Abstract

The study examined the clinical utility and psychometric properties of the Korean Modified Checklist of Autism in Toddlers (K-M-CHAT)-2. A sample of 2300 parents of 16- to 36-month-old children was recruited across South Korea. A phone interview was utilized to follow up with participants who initially screened positive for autism spectrum disorder (ASD). Item response theory was applied to assess the psychometric properties of the K-M-CHAT-2. Parents’ responses were substantially changed after the follow-up, and the final screen-positive rate was 2.3 %. Results indicated that the psychometric properties of items 1, 3, 11, 18 and 22 were not as strong as the other items. The K-M-CHAT-2 is a useful ASD screening test when implemented with a follow-up.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3

References

  1. American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Association.

    Google Scholar 

  2. Anderson, D., Liang, J. W., & Lord, C. (2014). Predicting young adult outcome among more and less cognitively able individuals with ASD spectrum disorders. Journal of Child Psychology and Psychiatry, 55, 485–494. doi:10.1111/jcpp.12178

    Article  PubMed  Google Scholar 

  3. Baron-Cohen, B., Allen, J., & Gillberg, C. (1992). Can ASD be detected at 18 months? The needle, the haystack, and the CHAT. The British Journal of Psychiatry, 161, 839–843. doi:10.1192/bjp.161.6.839

    Article  PubMed  Google Scholar 

  4. Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246.

    Article  PubMed  Google Scholar 

  5. Cabrera-Nguyen, P. (2010). Author guidelines for reporting scale development and validation results. Journal of the Society for Social Work and Research, 1(2), 99–103. doi:10.5243/jsswr.2010.8

    Article  Google Scholar 

  6. Canal-Bedia, R., Garcia-Primo, P., Martin-Cilleron, M. V., Santos-Borbujo, J., Guisuraga-Fernandez, Z., Herraez-Garcia, L., & Posada-de la Paz, M. (2011). Modified Checklist for ASD in Toddlers: Cross-cultural adaptation and validation in Spain. Journal of ASD and Developmental Disorders, 41, 1342–1351. doi:10.1007/s10803-010-1163-z

    Article  Google Scholar 

  7. Centers for Disease Control and Prevention (CDC) (2014). Prevalence of ASD spectrum disorder among children aged 8 years-ASD and developmental disabilities monitoring network, 11 sites, United States, 2010. Morbidity and Mortality Weekly Report, 63(2), 1–21. Retrieved from http://www.cdc.gov/mmwr/preview/mmwrhtml/ss6302a1.htm?s_cid=ss6302a1_w

  8. Chlebowski, C., Robins, D., Barton, M. L., & Fein, D. (2013). Large-scale use of the modified checklist for ASD in low-risk toddlers. Pediatrics, 131, e1121–e1127. doi:10.1542/peds.2012-1525

    PubMed Central  Article  PubMed  Google Scholar 

  9. Daniels, A. M., & Mandell, D. S. (2013). Children’s compliance with American Academy of Pediatrics’ well-child care visit guidelines and the early detection of ASD. Journal of ASD and developmental Disorders, 43(12), 2844–2854. doi:10.1007/s10803-013-x

    Article  Google Scholar 

  10. Dietz, C., Swinkels, S., van Daalen, E., van Engeland, H., & Buitelaar, J. K. (2006). Screening for autistic spectrum disorder in children aged 14–15 months. II: Population screening with the Early Screening of Autistic Traits Questionnaire (ESAT). Design and general findings. Journal of ASD and Developmental Disorders, 36, 713–722. doi:10.1007/s10803-006-0114-1

    Article  Google Scholar 

  11. Eaves, L. C., Wingert, H., & Ho, H. H. (2006). Screening for ASD: Agreement with diagnosis. ASD, 10(3), 229–242. doi:10.1177/1362361306063288

    Google Scholar 

  12. Filipeck, P. A., Accardo, P. J., Ashwal, S., Baranek, G. T., Cook, E. H., Dawson, G., et al. (2000). Practice parameter: Screening and diagnosis of ASD: Report of the quality standards subcommittee of the American Academy of Neurology and Child Neurology Society. Neurology, 55, 468–481. doi:10.1212/WNL.55.4.468

    Article  Google Scholar 

  13. Fombonne, E. (2009). Epidemiology of pervasive developmental disorders. Pediatrics Research, 65, 591–598. doi:10.1203/PDR.0b013e31819e7203

    Article  Google Scholar 

  14. Hays, R., Morales, L. S., & Reise, S. (2000). Item response theory and health outcomes measurement in the 21st century. Medical Care, 38, 1128–1142.

    Article  Google Scholar 

  15. Honda, H., Shimuzu, Y., Imai, M., & Nitto, Y. (2005). Cumulative incidence of childhood ASD; A total population study of better accuracy and precision. Developmental Medicine and Child Neurology, 47, 10–18. Retrieved from http://onlinelibrary.wiley.com; doi:10.1111/j.1469-8749.2005.tb01034.x/pdf

  16. Hong, K., Lee, S., Jung, B., Kim, B., & An, Y. (1999). Prevalence of ASD in a city (Gumi): Population study in 3–6 years old children. Journal of the Korean Association for Persons with ASD, 1(1), 1–25.

    Google Scholar 

  17. Kamio, Y., Inada, N., Koyama, T., Inokuchi, E., Tsuchiya, K., & Kuroda, M. (2013). Effectiveness of using the Modified Checklist for ASD in Toddlers in two-stage screening of ASD spectrum disorder at the 18-month health check-up in Japan. Journal of ASD and Developmental Disorders,. doi:10.1007/s10803-013-1864-1

    Google Scholar 

  18. Kim, H. U. (2009). Korean translation: Modified Checklist of ASD in Toddlers. http://www.mchatscreen.com/Official_M-CHAT_Website.html

  19. Kim, A. Y., Kim, H. J., & Lee, S. H. (2002). Development of K-CHAT. The Korean Journal of Developmental Psychology, 15(3), 17–32.

    Google Scholar 

  20. Kim, Y. S., Leventhal, B. L., Koo, Y., Fombonne, E., Laska, E., Lim, E., et al. (2011). Prevalence of ASD spectrum disorders in a total population sample. The American Journal of Psychiatry, 168, 904–912. doi:10.1176/appi.ajp.2011.10101532

    Article  PubMed  Google Scholar 

  21. Kim, S. J., Seung, H. K., & Hong, G. H. (2013). Preliminary examination of clinical use of the Korean modified checklist of ASD in toddlers. Communication Sciences and Disorders, 18(2), 172–182. doi:10.12963/csd.13017

    Article  Google Scholar 

  22. Kimple, K. S., Bartelt, E. A., Wysocki, K. L., & Stenier, M. J. (2014). Performance of the Modified Checklist for ASD in Toddlers in Spanish-speaking patients. Clinical Pediatrics,. doi:10.1177/0009922814522346

    PubMed  Google Scholar 

  23. Kleinman, J. M., Robins, D. L., Ventola, P. E., Pandey, J., Boorstein, H. C., Esser, E. L., et al. (2008). The Modified Checklist for ASD in Toddlers: A follow-up study investigating the early detection of ASD spectrum disorders. Journal of ASD and Developmental Disorders, 38, 827–839. doi:10.1007/s10803-007-0450-9

    Article  Google Scholar 

  24. Kogan, M. D., Strictland, B. B., Blumberg, S. J., Singh, G. K., Perrin, J. M., & van Dyck, P. C. (2008). A national profile of the health care experiences and family impact of ASD spectrum disorder among children in the United States, 2005–2006. Pediatrics, 122, e1149–e1158. doi:10.1542/peds.2008-1057

    Article  PubMed  Google Scholar 

  25. Korea Institute of Child Care and Education (2010). Korean children panel 2009 data. Korea Institute of Child Care and Education http://www.kicce.re.kr

  26. MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130–149.

    Article  Google Scholar 

  27. Muthén, B., & Muthén, L. (2013). Mplus statistical software version 7.11. https://www.statmodel.com

  28. Pandey, J., Verbalis, A., Robins, D., Boorstein, H., Klin, A., Babitz, T., et al. (2008). Screening for ASD in older and younger toddlers with the Modified Checklist for ASD in Toddlers. ASD, 12, 513–535. doi:10.1177/1362361308094503

    Google Scholar 

  29. Rice, C., Nicholas, J., Baio, J., Pettygrove, S., Lee, L.-C., Braun, K. V. N., et al. (2010). Changes in ASD spectrum disorder prevalence in 4 areas of the United States. Disability and Health Journal, 3, 186–201. doi:10.1016/j.dhjo.2009.10.008

    Article  PubMed  Google Scholar 

  30. Robins, D., Casagrande, K., Barton, M., Chen, C. M., Dumont-Mathieu, T., & Fein, D. (2014). Validation of the Modified Checklist for ASD in Toddlers, revised with follow-up (M-CHAT-R/F). Pediatrics, 133(1), 37–45. doi:10.1542/peds.2013-1813

    PubMed Central  Article  PubMed  Google Scholar 

  31. Robins, D. L., & Dumont-Mathieu, T. M. (2006). Early screening for ASD spectrum disorders: Update on the Modified Checklist for ASD in Toddlers and other measures. Developmental and Behavioral Pediatrics, 27(2), S111–S117. doi:10.1177/1362361308094503

    Article  Google Scholar 

  32. Robins, D. L., Fein, D., Barton, M. L., & Green, J. A. (2001). The Modified Checklist for ASD in Toddlers: An initial study investigating the early detection of ASD and pervasive developmental disorders. Journal of ASD and Developmental Disorders, 31(2), 131–144. doi:10.1007/s10803-007-0450-9

    Article  Google Scholar 

  33. Snow, A. V., & Lecavalier, L. (2008). Sensitivity and specificity of the Modified Checklist for ASD in Toddlers and the Social Communciation Questionnnaire in preschoolers suspected of having pervasive developmental disorders. ASD, 12, 627–644. doi:10.1177/1362361308097116

    Google Scholar 

  34. Stone, W. L., Coonrod, E. E., & Ousley, O. Y. (2000). Brief report: Screening tool for ASD in two-year-olds (STAT): Development and preliminary data. Journal of ASD and Developmental Disorders, 30(6), 607–612. Retrieved from http://download.springer.com/static/pdf/57/art%253A10.1023%252FA%253A1005647629002.pdf?auth66=1388709592_3f75704da7740879905f12a5802495bf&ext=.pdf

  35. Thissen, D. (2000). Reliability and measurement precision. In H. Wainer (Ed.), Computerized adaptive testing: A primer (2nd ed., pp. 159–184). Hillsdale, NJ: Lawrence Erlbaum Associates Publishers.

    Google Scholar 

  36. Thomas, M. L. (2011). The value of item response theory in clinical assessment: A review. Assessment, 18, 291–307. doi:10.1177/1073191110374797

    Article  PubMed  Google Scholar 

  37. Ventola, P., Kleinman, J., Pandey, J., Wilson, L., Esser, E., Boorstein, H., et al. (2007). Differentiating between autism spectrum disorders and other developmental disabilities in children who failed a screening instrument for ASD. Journal of Autism and Developmental Disorders, 37, 425–436. doi:10.1007/s10803-006-0177-z

    Article  PubMed  Google Scholar 

  38. Wiggins, L. D., Piazza, V., & Robins, D. L. (2014). Comparison of a broad-based screen versus disorder-specific screen in detecting young children with an ASD spectrum disorder. ASD, 18, 76–84. doi:10.1177/1362361312466962

    Google Scholar 

  39. Wong, V. C. N., & Hui, S. L. H. (2008). Epidemiological study of ASD spectrum disorder in China. Journal of Child Neurology, 23, 67–72. doi:10.1177/0883073807308702

    Article  PubMed  Google Scholar 

  40. Yama, B., Freeman, T., Graves, E., Yuan, S., & Campbell, M. K. (2012). Examination of the properties of the Modified Checklist for ASD in Toddlers (M-CHAT) in a population sample. Journal of ASD and Developmental Disorders, 42, 23–34. doi:10.1007/s10803-011-1211-3

    Article  Google Scholar 

  41. Zaroff, C. M., & Uhm, S. Y. (2012). Prevalence of ASD spectrum disorders and influence of country of measurement and ethnicity. Social Psychiatry and Psychiatric Epidemiology, 47(3), 395–398. doi:10.1007/s00127-011

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

This study was supported by a Fulbright Scholar Program 2012–2013 U.S. Scholar Award (Korean American Educational Commission) and California State University, Fullerton sabbatical award 2012. We are extremely grateful to the parents who participated in the study. We thank the Jungrang-gu public health center, as well as the many daycare centers, preschools, and many other individuals who assisted in recruiting the participants. An extended gratitude goes out to Korean colleagues (Moonja Shin, Sunah Chang, YoonKyung Lee, Sunghee Choi, DaeYoung Won, Mina Whang, JaeOk Kim) and Eunyoung Park, SuEun Chang, Joanne Min. Special thanks to Prof. Jiyoung Shin at the Korea University who provided with an office and scholarly inspiration during the first author’s sabbatical.

Author information

Affiliations

Authors

Corresponding author

Correspondence to HyeKyeung Seung.

Appendix: K-M-CHAT Version 2

Appendix: K-M-CHAT Version 2

아래 항목에 답해 주시기 바랍니다. 반드시 전 문항에 응답해주십시오. 만약 아래 질문 중 그 행동의 횟수가 빈번하지 않으면 (예: 한 두 번 본 경우) 그 문항은 ‘아니오’ 라고 답해 주십시오

1. 당신이 아이를 안고 그네처럼 흔들어 주거나 무릎에 앉혀 흔들어 주는 것을 아이가 좋아하나요? 아니오
2. 아이가 다른 아이들에게 관심을 가지나요? 아니오
3. 아이가 물건이나 가구에 올라가기나 계단 오르기를 좋아합니까? 아니오
4. 아이가 까꿍 놀이나 숨바꼭질을 좋아합니까? 아니오
5. 아이가 흉내 놀이를 하나요? (예: 인형 돌보기, 전화 걸기 놀기 등) 아니오
6. 아이가 뭔가를 요구할 때 검지 손가락으로 가리킵니까? 아니오
7. 아이가 흥미로운 것을 가리키기 위해 검지 손가락을 사용합니까? 아니오
8. 아이가 자동차나 블록과 같은 작은 장난감을 입으로 빨거나 반복적으로 떨어뜨리지 않고 용도에 맞게 갖고 노나요? 아니오
9. 아이가 당신에게 보여주기 위해 장난감이나 기타 물건을 가지고 오나요? 아니오
10. 아이가 1초에서 2초 이상 당신의 눈을 응시하나요? 아니오
11. 아이가 소리에 민감하다고 느끼시나요? (예: 시끄러워 귀를 막는 행동) 아니오
12. 당신의 얼굴을 보면 미소를 짓거나 당신이 웃으면 따라 웃나요? 아니오
13. 아이가 당신을 따라 하나요? (예: 찡그리면 따라서 찡그림) 아니오
14. 아이가 이름을 부르면 아이가 반응을 하나요? 아니오
15. 당신이 멀리 있는 물건을 손으로 가리키면 아이가 그 쪽을 보나요? 아니오
16. 아이가 걸어 다니나요? 아니오
17. 아이가 당신이 보고 있는 것을 따라 보나요? 아니오
18. 아이가 자신의 얼굴 주위에서 손가락으로 특이한 행동을 하나요? 아니오
19. 아이가 자신의 행동으로 당신의 관심을 끌려고 하나요? 아니오
20. 아이의 청각에 문제가 있다고 생각한 적이 있나요? 아니오
21. 아이가 다른 사람의 말을 이해하나요? 아니오
22. 아이가 허공을 응시하거나 목적 없이 돌아다니나요? 아니오
23. 아이가 낯선 것을 봤을 때 당신의 반응을 보기 위해 당신의 얼굴을 보나요? 아니오
  1. © Copyright by Diana Robins, Deborah Fein, and Marianne Barton. Translated into Korean by Hyun Uk Kim, Fairfield University

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Seung, H., Ji, J., Kim, SJ. et al. Examination of the Korean Modified Checklist of Autism in Toddlers: Item Response Theory. J Autism Dev Disord 45, 2744–2757 (2015). https://doi.org/10.1007/s10803-015-2439-0

Download citation

Keywords

  • ASD screening
  • Korean M-CHAT
  • Item response theory
  • Population screening