Validity and Reliability of the Early Development Instrument in Indonesia

Abstract

There is increasing interest from international organizations and the research community to use internationally comparable instruments that in turn foster global understanding while providing evidence for local and international policy development. In the field of early childhood, international comparisons have traditionally been limited to indicators such as infant or child mortality and anthropometric data such as stunting and wasting. However, there has been gradual interest in developing international measures that can be used to compare and monitor the holistic development of children. Using both the short and standard versions of the Early Development Instrument (EDI), this paper reports on the process of adaptation of the EDI in Indonesia. Further, it explores the content and construct validity, internal consistency, inter-rater reliability and predictive validity of the EDI using a number of measures including the Strengths and Difficulties Questionnaire, the Dimensional Change Card Sort, and school-based tests of language, mathematics and cognitive performance, collected from a number of informants (caregivers, teachers, and children). We report on data for two cohorts of children: the “younger cohort” were approximately 1 year old (N = 3116) and the “older cohort” were approximately 4 years old (N = 3251) at Time 1. Both cohorts were followed up approximately 4 years later, at Time 2. This study finds that the EDI shows moderate validity and reliability in poor communities in Indonesia and highlights some of the difficulties associated with adapting western instruments for non-western cultures and contexts.

This is a preview of subscription content, log in to check access.

Notes

  1. 1.

    The EDI is usually completed by a child’s class teacher. However, in Indonesia a child generally does not begin school until they are 7 years of age meaning this cohort had not yet begun school. Thus, the EDI was completed for this cohort by their caregiver as part of the overall suite of questionnaires.

References

  1. Alatas, H., Brinkman, S., Chang, M. C., Hadiyati, T., Hartono, D., Hasan, A., & Roesli, R. (2013). Early childhood education and development services in Indonesia. In D. Suryadarma & G. W. Jones (Eds.), Education in Indonesia. Singapore: ISEAS Publishing.

    Google Scholar 

  2. Bernard van Leer Foundation. (2006). A guide to general comment 7: implementing child rights in early childhood. The Hague: United Nations Committee on the Rights of the Child, United Nations Children’s Fund and Bernard van Leer Foundation.

  3. Brinkman, S. (2009, 16–18 November). The Impact and Reach of the EDI Around the World. Paper presented at the The Early Development Imperative: A Pan-Canadian Conference on Population Level Measurement of Children’s Development, Winnipeg, Canada.

  4. Brinkman, S., Silburn, S., Lawrence, D., Goldfeld, S., Sayers, M., & Oberklaid, F. (2007). Investigating the validity of the Australian Early Development Index. Early Education and Development, 18(3), 427–451. doi:10.1080/10409280701610812.

    Article  Google Scholar 

  5. Brinkman, S., Gregory, T., Harris, J., Hart, B., Blackmore, S., & Janus, M. (2013). Associations between the early development instrument at age 5 and reading and numeracy skills at ages 8, 10 and 12: a prospective linked data study. Child Indicators Research, 6(4), 695–708. doi:10.1007/s12187-013-9189-3.

    Article  Google Scholar 

  6. Carlson, S. M. (2005). Developmentally sensitive measures of executive functioning in preschool children. Developmental Neuropsychology, 28(2), 595–616. doi:10.1207/s15326942dn2802_3.

    Article  Google Scholar 

  7. Central Board of Statistics of Indonesia. (2010). National Socioeconomic Survey 2010 (SUSENAS 2010). Jakarta, Indonesia.

  8. Duku, E., Janus, M., Brinkman, S. (2015). Investigation of the cross-national equivalence of a measurement of early child development. Child Indicators Research, 8(2): 471–489. doi:10.1007/s12187-014-9249-3.

  9. Forer, B., & Zumbo, B. D. (2011). Validation of multilevel constructs: validation methods and empirical findings for the EDI. Social Indicators Research, 103(2), 231–265. doi:10.1007/s11205-011-9844-3.

    Article  Google Scholar 

  10. Forget-Dubois, N., Lemelin, J. P., Boivin, M., Dionne, G., Séguin, J. R., Vitaro, F., & Tremblay, R. E. (2007). Predicting early school achievement with the EDI: a longitudinal population-based study. Early Education and Development, 18(3), 405–426. doi:10.1080/10409280701610796.

    Article  Google Scholar 

  11. Frye, D., Zelazo, P. D., & Palfai, T. (1995). Theory of mind and rule-based reasoning. Cognitive Development, 10(4), 483–527. doi:10.1016/0885-2014(95)90024-1.

    Article  Google Scholar 

  12. Goodman, R. (2001). Psychometric properties of the strengths and difficulties questionnaire. Journal of American Academy of Child and Adolescent Psychiatry, 40, 1337–1345.

    Article  Google Scholar 

  13. Goodman, R. (2005). Strengths and Difficulties Questionnaire - Indonesian translation. Retrieved 14/12/2015, from http://www.sdqinfo.com/py/sdqinfo/b3.py?language=Indonesian.

  14. Goodman, R., Renfrew, D., & Mulick, M. (2000). Predicting type of psychiatric disorder from Strength and Difficulties Questionnaires (SDQ) scores in child mental health clinics in London and Dhaka. European Child and Adolescent Psychiatry, 9, 129–134.

    Article  Google Scholar 

  15. Hair, J. E., Anderson, R. E., Tatham, R. L., & Black, W. C. (1998). Multivariate Data Analysis (5th ed.). New Jersey: Prentice-Hall.

    Google Scholar 

  16. Hambleton, R. K., Merenda, P. F., & Speilberger, C. D. (2005). Adapting educational and psychological tests for cross cultural assessment. Mahwah: Lawrence Erlbaum Associates Inc.

    Google Scholar 

  17. Hasan, A., Hyson, M., & Chang, M. C. E. (2013). Early Childhood Education and Development in Poor Villages of Indonesia. Washington DC: Internation Bank for Reconstruction and Development / The World Bank.

    Google Scholar 

  18. Hawes, D. J., & Dadds, M. R. (2004). Australian data and psychometric properties of the Strengths and Difficulties Questionnaire. Australian and New Zealand Journal of Psychiatry, 38(8), 644–651.

    Article  Google Scholar 

  19. Hayes, L. (2007). Problem behaviours in early primary school children: Australian normative data using the strengths and difficulties questionnaire. Australian and New Zealand Journal of Psychiatry, 41, 231–238.

    Article  Google Scholar 

  20. Herdman, M., Fox-Rushby, J., & Badia, X. (1998). A model of equivalence in the cultural adaptation of HRQoL instruments: the universalist approach. Quality of Life Research, 7, 323–335.

    Article  Google Scholar 

  21. How to use the EDI. (2015). Retrieved 14/12/2015, from https://edi.offordcentre.com/researchers/how-to-use-the-edi/.

  22. International Test Commission (ITC). (2000). International Guidelines for Test Use. Retrieved 11/8/2010, from http://www.intestcom.org/guidelines/index.php.

  23. Ip, P., Li, S. L., Rao, N., Ng, S. S. N., Lau, W. W. S., & Chow, C. B. (2013). Validation study of the Chinese Early Development Instrument (CEDI). BMC Pediatrics, 13(1), 146. doi:10.1186/1471-2431-13-146.

    Article  Google Scholar 

  24. Janus, M., & Duku, E. K. (2005). Development of the Short Early Development Instrument (S-EDI). Report for the World Bank.

  25. Janus, M., & Offord, D. (2007). Development and psychometric properties of the Early Development Instrument (EDI): a measure of children’s school readiness. Canadian Journal of Behavioural Science, 39, 1–22.

    Article  Google Scholar 

  26. Janus, M., Brinkman, S., Duku, E., Hertzman, C., Santos, R., & Sayers, M. (2007). The early development instrument: A population-based measure for communities. A handbook on development, properties and use. Hamilton: Offord Centre for Child Studies.

    Google Scholar 

  27. Janus, M., Brinkman, S., & Duku, E. (2011). Validity and psychometric properties of the early development instrument in Canada, Australia, United States and Jamaica. Social Indicators Research, 103(2), 283–297. doi:10.1007/s11205-011-9846-1.

    Article  Google Scholar 

  28. Mize, L., Pambudi, E., Koblinsky, M., Stout, S., Marzoeki, P., Harimurti, P., & Rokx, C. (2010). “.....and then she died”: Indonesia maternal health assessment. In Heath Sector Review (Ed.). Jakarta: World Bank.

  29. Pradhan, M., Brinkman, S. A., Beatty, A., Maika, A., Satriawan, E., de Ree, J., & Hasan, A. (2013). Evaluating a community-based early childhood education and development program in Indonesia: study protocol for a pragmatic cluster randomized controlled trial with supplementary matched control group. Trials, 14(1), 259. doi:10.1186/1745-6215-14-259.

    Article  Google Scholar 

  30. Sabbagh, M., Xu, F., Carlson, S., Moses, L., & Lee, K. (2006). The development of executive functioning and theory-of-mind: a comparison of Chinese and US preschoolers. Psychological Science, 17(1), 74–81.

    Article  Google Scholar 

  31. Sommer, U., Fink, A., & Neubauer, A. C. (2008). Detection of high ability children by teachers and parents: psychometric quality of new rating checklists for the assessment of intellectual, creative and social ability. Psychology Science Quarterly, 50(2), 189–205.

    Google Scholar 

  32. UNICEF. (2009). The State of the World’s Children Special Edition: Celebrating 20 Years of the Convention on the Rights of the Child. New York: United Nations Children Fund.

    Google Scholar 

  33. Woolfson, L., Geddes, R., McNicol, S., Booth, J., & Frank, J. (2013). A cross-sectional pilot study of the Scottish early development instrument: a tool for addressing inequality. BMC Public Health, 13(1), 1187. doi:10.1186/1471-2458-13-1187.

    Article  Google Scholar 

  34. World Bank. (2010). Indonesia Economic Quarterly: Continuity Amidst Volatility. Jakarta.

  35. World Bank. (2012). Targeting Poor and Vulnerable Households in Indonesia. Jakarta: The World Bank.

    Google Scholar 

  36. World Bank. (2013). Slower growth; high risks. Indonesia Economic Quarterly, December 2013. http://www.worldbank.org/content/dam/Worldbank/document/EAP/Indonesia/IEQ-Dec13-ENGLISH.pdf.

  37. Zelazo, P. D. (2006). The Dimensional Change Card Sort (DCCS): a method of assessing executive function in children. Nature Protocols, 1(1), 297–301. doi:10.1038/nprot.2006.46.

    Article  Google Scholar 

Download references

Acknowledgments

Our collaboration has been partially supported by an Australian Government AusAID Development Research Awards Scheme Grant (ADRA0800261). Data collection was partially funded by the Government of the Kingdom of the Netherlands through the Dutch Education Support Program (DESP) Trust Fund (TF057272) which provides support to the Government of Indonesia through the World Bank for the purpose of developing policies, studies, and programs that help the Government achieve its education strategic plan. The findings, interpretations, and conclusions expressed in this paper, do not necessarily reflect the views of the Government of the Kingdom of the Netherlands or the Government of Indonesia.

We would particularly like to acknowledge the AusAID Education Thematic Group and Network Members for their support and interest in the translation of these results into evidence-based policy and practice. In carrying out this project we have worked closely with our colleagues at the World Bank, including Amanda Beatty, Hafid I. Alatas, Joppe de Ree, Titie Hadiyati, Djoko Hartono, Dedy Junaedi, Mayla Safuro, Mulyana and Rosfita Roesli.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Sally A. Brinkman.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Brinkman, S.A., Kinnell, A., Maika, A. et al. Validity and Reliability of the Early Development Instrument in Indonesia. Child Ind Res 10, 331–352 (2017). https://doi.org/10.1007/s12187-016-9372-4

Download citation

Keywords

  • Child Development
  • Early Development Instrument (EDI)
  • Validity
  • Reliability
  • Indonesia