Skip to main content

Investigation of the Cross-National Equivalence of a Measurement of Early Child Development

Child Indicators Research volume 8, pages 471–489 (2015)Cite this article

Abstract

The Early Development Instrument (EDI) is a measure of children’s developmental health at school entry in five domains, developed in Canada. A shorter, 48-item version of the EDI covering the same domains, created based on Canadian population data was used. The present study examined the psychometric properties of the domains of the 48-item EDI and the invariance of the measurement models of the domains of the 48-item EDI by sex and across the two South Asian countries, the Philippines and Indonesia. Data for 946, 3 to 5-year-olds in the Philippines, and for 3244, four-year-olds in Indonesia were used. The Strengths and Difficulties Questionnaire (SDQ) subscales were used for purposes of testing concurrent validity. The internal consistencies of the domains of the EDI except for Physical Health and Wellbeing were acceptable. Concurrent validity of the EDI domains with the SDQ subscales was acceptable and associations were in the expected directions. Modifications to the measurement models for the domains were made, where necessary, to allow for cross-loading items across the domains and to improve fit indices without over-fitting. Multiple group analysis using categorical confirmatory factor analysis within the Structural Equation Modeling framework showed that the models for the social competence and emotional maturity domains fit very well across sex and across the two countries. The findings are discussed in the context of requirements and conditions for the validation in modification and application of measures in international contexts.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

References

  • Achenbach, T. M. (1991). Integrative guide for the 1991 CBCL/4-18, YSR, and TRF profiles. Burlington: University of Vermont, Department of Psychiatry.

    Google Scholar 

  • Brinkman, S., Silburn, S., Lawrence, D., Goldfeld, S., Sayers, M., & Oberklaid, F. (2007). Investigating the validity of the Australian Early Development Index. Early Education sand Development, 18(3), 427–451.

    Article  Google Scholar 

  • Byrne, B. M. (2011). Structural equation modeling with Mplus: Basic concepts, applications, and programming. New York: Routledge.

    Google Scholar 

  • Byrne, B. M., & Campbell, T. L. (1999). Cross-cultural comparisons and the presumption of equivalent measurement and theoretical structure. Journal of Cross-Cultural Psychology, 30(5), 555–574.

    Article  Google Scholar 

  • Byrne, B. M., & van de Vijver, F. J. R. (2010). Testing for measurement and structural equivalence in large-scale cross-cultural studies: addressing the issue of nonequivalence. International Journal of Testing, 10(2), 107–132.

    Article  Google Scholar 

  • Byrne, B. M., & Watkins, D. (2003). The issue of measurement invariance revisited. Journal of Cross-Cultural Psychology, 34, 155–175.

    Article  Google Scholar 

  • Byrne, B. M., Shavelson, R. J., & Muthén, B. (1989). Testing for the equivalence of factor covariance and mean structures: the issue of partial measurement invariance. Psychological Bulletin, 105(3), 456–466.

    Article  Google Scholar 

  • Cheung, G. W., & Rensvold, R. B. (1999). Testing factorial invariance across groups: a reconceptualization and proposed new method. Journal of Management, 25, 1–27.

    Article  Google Scholar 

  • De Klerk, G. (2008). Cross-cultural testing. In M. Born, C. D. Foxcroft, & R. Butter (Eds.), Online Readings in Testing and Assessment. International Test Commission. Retrieved from http://www.intestcom.org/publications/orta/cross+cultural+testing.php

  • Forget-Dubois, N., Lemelin, J. P., Boivin, M., & Dionne, G. (2007). Predicting early school achievement with the EDI: a longitudinal population-based study. Early Education and Development, 18(3), 405–426.

    Article  Google Scholar 

  • Goodman, R. (2001). Psychometric properties of the strengths and difficulties questionnaire. Journal of the American Academy of Child & Adolescent Psychiatry., 40(11), 1337–1345.

    Article  Google Scholar 

  • Gregorich, S. E. (2006). Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Medical Care, 44(11), S78–S94.

    Article  Google Scholar 

  • Guhn, M., Gadermann, A., & Zumbo, B. D. (2007). Does the EDI measure school readiness in the same way across different groups of children? Early Education and Development, 18(3), 453–472.

    Article  Google Scholar 

  • Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55.

    Article  Google Scholar 

  • International Test Commission (2010). International test commission guidelines for translating and adapting tests. Retrieved 15/01/2012, from http://www.intestcom.org/upload/sitefiles/40.pdf.

  • Janus, M. (2006). Measuring community early child development. Canadian Association of Principals Journal, 14(3), 14–16.

    Google Scholar 

  • Janus, M. (2009). Steps in adapting and implementing the EDI. Retrieved 22/04/2011, from http://www.councilecd.ca/internationaledi/05.%20Steps%20in%20Adapting%20and%20Implementing%20the%20EDI.pdf.

  • Janus, M., & Duku, E. (2005). Development of the short Early Development Instrument (S-EDI). Report for the World Bank, June

  • Janus, M., & Gaskin, A. (2014). School readiness. In A. C. Michalos (Ed.), Encyclopedia of quality of life research. New York: Springer.

    Google Scholar 

  • Janus, M., & Offord, D. (2007). Development and psychometric properties of the Early Development Instrument (EDI): a measure of children’s school readiness. Canadian Journal of Behavioural Science, 39, 1–22.

    Article  Google Scholar 

  • Janus, M., Brinkman, S., Duku, E., Hertzman, C., Santos, R., & Sayers, M. (2007). The Early Development Instrument: A population-based measure for communities. A handbook on development, properties and use. Hamilton: Offord Centre for Child Studies.

    Google Scholar 

  • Janus, M., Brinkman, S., & Duku, E. (2008). Pilot test results: Child development outcome instruments to be included in UNICEF’s MICS Household Survey, Final Report for UNICEF.

  • Janus, M., Brinkman, S., & Duku, E. (2011). Validity and psychometric properties of Early Development Instrument in Canada, Australia, United States, and Jamaica. Social Indicators Research, 103, 283–297.

    Article  Google Scholar 

  • Millsap, R. E., & Yun-Tein, J. (2004). Assessing factorial invariance in ordered-categorical measures. Multivariate Behavioral Research, 39(3), 479–515.

    Article  Google Scholar 

  • Muthén, B.,& Asparouhov, T. (2002). Latent variable analysis with categorical outcomes: Multiple-group and growth modeling in Mplus. Mplus Web Notes: No. 4. Retrieved 22/04/2011, from www.statmodel.com.

  • Muthén, L. K., & Muthén, B. (2008a). Mplus 5.1 for windows. Los Angeles: Muthén & Muthén.

    Google Scholar 

  • Muthén, L. K., & Muthén, B. (2008b). Mplus user’s guide. Los Angeles: Author.

    Google Scholar 

  • Paulhus, D. L. (1991). Measurement and control of response biases. In J. P. Robinson, P. R. Shaver, & L. S. Wrightsman (Eds.), Measures of personality and social psychological attitudes. San Diego, CA: Academic.

  • Paunonen, S. V., & Ashton, M. C. (1998). The structured assessment of personality across cultures. Journal of Cross-Cultural Psychology, 29, 150–170.

    Article  Google Scholar 

  • Pradhan, M., Brinkman, S., Beatty, A., Satriawan, E., Maika, A., deRee, J., et al. (2013). Study protocol for the evaluation of a community based early childhood education and development program in Indonesia: a pragmatic cluster randomized controlled trial with supplementary matched control group. Trials, 14(1), 259.

    Article  Google Scholar 

  • Prince, M. (2008). Measurement validity in cross-cultural comparative research. Epidemiologia e Psichiatria Sociale, 17(3), 211–220.

    Article  Google Scholar 

  • Reichenheim, M. E., & Moraes, C. L. (2007). Operationalizing the cross-cultural adaptation of epidemiological measurement instruments. Revista de Saúde Pública, 41(4), 665–673.

    Article  Google Scholar 

  • Reise, S. P., Widaman, K. F., & Pugh, R. H. (1993). Confirmatory factor analysis and item response theory: two approaches for exploring measurement invariance. Psychological Bulletin, 114, 552–566.

    Article  Google Scholar 

  • Schmitt, N., & Kuljanin, G. (2008). Measurement invariance: review of practice and implications. Human Resource Management Review, 18, 210–222.

    Article  Google Scholar 

  • Teresi, J. A. (2006). Overview of quantitative measurement methods equivalence, invariance, and differential item functioning in health applications. Medical Care, 44(11), s39–s49.

    Article  Google Scholar 

  • Van de Vijver, F. J. R., & Tanzer, N. K. (2004). Bias and equivalence in cross-cultural assessment: an overview. European Review of Applied Psychology, 54(2), 119–135.

    Article  Google Scholar 

  • Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–69.

    Article  Google Scholar 

  • World Health Organization (2013). Nurturing human capital along the life course: Investing in early child development. Meeting Report 10–11 January 2013, WHO: Geneva, Switzerland.

Download references

Author information

Authors and Affiliations

  1. Offord Centre for Child Studies & Department of Psychiatry and Behavioural Neurosciences, McMaster University, Patterson Building, 1280 Main St. W, Hamilton, ON, L8S 4K1, Canada

    Eric Duku & Magdalena Janus

  2. Fraser Mustard Centre, Telethon Kids Institute, University of Western Australia, 100 Roberts Road, Subiaco, WA, 6008, Australia

    Sally Brinkman

Authors
  1. Eric Duku
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Magdalena Janus
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sally Brinkman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Eric Duku.

Appendices

Appendices

1.1 Appendix 1

Table 8 Items translated to Indonesian, back-translated to English and which were modified to improve the understanding/interpretability of the ranged response
Full size table

1.2 Appendix 2

Fig. 1
figure 1

Measurement models for Social competence and Emotional maturity domains of the EDI

Full size image

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Duku, E., Janus, M. & Brinkman, S. Investigation of the Cross-National Equivalence of a Measurement of Early Child Development. Child Ind Res 8, 471–489 (2015). https://doi.org/10.1007/s12187-014-9249-3

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12187-014-9249-3

Keywords

  • Early child development (ECD)
  • Cross-national equivalence
  • Early Development Instrument (EDI)