Abstract
The Early Development Instrument (EDI; Janus and Offord in Canadian Journal of Behavioural Science 39:1–22, 2007) project is a Canadian population-level, longitudinal research project, in which teacher ratings of Kindergarten children’s early development and wellbeing are linked to health and academic achievement variables at the individual level, and to demographic, cultural, and socioeconomic variables at the community level. In this article, we draw from Bronfenbrenner’s bioecological theory of human development to create a coherent theoretical framework for guiding validation research within a population-level approach to child development research in general and for the EDI project in particular. The discussion draws from a range of social and health sciences as well as validity theory. The paper seeks to align complex conceptual, theoretical, methodological, and psychometric considerations, to provide specific design, methodology, and validation recommendations for a population-level approach to studying children’s development and wellbeing, and to discuss the strengths and challenges of this approach.
Similar content being viewed by others
Notes
The illustrations adhere to conventional structural equation model, or path analysis, notation, and follow Bollen and Lennox’ (1991) recommendations for distinguishing between composite indicators, such as socioeconomic status, and effect indicators, such as school readiness and academic achievement, for both of which the arrows represent, respectively, the direction of association. For associations among constructs, arrows with open-shaped arrow heads are used, and for relationships between measures and constructs, arrows with solid heads are used.
The authors recognizes the multiple—and often conflicting—definitions of the term “(school) readiness”. In this paper, the term school readiness is used to refer to the teachers’ assessment of their Kindergarten class children’s developmental status in five different domains. For a current review of theoretical and empirical approaches to school readiness the reader is directed to Pianta et al. (2007). With regard to the EDI, Janus and Offord (2007) explicitly differentiate school readiness from readiness (to learn from birth), and consider school readiness to consist of a set of competences that will allow children to benefit from educational activities offered in the school environment (Janus and Offord 2000). In this paper, the term school readiness is consistently used.
Cf. Meisels (1999) for this categorization of school readiness theories.
With respect to Fig. 2, this perspective would be placed in the upper right quadrant—(emphasizing group characteristics and the role of experiences on development)—whereas traditionally widely employed school readiness tests would have to be placed in the lower left quadrant—(emphasizing individual characteristics and the developmental primacy of genetics and maturation).
The (University of) Chicago School is typically associated with ‘sociology’, but it needs to be noted that several of its influential scholars, like Dewey, Mead, and Blumer, came from backgrounds of philosophy and education, (social) psychology, and sociology, respectively.
It is well-understood, however, how poverty at the individual and family level goes hand in hand with developmentally detrimental processes, such as poor nutrition, enduring stress, exposure to toxic environments, and lack of developmentally positive experiences and opportunities (Berliner 2005).
The Gini coefficient is a statistical index used to describe the distribution of income in a population, where 0 means absolute equality of income (i.e., everyone has the same) and 1 means absolute inequality (i.e., one person has everything). A definition and world map showing each country’s Gini coefficient can be found at en.wikipedia.org/wiki/Gini_coefficient.
See Raudenbush and Sampson (1999) for a discussion of methodological and conceptual issues pertaining to the assessment of ecological settings.
It is noteworthy that the term interaction is used in different meaning in these two propositions. In the first, it is used to refer to processes occurring between the developing person and its environment. In the second, it refers to the concept of interactions as used in the field of statistics, where interactions refer to situations in which the effects of one (or more) factor(s) are moderated (i.e., amplified, attenuated, or reversed) by one (or more) other factor(s) with regard to an outcome.
This point is stressed, because research using multiple regression and multi-level analyses often fails to examine interactions, potentially because researchers assume that partitioning variance among multiple main effects is, in effect, accounting for ‘interactions’ between those variables. However, interaction terms must, of course, be statistically modeled by producing multiplicative interaction terms and by including them in the regression equations in addition to the main effect variables (cf. Cohen et al. 2003).
While DAP has gained much currency in both the theory and practice of early childhood programs, it has not been universally embraced. Some scholars have critiqued DAP as relying too much on universal notions of child development and the imposition of western ideas of child development on minority groups and on non-western societies. For a discussion, readers are referred to Kessler and Swadener (1992).
References
Alexander, K. L., & Entwisle, D. R. (1988). Achievement in the first two years of school: Patterns and processes. Monographs of the Society for Research in Child Development, 53, 1–157.
Anderhalter, O. F., & Perney, J. (Eds.). (2004). School readiness test (3rd ed.). Bensenville, IL: Scholastic Testing Service.
Asparouhov, T., & Muthen, B. (2006). Multilevel mixture models. Retrieved on 15 March 2009, from http://www.statmodel.com/download/MultilevelMixtures2.pdf.
Baltes, P. B., Reese, H. W., & Lipsitt, L. P. (1980). Life-span developmental psychology. Annual Review of Psychology, 31, 65–110.
Berliner, D. C. (2005). Our impoverished view of educational reform. Teachers College Record. Retrieved on 20 Nov 2006, from http://www.tcrecord.org/content.asp?contentid=12106.
Bollen, K., & Lennox, R. (1991). Conventional wisdom on measurement: A structural equation perspective. Psychological Bulletin, 110, 305–314.
Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2004). The concept of validity. Psychological Review, 111, 1061–1071.
Bourdieu, P. (1985). The forms of capital. In J. G. Richardson (Ed.), Handbook of theory and research for the sociology of education (pp. 241–258). New York: Greenwood.
Bowlby, G. (2008). Provincial drop-out rates—Trends and consequences. Statistics Canada. Retrieved from http://www.statcan.gc.ca/pub/81-004-x/2005004/8984-eng.htm.
Bredekamp, S. (1986). Developmentally appropriate practice. Washington, DC: National Association for the Education of Young Children.
Breton, J. J., Bergeron, L., Valla, J. P., Berthiaume, C., Gaudet, N., Lambert, J., et al. (1999). Quebec child mental health survey: Prevalence of DSM-III-R mental health disorders. Journal of Child Psychology and Psychiatry and Allied Disciplines, 40, 375–384.
Bronfenbrenner, U. (1974). Developmental research, public policy, and the ecology of childhood. Child Development, 45, 1–5.
Bronfenbrenner, U. (1979). The ecology of human development: Experiments by nature and design. Cambridge, MA: Harvard University Press.
Bronfenbrenner, U. (1988). Interacting systems in human development. Research paradigms: Present and future. In N. Bolger, A. Caspi, G. Downey, & M. Moorehouse (Eds.), Persons in context: Developmental processes (pp. 25–49). New York, NY: Cambridge University Press.
Bronfenbrenner, U. (1992). Ecological systems theory. In R. Vasta (Ed.), Six theories of child development: Revised formulations and current issues (pp. 187–249). London, UK: Jessica Kingsley Publishing.
Bronfenbrenner, U. (2001). The theory of human development. In N. J. Smelser & P. B. Baltes (Eds.), International encyclopedia of the social and behavioral sciences (Vol. 10, pp. 6963–6970). New York: Elsevier.
Bronfenbrenner, U., & Morris, P. (2006). The bioecological model of human development. In W. Damon & R. M. Lerner (Eds.), Handbook of child development, volume 1, theoretical models of human development (6th ed., pp. 793–828). Hoboken, NJ: Wiley.
Brooks-Gunn, J., Duncan, G. J., Klebanov, P. K., & Sealand, N. (1993). Do neighborhoods influence child and adolescent development? American Journal of Sociology, 99, 353–395.
Brunsdon, C., Fotheringham, S., & Charlton, M. (2003). Geographically weighted regression. Journal of the Royal Statistical Society: Series D (The Statistician), 47, 431–443.
Caughy, M. O., O’Campo, P. J., & Muntaner, C. (2003). When being alone might be better: Neighborhood poverty, social capital, and child mental health. Social Science and Medicine, 57, 227–237.
CCSD. (2004). Data from the Canadian Council on social development, retrieved on 15 Feb 2008, from http://www.ccsd.ca/factsheets/economic_security/poverty/index.htm.
Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Maywah, NJ: Erlbaum.
Cohen, N. J., Kiefer, H., & Pape, B. (2005). Handle with care: Strategies for promoting the mental health of young children in community-based child care. Toronto, ON: Hincks-Dellcrest. Retrieved on 20 Nov 2007, from http://www.hincksdellcrest.org/institute/documents/FinalReportMentalHealthReport11.pdf.
Coleman, J. S. (1988). Social capital in the creation of human capital. American Journal of Sociology, 94, 95–121.
Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302.
Dalton, J. H., Elias, M. J., & Wandersman, A. (2007). Community psychology: Linking individuals to communities (2nd ed.). Belmont, CA: Wadsworth Publishing.
Doherty, G. (1997). Zero to six: The basis for school readiness (No. R-97–8E). Ottawa, ON: Human Resources Development Canada, Applied Research Branch, Strategic Policy.
Duncan, G. J., Dowsett, C. J., Claessens, A., Magnuson, K., Huston, A. C., Klebanov, P., et al. (2007). School readiness and later achievement. Developmental Psychology, 43, 1428–1446.
Elder, G. H., Jr. (1974). Children of the great depression. Chicago, IL: University of Chicago Press.
Elder, G. H., Jr. (1994). Time, human agency, and social change: Perspectives on the life course. Social Psychology Quarterly, 57, 4–15.
Elias, M. J., Zins, J. E., Graczyk, P. A., & Weissberg, R. P. (2003). Implementation, sustainability, and scaling-up of social-emotional and academic innovations in public schools. School Psychology Review, 32, 303–319.
Entwisle, D. R., Alexander, K. L., & Olson, L. S. (2007). Early schooling: The handicap of being poor and male. The Sociology of Education, 80, 114–138.
Forer, B., & Zumbo, B. D. (2011). Validation of multilevel constructs: Validation methods and empirical findings for the EDI. Social Indicators Research. doi:10.1007/s11205-011-9844-3.
Gardner, H. (1999). Intelligence reframed: Multiple intelligences for the 21st Century. New York, NY: Basic Books.
Graue, M. E. (1995). Connecting visions of authentic assessment to the realities of educational practice. In T. A. Romberg (Ed.), Reform in school mathematics and authentic assessment (pp. 260–275). Albany, NY: State University of New York Press.
Guhn, M., Janus, M., & Hertzman, C. (2007). The Early Development Instrument: Translating school readiness assessment into community actions and policy planning. Early Education and Development, 18, 369–374.
Hair, E., Halle, T., Terry-Humen, E., Lavellea, B., & Calkins, J. (2006). Children’s school readiness in the ECLS-K: Predictions to academic, health, and social outcomes in first grade. Early Childhood Research Quarterly, 21, 431–454.
Heymann, J., Hertzman, C., Barer, M. L., & Evans, R. G. (Eds.). (2006). Healthier societies: From analysis to action. New York, NY: Oxford University Press.
Janus, M., Brinkman, S., Duku, E., Hertzman, C., Santos, R., Sayers, M., et al. (2007). The Early Development Instrument: A population-based measure for communities. A handbook on development, properties, and use. Hamilton, ON: Offord Centre for Child Studies. Retrieved on 10 June 2008, from http://www.offordcentre.com/readiness/pubs/2007_12_FINAL.EDI.HANDBOOK.pdf.
Janus, M., & Offord, D. R. (2000). Readiness to learn at school. Canadian Journal of Policy Research, 2, 71–75.
Janus, M., & Offord, D. (2007). Development and psychometric properties of the Early Development Instrument (EDI): A measure of children’s school readiness. Canadian Journal of Behavioural Science, 39, 1–22.
Jencks, C., & Mayer, S. (1990). The social consequences of growing up in a poor neighbourhood. In L. E. Lynn & M. G. H. McGeary (Eds.), Inner-city poverty in the United States (pp. 111–186). Washington, DC: National Academy Press.
Kagan, S. L., & Rigby, E. (2003). Policy matters: Setting and measuring benchmarks for state policies. Improving the readiness of children for school: Recommendations for state policy. Washington, DC: Center for the Study of Social Policy.
Kane, M. (2006). Validation. In R. L. Brennan (Ed.), Educational measurement (4th ed.). Westport, CT: American Council on Education/Praeger.
Kershaw, P., Forer, B., Lloyd, J. E. V., Hertzman, C., Boyce, W. T., Zumbo, B. D., et al. (2009). The use of population-level data to advance interdisciplinary methodology: A cell-through-society sampling framework for child development research. International Journal of Social Research Methodology, 12, 387–403.
Kershaw, P., Irwin, L., Trafford, K., & Hertzman, C. (2005). The British Columbia atlas of child development (1st ed., Vol. 40). Vancouver, BC: Human Early Learning Partnership, Western Geographical Press.
Kessler, S. A., & Swadener, B. B. (Eds.). (1992). Reconceptualizing the early childhood curriculum: Beginning the dialogue. New York, NY: Teachers College Press.
Kohen, D. E., Brooks-Gunn, J., Leventhal, T., & Hertzman, C. (2002). Neighborhood income and physical and social disorder in Canada: Associations with young children’s competencies. Child Development, 73, 1844–1860.
Kohen, D. E., Hertzman, C., & Brooks-Gunn, J. (1998). Neighborhood influences on children’s school readiness. Hull, QB: Human Resources Development Canada.
La Paro, K. M., & Pianta, R. C. (2000). Predicting children’s competence in the early school years: A meta-analytic review. Review of Educational Research, 70, 443–484.
LaPointe, V. R., Ford, L., & Zumbo, B. D. (2007). Examining the relationship between neighborhood environment and school readiness for Kindergarten children. Early Education and Development, 18, 473–495.
Lewit, E. M., & Schuurmann Baker, L. (1995). School readiness. The Future of Children, 5, 128–139.
Lloyd, J. E. V., & Hertzman, C. (2009). From Kindergarten readiness to fourth-grade assessment: Longitudinal analysis with linked population data. Social Science and Medicine, 68, 111–123.
Love, J. M., Aber, J. L., & Brooks-Gunn, J. (1994). Strategies for assessing community progress toward achieving the First National Educational Goal. Princeton, NJ: Mathematica Policy Research.
Meisels, S. (1999). Assessing readiness. In R. C. Pianta & M. J. Cox (Eds.), The transition to kindergarten (pp. 39–66). Baltimore, MD: Paul H. Brookes.
Messick, S. (1995). Validity of psychological assessment. Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741–749.
Messick, S. (1998). Test validity: A matter of consequence. Social Indicators Research, 45, 35–44.
NAEYC. (1996). Developmentally appropriate practice in early childhood programs serving children from birth through age 8. Washington, DC: National Association for the Education of Young Children. Retrieved on 20 Nov 2007, from http://www.naeyc.org/about/positions/pdf/PSDAP98.pdf.
National Education Goals Panel. (1995). The national education goals report. Washington, DC: US Government. Retrieved on 20 Nov 2007, from http://www.eric.ed.gov:80/ERICDocs/data/ericdocs2sql/content_storage_01/0000019b/80/14/41/7e.pdf.
Nosbush, L. (2006). Community report for children. The Understanding the Early Years final report. Prince Albert, SK: Saskatchewan Rivers School Division. Retrieved on 20 Nov 2007, from http://www.srsd119.ca/uey/.
Offord, D. R., Boyle, M. H., Szatmari, P., Rae-Grant, N. I., Links, P. S., Cadman, D. T., et al. (1987). Ontario child health study. II. Six-month prevalence of disorder and rates of service utilization. Archives of General Psychiatry, 44, 832–836.
Pelletier, J., & Corter, C. (2005). Design, implementation, and outcomes of a school readiness program for diverse families. The School Community Journal, 15, 89–116.
Pianta, R. C., Cox, M. J., & Snow, K. L. (Eds.). (2007). School readiness and the transition to Kindergarten in the era of accountability. Baltimore, MD: Paul H. Brooks.
Piantadosi, S., Byar, D. P., & Green, S. B. (1988). The ecological fallacy. American Journal of Epidemiology, 127, 893–904.
Piotrkowski, C. S. (2004). A community-based approach to school readiness in Head Start. In E. Zigler & S. Styfcoe (Eds.), The Head Start debates (pp. 129–142). New Haven: Yale University Press.
Putnam, R. D. (2000). Bowling alone. The collapse and revival of American community. New York, NY: Simon & Schuster.
Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models (2nd ed.). Thousand Oaks, CA: Sage Publications.
Raudenbush, S. W., & Sampson, R. S. (1999). ‘Ecometrics’: Toward a science of assessing ecological settings, with application to the systematic social observation of neighborhoods. Sociological Methodology, 29, 1–41.
Rimm-Kaufman, S. E., & Pianta, R. C. (2000). An ecological perspective on the transition to Kindergarten: A theoretical framework to guide empirical research. Journal of Applied Developmental Psychology, 21, 491–511.
Sampson, R. J., Morenoff, J. D., & Earls, F. (1999). Beyond social capital: Spatial dynamics of collective efficacy for children. American Sociological Review, 64, 633–660.
Sampson, R. J., Morenoff, J. D., & Gannon-Rowley, T. (2002). Assessing “neighborhood effects”: Social processes and new directions in research. Annual Review of Sociology, 28, 443–478.
Sampson, R. J., Raudenbush, S. W., & Earls, F. (1997). Neighborhoods and violent crime: A multilevel study of collective efficacy. Science, 277, 918–924.
Schrag, R. D. A., Styfco, S. J., & Zigler, E. (2004). Familiar concept, new name: Social competence/school readiness as the goal of Head Start. In E. Zigler & S. J. Styfco (Eds.), The Head Start debates. Baltimore, MD: Paul H. Brookes.
Schweinhart, L. J., Barnes, H. V., & Weikart, D. P. (1993). Significant benefits: The High/Scope Perry preschool study through age 27. Monographs of the High-Scope Educational Research Foundation, No. 10. Ypsilanti, MI: High/Slope Press.
Shonkoff, J. P. (2000). Science, policy, and practice: Three cultures in search of a shared mission. Child Development, 71, 181–187.
Smith, G. T. (2005). On construct validity: Issues of method and measurement. Psychological Assessment, 17, 396–408.
Spady, D. W., Schopflocher, D. P., Svenson, L. W., & Thompson, A. H. (2001). Prevalence of mental disorders in children living in Alberta, Canada, as determined from physician billing data. Archives of Pediatrics and Adolescent Medicine, 155, 1153–1159.
Statistics Canada. (2006). Participation and activity limitation survey 2006: Analytical report. Ottawa, ON: Ministry of Industry. Retrieved from http://www.statcan.gc.ca/pub/89-628-x/89-628-x2007002-eng.pdf.
Statistics Canada. (2007). National Longitudinal Study of Children and Youth (NLSCY). Retrieved on 15 Feb 2008, from http://www.statcan.gc.ca/cgi-bin/imdb/p2SV.pl?Function=getSurvey&SDDS=4450&lang=en&db=imdb&adm=8&dis=2.
Taylor, C., Gorard, S., & Fitz, J. (2003). The modifiable area unit problem: Segregation between schools and levels of analysis. International Journal of Social Research Methodology, 6, 41–60.
Tremblay, M. S., & Willms, J. D. (2000). Secular trends in the body mass index of Canadian children. Canadian Medical Association Journal, 163, 1429–1433.
Vygotsky, L. S. (1936/1978). Mind in society: The development of higher psychological processes. Cambridge, MA: Harvard University Press.
Watson, M., & Ecken, L. (2003). Learning to trust. San Francisco, CA: Wiley.
Wilson, W. J. (1987). The truly disadvantaged: The inner city, the underclass, and public policy. Chicago: University of Chicago Press.
Zigler, E., Gilliam, W. S., & Jones, S. M. (2006). A vision for universal preschool education. New York, NY: Cambridge University Press.
Zigler, E., & Valentine, J. (1979). Project Head Start: A legacy of the war on poverty. New York, NY: The Free Press.
Zumbo, B. D. (2009). Validity as contextualized and pragmatic explanation, and its implications for validation practice. In R. W. Lissitz (Ed.), The concept of validity: Revisions, new directions and applications (pp. 65–82). Charlotte, NC: Information Age Publishing.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Guhn, M., Goelman, H. Bioecological Theory, Early Child Development and the Validation of the Population-Level Early Development Instrument. Soc Indic Res 103, 193–217 (2011). https://doi.org/10.1007/s11205-011-9842-5
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11205-011-9842-5