Abstract
Measurement invariance of a one-factor model of effortful control (EC) was tested for 853 low-income preschoolers (M age = 4.48 years). Using a teacher-report questionnaire and seven behavioral measures, configural invariance (same factor structure across groups), metric invariance (same pattern of factor loadings across groups), and partial scalar invariance (mostly the same intercepts across groups) were established across ethnicity (European Americans, African Americans and Hispanics) and across sex. These results suggest that the latent construct of EC behaved in a similar way across ethnic groups and sex, and that comparisons of mean levels of EC are valid across sex and probably valid across ethnicity, especially when larger numbers of tasks are used. The findings also support the use of diverse behavioral measures as indicators of a single latent EC construct.
Similar content being viewed by others
Notes
Garon et al. (2008) distinguished between simple and complex inhibition, and the two-factor EFAs suggested that the three delay/persistence tasks (gift wrap, waiting for bow, and yarn tangle) primarily loaded on one factor, whereas the other tasks loaded on a second factor, providing some support for this distinction in our data despite the small second eigenvalues. In CFAs, the Bayesian Information Criterion (BIC; Raftery 1995) did not clearly favor one model over the other, and the correlations among the factors in the two-factor model were estimated to be .75 or above in each group. Moreover, when two factors were tested in each of the ethnic groups, the model would not converge for the Hispanic group. Therefore, we used the one-factor model to maintain parsimony.
The Kaiser criterion, which states that one should retain factors with eigenvalues greater than 1.0, was not used because it tends to overestimate the true number of factors (Lance et al. 2006; Zwick and Velicer 1982). In addition, the Kaiser criterion should only be used for principal components analysis, not factor analysis (Fabrigar et al. 1999).
Measurement invariance models in which the Hispanic group consisted of only of English speaking students or only Spanish-speaking students were compared to the models that included the entire sample. In these alternate models, metric, configural, and partial scalar invariance were established in both language groups. In the full sample, 5 intercepts needed to be released for partial scalar invariance. In the English speaking group, 4 needed to be released and all were the same as in the full sample. In the Spanish-speaking group, 5 needed to be released: 3 were the same as the full sample, and two were different. This finding suggests that language differences cannot fully explain the differences in intercepts among the ethnic groups in our sample.
References
Aikens, N. L., Coleman, C. P., & Barbarin, O. A. (2008). Ethnic differences in the effects of parental depression on preschool children’s socioemotional functioning. Social Development, 17, 137–160.
Blair, C., Granger, D., & Razza, R. P. (2005). Cortisol reactivity is positively related to executive function in preschool children attending Head Start. Child Development, 76, 554–554.
Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & S. J. Long (Eds.), Testing structural equation models. Newbery Park: Sage.
Byrne, B. M. (1994). Testing for the factorial validity, replication, and invariance of a measuring instrument: A paradigmatic application based on the Maslach Burnout Inventory. Multivariate Behavioral Research, 29, 289–311.
Capaldi, D. M., & Rothbart, M. K. (1992). Development and validation of an early adolescent temperament measure. The Journal of Early Adolescence, 12, 153–173.
Carlson, S. M. (2005). Developmentally sensitive measures of executive function in preschool children. Developmental Neuropsychology, 28, 595–616.
Carver, C. S. (2005). Impulse and constraint: Perspectives from personality psychology, convergence with theory in other areas, and potential for integration. Personality and Social Psychology Review, 9, 312–333.
Derryberry, D., & Rothbart, M. K. (1997). Reactive and effortful processes in the organization of temperament. Development & Psychopathology, 9, 633–652.
Eisenberg, N., & Morris, A. S. (2002). Children’s emotion-related regulation. In R. V. Kail (Ed.), Advances in child development and behavior (Vol. 30, pp. 189–229). San Diego: Academic.
Eisenberg, N., Fabes, R. A., Karbon, M., Murphy, B. C., Wosinski, M., Polazzi, L., et al. (1996). The relations of children’s dispositional prosocial behavior to emotionality, regulation, and social functioning. Child Development, 67, 974–992.
Eisenberg, N., Fabes, R. A., Shepard, S. A., Murphy, B. C., Jones, J., & Guthrie, I. K. (1998). Contemporaneous and longitudinal prediction of children’s sympathy from dispositional regulation and emotionality. Developmental Psychology, 34, 910–924.
Eisenberg, N., Pidada, S., & Liew, J. (2001). The relations of regulation and negative emotionality to Indonesian children’s social functioning. Child Development, 72, 1747–1763.
Eisenberg, N., Spinrad, T. L., Fabes, R. A., Reiser, M., Cumberland, A., Shepard, S. A., et al. (2004). The relations of effortful control and impulsivity to children’s resiliency and adjustment. Child Development, 75, 25–46.
Eisenberg, N., Sadovsky, A., & Spinrad, T. L. (2005a). Associations among emotion-related regulation, language skills, emotion knowledge, and academic outcomes. New Directions in Child and Adolescent Development, 109, 109–118.
Eisenberg, N., Sadovsky, A., Spinrad, T. L., Fabes, R. A., Losoya, S. H., Valiente, C., et al. (2005b). The relations of problem behavior status to children’s negative emotionality, effortful control, and impulsivity: Concurrent relations and prediction of change. Developmental Psychology, 41, 193–211.
Eisenberg, N., Ma, Y., Chang, L., Zhou, Q., West, S. G., & Aiken, L. (2007a). Relations of effortful control, reactive undercontrol, and anger to Chinese children’s adjustment. Development and Psychopathology, 19, 385–409.
Eisenberg, N., Michalik, N., Spinrad, T. L., Hofer, C., Kupfer, A., Valiente, C., et al. (2007b). The relations of effortful control and impulsivity to children’s sympathy: A longitudinal study. Cognitive Development, 22, 544–567.
Else-Quest, N. M., Hyde, J. S., Goldsmith, H. H., & Van Hulle, C. A. (2006). Gender differences in temperament: A meta-analysis. Psychological Bulletin, 132, 33–72.
Evans, G. W., & English, K. (2002). The environment of poverty: multiple stressor exposure, psychophysiological stress, and socioemotional adjustment. Child Development, 73, 1238–1248.
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4, 272–299.
Fantuzzo, J., Grim, S., Mordell, M., McDermott, P., Miller, L., & Coolahan, K. (2001). A multivariate analysis of the revised Conners’ teacher rating scale with low-income, urban preschool children. Journal of Abnormal Child Psychology, 29, 141–152.
Garon, N., Bryson, S. E., & Smith, I. M. (2008). Executive function in preschoolers: A review using an integrative framework. Psychological Bulletin, 134, 31–60.
Gilliom, M., Shaw, D. S., Beck, J. E., Schonberg, M. A., & Lukon, J. L. (2002). Anger regulation in disadvantaged preschool boys: Strategies, antecedents, and the development of self-control. Developmental Psychology, 38, 222–235.
Goldsmith, H. H., Reilly, J., Lemery, K. S., Longley, S., & Prescott, A. (1993). Preschool Laboratory Temperament Assessment Battery (PS Lab-TAB; Version 1.0). Technical Report, Department of Psychology, University of Wisconsin-Madison.
Howse, R. B., Lange, G., Farran, D. C., & Boyles, C. D. (2003). Motivation and self-regulation as predictors of achievement in economically disadvantaged young children. Journal of Experimental Education, 71, 151–174.
Ispa, J. M., Fine, M. A., Halgunseth, L. C., Harper, S., Robinson, J., Boyce, L., et al. (2004). Maternal intrusiveness, maternal warmth, and mother-toddler relationship outcomes: Variations across low-income ethnic and acculturation groups. Child Development, 75, 1613–1631.
Kagan, J., & Fox, N. (2006). Biology, culture, and temperamental biases. In W. Damon, R. L. Lerner (Series Eds.), & N. Eisenberg (Vol. Ed.), Handbook of child psychology: Vol. 3: Social, emotional, and personality development (6th ed., pp. 167–225). New York: Wiley.
Kelloway, E. K. (1998). Using LISREL for structural equation modeling: A researcher’s guide. Thousand Oaks: Sage.
Kim, S., Brody, G. H., & Murry, V. M. (2003). Factor structure of the early adolescent temperament questionnaire and measurement invariance across gender. The Journal of Early Adolescence, 23, 268–294.
Kindlon, D., Mezzacappa, E., & Earls, F. (1995). Psychometric properties of impulsivity measures: Temporal stability, validity, and factor structure. Journal of Child Psychology and Psychiatry and Allied Disciplines, 36, 645–661.
Kline, R. B. (1998). Principles and practices of structural equation modeling. New York: Guilford.
Kochanksa, G., & Knaack, A. (2003). Effortful control as a personality characteristic of young children: Antecedents, correlates, and consequences. Journal of Personality, 71, 1087–1112.
Kochanska, G., Murray, K. T., & Harlan, E. T. (2000). Effortful control in early childhood: Continuity and change, antecedents, and implications for social development. Developmental Psychology, 36, 220–232.
Kochanska, G., Murray, K., Jacques, T. Y., Koenig, A. L., & Vandegeest, K. A. (1996). Inhibitory control in young children and its role in emerging internalization. Child Development, 67, 490–507.
Lance, C. E., Butts, M. M., & Michels, L. C. (2006). The sources of four commonly reported cutoff criteria: What did they really say? Organizational Research Methods, 9, 202–220.
Lengua, L. J. (2003). Associations among emotionality, self-regulation, adjustment problems, and positive adjustment in middle childhood. Journal of Applied Developmental Psychology, 24, 595–618.
Li-Grining, C. P. (2007). Effortful control among low-income preschoolers in three cities: Stability, change, and individual differences. Developmental Psychology, 43, 208–221.
Loukas, A., & Roalson, L. A. (2006). Family environment, effortful control, and adjustment among European American and Latino early adolescents. Journal of Early Adolescence, 26, 432–455.
Luria, A. R. (1966). Higher cortical functions in man. NY: Basic Books.
Martel, M. M., Nigg, J. T., Wong, M. M., Fitzgerald, H. E., Jester, J. M., Puttler, L. I., et al. (2007). Childhood and adolescent resiliency, regulation, and executive functioning in relation to adolescent problems and competence in a high-risk sample. Development and Psychopathology, 19, 541–563.
McCabe, L. A., Rebello-Britto, P., Hernandez, M., & Brooks-Gunn, J. (2004). Games children play: Observing young children’s self-regulation across laboratory, home, and school settings. In R. DelCarmen-Wiggins & A. Carter (Eds.), Handbook of infant, toddler, and preschool mention health assessment (pp. 491–521). New York: Oxford University Press.
Mendez, J. L., Fantuzzo, J., & Cicchetti, D. (2002). Profiles of social competence among low-income African American preschool children. Child Development, 73, 1085–1100.
Mezzacappa, E. (2004). Alerting, orienting, and executive attention: developmental properties and sociodemographic correlates in an epidemiological sample of young, urban children. Child Development, 75, 1373–1386.
Miller, A. L., Fine, S. E., Gouley, K. K., Seifer, R., Dickstein, S., & Shields, A. (2006). Showing and telling about emotions: interrelations between facets of emotional competence and associations with classroom adjustment in Head Start preschoolers. Cognition & Emotion, 20, 1170–1170.
Muris, P., de Jong, P. J., & Engelen, S. (2004). Relationships between neuroticism, attentional control, and anxiety disorders symptoms in non-clinical children. Personality and Individual Differences, 37, 789–797.
Murray, K. T., & Kochanska, G. (2002). Effortful control: factor structure and relation to externalizing and internalizing behaviors. Journal of Abnormal Child Psychology, 30, 503–514.
Muthén, L. K., & Muthén, B. O. (2007). Mplus user’s guide (5th ed.). Los Angeles: Muthén & Muthén.
Nigg, J. T. (2000). On inhibition/disinhibition in developmental psychopathology: Views from cognitive and personality psychology and a working inhibition taxonomy. Psychological Bulletin, 126, 230–246.
Noble, K. G., Norman, M. F., & Farah, M. J. (2005). Neurocognitive correlates of socioeconomic status in kindergarten children. Developmental Science, 8, 74–87.
Oldehinkel, A. J., Hartman, C. A., Ferdinand, R. F., Verhulst, F. C., & Ormel, J. (2007). Effortful control as a modifier of the association between negative emotionality and adolescents’ mental health problems. Development and Psychopathology, 19, 523–539.
Olson, S. L., Bates, J. E., & Bayles, K. (1990). Early antecedents of childhood impulsivity: The role of parent-child interaction, cognitive competence, and temperament. Journal of Abnormal Child Psychology, 18, 317–334.
Olson, S. L., Sameroff, A. J., Kerr, D. C. R., Lopez, N. L., & Wellman, H. M. (2005). Developmental foundations of externalizing problems in young children: The role of effortful control. Development and Psychopathology, 17, 25–45.
Olson, S. L., Schilling, E. M., & Bates, J. E. (1999). Measurement of impulsivity: Construct coherence, longitudinal stability, and relationship with externalizing problems in middle childhood and adolescence. Journal of Abnormal Child Psychology, 27, 151–165.
Perner, J., & Lang, B. (2000). Theory of mind and executive function: Is there a developmental relationship? In S. Baron-Cohen, H. Tager-Flusberg, & D. J. Cohen (Eds.), Understanding other minds: Perspectives from developmental cognitive neuroscience (2nd ed., pp. 150–181). New York: Oxford University Press.
Pickering, A. D., & Gray, J. A. (1999). The neuroscience of personality. In O. P. John & L. A. Pervin (Eds.), Handbook of personality: Theory and research (2nd ed., pp. 277–299). New York: Guilford.
Raftery, A. E. (1995). Bayesian model selection in social research. Sociological Methodology, 25, 111–163.
Raver, C. C. (2004). Placing emotional self-regulation in sociocultural and socioeconomic contexts. Child Development, 75, 346–353.
Reed, M. A., Pien, D. L., & Rothbart, M. K. (1984). Inhibitory self-control in preschool children. Merrill-Palmer Quarterly, 30(2), 131–147.
Riggs, N. R., Greenberg, M. T., Kusche, C. A., & Pentz, M. A. (2006). The mediational role of neurocognition in the behavioral outcomes of a social-emotional prevention program in elementary school students: Effects of the PATHS curriculum. Prevention Science, 7, 91–102.
Rosvold, H. E., Mirsky, A. F., Sarason, I., Bransome, E. D., Jr., & Beck, L. H. (1956). A continuous performance test of brain damage. Journal of Consulting Psychology, 20(5), 343–350.
Rothbart, M. K., Ahadi, S. A., Hershey, K. L., & Fisher, P. (2001). Investigations of temperament at three to seven years: The Children’s Behavior Questionnaire. Child Development, 72, 1394–1408.
Rothbart, M. K., & Bates, J. E. (2006). Temperament. In W. Damon, R. L. Lerner (Series Eds.), & N. Eisenberg (Vol. Ed.), Handbook of child psychology: Vol. 3: Social, emotional, and personality development (6th ed., pp. 99–166). New York: Wiley.
Rydell, A.-M., Berlin, L., & Bohlin, G. (2003). Emotionality, emotion regulation, and adaptation among 5- to 8-year-old children. Emotion, 3, 30–47.
Schafer, J. L., & Graham, J. W. (2002). Missing data: our view of the state of the art. Psychological Methods, 7, 147–177.
Silk, J. S., Steinberg, L., & Morris, A. S. (2003). Adolescents’ emotion regulation in daily life: Links to depressive symptoms and problem behavior. Child Development, 74, 1869–1880.
Spinrad, T. L., Eisenberg, N., Cumberland, A., Fabes, R. A., Valiente, C., Shepard, S., et al. (2006). Relation of emotion-related regulation to children’s social competence: A longitudinal study. Emotion, 6, 498–510.
Spinrad, T. L., Eisenberg, N., Gaertner, B., Popp, T., Smith, C. L., Kupfer, A., et al. (2007). Relations of maternal socialization and toddlers’ effortful control to children’s adjustment and social competence. Developmental Psychology, 43, 1170–1186.
Tabachnik, B. G., & Fidell, L. S. (2006). Using multivariate statistics (5th ed.): Pearson/Allyn & Bacon.
Valiente, C., Eisenberg, N., Smith, C. L., Reiser, M., Fabes, R. A., Losoya, S., et al. (2003). The relations of effortful control and reactive control to children’s externalizing problems: A longitudinal assessment. Journal of Personality, 71, 1171–1196.
Valiente, C., Lemery-Chalfant, K., Swanson, J., & Reiser, M. (2008). Prediction of children’s academic competence from their effortful control, relationships, and classroom participation. Journal of Educational Psychology, 100, 67–77.
Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4–69.
White, J. L., Moffitt, T. E., Caspi, A., Bartusch, D. J., Needles, D. J., & Stouthamer-Loeber, M. (1994). Measuring impulsivity and examining its relationship to delinquency. Journal of Abnormal Psychology, 103, 192–205.
Widaman, K. F., & Thompson, J. S. (2003). On specifying the null model for incremental fit indices in structural equation modeling. Psychological Methods, 8, 16–37.
Windle, M. (1992). Revised Dimensions of Temperament Survey (DOTS–R): simultaneous group confirmatory factor analysis for adolescent gender groups. Psychological Assessment, 4, 228–234.
Windle, M., & Lerner, R. M. (1986). Reassessing the dimensions of temperamental individuality across the life span: The revised dimensions of temperament survey (DOTS–R). Journal of Adolescent Research, 1, 213–229.
Zhou, Q., Wang, Y., Eisenberg, N., Wolchik, S., Tein, J.-W., & Deng, X. (2008). Relations of parenting and temperament to Chinese children’s experience of negative life events, coping efficacy, and externalizing problems. Child Development, 79, 493–513.
Zwick, W. R., & Velicer, W. F. (1982). Factors influencing four rules for determining the number of components to retain. Multivariate Behavioral Research, 17, 253–269.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by a grant to the Nancy Eisenberg (PI), Tracy Spinrad, and Carlos Valiente and to the School Readiness Consortium from the National Institute of Child Health and Development.
Rights and permissions
About this article
Cite this article
Sulik, M.J., Huerta, S., Zerr, A.A. et al. The Factor Structure of Effortful Control and Measurement Invariance Across Ethnicity and Sex in a High-Risk Sample. J Psychopathol Behav Assess 32, 8–22 (2010). https://doi.org/10.1007/s10862-009-9164-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10862-009-9164-y