Abstract
There were two purposes of the present research: first, to add to scholarship about a key character virtue, hopeful future expectations; and second, to demonstrate a recent innovation in longitudinal methodology that may be especially useful in enhancing the understanding of the developmental course of hopeful future expectations and other character virtues that have been the focus of recent scholarship in youth development. Burgeoning interest in character development has led to a proliferation of short-term, longitudinal studies on character. These data sets are sometimes limited in their ability to model character development trajectories due to low power or relatively brief time spans assessed. However, the integrative data analysis approach allows researchers to pool raw data across studies in order to fit one model to an aggregated data set. The purpose of this article is to demonstrate the promises and challenges of this new tool for modeling character development. We used data from four studies evaluating youth character strengths in different settings to fit latent growth curve models of hopeful future expectations from participants aged 7 through 26 years. We describe the analytic strategy for pooling the data and modeling the growth curves. Implications for future research are discussed in regard to the advantages of integrative data analysis. Finally, we discuss issues researchers should consider when applying these techniques in their own work.
Similar content being viewed by others
Notes
Curran and Hussong (2009) distinguish between measurement invariance, which applies to studies with the same items, and measurement comparability, which applies to studies with different but similar items. For this demonstration, we selected a construct that shares the same items across studies, and so we focus on measurement invariance here.
Scale averages assume all items are exchangeable, meaning that they have equal factor loadings (DeShon, 2004). Although this assumption is usually not tested, we did examine whether it was feasible in our studies, to provide additional justification for the computation of scale scores. For this test, we began with the models assuming strong invariance and added the additional constraint of equality of factor loadings. The exchangeability constraint produced negligible decreases in model fit (based on the change in the Comparative Fit Index, ΔCFI ≤ .001) for the ACT/4-H and ACT/YES comparisons, but not for the CAMP/4-H comparisons (ΔCFI = .023); see Table 4.
References
Bainter, S. A., & Curran, P. J. (2015). Advantages of integrative data analysis for developmental research. Journal of Cognition and Development, 16, 1–10.
Berkowitz, M. W. (2011). What works in values education. International Journal of Educational Research, 50(3), 153–158.
Berkowitz, M. W. (2012). Moral and character education. In K. R. Harris, S. Graham, & T. Urdan (Eds.), APA educational psychology handbook. vol. 2: Individual differences, cultural variations, and contextual factors in educational psychology (pp. 247–264). Washington, DC: American Psychological Association.
Berkowitz, M. W., Bier, M. C., & McCauley, B. (2016). Effective features and practices that support character development. Paper presented at The National Academies of Sciences, Engineering, and Medicine Workshop on Approaches to the Development of Character, Washington, DC.
Bornstein, M. H. (2017). The specificity principle in acculturation science. Perspectives in Psychological Science, 12(1), 3–45.
Bowers, E. P., Geldhof, G. J., Schmid, K. L., Napolitano, C. M., Minor, K., & Lerner, J. V. (2012). Relationships with important nonparental adults and positive youth development: An examination of youth self-regulatory strengths as mediators. Research in Human Development, 9(4), 298–316.
Bowers, E. P., Hilliard, L. J., Batanova, M., Stacey, D. C., Tirrell, J. M., Wartella, K., & Lerner, R. M. (2015). The arthur interactive media study: Initial findings from a cross-age peer mentoring and digital media-based character development program. Journal of Youth Development, 10(3), 46–63.
Bowers, E. B., & Johnson, S. K. (2013). The adult social milieu and character development: Potential mechanisms of influence. In N. Hurd (Chair), Mentoring and adolescent development: Assessing pathways and exploring complexities. Symposium conducted at the annual meeting of the Association of Psychological Science, Washington, DC.
Callina, K. S., Johnson, S., Buckingham, M., & Lerner, R. M. (2014a). Hope in context: Developmental profiles of trust, hopeful future expectations, and civic engagement across adolescence. Journal of Youth and Adolescence, 43(6), 869–883.
Callina, K. S., Mueller, M. K., Buckingham, M. H., & Gutierrez, A. S. (2014b). Building hope for positive youth development: Research, policy, and practice. In E. P. Bowers, G. J. Geldhof, S. K. Johnson, L. J. Hilliard, R. M. Hershberg, J. V. Lerner, & R. M. Lerner (Eds.), Promoting Positive Youth Development: Lessons Learned from the 4-H Study (pp. 71–94). New York, NY: Springer.
Callina, K. S., Mueller, M. K., Napolitano, C. M., Lerner, J. V., & Lerner, R. M. (2016). Positive youth development: Relational developmental systems approaches to thriving from childhood to early adulthood. In S. J. Lopez, L. M. Edwards, & S. C. Marques (Eds.), The Oxford handbook of positive psychology. 3rd edn New York, NY: Oxford University Press. doi:10.1093/oxfordhb/9780199396511.013.11.
Callina, K. S., Ryan, D., Murray, E. D., Colby, A., Damon, W., Matthews, M., & Lerner, R. M. (2017). Developing leaders of character at the United States military academy: A relational developmental systems analysis. Journal of College and Character, 18(1), 9–27.
Callina, K. S., Snow, N., & Murray, E. D. (in press). The history of philosophical and psychological perspectives on hope: Toward defining hope for the science of positive human development. In M. Gallagher & S. J. Lopez (Eds.), The Oxford Handbook of Hope. New York, NY: Oxford University Press.
Card, N. A. (2011). Applied meta-analysis for social science research. New York, NY: Guilford Press.
Card, N. A. (in press). Methodological issues in measuring the development of character. Journal of Moral Education.
Carver, C. S., & Scheier, M. F. (2002). The hopeful optimist. Psychological Inquiry, 13(4), 288–290.
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255.
Cooper, H., & Patall, E. A. (2009). The relative benefits of meta- analysis conducted with individual participant data ver- sus aggregated data. Psychological Methods, 14, 165–176.
Cumming, G. (2013). The new statistics: Estimation for better research. Retrieved from www.thenewstatistics.com.
Curran, P. J. (2009). The seemingly quixotic pursuit of a cumulative psychological science: Introduction to the Special Issue. Psychological Methods, 14(2), 77–80.
Curran, P. J., & Hussong, A. M. (2009). Integrative data analysis: The simultaneous analysis of multiple data sets. Psychology Methods, 14, 81–100.
Curran, P. J., Hussong, A. M., Cai, L., Huang, W., Chassin, L., Sher, K. J., & Zucker, R. A. (2008). Pooling data from multiple longitudinal studies: The role of item response theory in integrative data analysis. Developmental Psychology, 44, 365–380.
DeShon, R. P. (2004). Measures are not invariant across groups without error variance homogeneity. Psychology Science, 46(1), 137–149.
Erikson, E. H. (1959). Identity and the life cycle. Psychological Issues, 1, 50–100.
Ettekal, A. V., Callina, K. S., & Lerner, R. M. (2015). The promotion of character through youth development programs. Journal of Youth Development, 10(3), 6–13.
Ferris, K. A., Vest Ettekal, A., Agans, J. P., Burkhard, B. M., & Lerner, R. M. (2016). Character development through youth sport: High school coaches’ perspectives about a character-based education program. Journal of Youth Development, 10(3), 127–140.
Geldhof, G. J., Bowers, E. P., & Lerner, R. M. (2013). Special section introduction: Thriving in context: Findings from the 4-H study of positive youth development. Journal of Youth and Adolescence, 42(1), 1–5.
Geldhof, G. J., Pornprasertmanit, S., Schoemann, A., & Little, T. D. (2013). Orthogonalizing through residual centering: Applications and caveats. Educational and Psychological Measurement, 73, 27–46.
Geldhof, G. J., Porter, T., Weiner, M. B., Malin, H., Bronk, K. C., Agans, J. P., Mueller, M., Damon, W., & Lerner, R. M. (2014). Fostering youth entrepreneurship: Preliminary findings from the Young Entrepreneurs Study. Journal of Research on Adolescence, 24, 431–446.
Grimm, K. J., & Ram, N. (2012). Growth curve modeling from a structural equation modeling perspective. In B. Laursen, T. D. Little, & N. A. Card (Eds.), Handbook of developmental research methods (pp. 411–431). New York, NY: Guilford Press.
Hilliard, L. J., Hershberg, R. M., Wang, J., Bowers, E. P., Chase, P. A., Champine, R. B., & Lerner, R. M. (2014). Program innovations and character in Cub Scouts: Findings from year 1 of a mixed-methods, longitudinal study. Journal of Youth Development, 9(4), 4–30.
Hofer, S. M., & Piccinin, A. M. (2009). Integrative data analysis through coordination of measurement and analysis protocol across independent longitudinal studies. Psychological Methods, 14, 150–164.
Johnson, S. K., Hershberg, R. M., Arbeit, M. R., DeSouza, L. M., Callina, K. S., & Gutierrez, A. S., et al. (2014). Exploring characteristics of young adult men: Initial findings from a mixed methods evaluation of an all-male character-focused trade school. Journal of Character Education, 10(2), 129–154.
Lapsley, D. K., & Narvaez, D. (2006). Character education. In A. Renninger, & I. Siegel (Eds.), Child psychology in practice. Volume 4 of the Handbook of Child Psychology. 6th edn. (pp. 248–296). New York: Wiley.
Lerner, R. M. (2015). Preface. In R. M. Lerner (Ed.), Handbook of child psychology and developmental science. 7th edn. (pp. xv–xxi). Hoboken, NJ: Wiley.
Lerner, R. M., & Callina, K. S. (2014). Relational developmental systems theories and the ecological validity of experimental designs. Human Development, 56(6), 372–380.
Lerner, R. M., Lerner, J. V., Almerigi, J., Theokas, C., Phelps, E., & Gestsdóttir, S., et al. (2005). Positive youth development, participation in community youth development programs, and community contributions of fifth-grade adolescents: Findings from the first wave of the 4-H study of positive youth development. Journal of Early Adolescence, 25(1), 17–71.
Lerner, R. M., Lerner, J. V., Bowers, E., & Geldhof, G. J. (2015). Positive youth development and relational developmental systems. In W. F. Overton, & P. C. Molenaar (Eds.), Theory and Method. Volume 1 of the Handbook of child psychology and developmental science. 7th edn. (pp. 607–651). Hoboken, NJ: Wiley.
Lerner, R. M., Schwartz, S. J., & Phelps, E. (2009). Problematics of time and timing in the longitudinal study of human development: Theoretical and methodological issues. Human Development, 52(1), 44–68.
Lerner, R. M., Vandell, D. L., & Tirrell, J. M. (in press). Approaches to the development of character: Meanings, methods, and measures. Journal of Character Education.
Little, T. D. (2013). Longitudinal structural equation modeling. New York: Guilford Press.
Lopez, S. J., Rose, S., Robinson, C., Marques, S. C., & Pais-Ribeiro, J. L. (2009). Measuring and promoting hope in school children. In R. Gilman, E. S. Huebner, & M. J. Furlong (Eds.), Handbook of positive psychology in the schools (pp. 37–51). Mahwah, NJ: Lawrence Erlbaum.
Markus, H., & Nurius, P. (1986). Possible selves. The American Psychologist, 41(9), 954–969.
Mascolo, M. F., & Fischer, K. W. (2015). Dynamic development of thinking, feeling, and acting. In W. F. Overton, & P. C. Molenaar (Eds.), Theory and method. Volume 1 of the Handbook of Child Psychology and Developmental Science. 7th edn. (pp. 113–161). Hoboken, NJ: Wiley.
McArdle, J. J. (2009). Latent variable modeling of differences and changes with longitudinal data. The Annual Review of Psychology, 60, 577–605.
McArdle, J. J., & Nesselroade, J. R. (2003). Growth cure analyses in contemporary psychological research. In S. H. Cohen, W. Velicer (Eds.), Comprehensive handbook of psychology: Vol. 2 Research methods in psychology (pp. 447–480). New York: Pergamon Press.
Molenaar, P. C. M., & Nesselroade, J. R. (2015). Systems methods for developmental research. In W. F. Overton, & P. C. Molenaar (Eds.), Handbook of child psychology and developmental science. Vol. 1: Theory and method. 7th edn. (pp. 652–682). Hoboken, NJ: Wiley.
Muthén, L. K., & Muthén, B. O. (1998–2010). Mplus user’s guide. 6th edn. Los Angeles, CA: Muthén & Muthén.
Nurmi, J. E. (1991). How do adolescents see their future? A review of the development of future orientation and planning. Developmental Review, 11, 1–59.
Nucci (in press). Character: A multi-faceted developmental system. Journal of Character Education.
Overton, W. F. (2015). Process and relational developmental systems. In W. F. Overton, & P. C. Molenaar (Eds.), Handbook of child psychology and developmental science. Vol. 1: Theory and method. 7th edn. (pp. 9–62). Hoboken, NJ: Wiley.
Raeff, C. (2016). Exploring the dynamics of human development: An integrative approach. London, England: Oxford University Press.
Rose, T. (2015). The end of average: How we succeed in a world that values sameness. New York, NY: HarperCollins Publishers.
Schaie, K. W. (1965). A general model for the study of developmental problems. Psychological Bulletin, 64(2), 92–107.
Schmid, K. L., & Lopez, S. (2011). Positive pathways to adulthood: The role of hope in adolescents’ constructions of their futures. In R. M. Lerner, J. V. Lerner, & J. B. Benson (Eds.), Advances in child development and behavior: Positive youth development 41, (72–89). London, England: Academic Press.
Schmid, K. L., Phelps, E., & Lerner, R. M. (2011a). Constructing positive futures: Modeling the relationship between adolescents’ hopeful future expectations and intentional self-regulation in predicting positive youth development. Journal of Adolescence, 34(6), 1127–1135.
Schmid, K. L., Phelps, E., Kiely, M. K., Napolitano, C. M., Boyd, M. J., & Lerner, R. M. (2011b). The role of adolescents’ hopeful futures in predicting positive and negative developmental trajectories: Findings from the 4-H study of positive youth development. Journal of Positive Psychology, 6(1), 45–56.
Seginer, R. (2009). Future orientation: Developmental and ecological perspectives. New York: Springer Series.
Seligman, M. E. P. (1991). Learned optimism: How to change your mind and your life. New York: Random House.
Seligman, M. E., Railton, P., Baumeister, R. F., & Sripada, C. (2013). Navigating into the future or driven by the past. Perspectives on Psychological Science, 8(2), 119–141.
Shrout, P. E. (2009). Short and long views of integrative data analysis: comments on contributions to the special issue. Psychological Methods, 14(2), 177–181.
Snyder, C. R. (1994). The psychology of hope: You can get there from here. New York: Free Press.
Snyder, C. R., Harris, C., Anderson, J. R., Holleran, S. A., Irving, L. M., Sigmon, S. T., Yoshinobu, L., Gibb, J., Langelle, C., & Harney, P. (1991). The will and the ways: Development and validation of an individual-differences measure of hope. Journal of Personality and Social Psychology, 60(4), 570–585.
Sokol, B. W., Hammond, S. I., & Berkowitz, M. W. (2010). The developmental contours of character. In T. Lovat, R. Toomey, N. Clement (Eds.), International research handbook on values education and student wellbeing (pp. 579–603). Dordrecht, Netherlands: Springer.
Steinberg, L., Graham, S., O’Brien, L., Woolard, J., Cauffman, E., & Banich, M. (2009). Age differences in future orientation and delay discounting. Child Development, 80(1), 28–44.
Templeton, J. M. (1998). The humble approach: Scientists discover God. Radnor, PA: Templeton Press.
Templeton, J. M. (2000). Worldwide laws of life: 200 Eternal spiritual principles. Radnor, PA: Templeton Press.
Trommsdorff, G. (1983). Future orientation and socialization. International Journal of Psychology, 18, 381–406.
Trommsdorff, G., Lamm, H., & Schmidt, R. W. (1979). A longitudinal study of adolescents’ future orientation (time perspective). Journal of Youth and Adolescence, 8(2), 131–147.
van de Schoot, R., Lugtig, P., & Hox, J. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486–492.
Wang, J., Batanova, M., Ferris, K. A., & Lerner, R. M. (2016). Character development within the relational developmental systems metamodel: A view of the issues. Research in Human Development, 13(2), 91–96.
Wang, J., Ferris, K. A., Hershberg, R. M., & Lerner, R. M. (2015). Developmental trajectories of youth character: A five-wave longitudinal study of cub scouts and non-scout boys. Journal of Youth and Adolescence, 44, 2359–2373.
Widaman, K. F., Grimm, K. J., Early, D. R., Robins, R. W., & Conger, R. D. (2013). Investigating factorial invariance of latent variables across populations when manifest variables are missing completely. Structural Equation Modeling, 20, 384–408.
Widaman, K. F., & Thompson, J. S. (2003). On specifying the null model for incremental fit indices in structural equation modeling. Psychological Methods, 8, 16–37.
Acknowledgements
The authors gratefully acknowledge the work of additional principal investigators, project directors, and other staff (including graduate and undergraduate students) to conduct the studies used in the present research. The authors also gratefully acknowledge the participation of schools and youth across the four studies, which made the present research possible. This research was supported in part by grants from the John Templeton Foundation, the Templeton Religion Trust, the National 4-H Council, and the Altria Corporation.
Author Contributions
K.S.C. conceived of the study, spearheaded its design and coordination, prepared the data and performed and interpreted statistical analyses, and had primary responsibility for writing the full manuscript; S.K.J. conceived of the study, participated in the study design and coordination, performed and interpreted statistical analyses, and contributed to writing the manuscript; J.M.T. helped to prepare, manage, and analyze the data, and contributed to writing in the manuscript; M.B. contributed to writing the manuscript; M.B.W. contributed to writing the manuscript; and R.M.L. conceived of the study and contributed to writing the manuscript. All authors read and approved the final manuscript.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no competing interests.
Ethical Approval
This research used secondary data based on studies conducted at the Institute for Applied Research in Youth Development, all of which received approval from the Internal Review Board at Tufts University.
Informed Consent
All eligible students for the studies used in the current research were fully informed about their voluntary participation. If students wished to refrain from participation, or if their parents disagreed with their children’s participation (as in the cases of the CAMP and 4-H studies), they were free to do so. Only students who provided permission or assent to participate, and who had parental permission to participate, were involved in the studies.
Rights and permissions
About this article
Cite this article
Callina, K.S., Johnson, S.K., Tirrell, J.M. et al. Modeling Pathways of Character Development across the First Three Decades of Life: An Application of Integrative Data Analysis Techniques to Understanding the Development of Hopeful Future Expectations. J Youth Adolescence 46, 1216–1237 (2017). https://doi.org/10.1007/s10964-017-0660-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10964-017-0660-1