Abstract
Advances in applied developmental science have contributed to the large literature on positive youth development (PYD) interventions. This study reports an investigation of a PYD program using an outcome-mediation evaluation model that drew on the treatment intervention science literature. The Changing Lives Program (CLP) is a community supported gender and ethnic inclusive PYD intervention framework. Using an empowerment approach, the CLP was implemented in a practice setting as a selective/indicated positive youth development program for multi-ethnic, multi-problem at risk youth in urban alternative high schools. The outcome-mediation evaluation model provided evidence in support of the direct outcome effects of the intervention. The model also proved effective in identifying at a micro process level a number of plausible causal mechanisms for use in the development of more conceptually complete models of the causal mechanisms that underlie intervention change. Implications for future development of theory informed empirically supported intervention models of PYD programs are discussed.
Similar content being viewed by others
Notes
Following recommendations of Bollen and Long (1993), a variety of global fit indices were used, including indices of absolute fit, indices of relative fit and indices of fit with a penalty function for lack of parsimony. First, the chi-square and its probability value (p-value) were examined. The higher the p-value is, the closer the fit between the hypothesized model and model fit (Byrne 2001), with a target p-value of greater than .05. The comparative fit index (CFI) was used as an index of fit based on the comparison of the hypothesized model with the independence model. A CFI value of greater than .95 was used to indicate model fit. The root mean square error of approximation (RMSEA) accounts for the error of approximation in the population. An RMSEA of less than .08, and a p-value for the test of closeness of fit for the RMSEA of greater than .50 were used to indicate model fit. The standardized root mean square residual (SRMR) compares the observed covariance matrix against that constructed through the model. An SRMR of less than .05 was used to indicate model fit.
Following the logic of Rausch et al. (2003), the scores of the baseline measures (PE1, IDR1, INFO1, INTERN1, EXTERN1) were used for the analysis of covariance of a quasi-experimental outcome design with two waves of assessment (pretest, posttest) to evaluate whether participation in the CLP was associated with change in IDR, INFO, PE, INTERN, and EXTERN relative to the comparison control condition. Specifically, CLP was defined as a two-valued dummy variable (scored 1 or 0) for the two intervention conditions (CLP vs. control). By design, difference in this variable (intervention vs. control) was hypothesized to be related to differential outcome (change in IDR, INFO, PE, INTERN, EXTERN) at posttest (IDR2, INFO2, PE2, INTERN2, EXTERN2) controlling for pretest (IDR1, INFO1, PE1, INTERN1, EXTERN1). The hypothesized differences were evaluated using covariate-adjusted change in which the baseline (pretest) measure of the outcome and the outcome at the posttest are strategically used as covariates to define different features of change (Rausch et al. 2003).
Two exogenous interpersonal contextual factor covariates, Gender (G) and Ethnicity (E), were included in the analysis of outcome as measured at pretest, as were all possible interaction terms (i.e., CLP*G, CLP*E, G*E, CLP*G*E), with CLP designated as the focal independent variable. Non-significant interactions were dropped from the final model, leaving two significant interaction terms (CLP*E and CLP*G). To reduce clutter, Fig. 3 excludes the paths associated with the constitutive terms E and G, as these path coefficients are contingent upon the higher order CLP*E and CLP*G interaction terms (Jaccard and Turrisi 2003). Fig. 3 includes paths associated with the focal independent variable.
Baseline scores for predictor variables were used as covariates in order to account for possible lagged effects on outcome variables at post-test. That is, the effect of change in a predictor variable on change in an outcome variable was modeled by using baseline scores for both the predictor variable and the outcome variable as covariates for the outcome variable at post-test. Due to likely reciprocity of effects, the error term for IDR at posttest (IDR2) was allowed to correlate with PE at pretest (PE1).
References
Achenbach, T., & Edelbrock, C. (1981). Behavioral problems and competencies reported by parents of normal and disturbed children aged four through sixteen. Monographs of the Society for Research in Child Development, 46(1), 1–82.
Adams, G. R., Munro, B., Doherty-Poirer, M., Munro, G., Petersen, A. R., & Edwards, J. (2001). Diffuse-avoidant, normative, and informational identity styles: Using identity theory to predict maladjustment. Identity, 1(4), 307–320.
Arnett, J. J. (2000). Emerging adulthood: A theory of development from the late teens through the twenties. American Psychologist, 55(5), 469–480.
Bandura, A. (1997). Self-efficacy: The exercise of control. Freeman: New York.
Benson, P. L., Mannes, M., Pittman, K., & Ferber, T. (2004). Youth development, developmental assets, and public policy. In R. M. Lerner & L. Steinberg (Eds.), Handbook of adolescent psychology (2nd ed., pp. 781–814). New York: John Wiley.
Benson, P. L., Scales, P. C., Hamilton, S. F., & Sesma, A., Jr. (2006). Positive youth development: Theory, research, and application. In W. W. Damon & R. M. Lerner (Eds.), Handbook of child psychology, Volume 1, theoretical models of human development. New York: John Wiley.
Berman, A., Schwartz, S. J., Kurtines, W. M., & Berman, S. L. (2001). The process of exploration in identity formation: The role of style and competence. Journal of Adolescence, 24(4), 513–528.
Berzonsky, M. D. (1989). Identity style: Conceptualization and measurement. Journal of Adolescent Research, 4, 267–281.
Berzonsky, M. D. (1990). Self-construction over the life-span: A process perspective on identity formation. In G. J. Neimeyer & R. A. Neimeyer (Eds.), Advances in personal construct psychology (Vol. 1, pp. 156–186). Greenwich, CT: JAI Press.
Berzonsky, M. D. (1992). Identity style and coping strategies. Journal of Personality, 60(4), 771–788.
Berzonsky, M. D. (2004). Identity style, parental authority, and identity commitment. Journal of Youth and adolescence, 33(3), 213–220.
Berzonsky, M. D., & Neimeyer, G. J. (1994). Ego identity status and identity processing orientation: The moderating role of commitment. Journal of Research in Personality, 28, 425–435.
Berzonsky, M. D., & Sullivan, C. (1992). Social-cognitive aspects of identity style: Need for cognition, experiential openness, and introspection. Journal of Adolescent Research, 7, 140–155.
Bollen, K., & Long, S. (1993). Testing structural equation models. Newbury Park: Sage.
Bosma, H. A., & Kunnen, E. S. (2001). Determinants and mechanisms in ego identity development: A review and synthesis. Developmental Review, 21, 39–66.
Byrne, B. M. (2001). Structural equation modeling with AMOS: Basic concepts, applications, and programming. Mahwah, NJ: Laurence Erlbaum Associates, Inc.
Catalano, R. F., Berglund, M. L., Ryan, J. A. M., Lonczak, H. S., & Hawkins, J. D. (1999). Positive youth development in the United States: Research findings on evaluations of positive youth development programs. Washington, D.C.: U.S. Department of Health and Human Services.
Catalano, R. F., Berglund, M. L., Ryan, J. A. M., Lonczak, H. S., & Hawkins, J. D. (2004). Positive youth development in the United States: Research findings on evaluations of positive youth development programs. The Annals of the American Academy of Political and Social Science, 591, 98–124.
Cicchetti, D., & Cohen, D. J. (2006). Developmental psychopathology (2nd ed., Vol. 3). New York: John Wiley and Sons.
Clingempeel, W. G., & Henggeler, S. W. (2002). Randomized clinical trials, developmental theory, and antisocial youth: Guidelines for research. Development and Psychopathology, 14, 695–711.
Elder, G. H. (1998). The life course and human development. In R. M. Lerner (Ed.), Handbook of child psychology, Vol. 1: Theoretical models of human development. New York: John Wiley.
Elder, G. H., & Shanahan, M. J. (2006). The life course and human development. In R. E. Lerner (ed.), Theoretical models of human development, (Chapter 12, pp. 665–715), (Volume 1: The handbook of child psychology, 6th ed.). William Damon, series editor. New York: Wiley.
Erikson, E. H. (1963). Childhood and society. New York: Norton.
Erikson, E. H. (1968). Identity: Youth and crisis. New York: Norton.
Ferrer-Wreder, L., Palchuk, A., Poyrazli, S., Small, M. L., & Domitrovich, C. E. (2008). Identity and adolescent adjustment. Identity: An International Journal of Theory and Research, 8(2), 95–105.
Greenberger, E., & Sorensen, A. B. (1974). Toward a concept of psychosocial maturity. Journal of Youth and Adolescence, 3, 329–358.
Grotevant, H. (1987). Toward a process model of identity formation. Journal of Adolescent Research, 2, 203–222.
Holmbeck, G. N. (2002). A developmental perspective on adolescent health and illness: An introduction to the special issues. Journal of Pediatric Psychology, 27, 409–416.
Jaccard, J., & Turrisi, R. (2003). Interaction effects in multiple regression. Thousand Oaks, CA: Sage.
Jensen, P., Hoagwood, K., & Trickett, E. (1999). Ivory towers or earthen trenches? Community collaborations to foster “real world” research. Applied Developmental Science, 3(4), 206–212.
Kazdin, A. E., & Nock, M. K. (2003). Delineating mechanisms of change in child and adolescent therapy: Methodological issues and research recommendations. Journal of Child Psychology and Psychiatry, 44(8), 116–1129.
Kraemer, H. C., Wilson, G. T., Fairburn, C. G., & Agras, W. S. (2002). Mediators and moderators of treatment effects in randomized clinical trials. Archives of General Psychiatry, 59, 877–884.
Kroger, J. (1997). Gender and identity: The intersection of structure, content, and context. Sex Roles, 36(11/12), 747–770.
Kurtines, W. M., Ferrer-Wreder, L., Berman, S. L., Lorente, C. C., Briones, E., Montgomery, M. J., et al. (2008a). Promoting positive youth development: The Miami Youth Development Project (YDP). Journal of Adolescent Research, 23(3), 256–267.
Kurtines, W. M., Ferrer-Wreder, L., Berman, S. L., Lorente, C. C., Silverman, W. K., & Montgomery, M. J. (2008b). Promoting positive youth development: New directions in developmental theory, methods, and research. Journal of Adolescent Research, 23(3), 233–244.
Kurtines, W. M., Montgomery, M. J., Eichas, K., Ritchie, R., Garcia, A., Albrecht, R., et al. (2008c). Promoting positive development in troubled youth: A Developmental Intervention Science outreach research approach. Identity: An International Journal of Theory and Research, 8, 125–138.
Lerner, R. M. (2005). Promoting positive youth development: Theoretical and empirical bases. White paper: Workshop on the Science of Adolescent Health & Development, NRC/Institute of Medicine. Washington, D.C.: National Academies of Science.
Lerner, R. M., Fisher, C. B., & Weinberg, R. A. (2000). Toward a science for and of the people: Promoting civil society through the application of Developmental Science. Child Development, 71(1), 11–20.
Lerner, R. M., Lerner, J. V., Almerigi, J. B., Theokas, C., Phelps, E., Gestsdottir, S., et al. (2005). Positive youth development, participation in community youth development programs, and community contributions of fifth-grade adolescents: Findings from the first wave of the 4-H study of positive youth development. Journal of Early Adolescents, 25(1), 17–71.
MacKinnon, D. P., Fritz, M. S., Williams, J., & Lockwood, C. M. (2007). Distribution of the product confidence limits for the indirect effect: Program PRODCLIN. Behavior Research Methods, 39(3), 384–389.
MacKinnon, D. P., Lockwood, C. M., Hoffman, J. M., West, S. G., & Sheets, V. (2002). A comparison of methods to test mediation and other intervening variable effects. Psychological Methods, 7(1), 83–104.
Mainieri, T. (2006). The panel study of income dynamics child development supplement: User guide for CDS-II. Ann Arbor Michigan: The Institute for Social Research.
Marcia, J. E. (1966). Development and validation of ego-identity status. Journal of Personality and Social Psychology, 3(5), 551–558.
Marcia, J. E. (1980). Identity in adolescence. In J. Adelson (Ed.), Handbook of adolescent psychology (pp. 159–187). New York: Wiley.
Marcia, J. E. (1988). Common processes underlying ego identity, cognitive/moral development, and individuation. In D. K. Lapsley & F. C. Power (Eds.), Self, ego, and identity: Integrative approaches (pp. 211–266). New York: Springer.
Masten, A. S. (2006). Developmental psychopathology: Pathways to the future. International Journal of Behavior Development, 30(1), 47–54.
McWhinnie, C., Abela, J. R. Z., Hilmy, N., & Ferrer, I. (2008). Positive youth development programs: An alternative approach to the prevention of depression in children and adolescents. In J. R. Z. Abela & B. L. Hankin (Eds.), Handbook of depression in children and adolescents (pp. 354–373). New York: Routledge.
Miranda, J., Bernal, G., Lau, A., Kohn, L., Hwang, W., & LaFromboise, T. (2005). State of the science on psychosocial interventions for ethnic minorities. Annual Review of Clinical Psychology, 1, 113–142.
Montgomery, M. J. (2005). Psychosocial intimacy and identity: From early adolescence to emerging adulthood. Journal of Adolescent Research, 20(3), 346–374.
Montgomery, M. J., Kurtines, W. M., Ferrer-Wreder, L., Berman, S. L., Lorente, C. C., Briones, E., et al. (2008). A Developmental Intervention Science (DIS) outreach research approach to promoting youth development: Theoretical, methodological, and meta-theoretical challenges. Journal of Adolescent Research, 23(3), 268–290.
Muthen, L. K. & Muthen, B. O. (1998–2007). Mplus user’s guide (5th ed). Los Angeles, CA: Muthen & Muthen.
Nurmi, J., Berzonsky, M. D., Tammi, K., & Kinney, A. (1997). Identity processing orientation, cognitive and behavioural strategies and well-being. International Journal of Behavioral Development, 21(3), 555–570.
Overton, W. (1998). Developmental psychology: Philosophy, concepts, and methodology. In R. M. Lerner (Ed.) & W. Damon (Series Ed.), Handbook of child psychology: Vol. 1. Theoretical models of human development (5th ed., pp. 107–187). New York: John Wiley.
Overton, W. F. (2006). Developmental psychology: Philosophy, concepts, methodology. In W. Damon & R. M. Lerner (Eds.) & R. M. Lerner (Vol. Ed.), Handbook of child psychology. Vol. 1: Theoretical models of human development (6th ed., pp. 18–88). Hoboken, NJ: Wiley.
Palen, L., & Coatsworth, J. D. (2007). Activity-based identity experiences and their relations to problem behavior and psychological well-being in adolescence. Journal of Adolescence, 30, 721–737.
Peterson, J. L., & Zill, N. (1986). Marital disruption, parent-child relationships, and behavioral problems in children. Journal of Marriage and the Family, 48(2), 295–307.
Rausch, J. R., Maxwell, S. E., & Kelly, K. (2003). Analytical methods for questions pertaining to randomized pretest, posttest, follow-up design. Journal of Clinical Child and Adolescent Psychology, 32(2), 467–486.
Rosenthal, D. A., Gurney, R. M., & Moore, S. M. (1981). From trust to intimacy: A new inventory for examining Erikson’s stages of psychosocial development. Journal of Youth and Adolescence, 10, 525–537.
Schwartz, S. J. (2001). The evolution of Eriksonian and Neo-Eriksonian identity theory and research: A review and integration. Identity: An International Journal of Theory and Research, 1(1), 7–58.
Schwartz, S. J. (2002). In search of mechanisms of change in identity development: Integrating the constructivist and discovery perspectives in identity. Identity: An International Journal of Theory and Research, 2(4), 317–339.
Schwartz, S. J., Cote, J. E., & Arnett, J. J. (2006). Identity and agency in emerging adulthood: Two developmental routes in the individualization process. Youth and Society, 37(2), 201–229.
Schwartz, S. J., Mullis, R. L., Waterman, A. S., & Dunham, R. M. (2000). Ego identity status, identity style, and personal expressiveness: An empirical investigation of three convergent constructs. Journal of Adolescent Research, 15(4), 504–521.
Schwartz, S. J., Pantin, H., Coatsworth, J. D., & Szapocznik, J. (2007). Addressing the challenges and opportunities for today’s youth: Toward an integrative model and its implications for research and intervention. The Journal of Primary Prevention, 28, 117–144.
Silverman, W. K., Kurtines, W. M., Jaccard, J., & Pina, A. A. (2009). Directionality of change in youth anxiety CBT involving parents: An initial examination. Journal of Consulting and Clinical Psychology, 77(3), 474–485.
Soenens, B., Berzonsky, M. D., Vansteenkiste, M., Beyers, W., & Goossens, L. (2005). Identity styles and causality orientations: In search of the motivational underpinnings of the identity exploration process. European Journal of Personality, 19, 427–442.
Spencer, M. B., & Markstrom-Adams, C. (1990). Identity processes among racial and ethnic minority children in America. Child Development, 61(2), 290–310.
Waterman, A. S. (1993). Finding something to do or someone to be: A eudaimonist perspective on identity formation. In L. Kroger (Ed.), Discussions on ego identity (pp. 147–167). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
Waterman, A. S. (1995). Eudaimonic theory: Self-realization and the collective good. In W. M. Kurtines & J. L. Gewirtz (Eds.), Moral development: An introduction (pp. 255–278). Boston: Allyn & Bacon.
Waterman, A. S. (1999). Identity, the identity statuses, and identity status development: A contemporary statement. Developmental Review, 19, 591–621.
Waterman, A. (2004). Finding someone to be: Studies on the role of intrinsic motivation in identity formation. Identity: An International Journal of Theory and Research, 4(3), 209–228.
Waterman, A. (2005). When effort is enjoyed: Two studies of intrinsic motivation for personally salient activities. Motivation and Emotion, 29(3), 165–188.
Weersing, V. R., & Weisz, J. R. (2002). Mechanisms of action in youth psychotherapy. Journal of Child Psychology and Psychiatry, 43(1), 3–29.
Weisz, J. R., & Hawley, J. (2002). Developmental factors in the treatment on adolescents. Journal of Consulting and Clinical Psychology, 70(1), 21–43.
Weisz, J. R., Sandler, I. N., Durlak, J. A., & Anton, B. S. (2005). Promoting and protecting youth mental health through evidence-based prevention and treatment. American Psychologist, 60(6), 628–648.
Zahn-Waxler, C., Klimes-Dougan, B., & Slattery, M. J. (2000). Internalizing problems of childhood and adolescence: Prospects, pitfalls, and progress in understanding the development of anxiety and depression. Development and Psychopathology, 12, 443–466.
Zimmerman, M. A. (1995). Psychological empowerment: Issues and illustrations. American Journal of Community Psychology, 23(5), 581–599.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Eichas, K., Albrecht, R.E., Garcia, A.J. et al. Mediators of Positive Youth Development Intervention Change: Promoting Change in Positive and Problem Outcomes?. Child Youth Care Forum 39, 211–237 (2010). https://doi.org/10.1007/s10566-010-9103-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10566-010-9103-9