Abstract
Empirical and conceptual literature on career and workforce development increasingly cites the importance of connections between policy, research and practice domains. Yet, few if any models inform such collaborations. In the proposed Tripartite Model of Program Evaluation, the inter-play between these three key stakeholder groups is conceptualized within the paradigm of program evaluation in relation to best practices. A case example of an actual application of the model conducted in Turkey is also provided to illustrate the Tripartite Model.
Résumé
Un Modèle Tripartite d’Evaluation de Programme: Implications pour des Services d’Orientation Professionnelle Efficaces et le Développement du personnel. La littérature empirique et conceptuelle sur le développement de carrière et du personnel cite de plus en plus l’importance des liens entre les domaines de la politique, de la recherche et de la pratique. Pourtant, peu de modèles, voire aucun, informent de tels liens. Dans le modèle tripartite d’évaluation de programme proposé, l’interaction entre ces trois groupes d’acteurs est conceptualisée dans le paradigme de l’évaluation de programme à l’aune des meilleures pratiques. Un exemple de cas issu d’une application du modèle en Turquie est également présenté pour illustrer le modèle tripartite.
Abstrakt
Ein dreiseitiges Modell der Programmbewertung: Auswirkungen auf eine effektive Laufbahnberatung und die Personalentwicklung. Empirische und konzeptionelle Literatur zur Laufbahn- und Mitarbeiterentwicklung verweist zunehmend auf die Bedeutung von Verbindungen zwischen Politik, Forschung und Praxis. Doch nur wenige oder gar keine Modelle informieren über solche Kooperationen. Im vorgeschlagenen dreiseitigen Modell zur Programmevaluierung wird das Zusammenspiel zwischen diesen drei wichtigsten Interessengruppen im Rahmen des Paradigmas zur Programmevaluierung und mit Bezug zu Best Practices konzipiert. Als Fallbeispiel wird zur Veranschaulichung des dreiseitigen Modells eine tatsächliche Anwendung des Modells in der Türkei dargestellt.
Resumen
Un modelo tripartito de evaluación de programa: implicaciones para unos servicios efectivos de la carrera y desarrollo de la fuerza laboral. La literature empírica y conceptual sobre la carrera y el desarrollo de la fuerza laboral hace referencia cada vez más a la importancia de las conexiones entre la política, la investigación y la práctica de dominio. Todavía pocos o algunos modelos informan sobre tales colaboraciones. En el propuesto Modelo Tripartito de Evaluación de Programa, la interacción entre estas tres claves de los grupos de la parte interesda es conceptualizado entre el paradigma de evaluación de programa en relación con las mejores practicas. Un caso ejemplar de una aplicación actual del modelo llevado a cabo en Turquia también se aporta para ilustrar el Modelo Tripartito.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Baudouin, T., & Hiebert, B. (2007). Introduction to special issue on evidence-based practice in career development. Canadian Journal of Counselling,41(3), 127–129.
Bloom, B. S. (1956). Taxonomy of educational objectives: The classification of educational goals. New York: Longmans.
Blustein, D. L., Masdonati, J., Rossier, J. (2017). Psychology and the International Labor Organization: The role of psychology in the Decent Work Agenda. Retrieved from http://www.ilo.org/global/research/publications/WCMS_561013/lang–en/index.htm. Accessed Mar 2018.
Brand, B., Valent, A., & Browning, A. (2013). How career and technical education can help students be college and career ready: A primer. Washington, D.C. American Institutes for Research. Retrieved from http://www.ccrscenter.org/products-resources/how-career-and-technical-education-can-help-students-be-college-and-career-ready. Accessed Mar 2018.
Bronfenbrenner, U. (1977). Toward an experimental psychology of human development. American Psychologist,32, 513–532.
Bronfenbrenner, U. (1994). Ecological models of human development. In International encyclopedia of education. Oxford, UK: Elsevier
Brown, S. D. (2016). Meta-analysis and evidence-based career practice: Current status and future directions. In J. P. Sampson, E. Bullock-Yowell, V. C. Dozier, D. S. Osborn, & J. G. Lenz (Eds.), Integrating theory, research, and practice in vocational psychology: Current status and future directions. Tallahassee: Florida State University.
Brown, S. D., Ryan, K., Nancy, E., Brecheisen, J., Castelino, P., Budisin, I., … Edens, L. (2000). Critical ingredients of career choice interventions: More analyses and new hypotheses. Journal of Vocational Behavior,62, 411–428.
CEDEFOP. (2009). Professionalising career guidance: Practitioner competences and qualification routes in Europe (Cedefop Panorama Series, 164). Luxembourg, Office for Official Publications of the European Communities. Retrieved from www.cedefop.europa.eu/files/5193_en.pdf. Accessed Jan 2018.
Dawis, R. V. (2002). Person-environment-correspondence theory. In D. Brown (Ed.), Career choice and development (4th ed., pp. 427–464). San Francisco, CA: Jossey-Bass.
Eyster, L., Anderson, T., & Durham, C. (2013). Innovations and future directions for workforce development in the post-recession era. Working paper no. 7. Washington, DC: Urban Institute. Retrieved from http://programs.lisc.org/isd/images/resources_for_practitioners/asset_upload_file447_17294.pdf. Accessed Mar 2018.
Goldin, N. (2015). Key considerations in youth workforce development. Retrieved from: https://www.csis.org/analysis/key-considerations-youth-workforce-development. Accessed Jan 2018.
Gottfredson, L. S. (2002). Gottfredson’s theory of circumscription, compromise, and self-creation. In D. Brown (Ed.), Career choice and development (4th ed., pp. 85–148). San Francisco: JosseyBass.
Gysbers, N. C., Heppner, M. J., & Johnston, J. A. (1998). Career counseling: Process, issues and techniques. Needham Heights, MA: Allyn & Bacon.
Gysbers, N. C., & Moore, E. J. (1981). Improving guidance programs. Englewood Cliffs: Prentice-Hall.
Herr, E. L. (2001) The costs/benefits of career development interventions: A practitioner’s perspective. Retrieved from www.iaevg.org/crc/files/symp01_Herr_e620_2.doc. Accessed Mar 2018.
Holsti, O. R. (1969). Content analysis for the social sciences and humanities. Reading: Addison-Wesley.
Holzer, H. J. (2012). Raising job quality and skills for American workers: Creating more effective education and workforce development systems in the States. Retrieved from http://iza.org/pp42.pdf. Accessed Jan 2018.
Hughes, D., Bimrose, J., Barnes, S. A., Bowes, L., & Orton, M. (2005). A systematic literature review of research into career development interventions for workforce development. Retrieved from: http://citeseerx.ist.psu.edu/viewdoc/download?. Accessed Jan 2018.
Hughes, D., Mann, A., Barnes, S., Baldauf, B., McKeown, R. (2016). Careers education: International literature review. Education Endowment Foundation and Bank of America Merrill Lynch, London. Retrieved November 2017 from https://educationendowmentfoundation.org.uk/public/files/Publications/Careers_review.pdf.
International Labour Organization. (2010). A skilled workforce for strong, sustainable and balanced growth. A G20 training strategy. Retrieved from https://www.oecd.org/g20/summits/toronto/G20-Skills-Strategy.pdf. Accessed Jan 2017.
International Labour Organization. (2011). A skilled workforce for strong, sustainable and balanced growth: A G20 training strategy. Retrieved from https://www.oecd.org/g20/summits/toronto/G20-Skills-Strategy.pdf. Accessed Jan 2017.
International Labour Organization. (2016). Interventions to improve the labour market outcomes of youth: A systematic review of training, entrepreneurship promotion, employment services and subsidized employment interventions. Retrieved from http://www.ilo.org/employment/Whatwedo/Publications/WCMS_508938/lang–en/index.htm. Accessed Jan 2017.
International Youth Foundation. (2014). Preparing youth to succeed: The importance of career guidance. Retrieved from http://www.iyfnet.org/library/preparing-youth-succeed-importance-career-guidance. Accessed Jan 2017.
Kavale, J. (2012). Needs and needs assessment in career guidance and counselling: Lack of scientific exploration and justification? Indian Journal of Career and Livelihood Planning Journal of the Indian Association for Career and Livelihood Planning,1(1), 28–35.
Lalande, V., Hiebert, B., Magnusson, K., Bezanson, L., Borgen, B. (2006). Measuring the impact of career services: current and desired practices. In R. Neault, N. Arthur, & L. Edwards (Eds.) Natcon Papers 2006. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?. Accessed Mar 2018.
Lent, R. W., Brown, S. D., & Hackett, G. (2001). Social cognitive career theory. In D. Brown (Ed.), Career choice and development (4th ed., pp. 255–311). San Francisco, CA: JosseyBass.
Liu, S., Huang, J. L., & Wang, M. (2014). Effectiveness of job search interventions: A meta-analytic review. Psychological Bulletin,140(4), 1009–1041.
Making Cents International. (2014). Understanding the technology skills training landscape: Framework and tool. Retrieved from https://youtheconomicopportunities.org/sites/default/files/uploads/resource/MakingCentsInternational_TechnologySkillsTrainingLandscape_2014.pdf. Accessed Jan 2017.
Ministry of National Education. (2014). Ortaokul Rehberlik ve Kariyer Planlama Dersi Öğretim Programı [Middle School Guidance and Career Planning Course Curriculum]. http://orgm.meb.gov.tr/www/rehberlik-programlari/icerik/102. Accessed Jan 2018.
Nassar, S. C., & Al-Qimlass, A. (2017). Career builders: Key components for effective global youth career and workforce development. (RTI Press Publication No. OP-0045-1709). Research Triangle Park: RTI Press. https://doi.org/10.3768/rtipress.2017.op.0045.1709. Accessed Mar 2018.
Nassar, S. C., Al-Qimlass, A., Karacan-Ozdemir, N., & Tovar, L. Z. (2019). Considerations for career intervention services in global youth workforce development: Consensus across policy, research, and practice. Empirical Research in Vocational Education and Training. https://doi.org/10.1186/s40461-019-0080-4.
Nassar, S.C., Al-Qimlass, A., Tovar, L.Z, & Karacan-Ozdemir, N. (2017). Career builders toolkit. Global center for youth employment. Retrieved from http://gcyerti.com/wp-content/uploads/2018/01/Nassar-et-al-CAREER-BUILDERS-TOOLKIT.pdf. Accessed Mar 2018.
Nassar-McMillan, S. C. (2014). A framework for cultural competence, advocacy, and social justice: Applications for global multiculturalism and diversity. International Journal for Educational and Vocational Guidance,14(1), 103–118. https://doi.org/10.1007/s10775-014-9265-3.
Nassar-McMillan, S. C., & Conley, A. H. (2011). Programme evaluation toolbox: Effective evaluation principles and considerations in career practice. International Journal for Educational and Vocational Guidance,11(3), 211–220.
Nassar-McMillan, S. C., & Vuorien, R. (2012). Public policy and career development: An International Symposium discussion. Career Development Quarterly.,60(5), 1–11.
Neary, S., Dodd, V., & Hooley, T. (2015). Understanding career management skills: Findings from the first phase of the CMS leader project. Derby, UK: International Centre for Guidance Studies, University of Derby.
OECD. (2003). Career guidance: New ways forward. In Education policy analysis (pp. 39–57). Retrieved from http://www.oecd.org/edu/innovation-education/19975192.pdf. Accessed Jan 2018.
Oliver, L. W., & Spokane, A. R. (1988). Career-intervention outcome: What contributes to client gain? Journal of Counseling Psychology,35(4), 447–462.
Parsons, F. (1909). Choosing a vocation. Boston, MA: Houghton Mifflin Co.
Rodríguez, O., Hughes, K. L., & Belfield, C. (2012). Bridging college and careers: Using dual enrollment to enhance career and technical education pathways. New York: National Center for Postsecondary Research. Retrieved from http://www.postsecondaryresearch.org/i/a/document/NCPRWorkingPaper_RodriguezHughesBelfield_DualEnrollment.pdf. Accessed Mar 2018.
Rosengren, K. E. (1981). Advances in Scandinavia content analysis: An introduction. In K. E. Rosengren (Ed.), Advances in content analysis (pp. 9–19). Beverly Hills, CA: Sage.
Savickas, M. L. (2012). Life Design: A paradigm for career intervention in the 21st Century. Journal of Counseling & Development,90(1), 13–19. https://doi.org/10.1111/j.1556-6676.2012.00002.x.
Sultana, R. G. (2004). Guidance policies in the learning society: Trends, challenges and responses across Europe. Retrieved from www.cedefop.europa.eu/files/5152_en.pdf. Accessed Jan 2018.
Sultana, R. G. (2008). From policy to practice: A systemic change to lifelong guidance in Europe. Thessaloniki: CEDEFOP. Retrieved from https://www.um.edu.mt/library/oar/handle/123456789/18493?show=full. Accessed Jan 2018.
Sultana, R. G. (2010). Career guidance and social inclusion: A challenge for Europe. Australian Journal of Career Development, 19(1), 18–23. Retrieved from https://www.um.edu.mt/__data/assets/pdf_file/0013/144121/Guidance-social_inclusion.PDF. Accessed Jan 2018.
UNESCO. (2013). Revisiting global trends in TVET: Reflections on theory and practice. Retrieved from http://www.unevoc.unesco.org/fileadmin/up/2013_epub_revisiting_global_trends_in_tvet_book.pdf. Accessed Jan 2017.
Watkins, R., West-Meiers, M., & Visser, Y. (2012). A guide to assessing needs: Tools for collecting information, making decisions, and achieving development results. Washington, DC: World Ban. Retrieved from https://openknowledge.worldbank.org/handle/10986/2231. Accessed Jan 2018.
Watts, A. G. (2008). Career guidance and public policy. In J. A. Athanasou & R. Van Esbroeck (Eds.), International handbook of career guidance (pp. 341–352). Dordrecht: Springer.
Watts, A. G., & Fretwell, D. (2004). Public policies for career development: Policy strategies for designing career information and guidance systems in middle-income and transition economies. Washington, DC: World Bank.
Whiston, S. C., Li, Y., Goodrich Mitts, N., & Wright, L. (2017). Effectiveness of career choice interventions: A meta-analytic replication and extension. Journal of Vocational Behavior,100, 175–184.
Whiston, S. C., Sexton, T. L., & Lasoff, D. (1998). Career-intervention outcome: A replication and extension of Oliver and Spokane. Journal of Counseling Psychology,45(2), 150–165.
Funding
The funding was provided by Research Triangle Institute.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Nassar, S.C., Al-Qimlass, A. & Ozdemir, N.K. A tripartite model of program evaluation: implications for effective career services and workforce development. Int J Educ Vocat Guidance 20, 411–427 (2020). https://doi.org/10.1007/s10775-019-09410-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10775-019-09410-6