Advertisement

Programme evaluation toolbox: effective evaluation principles and considerations in career practice

  • Sylvia Nassar-McMillan
  • Abigail Holland Conley
Article
First Online:
  • 321 Downloads

Abstract

In our ever-present age of accountability, career development professionals are increasingly called upon to document evidence-based outcomes and other metrics of programme effectiveness. In this article, we will review the key components of effective programme evaluation, including purposes and types of evaluation. Our review will span empirical and practical literature across disciplines and within guidance and counselling, specifically. We will review current evaluation models within an international context but focus predominantly on US based ones, along with articulating their shortfalls. Finally, we will present a potentially transformative advocacy-infused model of programme evaluation.

Keywords

Programme evaluation Advocacy in evaluation Vocational guidance efficacy 

Résumé

Évaluation du Programme Boîte à outils: principes d’évaluation efficace et considérations dans la pratique professionnelle. Dans notre époque où la responsabilisation est omniprésente, les professionnels du développement de carrière sont de plus en plus appelés à fournir des preuves de résultats efficaces ainsi que d’autres mesures de l’efficacité d’un programme. Cet article va examiner les éléments clés de l’évaluation des programmes efficaces, y compris les objectifs et les types d’évaluation. Notre examen s’étendra à la littérature empirique et pratique entre les disciplines et au sein du conseil en orientation, en particulier. Nous passerons en revue les modèles d’évaluation actuels dans un contexte international mais nous nous concentrerons surtout sur les modèles américains, tout en exprimant leurs déficits. Enfin, nous présenterons un modèle engagé d’évaluation de programme potentiellement transformateur.

Zusammenfassung

Toolbox der Programm Evaluation: Grundsätze und Überlegungen zur effektiven Evaluation in der Praxis der Laufbahnberatung. In unserem stets gegenwärtigen Zeitalter der Rechenschaftspflicht sind Fachpersonen in der Laufbahnberatung zunehmend gefordert, evidenz-basierte Ergebnisse und andere Messgrößen zur Programm Effektivität zu dokumentieren. Dieser Artikel überprüft die wichtigsten Komponentenvon wirksamen Programm-Evaluierungen, einschließlich Ziele und Arten der Evaluation. Unsere Übersicht wird empirische und praktische interdisziplinäre Literatur sowie im Speziellen innerhalb der Berufsberatung umfassen. Wir werden aktuelle Evaluierungsmodelle im internationalen Kontext beschreiben, aber uns überwiegend auf US-basierte konzentrieren, sowie deren Defizite artikulieren. Schließlich präsentieren wir ein potenziell transformatives Fürsprache-infundiertes Modell zur Progamm-Evaluierung.

Resumen

Repertorio de Evaluación de Programas: Principios Efectivos de Evaluación y Consideraciones para la Práctica de Orientación Profesional. En esta era en la que hay una continua necesidad de rendir cuentas, a los profesionales de la orientación para la carrera se les exige cada vez más aportar evidencias tangibles de sus resultados y otras medidas sobre la eficacia de sus programas. Este artículo presenta una revisión de los elementos clave de la evaluación eficaz de programas, incluyendo los objetivos y tipos de evaluación. Nuestra revisión abarca la literatura empírica y práctica interdisciplinar y específicamente dentro de la orientación. Se revisan los modelos de evaluación actuales en el contexto internacional, pero con mayor énfasis en los de Estados Unidos, señalando también sus dificultades. Finalmente, se presenta un modelo de evaluación de programas con potencial transformador.

This is a preview of subscription content, log in to check access.

References

  1. American School Counselor Association (ASCA) & Association for Assessment in Counselling (AACE). (2000). Competencies in assessment and evaluation for school counselors. Alexandria: Author.Google Scholar
  2. Astramovich, R. L., & Coker, J. K. (2007). Program evaluation: The accountability bridge model for counselors. Journal of Counseling & Development, 85(2), 162–172.Google Scholar
  3. Benkofske, M., & Heppner, C. C. (2008). Program evaluation. In P. P. Heppner, B. E. Wampold, & D. M. Kivlighan (Eds.), Research design in counseling. Belmont: Thomson.Google Scholar
  4. Chwalisz, K. (2003). Evidence-based practice: A framework for twenty-first-century scientist–practitioner Training. The Counselling Psychologist, 31(5), 497–528. doi: 10.1177/0011000003256347.
  5. Dimmitt, C. (2009). Why evaluation matters: Determining effective school counselling practices. Professional School Counselling, 12(6), 395–399.CrossRefGoogle Scholar
  6. Dimmitt, C., Carey, J. C., & Hatch, T. (2007). Evidence-based school counseling: Making a difference with data-driven practices. Thousand Oaks: Corwin Press.Google Scholar
  7. Drummond, R. J., & Jones, K. D. (2010). Assessment procedures for counselors and helping professionals (7th ed.). Upper Saddle River: Pearson Education.Google Scholar
  8. Goodyear, R. K., & Benton, S. (1986). The roles of science and research in the counselor’s work. In A. J. Palmo & W. J. Weikel (Eds.), Foundations of mental health counseling. Springfield: Charles C Thomas.Google Scholar
  9. Hayes, S. C., Barlow, D. H., & Nelson-Gray, R. O. (1999). The scientist practitioner: Research and accountability in the age of managed care. Needham Heights: Allyn & Bacon.Google Scholar
  10. Herman, J., Morris, L., & Fitz-Gibbon, C. (1987). Evaluator’s handbook. Newbury Park: Sage.Google Scholar
  11. International Association for Educational and Vocational Guidance, National Career Development Association, & Society for Vocational Psychology. (2010). International Symposium Survey. Broken Arrow: IAEVG, NCDA, SVP.Google Scholar
  12. Lusky, M. B., & Hayes, R. L. (2001). Collaborative consultation and program evaluation. Journal of Counseling & Development, 79(1), 26.Google Scholar
  13. Nassar-McMillan, S. C., & Vuorinen, R. (2011). Public policy and career development: An international symposium discussion. Career Development Quarterly, 57, 342–347.Google Scholar
  14. Plant, P. (2004). Quality in career guidance: Issues and methods. International Journal for Educational and Vocational Guidance, 4, 141–157. doi: 10.1007/s10775-005-1023-0.CrossRefGoogle Scholar
  15. Plant, P. (2011). Quality assurance and evidence in career guidance in Europe: Counting what is measured or measuring what counts? International Journal for Educational and Vocational Guidance, 11, 1–14. doi: 10.1007/s10775-011-9195-2.CrossRefGoogle Scholar
  16. Sampson, J. P., Jr. (2008). Designing and implementing career programs: A handbook for effective practice. Broken Arrow: National Career Development Association.Google Scholar
  17. Sampson, J. P., Jr. (2011). Translating career theory to practice: The risk of unintentional social injustice. Journal of Counseling & Development, 89, 326–337.Google Scholar
  18. Watt, G. (1998). Supporting employability: Guides to good practice in employment counselling and guidance. Luxembourg: Official Publications of the European Commission.Google Scholar
  19. Watts, A. G., & Sultana, R. G. (2004). Career guidance policies in 37 countries: Contrasts and common themes. International Journal for Educational and Vocational Guidance, 4, 105–122. doi: 10.1007/s10775-005-1025-y.CrossRefGoogle Scholar
  20. Wills, J., & Mack, D. (2009). Comprehensive career planning and its role in the global economy. Washington, DC: Institute for Educational Leadership and HeiTech Services.Google Scholar

Copyright information

© Springer Science+Business Media B.V. 2011

Authors and Affiliations

  • Sylvia Nassar-McMillan
    • 1
  • Abigail Holland Conley
    • 1
  1. 1.North Carolina State UniversityRaleighUSA

Personalised recommendations

Cite article

Buy options