Demystifying Program Evaluation for Surgical Education

  • Alexis BattistaEmail author
  • Michelle Yoon
  • E. Matthew Ritter
  • Debra Nestel
Part of the Innovation and Change in Professional Education book series (ICPE, volume 17)


In this chapter, we define program evaluation, address its role in evaluating surgical education programs, describe important early steps surgical program evaluators can take to improve the usefulness of program evaluation, discuss common challenges, and offer solutions evaluators can use to overcome these challenges. The chapter is intended for those who are engaging or considering engaging in program evaluation for the first time or are doing so with limited support from a formal program evaluator. Additionally, we have included resources and examples to provide guidance beyond the scope of this chapter.


Program evaluation Surgical program evaluation Stakeholder Logic model Formative evaluation Summative evaluation 


  1. 1.
    Rossi, P. H., Lipsey, M. W., & Freeman, H. E. (2003). Evaluation: A systematic approach. Thousand Oaks: Sage.Google Scholar
  2. 2.
    Yarbrough, D. B., Shulha, L. M., Hopson, R. K., & Caruthers, F. A. (2010). The program evaluation standards: A guide for evaluators and evaluation users. Los Angeles: Sage.Google Scholar
  3. 3.
    Stufflebeam, D. L. (1971). Educational evaluation and decision making. Ithaca: Peacock.Google Scholar
  4. 4.
    Cronbach, L. J. (1984). Essentials of psychological testing (4th ed.). New York: Harper & Row.Google Scholar
  5. 5.
    Kring, D. (2008). Research and quality improvement: Different processes, different evidence. MEDSURG Nursing, 17(3), 162–169.Google Scholar
  6. 6.
    Rozalis, M. L. (2003). Evaluation and research: Differences and similarities. The Canadian Journal of Program Evaluation, 18(2), 1–31.Google Scholar
  7. 7.
    Lovato, C., & Wall, D. (2014). Programme evaluation: Improving practice, influencing policy and decision-making. In Swanwick, T. (Ed.), Understanding medical education: Theory and practice (2nd ed.). Hoboken: Wiley.Google Scholar
  8. 8.
    Gomez, P. P., Willis, R. E., & Jaramillo, L. A. (2014). Evaluation of a dedicated, surgery-oriented visiting international medical student program. Journal of Surgical Education, 71(3), 325–328.CrossRefGoogle Scholar
  9. 9.
    Yu, A. Y., Wang, Q. M., Li, J., Huang, F., & Golnik, K. (2016). A cataract surgery training program: 2-year outcome after launching. Journal of Surgical Education, 73, 761–767.CrossRefGoogle Scholar
  10. 10.
    Dick, W., & Carey, L. (2011). The systematic design of instruction.Google Scholar
  11. 11.
    Greene, J. C. (2005). Mixed methods. In S. Mathison (Ed.), Encyclopedia of evaluation. Thousand Oaks: Sage.Google Scholar
  12. 12.
    McLaughlin, J. A., & Jordan, G. B. (1999). Logic models: A tool for telling your programs performance story. Evaluation and Program Planning, 22(1), 65–72.CrossRefGoogle Scholar
  13. 13.
    Shakman, K., & Rodriguez, S.M. (2015, May). Logic models for program design, implementation, and evaluation: Workshop toolkit. REL 2015-057. Regional Educational Laboratory Northeast & Islands.Google Scholar
  14. 14.
    Lawton, B., Brandon, P.R., Cicchinelli, L., Kekahio, W. (2014, February) Logic models: A tool for designing and monitoring program evaluations. REL 2014-007. Regional Educational Laboratory Pacific.Google Scholar
  15. 15.
    Kirkpatrick, D. L., & Kirkpatrick, J. D. (2006). Evaluating training programs: The four levels. San Francisco: Berrett-Koehler Publishers.Google Scholar
  16. 16.
    Patton, M. Q. (2008). Utilization-focused evaluation. Thousand Oaks: Sage Publications.Google Scholar
  17. 17.
    Stufflebeam, D. L., & Shinkfield, A. J. (2007). Evaluation theory, models, and applications (1st ed.). San Francisco: Jossey-Bass.Google Scholar
  18. 18.
    Torbeck, L., Canal, D. F., & Choi, J. (2014). Is our residency program successful? Structuring an outcomes assessment system as a component of program evaluation. Journal of Surgical Education., 71(1), 73–78.CrossRefGoogle Scholar
  19. 19.
    Fitzpatrick, J., Sanders, J., & Worthen, B. (2011). Reporting evaluation results: Maximizing use and understanding. program evaluation: Alternative approaches and practical guidelines (4th ed., pp. 453–489). Upper Saddle River: Pearson Education.Google Scholar
  20. 20.
    Thomas, P. A., Kern, D. E., Hughes, M. T., & Chen, B. Y. (2015). Curriculum development for medical education: A six-step approach. JHU Press.Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  • Alexis Battista
    • 1
    • 2
    Email author
  • Michelle Yoon
    • 3
  • E. Matthew Ritter
    • 4
  • Debra Nestel
    • 5
    • 6
  1. 1.Graduate Programs in Health Professions Education, Department of Medicine, F. Edward Hébert School of MedicineUniformed Services University of the Health SciencesBethesdaUSA
  2. 2.The Henry M Jackson Foundation for the Advancement of Military MedicineBethesdaUSA
  3. 3.University of Colorado School of MedicineAuroraUSA
  4. 4.USU/Walter Reed Department of SurgeryBethesdaUSA
  5. 5.Faculty of Medicine, Nursing & Health Sciences, Monash Institute for Health and Clinical EducationMonash UniversityClaytonAustralia
  6. 6.Faculty of Medicine Dentistry & Health Sciences, Department of Surgery, Melbourne Medical SchoolUniversity of MelbourneParkvilleAustralia

Personalised recommendations