Continuous Evaluation in Ethics Education: A Case Study
A great need for systematic evaluation of ethics training programs exists. Those tasked with developing an ethics training program may be quick to dismiss the value of training evaluation in continuous process improvement. In the present effort, we use a case study approach to delineate how to leverage formative and summative evaluation measures to create a high-quality ethics education program. With regard to formative evaluation, information bearing on trainee reactions, qualitative data from the comments of trainees, in addition to empirical findings, can ensure that the training program operates smoothly. Regarding summative evaluation, measures examining trainee cognition, behavior, and organization-level results provide information about how much trainees have changed as a result of taking the ethics training. The implications of effective training program evaluation are discussed.
KeywordsEvaluation Ethics training Ethical decision making Process improvement
- Antes, A. L., Brown, R. P., Murphy, S. T., Waples, E. P., Mumford, M. D., Connelly, S., & Devenport, L. D. (2007). Personality and ethical decision-making in research: The role of perceptions of self and others. Journal of Empirical Research on Human Research Ethics: International Journal, 2, 15–34.CrossRefGoogle Scholar
- Aronson, E., & Patnoe, S. (1997). The jigsaw classroom: Building cooperation in the classroom (2nd ed.). New York: Longman.Google Scholar
- Bagdasarov, Z., Thiel, C. E., Johnson, J. F., Connelly, S., Harkrider, L. N., Devenport, L. D., & Mumford, M. D. (2013). Case-based ethics instruction: The influence of contextual and individual factors in case content on ethical decision-making. Science and Engineering Ethics, 19, 1305–1322.CrossRefGoogle Scholar
- Borenstein, J., Drake, M., Kirkman, R., & Swann, J. (2008). The test of ethical sensitivity in science and engineering (TESSE): A discipline-specific assessment tool for awareness of ethical issues. In American Society for engineering education annual conference & exposition. Pittsburgh, PA.Google Scholar
- Council of Graduate Schools. (2012). Research and scholarly integrity in graduate education. Washington, DC: Author.Google Scholar
- Cullen, J. G., Sawzin, S. A., Sisson, G. R., & Swanson, R. A. (1978). Cost effectiveness: A model for assessing the training investment. Training and Development Journal, 32, 24–29.Google Scholar
- Dalton, R. (2000). NIH cash tied to compulsory training in good behaviour. Nature, 408, 629–629.Google Scholar
- DuBois, J. M., & Dueker, J. M. (2009). Teaching and assessing the responsible conduct of research: A delphi consensus panel report. Journal of Research Administration, 40, 49–70.Google Scholar
- Frazis, H. J., Herz, D. E., & Horrigan, M. W. (1995). Employer-provided training: Results from a new survey. Monthly Labor Review, 118, 3–17.Google Scholar
- Goldstein, I. L., & Ford, J. K. (2002). Training in organizations (4th ed.). Belmont, CA: Wadswroth Cengage Learning.Google Scholar
- Kirkpatrick, D. L. (1983). Four steps to measuring training effectiveness. Personnel Administrator, 28, 19–25.Google Scholar
- Kraiger, K. (2002). Decision-based evaluation. In K. Kraiger (Ed.), Creating, implementing, and maintaining effective training and development: State-of-the-art lessons for practice (pp. 331–375). San Francisco, CA: Jossey-Bass.Google Scholar
- MacDougall, A. E., Harkrider, L. N., Bagdasarov, Z., Johnson, J. F., Thiel, C. E., Peacock, J., Mumford, M. D., Devenport, L. D., & Connelly, S. (2014). Examining the effects of incremental case presentation and forecasting outcomes on case-based ethics instruction. Ethics & Behavior, 24, 126–150.CrossRefGoogle Scholar
- Mumford, M. D. (2006). Pathways to outstanding leadership: A comparative analysis of charismatic, ideological, and pragmatic leaders. Mahwah, NJ: Lawrence Erlbaum Associates Publishers.Google Scholar
- National Academy of Sciences. (2015). Optimizing the nation’s investment in academic research. A new regulatory framework for the 21st century part 1. In Committee on Federal research regulations and reporting requirements: A new framework for Research Universities in the 21st Century. The National Academies Press: Washington, DC.Google Scholar
- Noe, R. A. (2013). Employee training and development. New York, NY: McGraw Hill.Google Scholar
- Office of Research Integrity. (2001). United States Department of Health and Human Services, Rockvill, MD. Available from http://ori.dhhs.gov/html/publications/newsletters.asp.
- Online Ethics Center for Engineering and Science. (2001). Case Western Reserve University, Cleveland, OH. Available from http://onlineethics.org.
- Peacock, J., Harkrider, L. N., Bagdasarov, Z., Connelly, S., Johnson, J. F., Thiel, C. E., MacDougall, A. E., & Devenport, L. D. (2013). Effects of alternative outcome scenarios and structured outcome evaluation on case-based ethics instruction. Science and Engineering Ethics, 19, 1283–1303.CrossRefGoogle Scholar
- Shadish, W. R., Cook, T. D., & Campbell, D. T. (2001). Experimental and quasi-experimental designs for generalized causal inference. Stamford, CT: Cengage Learning.Google Scholar
- Watts, L. L., Medeiros, K. E., Mulhearn, T. J., Steele, L. M., Connelly, S., & Mumford, M. D. (2016a). Are ethics training programs improving? A meta-analytic review of past and present ethics instruction in the sciences. Ethics & Behavior, 1–34. doi:10.1080/10508422.2016.1182025.
- Watts, L. L., Mulhearn, T. J., Medeiros, K. E., Steele, L. M., Connelly, S., & Mumford, M. D. (2016b). Modeling the instructional effectiveness of responsible conduct of research education: A meta-analytic path-analysis. Ethics & Behavior, 1–19. doi:10.1080/10508422.2016.1247354.
- Weick, K. (1995). Sensemaking in organizations. Thousand Oaks, CA: Sage Publications.Google Scholar
- Welber, M. (2001). Web-based compliance training. E-learning, 2, 14–16.Google Scholar