To assess the influence of intensive focused leadership training on self-evaluation of leadership skills among Maternal and Child Health (MCH) professionals enrolled in the Maternal and Child Health Public Health Leadership Institute (MCH PHLI). Senior-level MCH leaders (n = 54) participated in the first two cohorts of the MCH PHLI, a senior-level training program funded through the Maternal and Child Health Bureau. Participants were asked to complete a retrospective pre- and post-test rating inventory at program completion. Participants self-identified their skill level across 20 leadership skills that were the focus of the training program. These skills were derived from the MCH Leadership Competencies, 3.0 and literature reviews, and then divided into two domains: Core leadership skills and Organizational/Institutional leadership skills. Data were analyzed to determine whether participants perceived skill level increased by the end of their training year. A one-sided (upper) paired T Test and a Wilcoxen Signed Rank Sum Test were used to determine statistical significance. Increases in perceived skill levels were found to be statistically significant at the alpha = .01 level for all 20 target skills. The MCH PHLI model of intensive leadership development, incorporating a hybrid approach of onsite and distance-based learning, was broadly effective in building targeted leadership skills as perceived by participants.
This is a preview of subscription content,to check access.
Access this article
Fernandez, C. S. P., & Steffen, D. (2013). Leadership for public health. In L. Shi & J. A. Johnson (Eds.), Novick and Morrow’s Public health administration: Principles for population based management (3rd ed., pp. 241–265). Sudbury, MA: Jones and Bartlett Publishers.
Institute of Medicine. (1988). The future of public health. Washington: National Academies Press.
Halverson, P. K., Mays, G. P., Kaluzny, A. D., & House, R. M. (1997). Developing leaders in public health: The role of executive training programs. The Journal of Health Administration Education, 15, 87–100.
Gebbie, K. M., & Hwang, I. (1998) Preparing currently employed public health professionals forcChanges in the health system. New York: Columbia University School of Nursing Center for Health Policy and Health Services Research.
Wright, K., Baker, E., Rowitz, L., Merkle, A., Reid, W., Robinson, G., et al. (2000). Competency development in public health leadership. American Journal of Public Health, 90(8), 1202–1207.
Baker, J., Edward, L., & Koplan, J. P. (2002) Strengthening the nation’s public health infrastructure: Historic challenge, unprecedented opportunity. Health Aff (Millwood) 21(6):15–27.
Schein, E. H. (2010). Organizational culture and leadership. San Francisco: Josey-Bass.
Fernandez, C. P. (2007). Employee engagement. Journal of Public Health Management and Practice, 13(5), 524–526.
Gifford, B. D., Zammuto, R. F., & Goodman, E. A. (2002). The relationship between hospital unit culture and nurses’ quality of work life. Journal of Healthcare Management, 47(1), 13–25.
Hill, K. (2002). The relationship between hospital unit culture and nurses’ quality of work life: Practitioner application. Journal of Healthcare Management, 47(1), 25–26.
Freshman, B., & Rubino, L. (2002). Emotional intelligence: A core competency for health care administrators. The Health Care Manager, 20(4), 1–9.
Barak, M. E. M., Nissly, J. A., & Levin, A. (2001). Antecedents to retention and turnover among child welfare, social work, and other human service employees: What can we learn from past research? A review and metanalysis. Social Service Review, 75(4), 625–661.
Institute of Medicine of the National Academies. For the public’s health: Investing in a healthier future [Internet]. Washington: National Academy Press; 2012 [cited 2012 Sep 18]. Available from: http://www.iom.edu/Reports/2012/For-the-Publics-Health-Investing-in-a-Healthier-Future.aspx.
MCH leadership competencies, vers. 3.0 [Internet]. c2009-2012 [updated 2011 Sept 13; cited 2013 Sept 10]. MCH leadership competencies; [about 2 screens]. Available from: http://leadership.mchtraining.net/.
Dodds, J., Vann, W., Lee, J., Rosenberg, A., Rounds, K., Roth, M., et al. (2010). The UNC-CH MCH leadership training consortium: Building the capacity to develop interdisciplinary MCH leaders. Maternal and Child Health Journal, 14(4), 642–648.
MCH Training Program: MCH Professional Development Grant, Division of Research, Training and Education. Maternal and Child Health Bureau of the Health Resources and Services Administration, Updated 7/2009. Available at: http://www.mchb.hrsa.gov/training/projects.asp?program=10; accessed June 12, 2013.
Maternal and Child Health Public Health Leadership Institute [Internet]. Chapel Hill: University of North Carolina at Chapel Hill; [n.d.; cited 2013 Sept 11]. Available from: http://mchphli.org/.
Kirkpatrick, D. L., & Kirkpatrick, J. D. (2006). Evaluating training programs (3rd ed.). San Francisco: Berrett-Koehler Publishers.
Kirkpatrick, D. L., & Kirkpatrick, J. D. (2007). Implementing the four levels. San Francisco: Berrett-Koehler Publisher.
Sprangers, M., & Hoogstraten, J. (1989). Pretesting effects in retrospective pretest-posttest designs. Journal of Applied Psychology, 74(89), 265–272.
Rockwell, S. K., & Kohn H. (1989) Post-then-pre evaluation. Journal of Extension [Internet]. 27(2) [about 7 screens]. Available from: http://www.joe.org/joe/1989summer/a5.php.
Lam, T. M., & Bengo, P. (2003). A comparison of three retrospective self-reporting methods of measuring change in instructional practice. American Journal of Evaluation, 24(1), 65–80.
Pratt, C. C., McGuigan, W. M., & Katzev, A. R. (2000). Measuring program outcomes: Using retrospective pretest methodology. American Journal of Evaluation, 21(3), 341–349.
Rohs, F. R. (1999). Response shift bias: A problem in evaluating leadership development with self-report pretest-posttest measures. Journal of Agricultural Education, 40(4), 28–37.
Mezoff, B. (1981). Pre-then-post testing: A tool to improve the accuracy of management training program evaluation. Performance and Instruction, 20(8), 10–11.
Hill, G. H., & Betz, D. L. (2005). Revisiting the retrospective pretest. American Journal of Evaluation, 26(4), 501–517.
Saleh, S. S., Williams, D., & Balougan, M. (2004). Evaluating the effectiveness of public health leadership training: The NEPHLI experience. American Journal of Public Health, 94(7), 1245–1249.
The Food Systems Leadership Institute [Internet]. The Food Systems Leadership Institute; c2006-2012 [cited 2012 Sept 13]. Developing individual and institutional leadership for a 21st century food system. Available at: www.fsli.org.
U.S. Department of Health and Human Services, Health Resources and Services Administration, Maternal and Child Health [Internet]. Rockville, MD: The Department; n.d. [cited 2013 Sept 13]. Maternal and Child Health training program [about 5 screens]. Available from: www.mchb.hrsa.gov/training/did_you_know.asp.
U.S. Department of Health and Human Services, Health Resources and Services Administration, Maternal and Child Health [Internet]. Rockville, MD: The Department; n.d. [cited 2013 Sept 13]. 2012-2020 strategic plan goals and strategies (draft) [about 4 screens]. Available from: http://www.mchb.hrsa.gov/training/about-national-goals.asp.
Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191–215.
McCormick, M. J. (2001). Self-efficacy and leadership effectiveness: Applying social cognitive theory to leadership. Journal of Leadership & Organizational Studies, 8(1), 22–33.
MaChida, M., & Schaubroeck, J. (2011). The role of self-efficacy beliefs in leader development. Journal of Leadership & Organizational Studies, 18(4), 459–468.
Olson, L. G. (2013). Public health leadership development: Factors contributing to growth. Journal of Public Health Management and Practice, 19(4), 341–347.
Green, S. G. (2002). Leadership self-efficacy and managers’ motivation for leading change. Journal of Organizational Behavior, 23(2), 215–235.
Pearlmutter, S. (1998). Self-efficacy and organizational change leadership. Administration in Social Work, 22(3), 23–38.
Fitzgerald, S., & Schutte, N. S. (2010). Increasing transformational leadership through enhancing self-efficacy. Journal of Management Development, 29(5), 495–505.
Paglis, L. L. (2010). Leadership self-efficacy: Research findings and practical applications. Journal of Management Development, 29(9), 771–782.
Anderson, D. W., Krajewski, H. T., Goffin, R. D., & Jackson, D. N. (2008). A leadership self-efficacy taxonomy and its relation to effective leadership. The Leadership Quarterly, 19(5), 595–608.
Furnham, A. (1986). Response bias, social desirability and dissimulation. Personality and Individual Differences, 7(3), 385–400.
MCH-PHLI is supported in full by a Project T04 MC12783 from the Maternal and Child Health Bureau (Title V, Social Security Act), Health Resources and Services Administration, Department of Health and Human Services.
Conflict of interest
Mr. Ruben Fernandez, JD, serves as a faculty in the MCH PHLI program and is related to the project Principal Investigator. The UNC conflict of interest management plan requires that all papers and presentations offer this acknowledgement, which can be included with the publication or not at the discretion of the editor.
About this article
Cite this article
Fernandez, C.S.P., Noble, C.C., Jensen, E. et al. Moving the Needle: A Retrospective Pre- and Post-analysis of Improving Perceived Abilities Across 20 Leadership Skills. Matern Child Health J 19, 343–352 (2015). https://doi.org/10.1007/s10995-014-1573-1