Moving the Needle: A Retrospective Pre- and Post-analysis of Improving Perceived Abilities Across 20 Leadership Skills

Abstract

To assess the influence of intensive focused leadership training on self-evaluation of leadership skills among Maternal and Child Health (MCH) professionals enrolled in the Maternal and Child Health Public Health Leadership Institute (MCH PHLI). Senior-level MCH leaders (n = 54) participated in the first two cohorts of the MCH PHLI, a senior-level training program funded through the Maternal and Child Health Bureau. Participants were asked to complete a retrospective pre- and post-test rating inventory at program completion. Participants self-identified their skill level across 20 leadership skills that were the focus of the training program. These skills were derived from the MCH Leadership Competencies, 3.0 and literature reviews, and then divided into two domains: Core leadership skills and Organizational/Institutional leadership skills. Data were analyzed to determine whether participants perceived skill level increased by the end of their training year. A one-sided (upper) paired T Test and a Wilcoxen Signed Rank Sum Test were used to determine statistical significance. Increases in perceived skill levels were found to be statistically significant at the alpha = .01 level for all 20 target skills. The MCH PHLI model of intensive leadership development, incorporating a hybrid approach of onsite and distance-based learning, was broadly effective in building targeted leadership skills as perceived by participants.

This is a preview of subscription content, log in to check access.

Fig. 1

References

  1. 1.

    Fernandez, C. S. P., & Steffen, D. (2013). Leadership for public health. In L. Shi & J. A. Johnson (Eds.), Novick and Morrow’s Public health administration: Principles for population based management (3rd ed., pp. 241–265). Sudbury, MA: Jones and Bartlett Publishers.

    Google Scholar 

  2. 2.

    Institute of Medicine. (1988). The future of public health. Washington: National Academies Press.

    Google Scholar 

  3. 3.

    Halverson, P. K., Mays, G. P., Kaluzny, A. D., & House, R. M. (1997). Developing leaders in public health: The role of executive training programs. The Journal of Health Administration Education, 15, 87–100.

    CAS  PubMed  Google Scholar 

  4. 4.

    Gebbie, K. M., & Hwang, I. (1998) Preparing currently employed public health professionals forcChanges in the health system. New York: Columbia University School of Nursing Center for Health Policy and Health Services Research.

  5. 5.

    Wright, K., Baker, E., Rowitz, L., Merkle, A., Reid, W., Robinson, G., et al. (2000). Competency development in public health leadership. American Journal of Public Health, 90(8), 1202–1207.

    CAS  PubMed Central  PubMed  Article  Google Scholar 

  6. 6.

    Baker, J., Edward, L., & Koplan, J. P. (2002) Strengthening the nation’s public health infrastructure: Historic challenge, unprecedented opportunity. Health Aff (Millwood) 21(6):15–27.

  7. 7.

    Schein, E. H. (2010). Organizational culture and leadership. San Francisco: Josey-Bass.

    Google Scholar 

  8. 8.

    Fernandez, C. P. (2007). Employee engagement. Journal of Public Health Management and Practice, 13(5), 524–526.

    PubMed  Article  Google Scholar 

  9. 9.

    Gifford, B. D., Zammuto, R. F., & Goodman, E. A. (2002). The relationship between hospital unit culture and nurses’ quality of work life. Journal of Healthcare Management, 47(1), 13–25.

    PubMed  Google Scholar 

  10. 10.

    Hill, K. (2002). The relationship between hospital unit culture and nurses’ quality of work life: Practitioner application. Journal of Healthcare Management, 47(1), 25–26.

    Google Scholar 

  11. 11.

    Freshman, B., & Rubino, L. (2002). Emotional intelligence: A core competency for health care administrators. The Health Care Manager, 20(4), 1–9.

    PubMed  Article  Google Scholar 

  12. 12.

    Barak, M. E. M., Nissly, J. A., & Levin, A. (2001). Antecedents to retention and turnover among child welfare, social work, and other human service employees: What can we learn from past research? A review and metanalysis. Social Service Review, 75(4), 625–661.

    Article  Google Scholar 

  13. 13.

    Institute of Medicine of the National Academies. For the public’s health: Investing in a healthier future [Internet]. Washington: National Academy Press; 2012 [cited 2012 Sep 18]. Available from: http://www.iom.edu/Reports/2012/For-the-Publics-Health-Investing-in-a-Healthier-Future.aspx.

  14. 14.

    MCH leadership competencies, vers. 3.0 [Internet]. c2009-2012 [updated 2011 Sept 13; cited 2013 Sept 10]. MCH leadership competencies; [about 2 screens]. Available from: http://leadership.mchtraining.net/.

  15. 15.

    Dodds, J., Vann, W., Lee, J., Rosenberg, A., Rounds, K., Roth, M., et al. (2010). The UNC-CH MCH leadership training consortium: Building the capacity to develop interdisciplinary MCH leaders. Maternal and Child Health Journal, 14(4), 642–648.

    PubMed  Article  Google Scholar 

  16. 16.

    MCH Training Program: MCH Professional Development Grant, Division of Research, Training and Education. Maternal and Child Health Bureau of the Health Resources and Services Administration, Updated 7/2009. Available at: http://www.mchb.hrsa.gov/training/projects.asp?program=10; accessed June 12, 2013.

  17. 17.

    Maternal and Child Health Public Health Leadership Institute [Internet]. Chapel Hill: University of North Carolina at Chapel Hill; [n.d.; cited 2013 Sept 11]. Available from: http://mchphli.org/.

  18. 18.

    Kirkpatrick, D. L., & Kirkpatrick, J. D. (2006). Evaluating training programs (3rd ed.). San Francisco: Berrett-Koehler Publishers.

    Google Scholar 

  19. 19.

    Kirkpatrick, D. L., & Kirkpatrick, J. D. (2007). Implementing the four levels. San Francisco: Berrett-Koehler Publisher.

    Google Scholar 

  20. 20.

    Sprangers, M., & Hoogstraten, J. (1989). Pretesting effects in retrospective pretest-posttest designs. Journal of Applied Psychology, 74(89), 265–272.

    Article  Google Scholar 

  21. 21.

    Rockwell, S. K., & Kohn H. (1989) Post-then-pre evaluation. Journal of Extension [Internet]. 27(2) [about 7 screens]. Available from: http://www.joe.org/joe/1989summer/a5.php.

  22. 22.

    Lam, T. M., & Bengo, P. (2003). A comparison of three retrospective self-reporting methods of measuring change in instructional practice. American Journal of Evaluation, 24(1), 65–80.

    Article  Google Scholar 

  23. 23.

    Pratt, C. C., McGuigan, W. M., & Katzev, A. R. (2000). Measuring program outcomes: Using retrospective pretest methodology. American Journal of Evaluation, 21(3), 341–349.

    Article  Google Scholar 

  24. 24.

    Rohs, F. R. (1999). Response shift bias: A problem in evaluating leadership development with self-report pretest-posttest measures. Journal of Agricultural Education, 40(4), 28–37.

    Article  Google Scholar 

  25. 25.

    Mezoff, B. (1981). Pre-then-post testing: A tool to improve the accuracy of management training program evaluation. Performance and Instruction, 20(8), 10–11.

    Article  Google Scholar 

  26. 26.

    Hill, G. H., & Betz, D. L. (2005). Revisiting the retrospective pretest. American Journal of Evaluation, 26(4), 501–517.

    Article  Google Scholar 

  27. 27.

    Saleh, S. S., Williams, D., & Balougan, M. (2004). Evaluating the effectiveness of public health leadership training: The NEPHLI experience. American Journal of Public Health, 94(7), 1245–1249.

    PubMed Central  PubMed  Article  Google Scholar 

  28. 28.

    The Food Systems Leadership Institute [Internet]. The Food Systems Leadership Institute; c2006-2012 [cited 2012 Sept 13]. Developing individual and institutional leadership for a 21st century food system. Available at: www.fsli.org.

  29. 29.

    U.S. Department of Health and Human Services, Health Resources and Services Administration, Maternal and Child Health [Internet]. Rockville, MD: The Department; n.d. [cited 2013 Sept 13]. Maternal and Child Health training program [about 5 screens]. Available from: www.mchb.hrsa.gov/training/did_you_know.asp.

  30. 30.

    U.S. Department of Health and Human Services, Health Resources and Services Administration, Maternal and Child Health [Internet]. Rockville, MD: The Department; n.d. [cited 2013 Sept 13]. 2012-2020 strategic plan goals and strategies (draft) [about 4 screens]. Available from: http://www.mchb.hrsa.gov/training/about-national-goals.asp.

  31. 31.

    Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191–215.

    CAS  PubMed  Article  Google Scholar 

  32. 32.

    McCormick, M. J. (2001). Self-efficacy and leadership effectiveness: Applying social cognitive theory to leadership. Journal of Leadership & Organizational Studies, 8(1), 22–33.

    Article  Google Scholar 

  33. 33.

    MaChida, M., & Schaubroeck, J. (2011). The role of self-efficacy beliefs in leader development. Journal of Leadership & Organizational Studies, 18(4), 459–468.

    Article  Google Scholar 

  34. 34.

    Olson, L. G. (2013). Public health leadership development: Factors contributing to growth. Journal of Public Health Management and Practice, 19(4), 341–347.

    PubMed  Article  Google Scholar 

  35. 35.

    Green, S. G. (2002). Leadership self-efficacy and managers’ motivation for leading change. Journal of Organizational Behavior, 23(2), 215–235.

    Article  Google Scholar 

  36. 36.

    Pearlmutter, S. (1998). Self-efficacy and organizational change leadership. Administration in Social Work, 22(3), 23–38.

    Article  Google Scholar 

  37. 37.

    Fitzgerald, S., & Schutte, N. S. (2010). Increasing transformational leadership through enhancing self-efficacy. Journal of Management Development, 29(5), 495–505.

    Article  Google Scholar 

  38. 38.

    Paglis, L. L. (2010). Leadership self-efficacy: Research findings and practical applications. Journal of Management Development, 29(9), 771–782.

    Article  Google Scholar 

  39. 39.

    Anderson, D. W., Krajewski, H. T., Goffin, R. D., & Jackson, D. N. (2008). A leadership self-efficacy taxonomy and its relation to effective leadership. The Leadership Quarterly, 19(5), 595–608.

    Article  Google Scholar 

  40. 40.

    Furnham, A. (1986). Response bias, social desirability and dissimulation. Personality and Individual Differences, 7(3), 385–400.

    Article  Google Scholar 

Download references

Acknowledgments

MCH-PHLI is supported in full by a Project T04 MC12783 from the Maternal and Child Health Bureau (Title V, Social Security Act), Health Resources and Services Administration, Department of Health and Human Services.

Conflict of interest

Mr. Ruben Fernandez, JD, serves as a faculty in the MCH PHLI program and is related to the project Principal Investigator. The UNC conflict of interest management plan requires that all papers and presentations offer this acknowledgement, which can be included with the publication or not at the discretion of the editor.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Cheryl C. Noble.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Fernandez, C.S.P., Noble, C.C., Jensen, E. et al. Moving the Needle: A Retrospective Pre- and Post-analysis of Improving Perceived Abilities Across 20 Leadership Skills. Matern Child Health J 19, 343–352 (2015). https://doi.org/10.1007/s10995-014-1573-1

Download citation

Keywords

  • Leadership
  • Workforce development
  • MCH leadership competencies
  • Skill development
  • MCH PHLI