Abstract
Despite the growing numbers of leadership programs, little is known about the effectiveness of such programs. In view of this, evaluation research is integrated into the implementation of service leadership programs at The Hong Kong Polytechnic University (PolyU). In this chapter, evaluation methods based on objective outcome evaluation, subjective outcome evaluation, process evaluation, and qualitative evaluation are outlined. The findings of evaluation research adopting these methods are reported to show the effectiveness of service leadership programs at PolyU. Overall, results indicate that service leadership programs at PolyU have a beneficial impact for students.
This preparation for this paper and the Service Leadership project are financially supported by the Victor and William Fung Foundation. The authorship is equally shared by the first author and second author.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Andenoro, A. C., Allen, S. J., Haber-Curran, P., Jenkins, D. M., Sowcik, M., Dugan, J. P., & Osteen, L. (2013). National leadership education research agenda 2013–2018: Providing strategic direction for the field of leadership education. Retrieved from Association of Leadership Educators website: http://leadershipeducators.org/ResearchAgenda
Astin, A. W., & Astin, H. S. (2000). Leadership reconsidered: Engaging higher education in social change [Online]. Retrieved from: http://www.wkkf.org/Pubs/CCT/Leadership/Pub3368.PDF
Attkisson, C. C., & Zwick, R. (1982). The client satisfaction questionnaire: Psychometric properties and correlations with service utilization and psychotherapy outcome. Evaluation and Program Planning, 5(3), 233–237.
Barker, R. L. (Ed.). (2003). The social work dictionary (5th ed.). Washington, DC: NASW.
Boatman, S. A. (2000). Assessment of leadership programs: Enhancing student leadership development. Concepts & Connections, 9(1), 5–8.
Brestan, E. V., Jacobs, J. R., Rayfield, A. D., & Eyberg, S. M. (1999). A consumer satisfaction measure for parent-child treatments and its relation to measures of child behavior change. Behavior Therapy, 30(1), 17–30.
Brungardt, C., & Crawford, C. B. (1996). A comprehensive approach to assessing leadership students and programs: Preliminary findings. Journal of Leadership & Organizational Studies, 3(1), 37–48.
Brungardt, C., Greenleaf, J., Brungardt, C., & Arensdorf, J. (2006). Majoring in leadership: A review of undergraduate leadership degree programs. Journal of Leadership Education, 5(1), 4–25.
Cashin, W. E. (1990). Student ratings of teaching: Recommendations for use. Manhattan: Center for Faculty Evaluation and Development (IDEA No. 22).
Centra, J. A. (1998). Development of the student instructional report II. Princeton: Educational Testing Service.
Chambers, T. (1994). Criteria to evaluate student leadership programs: What leadership educators consider important. NASPA Journal, 31(3), 225–234.
Datta, L. E. (1997). A pragmatic basis for mixed‐method designs. New Directions for Evaluation, 1997(74), 33–46.
Delp, L., Brown, M., & Domenzain, A. (2005). Fostering youth leadership to address workplace and community environmental health issues: A university-school-community partnership. Health Promotion Practice, 6(3), 270–285.
Denzin, N. K., & Lincoln, Y. S. (Eds.). (2011). The Sage handbook of qualitative research. Thousand Oaks: Sage.
Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3–4), 327–350.
Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18(2), 237–256.
Eyberg, S. M. (1993). Consumer satisfaction measures for assessing parent training programs. In L. VandeCreek, S. Knapp & T. L. Jackson (Eds.), Innovations in clinical practice: A source book (Vol. 12). Sarasota: Professional Resource Press.
Hall, W. J., Zeveloff, A., Steckler, A., Schneider, M., Thompson, D., Pham, T., … & McMurray, R. G. (2012). Process evaluation results from the HEALTHY physical education intervention. Health Education Research, 27(2), 307–318.
Harachi, T. W., Abbott, R. D., Catalano, R. F., Haggerty, K. P., & Fleming, C. B. (1999). Opening the black box: Using process evaluation measures to assess implementation and theory building. American Journal of Community Psychology, 27(5), 711–731.
Helitzer, D., Yoon, S. J., & Wallerstein, N. (2000). The role of process evaluation in the training of facilitators for an adolescent health education program. Journal of School Health, 70(4), 141–147.
Howard, G. S. (1980). Response-shift bias a problem in evaluating interventions with pre/post self-reports. Evaluation Review, 4(1), 93–106.
Kalafat, J., Illback, R. J., & Sanders, D. (2007). The relationship between implementation fidelity and educational outcomes in a school-based family support program: Development of a model for evaluating multidimensional full-service programs. Evaluation and Program Planning, 30(2), 136–148.
Kass, D., & Grandzol, C. (2011). Learning to lead at 5,267 feet. Journal of Leadership Education, 10(1), 41–62.
Keating, K., Rosch, D., & Burgoon, L. (2014). Developmental readiness for leadership: The differential effects of leadership courses on creating “ready, willing, and able” leaders. Journal of Leadership Education, 13(3), 1–16.
Komives, S. R. (2011). Advancing leadership education. In S. R. Komives, J. P. Dugan, J. E. Owen, W. Wagner, C. Slack & Associates (Eds.), Handbook for student leadership development (pp. 1–34). San Francisco: Wiley.
Law, B. M. F., & Shek, D. T. L. (2011). Process evaluation of a positive youth development program: Project P.A.T.H.S. Research on Social Work Practice, 21, 539–548.
Lebow, J. L. (1983). Research assessing consumer satisfaction with mental health treatment: A review of findings. Evaluation and Program Planning, 6(3), 211–236.
Ma, H. K., & Shek, D. T. L. (2010). Subjective outcome evaluation of a positive youth development program in Hong Kong: Profiles and correlates. The Scientific World Journal, 10, 192–200.
Marsh, H. W. (2007). Students’ evaluations of university teaching: Dimensionality, reliability, validity, potential biases and usefulness. In R. P. Perry & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence-based perspective (pp. 319–383). Dordrecht: Springer.
Marsh, H. W., Hau, K. T., Chung, C. M., & Siu, T. L. (1997). Students’ evaluations of university teaching: Chinese version of the students’ evaluations of educational quality instrument. Journal of Educational Psychology, 89(3), 568–572.
McCall, R. B., Green, B. L., Strauss, M. S., & Groark, C. J. (1998). Issues in community-based research and program evaluation. In W. Damon, I. E. Sigel & K. A. Renninger (Eds.), Handbook of child psychology (5th ed., Vol. 4): Child psychology in practice (pp. 955–997). New York: Wiley.
Mertens, D. M., & Wilson, A. T. (2012). Program evaluation theory and practice: A comprehensive guide. New York: Guilford Press.
Ngai, N. P., Cheung, C. K., Ngai, S. S. Y., & To, S. M. (2012). Youth leadership training in Hong Kong: Current developments and the way ahead. International Journal of Adolescence and Youth, 17(2–3), 165–179.
Owen, J. E. (2011). Assessment and evaluation. In S. R. Komives, J. P. Dugan, J. E. Owen, W. Wagner, C. Slack & Associates (Eds.), The handbook for student leadership development (pp. 177–202). San Francisco: Wiley.
Patton, M. Q. (1990). Qualitative evaluation and research methods. Newbury Park: Sage.
Posner, B. Z. (2009). A longitudinal study examining changes in students’ leadership behavior. Journal of College Student Development, 50(5), 551–563.
Priest, K. L., & Donley, S. (2014). Developing leadership for life: Outcomes from a collegiate student-alumni mentoring program. Journal of Leadership Education, 13(3), 107–117.
Riggio, R. E. (2008). Leadership development: The current state and future expectations. Consulting Psychology Journal: Practice and Research, 60(4), 383–392.
Rohs, F. R. (2002). Improving the evaluation of leadership programs. Journal of Leadership Education, 1(2), 50–61.
Royse, D. (2007). Research methods in social work. Belmont: Thomson Brooks/Cole.
Royse, D., Thyer, B., & Padgett, D. (2006). Program evaluation: An introduction (4th ed.). Belmont: Wadsworth.
Shapiro, J. P., Welker, C. J., & Jacobson, B. J. (1997). The youth client satisfaction questionnaire: Development, construct validation, and factor structure. Journal of Clinical Child Psychology, 26(1), 87–98.
Shek, D. T. L. (2009). Subjective outcome and objective outcome evaluation findings: Insights from a Chinese context. Research on Social Work Practice, 20(3), 293–301.
Shek, D. T. L. (2013). Evaluation of the Project P.A.T.H.S. using multiple evaluation strategies. In D. T. L. Shek & R. C. F. Sun (Eds.), Development and evaluation of positive adolescent training through holistic social programs (P.A.T.H.S.) (pp. 53–67). Singapore: Springer.
Shek, D. T. L. (2014). Evaluation data of subject “Service Leadership”. Unpublished data.
Shek, D. T. L., & Li, X. (in press). Evaluation of an innovative leadership training program for Chinese students: Subjective outcome evaluation. International Journal on Disability and Human Development.
Shek, D. T. L., & Liang, J. Q. (in press). Subjective outcome evaluation of a university subject on service leadership. International Journal on Disability and Human Development.
Shek, D. T. L., Lin, L., & Liu, T. T. (2014a). Service leadership education for university students in Hong Kong: Subjective outcome evaluation. International Journal on Disability and Human Development. Advance online publication. doi: 10.1515/ijdhd-2014-0349.
Shek, D. T. L., Lin, L., Leung, H., Law, M. Y. M., & Li, X. (2014b, May 14–15). Evaluation of service leadership programs using multiple evaluation methods. Paper presented at the International Conference on Service Leadership Education for University Students: Experience in Hong Kong, Hong Kong.
Shek, D. T. L., Lin, L., Liu, T. T., & Law, M. Y. M. (2014c). Process evaluation of a pilot subject on service leadership for university students in Hong Kong. International Journal on Disability and Human Development. Advance online publication. doi: 10.1515/ijdhd-2014-0351.
Shek, D. T. L., Lin, L., Liu, T. T., & Law, M. Y. M. (2014d). Service leadership education for university students in Hong Kong: Qualitative evaluation. International Journal on Disability and Human Development. Advance online publication. doi: 10.1515/ijdhd-2014-0350.
Shek, D. T. L., Yu, L., & Ma, C. M. S. (2014e). The students were happy but did they change positively? Yes, they did. International Journal on Disability and Human Development. Advance online publication. doi: 10.1515/ijdhd-2014-0348
Shek, D. T. L., Liu, T. T., & Law, M. Y. M. (in press-a). Focus group evaluation of a service leadership subject in Hong Kong. International Journal on Disability and Human Development.
Shek, D. T. L., Xie, Q. Z., Lin, L., & Law, M. Y. M. (in press-b). Evaluation of a service leadership subject in Chinese university students in Hong Kong using focus groups. International Journal on Disability and Human Development.
Thomas, L., & Beauchamp, C. (2011). Understanding new teachers’ professional identities through metaphor. Teaching and Teacher Education, 27(4), 762–769.
Weinbach, R. W. (2005). Evaluating social work services and programs. Boston: Allyn and Bacon.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer Science+Business Media Singapore
About this chapter
Cite this chapter
Shek, D.T.L., Lin, L. (2015). Evaluating Service Leadership Programs with Multiple Strategies. In: Shek, D., Chung, P. (eds) Promoting Service Leadership Qualities in University Students. Quality of Life in Asia, vol 6. Springer, Singapore. https://doi.org/10.1007/978-981-287-515-0_13
Download citation
DOI: https://doi.org/10.1007/978-981-287-515-0_13
Publisher Name: Springer, Singapore
Print ISBN: 978-981-287-514-3
Online ISBN: 978-981-287-515-0
eBook Packages: Behavioral ScienceBehavioral Science and Psychology (R0)