Abstract
This article presents a case study that examines the use of digital open badges for training student instructors at a university’s multimedia lab. Over two years, the lab implemented competency-based badges to facilitate student instructors in teaching software workshops. The study was designed to evaluate the effectiveness of the training badges in meeting their goals and to identify areas for improvement in future iterations. The study found that the badge-assisted training successfully not only tracked the employees’ skills and progress but also revealed a need to make the badges more relevant to employees and increase their intrinsic motivation to use them for building portfolios. The paper concludes by discussing potential challenges that may arise when adopting a badge-assisted training approach, based on the lessons learned from this case study.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
The author confirms that all data generated or analysed during this study are included in this published article.
References
Abramovich, S. (2016). Understanding digital badges in higher education through assessment. On the Horizon, 24(1), 126–131.
Ahn, J., Pellicone, A., & Butler, B. S. (2014). Open badges for education: What are the implications at the intersection of open systems and badging? Research in Learning Technology, 2014(22), 23563. https://doi.org/10.3402/rlt.v22.23563
Attali, Y., & Arieli-Attali, M. (2015). Gamification in assessment: Do points affect test performance? Computers & Education, 8, 57–63. https://doi.org/10.1016/j.compedu.2014.12.012
Brightwell, A., & Grant, J. (2013). Competency-based training: Who benefits? Postgraduate Medical Journal,89(1048), 107–110. https://doi.org/10.1136/postgradmedj-2012-130881
Cheng, Z., Watson, S. L., & Newby, T. J. (2018). Goal setting and open digital badges in higher education. TechTrends, 62(2), 190–196
Clements, K. (2018). Employee Skill Tracking With Open Badges. Unpublished masters project manuscript, Department of Instructional Psychology and Technology, Brigham Young University, Provo, Utah. Retrieved from https://scholarsarchive.byu.edu/ipt_projects/11
Clements, K., Jackson, S., & West, R. E. (2020). Open badges for employee skill tracking. International Journal of Designs for Learning, 11(2), 1–8
Creswell, J. W. (2017). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). Sage Publications
Davies, R. S. (2020). Designing surveys for evaluations and research. EdTech Books. https://edtechbooks.org/designing_surveys
Eynon, B., & Gambino, L. M. (2017). High-impact e-portfolio practice: A catalyst for student, faculty, and institutional learning. Stylus
Farmer, T., & West, R. E. (2016). Opportunities and challenges with digital open badges. Educational Technology, 56(5), 45–48
Fitzpatrick, J., Sanders, J., & Worthen, B. (2011). Program evaluation: Alternative approaches and practical guidelines (4th ed.). Pearson Education
Fullerton, S., Menking, A., Lee, C., & Davis, K. (2014, April). Stakeholder’ perceptions of the opportunities, challenges, and value of digital badges in education. SSRN. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2982124
Fulton, C. (2019). Innovating with digital badges in assessment: A Case study using digital badges in an undergraduate university module. All Ireland Journal of Higher Education, 11(3).
Gamrat, C., Zimmerman, H. T., Dudek, J., & Peck, K. (2014). Personalized workplace learning: An exploratory study on digital badging within a teacher professional development program. British Journal of Educational Technology, 45(6), 1136–1148
Gibson, D., Ostashewshi, N., Flintoff, K., Grant, S., & Knight, E. (2015). Digital badges in education, Education and Information Technologies. 20, 403–410. https://doi.org/10.1007/s10639-013-9291-7
Grant, S. (2014). Badges: Show what you know. Young Adult Library Services, 12(2), 28–32
Hanus, M. D., & Fox, J. (2015). Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance. Computers & Education, 80, 152–161. https://doi.org/10.1016/j.compedu.2014.08.019
Hodge, S. (2007). The origins of competency-based training. Australian Journal of Adult Learning, 47(2), 179–209
Leaser, D. (2019). Do digital badges really provide value to businesses? IBM. https://www.ibm.com/blogs/ibm-training/do-digital-badges-really-provide-value-to-businesses/
Lepage, K., Kratochwill, T. R., & Elliott, S. N. (2004). Competency-based behavior consultation training: An evaluation of consultant outcomes, treatment effects, and consumer satisfaction. School Psychology Quarterly, 19(1), 1–28
Mangan, K. (2015, September 14). Stack those credentials. Chronicle of Higher Education. http://chronicle.com/article/Stack-Those-Credentials/232985/?cid=at%26utm_source=at%26utm_medium=en.
Maina, M. F., Ortiz, L. G., Mancini, F., & Melo, M. M. (2022). A micro-credentialing methodology for improved recognition of HE employability skills. International Journal of Educational Technology in Higher Education, 19(10). https://doi.org/10.1186/s41239‐021‐00315‐5
Marcus, J. (2017). Competency-based education, put to the test: An inside look at learning and assessment at western governors’ university. Education next, 17(4), 27–33
Nguyen, V. T., & Losee, J. E. (2016). Time-versus competency-based residency training. Plastic and Reconstructive Surgery, 138(2), 527–531
Parker, H. E. (2015, April). Digital badges as effective assessment tools. Urbana, IL: University of Illinois and Indiana University. National Institute for Learning Outcomes Assessment (NILOA). https://www.learningoutcomesassessment.org/wp-content/uploads/2019/04/AiP_Parker.pdf
Perkins, J., & Pryor, M. (2021). Digital badges: Pinning down employer challenges. Journal of Teaching and Learning for Graduate Employability, 12(1), 24–38
Randall, D., & West, R. E. (2022). Who cares about open badges? An examination of principals’ perceptions of the usefulness of teacher open badges in the United States. Open Learning: The Journal of Open, Distance, and e-Learning, 33 (1), 65–83. https://doi.org/10.1080/02680513.2020.1752166
Spector, J. M., & Yuen, A. H. (2016). Educational Technology Program and Project Evaluation (1st ed.). Routledge
The Mozilla Foundation, Peer 2 Peer University, & The MacArthur Foundation. (2012). Open badges for lifelong learning (Working paper). https://wiki.mozilla.org/images/5/59/OpenBadges-Working-Paper_012312.pdf
West, R. E. (2023, February 9). Flexible open credentials: How micro and nanocredentials can revolutionize higher education (Working Paper). The Center for Growth and Opportunity. https://www.thecgo.org/wp-content/uploads/2023/02/Microcredentials.pdf
Zhang, J., & West, R. E. (2020). Designing microlearning instruction for professional development through a competency based approach. TechTrends, 64(2), 310–318
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare no conflict of interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Zhang, J., West, R.E. Use of Open Badges for Student Instructor Training: An Evaluation Case Study. J Form Des Learn 7, 126–138 (2023). https://doi.org/10.1007/s41686-023-00078-4
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41686-023-00078-4