Abstract
Open Badges (OBs) have evolved as novel means of recognizing and credentialing skills/competences (either hard or soft skills) acquired in various learning settings (formal or informal, online or traditional classroom). In addition, they offer new ways of motivating learners and scaffolding the learning process, while also promoting values such as openness and learners’ agency, participatory learning practices and peer-learning communities. While OBs are rapidly gaining traction among educational practitioners, education-oriented companies and non-profit organizations, there have been only a few research studies aimed at deep understanding of not only OBs and their potential roles, but also of the larger educational ecosystem within which they operate and evolve. This paper aims at bridging this gap by thoroughly examining benefits, concerns and challenges related to OBs from the perspectives of different stakeholders—learners, teachers, schools, employers, and other institutions and associations. Based on these different perspectives, the paper proposes a comprehensive framework for design and development of OB ecosystems and suggests directions for future research.
Similar content being viewed by others
Notes
Open Badge Infrastructure specification: https://wiki.mozilla.org/Badges/Onboarding-Issuer#Mozilla_Open_Badge_Infrastructure_.28OBI.29.
In this paper, the term “badge” denotes an OB, i.e. an OBI-compliant badge, and is used interchangeably with "OB".
We use the term educator to refer to any individual who assumes the teacher role in various formal, semi-formal or informal learning settings.
Digital Studies project: http://digitalstudieswiki.pbworks.com/.
See http://bit.ly/platform-chart for a comparative list of other platforms, but mind the concerns discussed in the Schools' perspective subsection.
Badge Allinace Research Working group: http://wiki.badgealliance.org/index.php/Research_Working_Group.
References
Anderson, L. W., Krathwohl, D. R., Airasian, P. W., Cruikshank, K. A., Mayer, R. E., Pintrich, P. R., et al. (2001). A taxonomy for learning, teaching, and assessing: A revision of bloom’s taxonomy of educational objectives. Boston, MA: Pearson.
Antin, J., & Churchill, E. (2011). Badges in social media: a social psychological perspective. In G. Fitzpatrick, C. Gutwin, B. Begole, & W.A. Kellogg (Eds.), Proceedings of the ACM CHI 2011 (pp. 1–4). New York, NY: ACM.
Ash, K. (2012a). Digital badges would represent students’ skill acquisition. Education Week 5(3), 24–25. Retrieved from http://www.edweek.org/dd/articles/2012/06/13/03badges.h05.html
Ash, K. (2012b). Colleges use ‘digital badges’ to replace traditional grading. Education Week 5(3), 26–27. Retrieved from http://www.edweek.org/dd/articles/2012/06/13/03badges-s1.h05.html
Batson, T. (2014). Badges and the gravitational pull of teacher control [Web log post]. Retrieved from http://aaeebl.site-ym.com/blogpost/1008436/188863/Badges-and-the-Gravitational-Pull-of-Teacher-Control
Brusilovsky, P., Sosnovsky, S.A.,& Shcherbinin, O. (2005). User modeling in a distributed e-learning architecture. In L. Ardissono, P. Brna, & A. Mitrovic (Eds.), Proceedings of the 10th international conference on user modelling (pp. 387–391). Berlin: Springer.
Carey, K. (2012). The higher education monopoly is crumbling as we speak. New Republic. Retrieved from http://www.newrepublic.com/article/politics/101620/higher-education-accreditation-MIT-university
Casilli, C. (2013). Badge pathways, parts 0-3 [Web log posts]. Retrieved from https://carlacasilli.wordpress.com/category/badge-pathways/
Catalano, F., & Doucet, K.J. (2013). Digital ‘badges’ emerge as part of credentialing’s future (2013). Retrieved from http://www.proexam.org/images/resources/ProExam_DigitalBadgesPaper_071713.pdf
Charleer, S., Klerkx, J., Santos Odriozola, J.L., & Duval, E. (2013). Improving awareness and reflection through collaborative, interactive visualizations of badges. In M. Kravcik, B. Krogstie, A. Moore, V. Pammer, L. Pannese, M. Prilla, W. Reinhardt & T.D. Ullmann (Eds.) Proceedings of the 3rd workshop on awareness and reflection in technology-enhanced learning, Vol. 1103 (pp. 69–81). RWTH Aachen University: CEUR
Cole-Karagory, M. (2013). Introducing BadgeKit. [PowerPoint slides]. Presentation openly available on Slide Share. Retrieved from http://www.slideshare.net/megan_cole/mozilla-badge-kitfinal
Davidson, C.N. (2011a). Why badges work better than grades. Retrieved August 29, 2014, from the HASTAC website: http://hastac.org/blogs/cathy-davidson/why-badges-work-better-grades
Davidson, C.N. (2011b). Could badges for lifelong learning be our tipping point? Retrieved August 29, 2014, from the HASTAC website: http://www.hastac.org/blogs/cathy-davidson/2011/11/14/could-badges-lifelong-learning-be-our-tipping-point
Deci, E. L., Koestner, R., & Ryan, R. M. (2001). Extrinsic rewards and intrinsic motivation in education: Reconsidered once again. Review of Educational Research, 71(1), 1–27.
Deterding, S. (2011). Situated motivational affordances of game elements: a conceptual model. In G. Fitzpatrick, C. Gutwin, B. Begole, & W.A. Kellogg (Eds.), Proceedings of the ACM CHI 2011 (pp. 34–37). New York, NY: ACM
Dodd, T. (2014). Digital badge sets students on new course. Financial Review. Retrieved from http://www.afr.com/p/national/education/digital_badge_sets_students_on_new_1iN8Ytv03Y8yAfBuHxVEQM
Dolog, P. & Schäfer, M. (2005). A framework for browsing, manipulating and maintaining interoperable learner profiles. In L. Ardissono, P. Brna, & A. Mitrovic (Eds.), Proceedings of the 10th international conference on user modelling (pp. 397–401). Berlin: Springer
Dominguez, A., Saenz-de Navarrete, J., de Marcos, L., Fernandez-Sanz, L., Pages, C., & Martınez-Herraiz, J. J. (2013). Gamifying learning experiences: practical implications and outcomes. Computers & Education, 63, 380–392.
Escribano, F. & Moreton, J. (2014). Proposal: BadgeRank & BadgeScore—OpenBadges value. Retrieved August 29, 2014, from Mozilla OpenBadges website: https://openbadges.etherpad.mozilla.org/research-calls-19Feb
Gibson, D., Ostashewski, N., Flintoff, K., Grant, S., & Knight, E. (2015). Digital badges in education. Education and Information Technologies, 20(2), 403–410.
Glover, I. & Latif, F. (2013). Investigating perceptions and potential of open badges in formal higher education. In J. Herrington, A. Couros, & V. Irvine (Eds.), Proceedings of world conference on educational multimedia, hypermedia and telecommunications 2013 (pp. 1398–1402).
Grant, S. (2014). What counts as learning—Open Digital Badges for new opportunities. DML Hub. Retrieved from http://dmlhub.net/publications/what-counts-learning
GRASS project (2015a). Deliverable D4.1—Implementation of application cases (ACs) and pilot testing. Retrieved from https://goo.gl/pwP34f
GRASS project (2015b). Deliverable D5.1—Comprehensive description of project outputs. Retrieved from https://goo.gl/fmZGOq
Hakulinen, L., Auvinen, T., Korhonen, A. (2013). Empirical study on the effect of achievement badges in TRAKLA2 online learning environment. In Proceedings of the 2013 learning and teaching in computing and engineering—LATICE ‘13 (pp. 47–54). Washington, DC: IEEE Computer Society.
Hamilton, G. (2014). Evidencing employability skills with Open Badges. JISC RSC Scotland e-Assessment. Retrieved from http://goo.gl/eiBlim
Hickey, D.T., Otto, N., Itow, R., Schenke, K., Tran, C., & Chow, C. (2014). Badges design principles documentation (DPD). Interim project report. Retrieved from Indiana University, Center for Research on Learning and Technology website: http://iudpd.indiana.edu/JanuaryReport
Higashi, R., Abramovich, S., Shoop, R., & Schunn, C. (2012). The roles of badges in the computer science student network. Paper presented at the 2012 games + learning + society conference, Madison, WI. Retrieved from https://www.ri.cmu.edu/pub_files/2012/6/GLS_Conference_Proceedings_June_2012.pdf
Ito, M., Gutiérrez, K., Livingstone, S., Penuel, B., Rhodes, J., Salen, K., Schor, J, Sefton-Green, J., Watkins, S.C. (2013). Connected learning: an agenda for research and design. Retrieved from the Connected Learning Research Network website: http://goo.gl/o76iI0
Jeremic, Z., Jovanovic, J., & Gasevic, D. (2013). Personal learning environments on Social Semantic Web. Semantic Web Journal, 4(1), 23–51.
Joseph, B. (2012). Six ways to look at badging systems designed for learning. Retrieved August 29, 2014, from the Online Leadership Program website: http://www.olpglobalkids.org/content/six-ways-look-badging-systems-designed-learning
Jovanovic, J., Devedzic, V. (2014). Open Badges: Challenges and Opportunities. In Proceedings of The 13th international conference on web-based learning- ICWL 2014 (pp. 56–65).Berlin: Springer
Knight, E. (2012). Open Badges for lifelong learning. Retrieved from Mozilla Foundation whitepaper archive website: https://wiki.mozilla.org/images/5/59/OpenBadges-Working-Paper_012312.pdf
Knight, E. (2013). An open, distributed system for badge validation. Retrieved from Mozilla Foundation whitepaper archive website: http://bit.ly/badgevalidation
Laanpere, M., Pata, K., Normak, P., & Põldoja, H. (2014). Pedagogy-driven design of digital learning ecosystems. Computer Science and Information Systems, 11(1), 419–442.
O’Byrne, W.I. (2013). Challenges in launching and hosting an open, digital badge initiative. [Web log post]. Retrieved from http://wiobyrne.com/challenges-in-launching-and-hosting-an-open-digital-badge-initiative/
Olneck, M. (2012). Insurgent credentials: A challenge to established institutions of higher education. Retrieved from HASTAC website: http://www.hastac.org/files/insurgent_credentials__michael_olneck_2012.pdf
Riconscente, M.M., Kamarainen, A., & Honey, M. (2013). STEM badges: current terrain and the road ahead. Retrieved from New York Hall of Science website: http://badgesnysci.files.wordpress.com/2013/08/nsf_stembadges_final_report.pdf
Rughinis, R. (2013). Talkative objects in need of interpretation: re-thinking digital badges in education. In W. E. Mackay, S. Brewster, & S. Bødker (Eds.), CHI ‘13 extended abstracts on human factors in computing systems, CHI EA ‘13 (pp. 2099–2108). New York, NY: ACM.
Ryan, R. M., & Deci, E. L. (2000). Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemporary Educational Psychology, 25, 54–67.
Santos, J.L., Charleer, S., Parra, G., Klerkx, J., Duval, E. & Verbert, K. (2013). Evaluating the use of open badges in an open learning environment. In C. Rensing, S. de Freitas, T. Ley, & P.J. Muñoz-Merino (Eds.), Proceedings of the 8th european conference, on technology enhanced learning, EC-TEL 2013 (pp. 314–327). Berlin: Springer.
Schenke, K., Tran, C., & Hickey, D. (2013) Design principles for motivating learning with digital badges. HASTAC. Retieved from: http://www.hastac.org/blogs/kschenke/2013/06/05/design-principles-motivating-learning-digital-badges
Siadaty, M., Jovanovic, J., Pata, K., Holocher-Ertl, T., Gasevic, D., & Milikic, N. (2011). A Semantic Web-enabled tool for self-regulated learning in the workplace. In I. Aedo, N.-S. Chen, & D. Sampson (Eds.), Proceedings of the 11th IEEE international conference on advanced learning technologies (pp. 66–70). Los Alamitos, CA: IEEE
Sullivan, F.M. (2013). New and alternative assessments, digital badges, and civics: an overview of emerging themes and promising directions. CIRCLE Working Paper #77. Retrieved August 29, 2014, from The Center for Information & Research on Civic Learning & Engagement website: http://www.civicyouth.org/wp-content/uploads/2013/03/WP_77_Sullivan_Final.pdf
Tally, S. (2012, September 11). Digital badges show students’ skills along with degree. Purdue News. Retrieved from http://www.purdue.edu/newsroom/releases/2012/Q3/digital-badges-show-students-skills-along-with-degree.html
Vassileva, J. (2009). Towards social learning environments. IEEE Transactions on Learning Technologies, 1(4), 199–214.
What students say they need in order to become more engaged in class. (2014). Cengage Learning. Retrieved from http://assets.cengage.com/pdf/mi_digital_transition.pdf
Acknowledgments
The work presented in the paper is a result of the GRASS Project (reference number: 543029-LLP-1-2013-1-RS-KA3-KA3MP) that is funded with support from the European Commission. The paper reflects only the authors’ views, and the Commission cannot be held responsible for any use which may be made of the information contained therein.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Devedžić, V., Jovanović, J. Developing Open Badges: a comprehensive approach. Education Tech Research Dev 63, 603–620 (2015). https://doi.org/10.1007/s11423-015-9388-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11423-015-9388-3