Abstract
Serious games have shown great potential as an instructional tool in various fields by providing improved accessibility to simulations, modeling of environments, and visualizations. However, a challenging problem in the design of serious games has been to strike a fine balance between gaming and the pedagogical elements such as content, methodology of instruction, and evaluation. Several models and frameworks have been proposed to support the serious game’s design and analysis to address the above-mentioned gap. In this paper, we present a serious game design and validation process in the context of cybersecurity education. We assess the effectiveness of a serious game as an educational tool by using a game designed to teach network firewalls and validate the game’s effectiveness to meet the learning objectives by performing a preliminary analysis consisting of objective and subjective parts. The objective analysis is performed by capturing the player’s interaction data, while the subjective analysis consists of a survey study to understand the user experience. Furthermore, we also perform an analysis of our game using the Learning Mechanics-Game Mechanics framework to highlight the interrelations between gaming and learning features. Our study demonstrates the significance of objective and subjective analysis, and our preliminary results on using our game to teach security have been found to be encouraging.
This work is supported by funding received from Government of India, for the IMPRINT project no. 7804.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Harris, M., Cullen, R.: Learner-centered leadership: an agenda for action. Innov. Higher Educ. 33, 21–28 (2008)
Yilmaz, G., Bulut, S.: From a Teaching-Centred to a Learning-Centred Approach to Curriculum Design: Transforming Teacher Candidates, pp. 69–94. Libri Publishing, Oxfordshire (2017)
Ulicsak, M.: Games in Education: Serious Games. a FutureLab Literature Review, p. 139 (2010). http://www.futurelab.org.uk/projects/games-in-education
Connolly, T.M., Boyle, E.A., MacArthur, E., Hainey, T., Boyle, J.M.: A systematic literature review of empirical evidence on computer games and serious games. Comput. Educ. 59(2), 661–686 (2012). http://www.sciencedirect.com/science/article/pii/S0360131512000619
Prensky, M.: Digital game-based learning . Comput. Entertain. 1(1), 21 (2003). https://doi.org/10.1145/950566.950596
L., M., E., T., B., H.: Capture the flag as cyber security introduction. In: 2016 49th Hawaii International Conference on System Sciences (HICSS), pp. 5479–5486, January 2016
Bishop, M.: Teaching computer security. In: SEC, pp. 65–74. Citeseer (1993)
Hendrix, M., Al-Sherbaz, A., Bloom, V.: Game based cyber security training: are serious games suitable for cyber security training? Int. J. Serious Games 3(1) (2016). http://journal.seriousgamessociety.org/index.php?journal=IJSG&page=article&op=view&path[]=107
Jones, J., Yuan, X., Carr, E., Yu, H.: A comparative study of CyberCIEGE game and department of defense information assurance awareness video. In: Conference Proceedings - IEEE SOUTHEASTCON, pp. 176–180 (2010)
Sheng, S., Magnien, B.: Anti-phishing phil: the design and evaluation of a game that teaches people not to fall for phish. In: Proceedings of SOUPS 2007, pp. 88–99 (2007). http://dl.acm.org/citation.cfm?id=1280692
Blunt, R.: Does game-based learning work? results from three recent studies. In: Proceedings of the Interservice/Industry Training, Simulation, & Education Conference, pp. 945–955. National Defense Industrial Association Orlando eFL FL (2007)
Rooney, P.: A theoretical framework for serious game design: exploring pedagogy, play and fidelity and their implications for the design process. IJGBL 2, 41–60 (2012)
Arnab, S., et al.: Pedagogy-driven design of serious games: an overall view on learning and game mechanics mapping, and cognition-based models (2015)
Lim, T., et al.: The lm-gm framework for serious games analysis (2013)
All, A., Castellar, E.P.N., Looy, J.V.: Towards a conceptual framework for assessing the effectiveness ofâ digital game-based learning. Comput. Educ. 88, 29–37 (2015). http://www.sciencedirect.com/science/article/pii/S036013151500113X
Calderón, A., Ruiz, M.: A systematic literature review on serious games evaluation: an application to software project management. Comput. Educ. 87, 396–422 (2015). http://www.sciencedirect.com/science/article/pii/S0360131515300166
Min, L., Jina, K., Sa, L., Wenting, Z., Jeff, H.: Learning analytics as an assessment tool in serious games: a review of literature. Serious Games Edutainment Appl. 2, 537–563 (2017). https://doi.org/10.1007/978-3-319-51645-5_24
Chaudy, Y., Connolly, T., Hainey, T.: Learning analytics in serious games: a review of the literature. In: European Conference in the Applications of Enabling Technologies 2014 (2014)
Serrano-Laguna, Á., Manero, B., Freire, M., Fernández-Manjón, B.: A methodology for assessing the effectiveness of serious games and for inferring player learning outcomes. Multimedia Tools Applicat. 77(2), 2849–2871 (2017). https://doi.org/10.1007/s11042-017-4467-6
Garris, R., Ahlers, R., Driskell, J.E.: Games, motivation, and learning: a research and practice model. Simul. Gaming 33(4), 441–467 (2002). https://doi.org/10.1177/1046878102238607
Technologies, U.: Unity game engine. https://unity3d.com/
Garrido, J.M., Bandyopadhyay, T.: Simulation model development in information security education. In: 2009 Information Security Curriculum Development Conference. pp. 21–26. InfoSecCD 2009, ACM, New York (2009). https://doi.org/10.1145/1940976.1940983
Wang, X., Hembroff, G.C., Yedica, R.: Using vmware vcenter lab manager in undergraduate education for system administration and network security. In: Proceedings of the 2010 ACM Conference on Information Technology Education, pp. 43–52. SIGITE 2010, ACM, New York (2010). https://doi.org/10.1145/1867651.1867665
Carvalho, M., et al.: An activity theory-based model for serious games analysis and conceptual design. Comput. Educ. 87, 166 (2015)
Google firebase. https://firebase.google.com/. Accessed 20 Jul 2019
Garbade, D.M.J.: k-means-clustering (2018). https://towardsdatascience.com/understanding-k-means-clustering-in-machine-learning-6a6e67336aa1
Johnston, K., Aldridge, B.: Examining a mathematical model of mastery learning in a classroom setting. J. Res. Sci. Teach. 22, 543–554 (1985)
Moizer, J., et al.: An approach to evaluating the user experience of serious games. Comput. Educ. 136 (2019)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Kulshrestha, S., Agrawal, S., Gaurav, D., Chaturvedi, M., Sharma, S., Bose, R. (2021). Development and Validation of Serious Games for Teaching Cybersecurity. In: Fletcher, B., Ma, M., Göbel, S., Baalsrud Hauge, J., Marsh, T. (eds) Serious Games. JCSG 2021. Lecture Notes in Computer Science(), vol 12945. Springer, Cham. https://doi.org/10.1007/978-3-030-88272-3_18
Download citation
DOI: https://doi.org/10.1007/978-3-030-88272-3_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-88271-6
Online ISBN: 978-3-030-88272-3
eBook Packages: Computer ScienceComputer Science (R0)