Skip to main content

Advertisement

Log in

Studying the effects of teaching programming to lower secondary school students with a serious game: a case study with Python and CodeCombat

  • Published:
Education and Information Technologies Aims and scope Submit manuscript

Abstract

Serious games, or else educational games, for programming are considered to have a positive impact on learning programming. Specifically, serious games are considered to motivate students and engage them in playing and learning programming. However, more research is required in order to study their effects in learning programming, as well as their added value in comparison with typical teaching approaches. In this study the effects of teaching programming to lower secondary school students with the serious game CodeCombat and the typical teaching approach are compared. Specifically, fifty-nine students formed an experimental group that was taught programming with CodeCombat and a control group that was taught programming through lecturing and problem solving in Python with a typical programming environment. The study aimed to investigate whether a game like CodeCombat that is based on a text-based real programming language: improves students’ performance in basic programming concepts; brings better learning outcomes in comparison with typical teaching methods; engages students’ interest. Data was collected through a pre and post test, as well as a survey prior the intervention and another one based on the Technology Acceptance Model at the end. It was concluded that the experimental group performed better than the control group, but this difference was not found to be statistically significant. CodeCombat was evaluated positively in terms of its perceived ease of use and usefulness, as well as the attitude towards its use. The results were neutral in terms of students’ behavioral intention to use CodeCombat, but were positive in using serious games for programming in general.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Alves, J. R., & Letouze, P. (2018). The Curriculum Integration of a course of ’Introduction to Programming Logic’with a Serious Game-Colobot. International Journal of Social Science and Humanity, 8(11), 275–280.

    Article  Google Scholar 

  • Brusilovsky, P., Calabrese, E., Hvorecky, J., Kouchnirenko, A., & Miller, P. (1997). Mini-languages: A way to learn programming principles. Education and Information Technologies, 2(1), 65–83.

    Article  Google Scholar 

  • Combéfis, S., Beresnevičius, G., & Dagienė, V. (2016). Learning programming through games and contests: Overview, characterisation and discussion. Olympiads in Informatics, 10(1), 39–60. https://doi.org/10.15388/ioi.2016.03

    Article  Google Scholar 

  • Danks, S., Fraumeni, B., Smrekar, M. (2019). CodeCombat: Implementation Study. Summary Report, February 2019, McREL International. Available from: https://codecombat.com/images/pages/impact/pdf/CodeCombat_ImplementationStudy_Summary.pdf

  • Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13, 319–339.

    Article  Google Scholar 

  • Eguíluz, A., Garaizar, P., & Guenaga, M. (2018). An Evaluation of Open Digital Gaming Platforms for Developing Computational Thinking Skills. In Simulation and Gaming. InTech. https://doi.org/10.5772/intechopen.71339

  • Esper, S., Foster, S. R., & Griswold, W. G. (2013). CodeSpells: embodying the metaphor of wizardry for programming. In Proceedings of the 18th ACM conference on Innovation and technology in computer science education, 249–254.

  • Esper, S., Foster, S. R., Griswold, W. G., Herrera, C., & Snyder, W. (2014). CodeSpells: bridging educational language features with industry-standard languages. In Proceedings of the 14th Koli calling international conference on computing education research, 5–14.

  • Giannakoulas, A., & Xinogalos, S. (2020). A Review of Educational Games for Teaching Programming to Primary School Students. In Kalogiannakis, M., & Papadakis, S. (Ed.), Handbook of Research on Tools for Teaching Computational Thinking in P-12 Education (pp. 1–30). IGI Global. https://doi.org/10.4018/978-1-7998-4576-8.ch001.

  • Giannakoulas, A., Terzopoulos, G., Xinogalos, S., Satrtatzemi, M. (2021). A Proposal for an Educational Game Platform for Teaching Programming to Primary School Students. In: A. Reis et al. (eds) Technology and Innovation in Learning, Teaching and Education. TECH-EDU 2020. Communications in Computer and Information Science, vol 1384. Springer, Cham.Springer Nature Switzerland AG.

  • Giannakoulas, A., & Xinogalos, S. (2018). A pilot study on the effectiveness and acceptance of an educational game for teaching programming concepts to primary school students. Education and Information Technologies, 23, 2029–2052. https://doi.org/10.1007/s10639-018-9702-x

    Article  Google Scholar 

  • Gomes, A., & Mendes, A. J. (2007). An environment to improve programming education. In Proceedings of the 2007 international conference on Computer systems and technologies (pp. 1–6).

  • Kinzie, M. B., & Joseph, D. R. (2008). Gender differences in game activity preferences of middle school children: implications for educational game design. Educational Technology Research and Development, 56(5–6), 643–663. https://doi.org/10.1007/s11423-007-9076-z

    Article  Google Scholar 

  • Laporte, L., & Zaman, B. (2016). Informing Content-driven Design of Computer Programming Games: a Problems Analysis and a Game Review. In Proceedings of the 9th Nordic Conference on HumanComputer Interaction (p. 10). ACM. https://doi.org/10.1145/2971485.2971499

  • Malliarakis, C., Satratzemi, M., & Xinogalos, S. (2014a). Designing Educational Games for Computer Programming: A Holistic Framework. Electronic Journal of e-Learning, 12(3), 281–298.

    Google Scholar 

  • Malliarakis, C., Satratzemi, M., & Xinogalos, S. (2014b). Educational games for teaching computer programming. In Research on e-learning and ICT in Education: Technological, Pedagogical and Instructional Perspectives (pp. 87–98). Springer.

  • Maloney, J., Resnick, M., Rusk, N., Silverman, B., Eastmond, E. (2010). The Scratch Programming Language and Environment, Transactions on Computing Education10, 4, Article 16 (November 2010), 15 pages. https://doi.org/10.1145/1868358.1868363

  • Maragkos K., & Grigoriadou M. (2005). The dynamics of electronic games in the learning process. A suggestion to address learning difficulties in scheduling tables. 3rd Pan-Hellenic ICT Teachers' Conference "Exploiting Information and Communication Technologies in Teaching Practice", Syros, 13–15 May 2005.

  • Michael, D. R., & Chen, S. L. (2005). Serious games: Games that educate, train, and inform. Muska & Lipman/Premier-Trade.

  • Miljanovic, Μ.Α., & Bradbury, J.S. (2018). A Review of Serious Games for Programming. In: Göbel S. et al. (eds) Serious Games. JCSG 2018. Lecture Notes in Computer Science, vol 11243, 2018, Springer, Cham, https://doi.org/10.1007/978-3-030-02762-9_21

  • Mitchell, A., & Savill-Smith, C. (2004). The use of computer and video games for learning. A review of the literature. Learning and Skills Development Agency.

    Google Scholar 

  • Mladenović, M., Boljat, I., & Žanko, Ž. (2018). Comparing loops misconceptions in block-based and text-based programming languages at the K-12 level. Education and Information Technologies, 23, 1483–1500. https://doi.org/10.1007/s10639-017-9673-3

    Article  Google Scholar 

  • Nazry, N., Nazrina, M., & Romano, D. M. (2017). Mood and learning in navigation-based serious games. Computers in Human Behavior, 73, 596–604.

    Article  Google Scholar 

  • Papadakis S., Kalogiannakis M. (2018) Using Gamification for Supporting an Introductory Programming Course. The Case of ClassCraft in a Secondary Education Classroom. In: Brooks A., Brooks E., Vidakis N. (eds) Interactivity, Game Creation, Design, Learning, and Innovation. ArtsIT 2017, DLI 2017. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 229. Springer, Cham. https://doi.org/10.1007/978-3-319-76908-0_35

  • Papadakis, S. (2020). Evaluating a game-development approach to teach introductory programming concepts in secondary education. International Journal of Technology Enhanced Learning, 12(2), 127–145. https://doi.org/10.1504/ijtel.2020.106282.

    Article  Google Scholar 

  • Park, S. Y. (2009). An analysis of the technology acceptance model in Understanding University students’ behavioral intention to use e-learning. Educational Technology & Society, 12(3), 150–162.

    Google Scholar 

  • Sáez-López, J. M., Román-González, M., & Vázquez-Cano, E. (2016). Visual programming languages integrated across the curriculum in elementary school: A two year case study using “Scratch” in five schools. Computers & Education, 97, 129–141.

    Article  Google Scholar 

  • Shuhidan, S. M., Hamilton, M., & D’Souza, D. (2011). Understanding novice programmer difficulties via guided learning. ACM, ITiCSE ’11, p. 213–217.

  • Siegle, D. (2017). Technology: Encouraging creativity and problem solving through coding. Gifted Child Today, 40(2), 117–123.

    Article  Google Scholar 

  • Vahldick, A., Mendes, A. J., & Marcelino, M. J. (2014). A review of games designed to improve introductory computer programming competencies. In Frontiers in Education Conference (FIE) (pp. 1–7). IEEE. https://doi.org/10.1109/FIE.2014.7044114

  • Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS quarterly, 425–478.

  • Virvou, M., Katsionis, G., & Manos, K. (2005). Combining Software Games with Education: Evaluation of its Educational Effectiveness. Educational Technology & Society, Journal of International Forum of Educational Technology & Society and IEEE Learning Technology Task Force, 8(2), 54–65.

    Google Scholar 

  • Weintrop, D., and Wilensky, U. (2017). Comparing Block-Based and Text-Based Programming in High School Computer Science Classrooms. ACM Trans. Comput. Educ. 18, 1, Article 3 (October 2017), 25 pages. https://doi.org/10.1145/3089799

  • Xinogalos, S. (2016). Designing and deploying programming courses: Strategies, tools, difficulties and pedagogy. Education and Information Technologies, 21(3), 559–588.

    Article  Google Scholar 

  • Yücel, Y., & Rızvanoğlu, K. (2019). Battling gender stereotypes: A user study of a code-learning game, “Code Combat”, with middle school children. Computers in Human Behavior, 99, 352–365.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Stelios Xinogalos.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kroustalli, C., Xinogalos, S. Studying the effects of teaching programming to lower secondary school students with a serious game: a case study with Python and CodeCombat. Educ Inf Technol 26, 6069–6095 (2021). https://doi.org/10.1007/s10639-021-10596-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10639-021-10596-y

Keywords

Navigation