Skip to main content
SpringerLink
Log in

Design and Evaluation of a Programming Tutor Based on an Instant Messaging Interface

  • Conference paper
  • First Online:
Social Computing and Social Media: Applications in Education and Commerce (HCII 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13316))

Included in the following conference series:

  • 722 Accesses

Abstract

Computer programming skills are essential for a variety of disciplines in the fields of Science, Technology, Engineering and Mathematics (STEM). To support learning of programming in personalized ways, Programming Tutors (PTs) have been utilized in higher education contexts for decades. However, implementation of PTs with mobile devices has remained unexplored from both design and adoption standpoints. In this research, we designed, implemented, and trialled a PT based on Telegram Messenger. The tutor was introduced to a cohort of engineering freshmen (\(N=227\)) in a computer programming course; however, it was introduced as an optional learning tool with no extrinsic incentives for fostering its adoption. Under these conditions, students’ activity with the tool was monitored for 11 days. A total of 99 students (\(44.7\%\)) chose to use the tutor and did so at least once. In average, students who used the tutor solved 9.2 tasks out of a maximum of 18 (\(SD=5.49\)). The use of notifications was found highly influential to motivate tutor use: within 3 days of a student receiving a reminder notification, 80.6% of responses to tasks were registered. The tutor scored a mean of 73.8 (\(SD=13.81\)) in the Systems Usability Scale. Students suggestions for improvement emphasized the need for more elaborate feedback after submitting their responses to problems and leveling of task difficulty. Regarding the tutor’s best features, mobility and ease of use of the interface were found the most prominent.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Alvarez, C., Wise, A., Altermatt, S., Aranguiz, I.: Predicting academic results in a modular computer programming course. In: 2nd Latin American Conference on Learning Analytics, LALA, vol. 2425, pp. 21–30 (2019)

    Google Scholar 

  2. Anderson, L.W., Krathwohl, D.R.: A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives. Longman, Harlow (2001)

    Google Scholar 

  3. Bangor, A., Kortum, P., Miller, J.: Determining what individual SUS scores mean: adding an adjective rating scale. J. Usability Stud. 4(3), 114–123 (2009)

    Google Scholar 

  4. Bennedsen, J., Caspersen, M.E.: Failure rates in introductory programming: 12 years later. ACM Inroads 10(2), 30–36 (2019)

    Article  Google Scholar 

  5. Biggs, J.B.: Teaching for Quality Learning at University: What the Student Does. McGraw-Hill Education (UK), London (2011)

    Google Scholar 

  6. Bocconi, S., Chioccariello, A., Dettori, G., Ferrari, A., Engelhardt, K., et al.: Developing computational thinking in compulsory education-implications for policy and practice. Technical report, Joint Research Centre (Seville site) (2016)

    Google Scholar 

  7. Chao, C.M.: Factors determining the behavioral intention to use mobile learning: an application and extension of the UTAUT model. Front. Psychol. 10, 1652 (2019)

    Article  Google Scholar 

  8. Crompton, H., Burke, D.: The use of mobile learning in higher education: a systematic review. Comput. Educ. 123, 53–64 (2018)

    Article  Google Scholar 

  9. Crow, T., Luxton-Reilly, A., Wuensche, B.: Intelligent tutoring systems for programming education: a systematic review. In: Proceedings of the 20th Australasian Computing Education Conference, pp. 53–62 (2018)

    Google Scholar 

  10. Foxhack: Ninja Gaiden series. https://www.mobygames.com/game-group/ninja-gaiden-series. Accessed 28 Jan 2022

  11. Garner, J., Denny, P., Luxton-Reilly, A.: Mastery learning in computer science education. In: Proceedings of the Twenty-First Australasian Computing Education Conference, pp. 37–46 (2019)

    Google Scholar 

  12. Gerdes, A., Heeren, B., Jeuring, J., van Binsbergen, L.T.: Ask-Elle: an adaptable programming tutor for Haskell giving automated feedback. Int. J. Artif. Intell. Educ. 27(1), 65–100 (2017). https://doi.org/10.1007/s40593-015-0080-x

    Article  Google Scholar 

  13. Gruber, J.: Markdown (2002). https://daringfireball.net/projects/markdown/. Accessed 19 May 2021

  14. Kamen, R.M., Avildsen, J.G.: (nd). https://www.imdb.com/title/tt0087538/. Accessed 19 Jan 2022

  15. Kulik, J.A., Fletcher, J.: Effectiveness of intelligent tutoring systems: a meta-analytic review. Rev. Educ. Res. 86(1), 42–78 (2016)

    Article  Google Scholar 

  16. Kumar, V., Nanda, P.: Social media in higher education: a framework for continuous engagement. Int. J. Inf. Commun. Technol. Educ. (IJICTE) 15(1), 97–108 (2019)

    Article  Google Scholar 

  17. Lewis, J.R., Sauro, J.: Item benchmarks for the system usability scale. J. Usability Stud. 13(3), 158–167 (2018)

    Google Scholar 

  18. Ma, W., Adesope, O.O., Nesbit, J.C., Liu, Q.: Intelligent tutoring systems and learning outcomes: a meta-analysis. J. Educ. Psychol. 106(4), 901 (2014)

    Article  Google Scholar 

  19. Meerbaum-Salant, O., Armoni, M., Ben-Ari, M.: Learning computer science concepts with scratch. Comput. Sci. Educ. 23(3), 239–264 (2013)

    Article  Google Scholar 

  20. Mousavinasab, E., Zarifsanaiey, N., R. Niakan Kalhori, S., Rakhshan, M., Keikha, L., Ghazi Saeedi, M.: Intelligent tutoring systems: a systematic review of characteristics, applications, and evaluation methods. Interact. Learn. Environ. 29, 1–22 (2018)

    Google Scholar 

  21. Pirker, J., Riffnaller-Schiefer, M., Gütl, C.: Motivational active learning: engaging university students in computer science education. In: Proceedings of the 2014 Conference on Innovation & Technology in Computer Science Education, pp. 297–302 (2014)

    Google Scholar 

  22. Smutny, P., Schreiberova, P.: Chatbots for learning: a review of educational chatbots for the Facebook messenger. Comput. Educ. 151, 103862 (2020)

    Google Scholar 

  23. So, S.: Mobile instant messaging support for teaching and learning in higher education. Internet High. Educ. 31, 32–42 (2016)

    Article  Google Scholar 

  24. Telegram: Telegram messenger (2020). https://telegram.org/. Accessed 20 Dec 2020

  25. Telegram: Telegram chatbot API (nd). https://core.telegram.org/bots/api. Accessed 19 Jan 2022

  26. Zimmerman, B.J.: Investigating self-regulation and motivation: historical background, methodological developments, and future prospects. Am. Educ. Res. J. 45(1), 166–183 (2008)

    Article  Google Scholar 

Download references

Acknowledgements

We thank Dr. Alyssa F. Wise for her cooperation with this research. This research was funded by ANID/FONDECYT Initiation into Research grant 11160211.

Author information

Authors and Affiliations

  1. Universidad de los Andes, Facultad de Ingeniería y Ciencias Aplicadas, Santiago, Chile

    Claudio Alvarez & Juan de Dios Valenzuela

  2. Facultad de Ciencias Empresariales, Departamento de Ciencias de la Computación y Tecnologías de la Información, Universidad del Bío-Bío, Concepción, Chile

    Luis A. Rojas

Authors
  1. Claudio Alvarez
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Luis A. Rojas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Juan de Dios Valenzuela
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Claudio Alvarez .

Editor information

Editors and Affiliations

  1. Towson University, Towson, MD, USA

    Gabriele Meiselwitz

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Alvarez, C., Rojas, L.A., de Dios Valenzuela, J. (2022). Design and Evaluation of a Programming Tutor Based on an Instant Messaging Interface. In: Meiselwitz, G. (eds) Social Computing and Social Media: Applications in Education and Commerce. HCII 2022. Lecture Notes in Computer Science, vol 13316. Springer, Cham. https://doi.org/10.1007/978-3-031-05064-0_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-05064-0_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-05063-3

  • Online ISBN: 978-3-031-05064-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation