Skip to main content

Learning and Gamification Dashboards: A Mixed-Method Study with Teachers

  • Conference paper
  • First Online:
Intelligent Tutoring Systems (ITS 2021)

Abstract

Previous studies have investigated the provision of students’ relevant data, usually available in intuitive dashboards, to assist teachers in pedagogical decision-making in learning systems. Researchers are also interested in investigating how students’ interaction data with gamification elements improve teachers’ understanding of students’ status and helps students with adequate pedagogical recommendations. However, there is a lack of understanding of how teachers perceive data visualizations provided through dashboards recently explored in gamified educational systems. In this paper, the authors investigate teachers’ perceptions about three different dashboards with visualizations about 1) students’ interaction with learning resources, 2) students’ interaction with gamification elements, and 3) students’ interaction with learning resources and gamification elements. As such, the researchers conducted a mixed-method study with 47 teachers to evaluate their perceived understanding, perceived usefulness, perceived behavioral change, and perceived decision-making support regarding the three dashboards. The results suggest teachers perceived that the dashboard with visualizations concerning students’ interaction with learning resources and gamification elements provide better support to them in the decision-making process. Teachers also perceived the third dashboard has a more significant potential to impact behavioral changes than the other two dashboards.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Amin, N.A.: Redefining the role of teachers in the digital era. Int. J. Indian Psychol. 3(3) (2016), http://www.doi.org/10.25215/0303.101

  2. Araújo Paiva, R.O., Bittencourt, I.I., Da Silva, A.P., Isotani, S., Jaques, P.: Improving pedagogical recommendations by classifying students according to their interactional behavior in a gamified learning environment. In: Proceedings of the ACM Symposium on Applied Computing, vol. 13–17-April-2015, pp. 233–238. Association for Computing Machinery, New York (2015). http://www.doi.org/10.1145/2695664.2695874

  3. Corbin, J.M., Strauss, A.L.: Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory. Sage Publications, Los Angeles (2008)

    Google Scholar 

  4. Dermeval, D., Bittencourt, I.I.: Co-designing gamified intelligent tutoring systems with teachers. Braz. J. Comput. Educ. Revista Brasileira de Informática na Educaçã-RBIE 28, 73–91 (2020). http://www.doi.org/10.5753/RBIE.2020.28.0.73

  5. Dermeval, D., et al.: An ontology-driven software product line architecture for developing gamified intelligent tutoring systems. Int. J. Knowl. Learn. 12(1), 27–48 (2017). https://doi.org/10.1504/IJKL.2017.10009129

    Article  Google Scholar 

  6. Dermeval, D., Paiva, R., Bittencourt, I.I., Vassileva, J., Borges, D.: Authoring tools for designing intelligent tutoring systems: a systematic review of the literature. Int. J. Artif. Intell. Educ. 28(3), 336–384 (2017). https://doi.org/10.1007/s40593-017-0157-9

    Article  Google Scholar 

  7. González González, C., Toledo, P., Muñoz, V.: Enhancing the engagement of intelligent tutorial systems through personalization of gamification. Int. J. Eng. Educ. 32(1), 532–541 (2016)

    Google Scholar 

  8. Heilbrunn, B., Herzig, P., Schill, A.: Gamification analytics—methods and tools for monitoring and adapting gamification designs. In: Stieglitz, S., Lattemann, C., Robra-Bissantz, S., Zarnekow, R., Brockmann, T. (eds.) Gamification. PI, pp. 31–47. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-45557-0_3

    Chapter  Google Scholar 

  9. Hui, Y.K., Kwok, L.F.: A review on learning analytics. Int. J. Innov. Learn. 25(2), 197–222 (2019). https://doi.org/10.1504/IJIL.2019.097673

    Article  Google Scholar 

  10. Izumi, L., Fathers, F., Clemens, J.: Technology and Education: A primer. Fraser Institute, Canada (2013)

    Google Scholar 

  11. Lee, L.-K., Cheung, S.K.S., Kwok, L.-F.: Learning analytics: current trends and innovative practices. J. Comput. Educ. 7(1), 1–6 (2020). https://doi.org/10.1007/s40692-020-00155-8

    Article  Google Scholar 

  12. Llorens-Largo, F., et al.: Chapter 12 - LudifyME: An Adaptive Learning Model Based on Gamification. In: Caballé, S., Clarisó, R. (eds.) Formative Assessment, Learning Data Analytics and Gamification, pp. 245–269. Academic Press, Boston (2016). https://doi.org/10.1016/B978-0-12-803637-2.00012-9

  13. Macleod, H., Sinclair, C.: Digital Learning and the Changing Role of the Teacher. In: Peters, M.A. (eds.) Encyclopedia of Educational Philosophy and Theory, pp. 566–571. Springer, Singapore (2017). https://doi.org/10.1007/978-981-287-588-4_126

  14. Molenaar, I., Knoop-van Campen, C.: How Teachers Make Dashboard Information Actionable. IEEE Trans. Learn. Technol. 1 (2018). https://doi.org/10.1109/TLT.2018.2851585

  15. Nye, B.D.: Barriers to ITS adoption: a systematic mapping study. In: Trausan-Matu, S., Boyer, K.E., Crosby, M., Panourgia, K. (eds.) ITS 2014. LNCS, vol. 8474, pp. 583–590. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07221-0_74

    Chapter  Google Scholar 

  16. Jethro, O.O., Grace, A.M., Thomas, A.K.: E-Learning and its effects on teaching and learning in a global age. Int. J. Acad. Res. Bus. Soc. Sci. 2(1), 244–252 (2012)

    Google Scholar 

  17. Paiva, R., Bittencourt, I.I.: The Authoring of Pedagogical Decisions Informed by Data, on the Perspective of a MOOC. In: Anais dos Workshops do VI Congresso Brasileiro de Informática na Educação (CBIE 2017), vol. 1, p. 15. Brazilian Computer Society (Sociedade Brasileira de Computação - SBC) (2017). https://doi.org/10.5753/cbie.wcbie.2017.15

  18. Paiva, R., Bittencourt, I.I., Tenrio, T., Jaques, P., Isotani, S.: What Do Students Do On-line? Modeling Students’ Interactions to Improve Their Learning Experience. Comput. Hum. Behav. 64(C), 769–781 (2016). https://doi.org/10.1016/j.chb.2016.07.048

  19. Paiva, R., de Holanda, J.F.S., Peixoto, M.D., Vieira, J.P.: Augmenting teachers with data science powers: Joining human and artificial intelligence to assist students. In: Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação-SBIE), vol. 30, p. 1721 (2019). https://doi.org/10.5753/cbie.sbie.2019.1721

  20. Park, Y., Jo, I.-H.: Factors that affect the success of learning analytics dashboards. Educ. Technol. Res. Dev. , 1–25 (2019). https://doi.org/10.1007/s11423-019-09693-0

  21. Pinkwart, N.: Another 25 years of AIED? challenges and opportunities for intelligent educational technologies of the future. Int. J. Artif. Intell. Educ. 26(2), 771–783 (2016). https://doi.org/10.1007/s40593-016-0099-7

    Article  Google Scholar 

  22. Prenger, R., Schildkamp, K.: Data-based decision making for teacher and student learning: a psychological perspective on the role of the teacher. Educ. Psychol. 38(6), 734–752 (2018). https://doi.org/10.1080/01443410.2018.1426834

  23. Sharpe, D.: Chi-square test is statistically significant: now what? Pract. Assess. Res. Eval. 20(1) (2015). https://doi.org/10.7275/tbfa-x148

  24. Tenório, K., et al.: Helping teachers assist their students in gamified adaptive educational systems: towards a gamification analytics tool. In: Bittencourt, I.I., Cukurova, M., Muldner, K., Luckin, R., Millán, E. (eds.) AIED 2020. LNCS (LNAI), vol. 12164, pp. 312–317. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-52240-7_57

    Chapter  Google Scholar 

  25. Tenório, K., Dermeval, D., Monteiro, M., Peixoto, A., Pedro, A.: Raising teachers empowerment in gamification design of adaptive learning systems: a qualitative research. In: Bittencourt, I.I., Cukurova, M., Muldner, K., Luckin, R., Millán, E. (eds.) AIED 2020. LNCS (LNAI), vol. 12163, pp. 524–536. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-52237-7_42

    Chapter  Google Scholar 

  26. Tenório, K., et al.: An Evaluation of the GamAnalytics Tool: Is the Gamification Analytics Model Ready for Teachers? In: Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação), pp. 562–571. Sociedade Brasileira de Computação (2020). https://doi.org/10.5753/cbie.sbie.2020.562

  27. UNICEF: Raising Learning Outcomes: the opportunities and challenges of ICT for learning. Technical Report (2018). https://www.unicef.org/esa/media/2636/file/UNICEF-AKF-IU-2018-ICT-Education-WCAR-ESAR.pdf

  28. Zaric, N., Gottschlich, M., Roepke, R., Schroeder, U.: Supporting gamification with an interactive gamification analytics tool (IGAT). In: Alario-Hoyos, C., Rodríguez-Triana, M.J., Scheffel, M., Arnedillo-Sánchez, I., Dennerlein, S.M. (eds.) EC-TEL 2020. LNCS, vol. 12315, pp. 461–466. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-57717-9_45

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kamilla Tenório .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Tenório, K. et al. (2021). Learning and Gamification Dashboards: A Mixed-Method Study with Teachers. In: Cristea, A.I., Troussas, C. (eds) Intelligent Tutoring Systems. ITS 2021. Lecture Notes in Computer Science(), vol 12677. Springer, Cham. https://doi.org/10.1007/978-3-030-80421-3_45

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-80421-3_45

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-80420-6

  • Online ISBN: 978-3-030-80421-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics