Skip to main content
SpringerLink
Log in
Book cover

International Conference on Human-Computer Interaction

HCII 2022: HCI International 2022 - Late Breaking Papers. Interaction in New Media, Learning and Games pp 390–408Cite as

Development and Evaluation of a Learning Analytics Dashboard for Moodle Learning Management System

Part of the Lecture Notes in Computer Science book series (LNCS,volume 13517)

Abstract

Learning analytics provides a potential for adapting learning, teaching and knowledge testing processes to individual needs. One of the ways of using learning analytics is a dashboard for providing feedback to students and teachers. This paper presents the development and evaluation of the learning analytics dashboard for students (LAD-S). The LAD-S displays three views: a look at student success, system activities and prediction based on machine learning algorithms. We have used LAD-S as a part of Moodle online courses, one during the second semester in the 2020/2021, and the other two during the first semester in the 2021/2022. A survey was designed to examine students’ opinion about the LAD-S that included student’s self-awareness, influence of the dashboard on learning effectiveness, satisfaction with the type of data collected, usefulness and ease-of-use, intention to use the learning analytics dashboard. Data from 33 undergraduate and graduate students were collected. The results have shown that students are satisfied with all examined aspects of the LAD-S above the average. Students express the greatest satisfaction for ease of use (M = 3.79), clarity of collected data (M = 3.6), usefulness (M = 3.6), SUS questionnaire (M = 3.6), behavioral intention (M = 3.4) and satisfaction with individual functions of LAD-S (M = 3.4). Lower, yet above-average satisfaction was obtained for the impact of the LAD-S on more effective learning (M = 3.2); intention to use (M = 3.3) and satisfaction with the possibility of behavioral changes (M = 3.1). To verify the reliability of the measures used, the Cronbach’s alpha reliability coefficient was calculated for each scale. Satisfactory reliability of all measures used was obtained, with alpha coefficients ranging from 0.704 for the SUS questionnaire to 0.942 for the ease-of-use measure.

Keywords

  • Learning analytics
  • Learning analytics dashboard
  • Evaluation

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Dyckhoff, A.L., Lukarov, V., Muslim, A., Chatti, M.A., Schroeder, U.: Supporting action research with learning analytics. In: LAK 2013, 08–12 April, Leuven, Belgium (2013)

    Google Scholar 

  2. Bodily, R., Ikahihif, T.K., Mackley, B., Graham, C.R.: The design, development, and implementation of studentfacing learning analytics dashboards. J. Comput. High. Educ. 30, 572–598 (2018)

    Google Scholar 

  3. Ferguson, R.: Learning analytics: drivers, developments and challenges. Int. J. Technol. Enhanced Learn. 4(5–6), 304–317 (2012)

    CrossRef  Google Scholar 

  4. Siemens, G.: Learning analytics & knowledge. In: LAK 2011, Banff, Alberta (2011)

    Google Scholar 

  5. Suthers, D., Verbert, K.: Learning analytics as a middle space. In: Proceedings of the Third International Conference on Learning Analytics and Knowledge (2013)

    Google Scholar 

  6. Greller, W., Drachsler, H.: Translating learning into numbers: a generic framework for learning analytics. Educ. Technol. Soc. 15(3), 42–57 (2012)

    Google Scholar 

  7. Durall, E., Gros, B.: Learning analytics as a metacognitive tool. In: 6th International Conference on Computer Supported Education, Barcelona, Spain (2014)

    Google Scholar 

  8. Few, S.: Information Dashboard Design: Displaying Data for At-a-Glance Monitoring. Analytics Press, Burlingame (2013)

    Google Scholar 

  9. Charleer, S., Klerkx, J., Duval, E., De Laet, T., Verbert, K.: Creating effective learning analytics dashboards: lessons learnt. In: European Conference on Technology Enhanced Learning, (2016)

    Google Scholar 

  10. Safsouf, Y., Mansouri, K., Poirier, F.: TaBAT: design and experimentation of a learning analysis dashboard for teachers and learners. J. Inf. Technol. Educ. Res. 20, 331–350 (2021)

    Google Scholar 

  11. Siemens, G., Baker, R.S.J.D.: Learning analytics and educational data mining: towards communication and collaboration. In: Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, pp. 252–254, April 2012

    Google Scholar 

  12. Sarikaya, A., Correll, M., Mela, L.B.: What do we talk about when we talk about dashboards? IEEE Trans. Visual Comput. Graph. 25(1), 682–692 (2018)

    CrossRef  Google Scholar 

  13. Schwendimann, B.A., et al.: Perceiving learning at a glance: a systematic literature review of learning dashboard research. IEEE Trans. Learn. Technol. 10(1) Siječanj-ožujak (2017)

    Google Scholar 

  14. Zimmerman, B.J., Moylan, A.R.: Self-regulation: where metacognition and motivation intersect. In: Hacker, D.J., Dunlosky, J., Graesser, A.C. (eds.) Handbook of Metacognition in Education, pp. 299–315 (2009)

    Google Scholar 

  15. Matcha, W., Gasevic, D., Ahmad Uzir, N., Pardo, A.: A systematic review of empirical studies on learning analytics dashboards: a self-regulated learning perspective. Trans. Learn. Technol. Svibanj (2019)

    Google Scholar 

  16. Aldowah, H., Al-Samarraie, H., Fauzy, W.M.: Educational data mining and learning analytics for 21st century higher education: a review and synthesis. Telematics Inform. 37, 13–49 (2019)

    CrossRef  Google Scholar 

  17. Gasevic, D., Dawson, S., Rogers, T., Gasevic, D.: Learning analytics should not promote one size fits all: the effects of instructional conditions in predicting academic success. Internet High. Educ. 28, 68–84 (2016)

    Google Scholar 

  18. Naranjo, D.M., Prieto, J.R., Moltó, G., Calatrava, A.: A visual dashboard to track learning analytics for educational cloud computing. Adv. Sens. Technol. Educ. 19, 2952 (2019)

    Google Scholar 

  19. Ruiperez-Valiente, J.A., Munoz-Merino, P.J., Gascon-Pinedo, J.A., Kloss, C.D.: Scaling to massiveness with ANALYSE: a learning analytics tool for open edX. IEEE Trans. Hum.-Mach. Syst. 47, 909–914 (2016)

    Google Scholar 

  20. Hussain, M., Hussain, S., Zhang, W.: Mining Moodle data to detect the inactive and low performance students during the Moodle course. In: ICBDR, 27–29 October 2018

    Google Scholar 

  21. Park, Y., Jo, I.-H.: Development of the learning analytics dashboard to support students’ learning performance. J. Universal Comput. Sci. 21(1) (2015)

    Google Scholar 

  22. Podgorelec, V., Kuhar, S.: Taking advantage of education data: advanced data analysis and reporting in virtual learning environments. Electron. Electri. Eng. 8(114) (2011). ISSN 1392–1215

    Google Scholar 

  23. Aljohani, N.R., Daud, A., Abbasi, R.A., Alowibd, J.S., Basheri, M., Aslam, M.A.: An integrated framework for course adapted student learning analytics dashboard. Comput. Hum. Behav. (2018)

    Google Scholar 

  24. Azcona, D., Hsiao, I.-H., Smeaton, A.F.: Personalizing computer science education by leveraging multimodal learning analytics. IEEE (2018)

    Google Scholar 

  25. Shi, C., Fu, S., Chen, Q., Qu, H.: VisMOOC: visualizing video clickstream data from massive open online courses. In: IEEE Pacific Visualization Symposium, 14–17 April 2015

    Google Scholar 

  26. Akçapinar, G., Bayazit, A.: MoodleMiner: data mining analysis tool for moodle learning management system. Elementary Educ. Online, 406–415 (2019)

    Google Scholar 

  27. Tervakari, A., Kuosa, K., Koro, J., Paukkeri, J., Kailanto, M.: Teachers’ learning analytics tools in a social media enhanced learning environment. In: International Conference on Interactive Collaborative Learning (ICL), 03–06 December 2014

    Google Scholar 

  28. Corrin, L., et al.: Loop: a learning analytics tool to provide teachers with useful data visualisations. In: Ascilite, Perth, Australia (2015)

    Google Scholar 

  29. Martinez-Maldonado, R., Pardo, A., Mirriahi, N., Yacef, K.: The LATUX workflow: designing and deploying awareness tools in technology-enabled learning settings. In: International Conference on Learning Analytics and Knowledge, At Poughkeepsie, NY, USA (2015)

    Google Scholar 

  30. Gamage, S.H.P.W., Ayres, J.R., Behrend, M.B.: A systematic review on trends in using Moodle for teaching and learning. Int. J. STEM Educ. (2022). Article number: 9

    Google Scholar 

  31. Xin, O.K., Singh, D.: Development of learning analytics dashboard based on moodle learning management system. Int. J. Adv. Comput. Sci. Appl. 12(7) (2021)

    Google Scholar 

  32. Moodle docs, Moodle. https://docs.moodle.org/400/en/Analytics_plugins. Accessed 15 Apr 2022

  33. Create better learning experiences. https://intelliboard.net/

  34. Marticorena-Sánchez, R., López-Nozal, C., Ji, Y.P., Pardo-Aguilar, C., Arnaiz-González, Á.: UBUMonitor: an open-source desktop application for visual E-learning analysis with moodle. Open Source Softw. Learn. Environ. (2022)

    Google Scholar 

  35. Krishnan, R., et al.: Smart analysis of learners performance using learning analytics for improving academic progression: a case study model. Entrepreneurship Sustainability High. Educ. (2022)

    Google Scholar 

  36. SmartKlass™ learning analytics moodle. https://moodle.org/plugins/local_smart_klass

  37. My Feedback. https://moodle.org/plugins/report_myfeedback. Accessed 15 Apr 2022

  38. Parack, S., Zahid, Z., Merchant, F.: Application of data mining in educational databases for predicting academic trends and patterns. In: IEEE International Conference on Technology Enhanced Education (ICTEE), Kerala, 2012, pp. 1–4 (2012)

    Google Scholar 

  39. Tempelaar, D.T., Rienties, B., Giesbers, B.: In search for the most informative data for feedback generation: learning analytics in a data-rich context. Comput. Hum. Behav. 47, 157–167 (2015)

    Google Scholar 

  40. Scheffel, M., Drachsler, H., Toisoul, C., Ternier, S., Specht, M.: The proof of the pudding: examining validity and reliability of the evaluation framework for learning analytics. In: Data Driven Approaches in Digital Education. EC-TEL 2017. Lecture Notes in Computer Science, vol. 10474. pp. 194–208. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66610-5_15

  41. Persico, D., Pozzi, F.: Informing learning design with learning analytics to improve teacher inquiry. Br. J. Edu. Technol. 46(2), 230–248 (2014)

    CrossRef  Google Scholar 

  42. Orfanou, K., Tselios, N., Katsanos, C.: Perceived usability evaluation of learning management systems: empirical evaluation of the system usability scale. Int. Rev. Res. Open Distance Learn. 16(2), 227–246 (2015)

    Google Scholar 

  43. Celi, E.: Application of dashboards and scorecards for learning models IT risk management: a user experience. In: International Conference of Design, User Experience, and Usability (2015)

    Google Scholar 

  44. Ramirez-Anormaliza, R., Sabate, F.: Evaluating student acceptance level of e-learning systems. In: 8th International Conference of Education, Research and Innovation At: Sevilla Volume: ICERI2015 Proceedings (2015)

    Google Scholar 

Download references

Acknowledgment

This work was supported by the Office of Naval Research grant, N00014–20-1–2066 “Enhancing Adaptive Courseware based on Natural Language Processing”.

Author information

Authors and Affiliations

  1. Department of Information Sciences, University of Zadar, Zadar, Croatia

    Ivan Peraić

  2. Faculty of Science, University of Split, Split, Croatia

    Ani Grubišić

Authors
  1. Ivan Peraić
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ani Grubišić
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ivan Peraić .

Editor information

Editors and Affiliations

  1. Computer and Information Sciences, Towson University, Towson, MD, USA

    Gabriele Meiselwitz

  2. San Jose State University, San Jose, CA, USA

    Abbas Moallem

  3. Department of Multimedia and Graphic Arts, Cyprus University of Technology, Limassol, Cyprus

    Panayiotis Zaphiris

  4. Cyprus University of Technology, Limassol, Cyprus

    Andri Ioannou

  5. Soar Technology, Inc., Orlando, FL, USA

    Robert A. Sottilare

  6. MMS, Fraunhofer FKIE, Wachtberg, Nordrhein-Westfalen, Germany

    Jessica Schwarz

  7. DePaul University, Chicago, IL, USA

    Xiaowen Fang

Rights and permissions

Reprints and Permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Peraić, I., Grubišić, A. (2022). Development and Evaluation of a Learning Analytics Dashboard for Moodle Learning Management System. In: Meiselwitz, G., et al. HCI International 2022 - Late Breaking Papers. Interaction in New Media, Learning and Games. HCII 2022. Lecture Notes in Computer Science, vol 13517. Springer, Cham. https://doi.org/10.1007/978-3-031-22131-6_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-22131-6_30

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-22130-9

  • Online ISBN: 978-3-031-22131-6

  • eBook Packages: Computer ScienceComputer Science (R0)

search

Navigation