Skip to main content
SpringerLink
Log in

From Data to Outcomes: Experimental Learning Analytics Insights

  • Chapter
  • First Online:
Smart Learning Environments in the Post Pandemic Era

Part of the book series: Cognition and Exploratory Learning in the Digital Age ((CELDA))

  • 65 Accesses

Abstract

This systematic review, following the PRISMA 2020 protocol, provides a comprehensive analysis of experimental research in learning analytics. It identifies 52 relevant articles from various databases, shedding light on the evolution of experimental studies in this domain. The review reveals a significant increase in experimental studies in recent years, emphasizing the growing recognition of evidence-based research in learning analytics. These studies primarily focus on micro- and meso-level analytics, targeting students and instructors, highlighting the practicality and immediate impact of learning analytics in education. One of the most noteworthy findings is the positive impact of learning analytics-based interventions on key educational outcomes, including achievement, motivation, engagement, and system usage behaviors. These interventions demonstrate the potential to enhance academic achievements and create more engaging learning environments. The review also highlights the diversity of learning analytics interventions, such as learner-facing and instructor-facing dashboards, automated feedback, personalized feedback, and course material personalization. It underscores opportunities for further exploration in diagnostic, predictive, and prescriptive analytics to gain more comprehensive insights into educational phenomena. In conclusion, this systematic review reflects the evolving landscape of experimental research in learning analytics, its positive impact on education, and the potential for further advancements. It contributes to a more robust and empirically grounded understanding of learning analytics applications in education.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Alhothali, A., Albsisi, M., Assalahi, H., & Aldosemani, T. (2022). Predicting student outcomes in online courses using machine learning techniques: A review. Sustainability, 14(10), 6199.

    Article  Google Scholar 

  • Alonso-Fernández, C., Calvo-Morata, A., Freire, M., Martínez-Ortiz, I., & Fernández-Manjón, B. (2019). Applications of data science to game learning analytics data: A systematic literature review. Computers & Education, 141, 103612.

    Article  Google Scholar 

  • Bassani, R. V., & Cazella, S. C. (2021). The alignment between learning analytics and the general data protection regulation: A systematic literature review. ETD Educacao Tematica Digital, 23(4), 1022–1040.

    Article  Google Scholar 

  • Bodily, R., & Verbert, K. (2017a). Review of research on student-facing learning analytics dashboards and educational recommender systems. IEEE Transactions on Learning Technologies, 10(3), 405–418.

    Article  Google Scholar 

  • Bodily, R., & Verbert, K. (2017b, March). Trends and issues in student-facing learning analytics reporting systems research. In Proceedings of the seventh international learning analytics & knowledge conference (pp. 309–318).

    Google Scholar 

  • Chango, W., Lara, J. A., Cerezo, R., & Romero, C. (2022). A review on data fusion in multimodal learning analytics and educational data mining. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 12(4), e1458.

    Google Scholar 

  • Crescenzi-Lanna, L. (2020). Multimodal learning analytics research with young children: A systematic review. British Journal of Educational Technology, 51(4), 1485–1504.

    Article  Google Scholar 

  • Cui, Y., Chen, F., Shiri, A., & Fan, Y. (2019). Predictive analytic models of student success in higher education: A review of methodology. Information and Learning Sciences, 120(3/4), 208–227.

    Article  Google Scholar 

  • Daoudi, I. (2022). Learning analytics for enhancing the usability of serious games in formal education: A systematic literature review and research agenda. Education and Information Technologies, 1–30.

    Google Scholar 

  • Deho, O. B., Zhan, C., Li, J., Liu, J., Liu, L., & Duy Le, T. (2022). How do the existing fairness metrics and unfairness mitigation algorithms contribute to ethical learning analytics? British Journal of Educational Technology, 53(4), 822–843.

    Article  Google Scholar 

  • Du, X., Yang, J., Shelton, B. E., Hung, J.-L., & Zhang, M. (2021). A systematic meta-review and analysis of learning analytics research. Behaviour & Information Technology, 40(1), 49–62. https://doi.org/10.1080/0144929X.2019.1669712

    Article  Google Scholar 

  • Ferguson, R. (2019). Ethical challenges for learning analytics. Journal of Learning Analytics, 6(3), 25–30.

    Article  Google Scholar 

  • Galaige, J., Steele, G. T., Binnewies, S., & Wang, K. (2022). A framework for designing student-facing learning analytics to support self-regulated learning. IEEE Transactions on Learning Technologies, 15(3), 376–391.

    Article  Google Scholar 

  • Hellings, J., & Haelermans, C. (2020). The effect of providing learning analytics on student behaviour and performance in programming: A randomised controlled experiment. Higher Education, 1–18.

    Google Scholar 

  • Ifenthaler, D. (2015). Learning analytics. In J. M. Spector (Ed.), The Sage encyclopedia of educational technology (Vol. 2, pp. 448–451). Sage. https://doi.org/10.4135/9781483346397.n187

    Chapter  Google Scholar 

  • Ifenthaler, D., & Tracey, M. W. (2016). Exploring the relationship of ethics and privacy in learning analytics and design: Implications for the field of educational technology. Educational Technology Research and Development, 64, 877–880.

    Article  Google Scholar 

  • Ifenthaler, D., & Widanapathirana, C. (2014). Development and validation of a learning analytics framework: Two case studies using support vector machines. Technology, Knowledge and Learning, 19(2–3), 221–240.

    Article  Google Scholar 

  • Ifenthaler, D., & Yau, J. Y. (2020). Utilising learning analytics to support study success in higher education: A systematic review. Educational Technology Research and Development, 68(4), 1961–1990.

    Article  Google Scholar 

  • KaraoÄŸlan Yılmaz, F. G. (2022). The effect of learning analytics assisted recommendations and guidance feedback on students’ metacognitive awareness and academic achievements. Journal of Computing in Higher Education, 34(2), 396–415.

    Article  Google Scholar 

  • Larrabee Sønderlund, A., Hughes, E., & Smith, J. (2019). The efficacy of learning analytics interventions in higher education: A systematic review. British Journal of Educational Technology, 50(5), 2594–2618.

    Article  Google Scholar 

  • Leitner, P., Khalil, M., & Ebner, M. (2017). Learning analytics in higher education—A literature review. In Learning analytics: Fundaments, applications, and trends (pp. 1–23). Springer.

    Google Scholar 

  • Mah, D. K., Yau, J. Y., & Ifenthaler, D. (2019). Epilogue: Future directions on learning analytics to enhance study success. In Utilizing learning analytics to support study success. Springer.

    Google Scholar 

  • Mangaroska, K., & Giannakos, M. (2018). Learning analytics for learning design: A systematic literature review of analytics-driven design to enhance learning. IEEE Transactions on Learning Technologies, 12(4), 516–534.

    Article  Google Scholar 

  • Matcha, W., GaÅ¡ević, D., & Pardo, A. (2019). A systematic review of empirical studies on learning analytics dashboards: A self-regulated learning perspective. IEEE Transactions on Learning Technologies, 13(2), 226–245.

    Article  Google Scholar 

  • Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & PRISMA Group*. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Annals of Internal Medicine, 151(4), 264–269.

    Article  Google Scholar 

  • Mougiakou, S. Vinatsella, D. Sampson, D. Papamitsiou, Z. Giannakos, M, Ifenthaler, D. (2022, October). Educational data analytics for teachers and school leaders. Series advances in analytics for learning and teaching. Springer. ISBN 978-3-031-15265-8. Open Access Textbook.

    Google Scholar 

  • Murchan, D., & Siddiq, F. (2021). A call to action: A systematic review of ethical and regulatory issues in using process data in educational assessment. Large-scale Assessments in Education, 9(1), 25.

    Article  Google Scholar 

  • Namoun, A., & Alshanqiti, A. (2020). Predicting student performance using data mining and learning analytics techniques: A systematic literature review. Applied Sciences, 11(1), 237.

    Article  Google Scholar 

  • Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., et al. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Systematic Reviews, 10(1), 1–11.

    Article  Google Scholar 

  • Roberts, L. D., Howell, J. A., & Seaman, K. (2017). Give me a customizable dashboard: Personalized learning analytics dashboards in higher education. Technology, Knowledge and Learning, 22, 317–333.

    Article  Google Scholar 

  • Sampson, D., Papamitsiou, Z., Ifenthaler, D., Giannakos, M., Mougiakou, S., & Vinatsella, D. (2022, October). Educational data literacy. Series advances in analytics for learning and teaching. Monograph. Springer. ISBN 978-3-031-11704-6.

    Google Scholar 

  • Schumacher, C., & Ifenthaler, D. (2021). Investigating prompts for supporting students’ self-regulation—A remaining challenge for learning analytics approaches? Internet and Higher Education, 49.

    Google Scholar 

  • Sedrakyan, G., Malmberg, J., Verbert, K., Järvelä, S., & Kirschner, P. A. (2020). Linking learning behavior analytics and learning science concepts: Designing a learning analytics dashboard for feedback to support learning regulation. Computers in Human Behavior, 107, 105512.

    Article  Google Scholar 

  • Tepgec, M., Karaoglan Yilmaz, F.G., Yilmaz, R., Aydin, F., Sulak, S., Yurdugul, H. (2021, May 5). Learning analytics based feed-forward: Designing dashboards according to learner expectations and lecturer perspectives. In The Association for Educational Communications and Technology (AECT) international convention, Virtual and Chicago.

    Google Scholar 

  • Tlili, A., Chang, M., Moon, J., Liu, Z., Burgos, D., & Chen, N. S. (2021). A systematic literature review of empirical studies on learning analytics in educational games.

    Google Scholar 

  • Toro-Troconis, M., Alexander, J., & Frutos-Perez, M. (2019). Assessing student engagement in online programmes: Using learning design and learning analytics. International Journal of Higher Education, 8(5), 171–183.

    Article  Google Scholar 

  • Tzimas, D., & Demetriadis, S. (2021). Ethical issues in learning analytics: A review of the field. Educational Technology Research and Development, 69(3), 1101–1133.

    Article  Google Scholar 

  • Ãœstün, A. B., Zhang, K., KaraoÄŸlan Yılmaz, F. G., & Yılmaz, R. (2022). Learning analytics based feedback and recommendations in flipped classrooms: An experimental study in higher education. Journal of Research on Technology in Education. https://doi.org/10.1080/15391523.2022.2040401

  • Valle, N., Antonenko, P., Valle, D., Dawson, K., Huggins-Manley, A. C., & Baiser, B. (2021). The influence of task-value scaffolding in a predictive learning analytics dashboard on learners’ statistics anxiety, motivation, and performance. Computers & Education, 173, 104288.

    Article  Google Scholar 

  • Viberg, O., Hatakka, M., Bälter, O., & Mavroudi, A. (2018). The current landscape of learning analytics in higher education. Computers in Human Behavior, 89, 98–110.

    Article  Google Scholar 

  • Viberg, O., Khalil, M., & Baars, M. (2020). Self-regulated learning and learning analytics in online learning environments: A review of empirical research. In Proceedings of the tenth international conference on learning analytics & knowledge (pp. 524–533).

    Google Scholar 

  • Vieira, C., Parsons, P., & Byrd, V. (2018). Visual learning analytics of educational data: A systematic literature review and research agenda. Computers & Education, 122, 119–135.

    Article  Google Scholar 

  • Wang, D., & Han, H. (2021). Applying learning analytics dashboards based on process-oriented feedback to improve students’ learning effectiveness. Journal of Computer Assisted Learning, 37(2), 487–499.

    Article  Google Scholar 

  • Zheng, L., Zhong, L., & Niu, J. (2022). Effects of personalised feedback approach on knowledge building, emotions, co-regulated behavioural patterns and cognitive load in online collaborative learning. Assessment & Evaluation in Higher Education, 47(1), 109–125.

    Article  Google Scholar 

Download references

Acknowledgements

This study is financially supported by 2214-A programme of The Scientific and Technological Research Council of Turkey (TÃœBITAK).

Author information

Authors and Affiliations

  1. University of Mannheim, Mannheim, Germany

    Mustafa Tepgec & Dirk Ifenthaler

  2. Curtin University, Perth, Australia

    Dirk Ifenthaler

Authors
  1. Mustafa Tepgec
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dirk Ifenthaler
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. University of Piraeus, Piraeus, Greece

    Demetrios G. Sampson

  2. University of Mannheim, Mannheim, Baden-Württemberg, Germany

    Dirk Ifenthaler

  3. Universidade Aberta (Portuguese Open University), Lisboa, Portugal

    Pedro Isaías

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Tepgec, M., Ifenthaler, D. (2024). From Data to Outcomes: Experimental Learning Analytics Insights. In: Sampson, D.G., Ifenthaler, D., Isaías, P. (eds) Smart Learning Environments in the Post Pandemic Era. Cognition and Exploratory Learning in the Digital Age. Springer, Cham. https://doi.org/10.1007/978-3-031-54207-7_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-54207-7_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-54206-0

  • Online ISBN: 978-3-031-54207-7

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics

Search

Navigation