Abstract
Recent advances in the use of learning technologies for both in-person and distance education has enabled the collection of detailed data on learners’ access and use of resources at unprecedented levels. Simultaneously, the growth of technology use in the classroom has brought forward increased interest in the analysis and use of learner data. The field of learning analytics leverages these data with the aim to enhance understanding about and improve learning processes. The Society of Learning Analytics Research defines learning analytics as “the measurement, collection, analysis and reporting of data about learners and their context” (LAK in 1st international conference on learning analytics and knowledge, Banff, AB, Canada, 2011; SOLAR in What is learning analytics? 2021). This chapter provides an overview of leveraging learning analytics to enhance understanding and provide feedback about learning processes. We aim to offer insights into types of data used to generate learning analytics, use the research on procrastination as an example for interpreting and operationalizing learning processes through data and analytics, and offer recommendations for generating feedback about these data. We aim to offer a starting point for utilizing learning analytics and convey their potential to aid learning and pedagogical choices.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Akram, A., Fu, C., Li, Y., Javed, M.Y., Lin, R., Jiang, Y., Tang, Y.: Predicting students’ academic procrastination in blended learning course using homework submission data. IEEE Access 7, 102487–102498 (2019). https://doi.org/10.1109/ACCESS.2019.2930867
Amon, M.J., Vrzakova, H., D’Mello, S.K.: Beyond dyadic coordination: multimodal behavioral irregularity in triads predicts facets of collaborative problem solving. Cogn. Sci. 43(10), 1–22 (2019). https://doi.org/10.1111/cogs.12787
Baker, R.S.: Stupid tutoring systems, intelligent humans. Int. J. Artif. Intell. Educ. 26(2), 600–614 (2016). https://doi.org/10.1007/s40593-016-0105-0
Baker, S., Inventado, P.S.: Educational data mining and learning analytics: Potentials and possibilities for online education. In: Veletsianos, G. (ed.) Emergence and Innovation in Digital Learning, pp. 83–98. Athabasca University Press (2016). https://doi.org/10.15215/aupress/9781771991490.01
Blikstein, P., Worsley, M.: Multimodal learning analytics and education data mining: using computational technologies to measure complex learning tasks. J. Learn. Anal. 3(2), 220–238 (2016). https://doi.org/10.18608/jla.2016.32.11
Bodily, R., Verbert, K.: Review of research on student-facing learning analytics dashboards and educational recommender systems. IEEE Trans. Learn. Technol. 10(4), 405–418 (2017). https://doi.org/10.1109/TLT.2017.2740172
Brown, E., Glover, C.: Evaluating written feedback. In: Bryan, C., Clegg, K. (eds.) Innovative Assessment in Higher Education, pp. 81–91. Routledge (2006)
Buckingham Shum, S., Ferguson, R., Martinez-Maldonado, R.: Human-centered learning analytics. J. Learn. Anal. 6(2), 1–9 (2019). https://doi.org/10.18608/jla.2019.62.1
Claessens, B.J., Van Eerde, W., Rutte, C.G., Roe, R.A.: A review of the time management literature. Pers. Rev. 36(2), 255–276 (2007). https://doi.org/10.1108/00483480710726136
Cleary, T.J.: The Self-Regulated Learning Guide: Teaching Students to Think in the Language of Strategies. Routledge (2018)
Clow, D.: An overview of learning analytics. Teach. High. Educ. 18(6), 683–695 (2013). https://doi.org/10.1080/13562517.2013.827653
Dawson, P., Henderson, M., Mahoney, P., Phillips, M., Ryan, T., Boud, D., Molloy, E.: What makes for effective feedback: staff and student perspectives. Assess. Eval. High. Educ. 44(1), 25–36 (2019). https://doi.org/10.1080/02602938.2018.1467877
D’Mello, S.: A selective meta-analysis on the relative incidence of discrete affective states during learning with technology. J. Educ. Psychol. 105(4), 1082–1099 (2013). https://doi.org/10.1037/a0032674
Duval, E., Verbert, K.: Learning analytics. ELEED: E-Learn. Educ. 8(1), 3–7 (2012)
Ez-Zaouia, M., Lavoué, E.: EMODA: a tutor oriented multimodal and contextual emotional dashboard. In: Proceedings of the Seventh International Learning Analytics & Knowledge Conference, pp. 429–438 (2017)
Fairclough, S.H., Venables, L., Tattersall, A.: The influence of task demand and learning on the psychophysiological response. Int. J. Psychophysiol. 56(2), 171–184 (2005). https://doi.org/10.1016/j.ijpsycho.2004.11.003
Ferguson, R.: Learning analytics: drivers, developments and challenges. Int. J. Technol. Enhanced Learn. 4(5/6), 304–317 (2012). https://doi.org/10.1504/IJTEL.2012.051816
Gelmez, K., Bagli, H.: Tracing design students’ affective journeys through reflective writing. Int. J. Technol. Des. Educ. 28(4), 1061–1081 (2018). https://doi.org/10.1007/s10798-017-9424-1
Grunschel, C., Patrzek, J., Fries, S.: Exploring reasons and consequences of academic procrastination: an interview study. Eur. J. Psychol. Educ. 28(3), 841–861 (2013). https://doi.org/10.1007/s10212-012-0143-4
Henderson, M., Ajjawi, R., Boud, D., Molloy, E.: Identifying feedback that has impact. In: M. Henderson, R. Ajjawi, D. Boud, E. Molloy (eds.) The Impact of Feedback in Higher Education, pp 15–34 (2017). Springer. https://doi.org/10.1007/978-3-030-25112-8163_2
Hooshyar, D., Pedaste, M., Yang, Y.: Mining educational data to predict students’ performance through procrastination behavior. Entropy 22(1), 12–36 (2020). https://doi.org/10.3390/e22010012
Hu, A., Flaxman, S.: Multimodal sentiment analysis to explore the structure of emotions. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 350–358 (2018). https://doi.org/10.1145/3219819.3219853
Ichihara, Y.G., Okabe, M., Iga, K., Tanaka, Y., Musha, K., Ito, K.: Color universal design: the selection of four easily distinguishable colors for all color vision types. In: Proceedings of SPIE, vol. 6807 (2008). https://doi.org/10.1117/12.765420
Ishii, R., Otsuka, K., Kumano, S., Higashinaka, R., Tomita, J.: Analyzing gaze behavior and dialogue act during turn-taking for estimating empathy skill level. In: Proceedings of the 20th ACM International Conference on Multimodal Interaction, pp. 31–39 (2018). https://doi.org/10.1145/3242969.3242978
Järvelä, S., Malmberg, J., Haataja, E., Sobocinski, M., Kirschner, P.A.: What multimodal data can tell us about the students’ regulation of their learning process. Learn. Instr. 72, 101203 (2019). https://doi.org/10.1016/j.learninstruc.2019.04.004
Jivet, I., Scheffel, M., Schmitz, M., Robbers, S., Specht, M., Drachsler, H.: From students with love: an empirical study on learner goals, self-regulated learning and sense-making of learning analytics in higher education. Internet Higher Educ. 47, 100758 (2020). https://doi.org/10.1016/j.iheduc.2020.100758
Joksimović, S., Kovanović, V., Dawson, S.: The journey of learning analytics. HERDSA Rev. Higher Educ. 6, 27–63 (2019)
Kahn, P., Everington, L., Kelm, K., Reid, I., Watkins, F.: Understanding student engagement in online learning environments: The role of reflexivity. Educ. Technol. Res. Dev. 65, 203–218 (2017). https://doi.org/10.1007/s11423-016-9484-z
Kahu, E., Nelson, K., Picton, C.: Student interest as a key driver of engagement for first year students. Stud. Success 8(2), 55–66 (2017). https://doi.org/10.5204/ssj.v8i2.379
Klingsieck, K.B., Fries, S., Horz, C., Hofer, M.: Procrastination in a distance university setting. Distance Educ. 33(3), 295–310 (2012). https://doi.org/10.1080/01587919.2012.723165
Knight, S., et al.: AcaWriter: a learning analytics tool for formative feedback on academic writing. J. Writ. Res. 12(1), 299–344 (2020). https://doi.org/10.17239/jowr-2020.12.01.06
Konert, J., Bohr, C., Bellhäuser, H., Rensing, C.: PeerLA-assistant for individual learning goals and self-regulation competency improvement in online learning scenarios. In: IEEE 16th International Conference on Advanced Learning Technologies, pp. 52–56. IEEE (2016)
Kotsopoulos, D.: Developing an undergraduate business course using open educational resources. Can. J. Scholarsh. Teach. Learn. 13(1) (2022). https://doi.org/10.5206/cjsotlrcacea.2022.1.10992
Kovanovic, V., Gašević, D., Dawson, S., Joksimovic, S., Baker, R.: Does time-on-task estimation matter? implications on validity of learning analytics findings. J. Learn. Anal. 2(3), 81–110 (2016). https://doi.org/10.18608/jla.2015.23.6
LAK.: 1st International Conference on Learning Analytics and Knowledge, Banff, AB, Canada (2011)
Larmuseau, C., Vanneste, P., Desmet, P., Depaepe, F.: Multichannel data for understanding cognitive affordances during complex problem solving. In: Proceedings of the 9th International Conference on Learning Analytics & Knowledge, pp. 61–70 (2019). https://doi.org/10.1145/3303772.3303778
Laney, D.: 3D data management: controlling data volume, velocity and variety. META Group Res. Note 6, 70 (2001)
Lindblom-Ylänne, S.A., Saariaho-Räsänen, E.J., Inkinen, M.S., Haarala-Muhonen, A.E., Hailikari, T.K.: Academic procrastinators, strategic delayers and something betwixt and between: an interview study. Front. Learn. Res. 3(2), 47–62 (2015). https://doi.org/10.14786/flr.v3i2.154
Lister, K., Coughlan, T., Iniesto, F., Freear, N., Devine, P.: Accessible conversational user interfaces: considerations for design. In: Proceedings of the 17th International Web for All Conference, pp. 1–11 (2020)
Lockyer, L., Heathcote, E., Dawson, S.: Informing pedagogical action: aligning learning analytics with learning design. Am. Behav. Sci. 57(10), 1439–1459 (2013). https://doi.org/10.1177/0002764213479367
Macfadyen, L.P., Lockyer, L., Rienties, B.: Learning design and learning analytics: Snapshot. J. Learn. Anal. 7(3), 6–12 (2020). https://doi.org/10.18608/jla.2020.73
Mai, N.N., Takahashi, Y., Oo, M.M.: Testing the effectiveness of transfer interventions using Solomon four-group designs. Educ. Sci. 10(4), 92–106 (2020). https://doi.org/10.3390/educsci10040092
Marzouk, Z., Rakovic, M., Liaqat, A., Vytasek, J., Samadi, D., Stewart-Alonso, J., Nesbit, J.C.: What if learning analytics were based on learning science? Australas. J. Educ. Technol. 32(6), 1–18 (2016). https://doi.org/10.14742/ajet.3058
McCardle, L., Webster, E.A., Haffey, A., Hadwin, A.F.: Examining students’ self-set goals for self-regulated learning: goal properties and patterns. Stud. High. Educ. 42(11), 2153–2169 (2017). https://doi.org/10.1080/03075079.2015.1135117
Ochoa, X., Wise, A.F.: Supporting the shift to digital with learner-centered learning analytics. Educ. Tech. Res. Dev. 69, 357–361 (2021). https://doi.org/10.1007/s11423-020-09882-2
Ochoa, X., Worsley, M.: Augmenting learning analytics with multimodal sensory data. J. Learn. Anal. 3(2), 213–219 (2016). https://doi.org/10.18608/jla.2016.32.10
Papamitsiou, Z., Economides, A.A.: Exploring autonomous learning capacity from a self-regulated learning perspective using learning analytics. Br. J. Edu. Technol. 50(6), 3138–3155 (2019). https://doi.org/10.1111/bjet.12747
Patzak, A.: Measuring and understanding self-handicapping in education. Unpublished doctoral dissertation. Simon Fraser University (2020)
Rebetez, M.M.L., Rochat, L., Van der Linden, M.: Cognitive, emotional, and motivational factors related to procrastination: a cluster analytic approach. Pers. Individ. Differ. 76, 1–6 (2015). https://doi.org/10.1016/j.paid.2014.11.044
Rienties, B., Cross, S., Zdrahal, Z.: Implementing a learning analytics intervention and evaluation framework: what works? In: Motidyang, B., Butson, R. (eds.) Big Data and Learning Analytics in Higher Education, pp. 147–166. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-06520-5_10
Rienties, B., Rivers, B.A.: Measuring and understanding learner emotions: evidence and prospects. Learn. Anal. Rev. 1(1), 1–27 (2014)
Rogaten, J., Rienties, B., Sharpe, R., Cross, S., Whitelock, D., Lygo-Baker, S., Littlejohn, A.: Reviewing affective, behavioural and cognitive learning gains in higher education. Assess. Eval. High. Educ. 44(3), 321–337 (2019). https://doi.org/10.1080/02602938.2018.1504277
Ruiz, S., Charleer, S., Urretavizcaya, M., Klerkx, J., Fernández-Castro, I., Duval, E.: Supporting learning by considering emotions: tracking and visualization a case study. In: Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, pp. 254–263 (2016)
Samuelsen, J., Chen, W., Wasson, B.: Integrating multiple data sources for learning analytics—review of literature. Res. Pract. Technol. Enhanc. Learn. 14(1), 1–20 (2019). https://doi.org/10.1186/s41039-019-0105-4
Santelli, B., Robertson, S.N., Larson, E.K., Humphrey, S.: Procrastination and delayed assignment submissions: student and faculty perceptions of late point policy and grace within an online learning environment. Online Learn. 24(3), 35–49 (2020)
Sarmiento, J.P., Wise, A.F.: Participatory and co-design of learning analytics: an initial review of the literature. In: LAK22: 12th International Learning Analytics and Knowledge Conference, pp. 535–541 (2022)
Shankar, S.K., Prieto, L.P., Rodriguez-Triana, M.J., Ruiz-Calleja, A.: A review of multimodal learning analytics architectures. In: 2018 IEEE 18th International Conference on Advanced Learning Technologies (ICALT), vol. 00, pp. 212–214 (2018). https://doi.org/10.1109/ICALT.2018.00057
Soleymani, M., Garcia, D., Jou, B., Schuller, B., Chang, S.F., Pantic, M.: A survey of multimodal sentiment analysis. Image Vis. Comput. 65, 3–14 (2017). https://doi.org/10.1016/j.imavis.2017.08.003
Siemens, G.: Learning analytics: the emergence of a discipline. Am. Behav. Sci. 57(10), 1380–1400 (2013). https://doi.org/10.1177/0002764213498851
Simpson, W.K., Pychyl, T.A.: In search of the arousal procrastinator: Investigating the relation between procrastination, arousal-based personality traits and beliefs about procrastination motivations. Personal. Individ. Differ. 47(8), 906–911 (2009). https://doi.org/10.1016/j.paid.2009.07.013
Slade, S., Prinsloo, P.: Student perspectives on the use of their data: Between intrusion, surveillance, and care. In: Challenges for research into open & distance learning: doing things better—doing better things, pp. 291–300. Eur. Distance E-Learn. Netw., Oxford (2014)
SOLAR.: What is Learning Analytics? Retrieved July 2021 from (2021). https://www.solaresearch.org/about/what-is-learning-analytics/
Steel, P.: The nature of procrastination: a meta-analytic and theoretical review of quintessential self-regulatory failure. Psychol. Bull. 133(1), 65–94 (2007). https://doi.org/10.1037/0033-2909.133.1.65
Steel, P., König, C.J.: Integrating theories of motivation. Acad. Manag. Rev. 31(4), 889–913 (2006). https://doi.org/10.5465/amr.2006.22527462
Stevens, S.S.: The operational definition of psychological concepts. Psychol. Rev. 42(6), 517–527 (1935). https://doi.org/10.1037/h0056973
Stewart, A.E., Keirn, Z.A., D'Mello, S.K.: Multimodal modeling of coordination and coregulation patterns in speech rate during triadic collaborative problem solving. In: Proceedings of the 20th ACM International Conference on Multimodal Interaction, pp. 21–30 (2018). https://doi.org/10.1145/3242969.3242989
Tuominen, H., Niemivirta, M., Lonka, K., Salmela-Aro, K.: Motivation across a transition: changes in achievement goal orientations and academic well-being from elementary to secondary school. Learn. Individ. Differ. 79, 101854 (2020). https://doi.org/10.1016/j.lindif.2020.101854
van Leeuwen, A.: Learning analytics to support teachers during synchronous CSCL: balancing between overview and overload. J. Learn. Anal. 2(2), 138–162 (2015). https://doi.org/10.18608/jla.2015.22.11
Vrzakova, H., Amon, M.J., Stewart, A., Duran, N.D., D'Mello, S.K.: Focused or stuck together: multimodal patterns reveal triads’ performance in collaborative problem solving. In: Proceedings of the Tenth International Conference on Learning Analytics & Knowledge, pp. 295–304 (2020). https://doi.org/10.1145/3375462.3375467
Vytasek, J.M., Patzak, A., Winne, P.H.: Analytics for student engagement. In: Virvou, M., Alepis, E., Tsihrintzis, G.A., Jain, L.C. (eds.) Machine Learning Paradigms, pp. 23–48. Springer, New York, NY (2020). https://doi.org/10.1007/978-3-030-13743-4_3
Wang, M.T., Binning, K.R., Del Toro, J., Qin, X., Zepeda, C.D.: Skill, thrill, and will: the role of metacognition, interest, and self-control in predicting student engagement in mathematics learning over time. Child Dev. 92(4), 1369–1387 (2021). https://doi.org/10.1111/cdev.13531
Winne, P.H.: Experimenting to bootstrap self-regulated learning. J. Educ. Psychol. 89(3), 397–410 (1997). https://doi.org/10.1037/0022-0663.89.3.397
Winne, P.H.: Bootstrapping learner’s self-regulated learning. Psychol. Test Assess. Model. 52(4), 472–490 (2010)
Winne, P.H.: Construct and consequential validity for learning analytics based on trace data. Comput. Hum. Behav. 112, 106457 (2020). https://doi.org/10.1016/j.chb.2020.106457
Winne, P.H.: Commentary: a proposed remedy for grievances about self-report methodologies. Front. Learn. Res. 8(3), 164–173 (2020b). https://doi.org/10.14786/flr.v8i3.625
Winne, P.H., Teng, K., Chang, D., Lin, M.P.C., Marzouk, Z., Nesbit, J.C., Patzak, A., Rakovic, M., Samadi, D., Vytasek, J.: nStudy: Software for learning analytics about processes for self-regulated learning. J. Learn. Anal. 6(2), 95–106 (2019). https://doi.org/10.18608/jla.2019.62.7
Winne, P.H., Marzouk, Z.: Learning strategies and self-regulated learning (Ch. 27). In: Dunlosky, J., Rawson, K.A. (eds) The Cambridge Handbook of Cognition and Education, pp 696–715. Cambridge University Press (2019)
Winstone, N., Carless, D.: Designing Effective Feedback Processes in Higher Education: A Learning-Focused Approach. Routledge (2019)
Wise, A.F.: Designing pedagogical interventions to support student use of learning analytics. In: Proceedings of the Fourth International Conference on Learning Analytics and Knowledge, pp. 203–211 (2014)
Wise, A.F.: Learning analytics: using data-informed decision-making to improve teaching and learning. In: Adesope, O.O., Rud, A.G. (eds.) Contemporary technologies in education, pp. 119–143. Palgrave Macmillan, Cham (2019). https://doi.org/10.1007/978-3-319-89680-9_7
Wise, A.F., Shaffer, D.W.: Why theory matters more than ever in the age of big data. J. Learn. Anal. 2(2), 5–13 (2015). https://doi.org/10.18608/jla.2015.22.2
Wise, A.F., Vytasek, J.M.: Learning analytics implementation design. In: Lang, C., Siemens, G., Wise, A., Gašević, D. (eds.) Handbook of Learning Analytics and Educational Data Mining, pp. 151–160. Society for Learning Analytics Research (2017). https://doi.org/10.18608/hla17
Wise, A.F., Vytasek, J.M., Hausknecht, S., Zhao, Y.: Developing learning analytics design knowledge in the “middle space”: the student tuning model and align design framework for learning analytics use. Online Learn. J. 20(2):155–182 (2016). https://doi.org/10.24059/OLJ.V20I2.783
Worsley, M.: (Dis)engagement matters: Identifying efficacious learning practices with multimodal learning analytics. In: Proceedings of the 8th International Conference on Learning Analytics and Knowledge, pp. 365–369 (2018)
W3C.: Web Content Accessibility Guidelines (WCAG) 2.1. Accessed July 2021 from http://www.w3.org/TR/WCAG/ (2018)
Tempelaar, D., Nguyen, Q., Rienties, B.: Learning feedback based on dispositional learning analytics. In: Virvou, M., Alepis, E., Tsihrintzis, G.A., Jain, L.C. (eds) Machine learning paradigms: Advances in learning analytics. Intelligent systems reference library, vol. 158, pp. 69–89. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-13743-4_5
Tzimas, D., Demetriadis, S.: Ethical issues in learning analytics: a review of the field. Educ. Tech. Res. Dev. 69(2), 1101–1133 (2021). https://doi.org/10.1007/s11423-021-09977-4
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Patzak, A., Vytasek, J. (2023). Operationalizing Learning Processes Through Learning Analytics. In: Woolford, D.G., Kotsopoulos, D., Samuels, B. (eds) Applied Data Science. Studies in Big Data, vol 125. Springer, Cham. https://doi.org/10.1007/978-3-031-29937-7_6
Download citation
DOI: https://doi.org/10.1007/978-3-031-29937-7_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-29936-0
Online ISBN: 978-3-031-29937-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)