Abstract
Temporal analysis of learning data is attracting the interest of researchers, and a growing body of Learning Analytics (LA) research applies lag sequential analysis. However, lack of methodological frameworks that guide the data gathering and analysis poses multiple conceptual, methodological, analytical and technical challenges. While observation as a technique has been already used in LA, systematic observation methods and designs have not been applied so far, and parameters often used in the observational domain (such as order and duration) are still under-researched. In this paper we propose a methodological framework, and illustrate its potential by applying it in the analysis of a Knowledge Forum dataset. Results show the potential of the proposed method to uncover behavioral patterns prospectively (lag +1 to lag +5) or retrospectively (lag −1 to lag −5), and to reduce this information through polar coordinate analysis. Moreover, as illustrated in this paper, observational methods offer a rigorous framework for LA datasets, enabling the replicability, validity and reliability of the results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Macfadyen, L.P., Dawson, S.: Numbers are not enough. Why e-learning analytics failed to inform an institutional strategic plan. J. Educ. Technol. Soc. 15, 149–163 (2012)
Eradze, M., Rodríguez-Triana, M.J., Laanpere, M.: Semantically annotated lesson observation data in learning analytics datasets: a reference model. Interact. Des. Archit. J. 33, 75–91 (2017)
Rodríguez-Triana, M.J., Vozniuk, A., Holzer, A., Gillet, D., Prieto, L.P., Boroujeni, M.S., Schwendimann, B.A.: Monitoring, awareness and reflection in blended technology enhanced learning: a systematic review. Int. J. Technol. Enhanc. Learn. 9, 126–150 (2017)
Blikstein, P., Worsley, M.: Multimodal learning analytics and education data mining: using computational technologies to measure complex learning tasks. J. Learn. Anal. 3, 220–238 (2016)
Anguera, M.T.: Observational methods (General). In: Fernández-Ballesteros, R. (ed.) Encyclopedia of Psychological Assessment, vol. 2, pp. 632–637. Sage, London (2003)
Bakeman, R., Quera, V.: Sequential Analysis and Observational Methods for the Behavioral Sciences. Cambridge University Press, Cambridge (2011)
Chen, B., Resendes, M., Chai, C.S., Hong, H.Y.: Two tales of time: uncovering the significance of sequential patterns among contribution types in knowledge-building discourse. Interact. Learn. Environ. 25, 162–175 (2017)
Ochoa, X., Hershkovitz, A., Wise, A., Knight, S.: Towards a convergent development of learning analytics. J. Learn. Anal. 4, 1–6 (2017)
Scheffel, M., Drachsler, H., Toisoul, C., Ternier, S., Specht, M.: The proof of the pudding: examining validity and reliability of the evaluation framework for learning analytics. In: Lavoué, É., Drachsler, H., Verbert, K., Broisin, J., Pérez-Sanagustín, M. (eds.) EC-TEL 2017. LNCS, vol. 10474, pp. 194–208. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66610-5_15
Rodríguez-Triana, M.J., Prieto, L.P., Martínez-Monés, A., Asensio-Pérez, J.I., Dimitriadis, Y.: The teacher in the loop: customizing multimodal learning analytics for blended learning. In: Proceedings of the 8th International Conference on Learning Analytics and Knowledge, pp. 417–426. ACM (2018)
Schwendimann, B.A., Rodriguez-Triana, M.J., Vozniuk, A., Prieto, L.P., Boroujeni, M.S., Holzer, A., Gillet, D., Dillenbourg, P.: Perceiving learning at a glance: a systematic literature review of learning dashboard research. IEEE Trans. Learn. Technol. 10, 30–41 (2017)
Anguera, M.T., Portell, M., Chacón-Moscoso, S.: Indirect observation in everyday contexts: concepts and methodological guidelines within a mixed methods framework. Front. Psychol. 9, 1–20 (2018). https://doi.org/10.18608/jla.2017.43.1
Radzikowski, J., Stefanidis, A., Jacobsen, K.H., Croitoru, A., Crooks, A., Delamater, P.L.: The measles vaccination narrative in Twitter: a quantitative analysis. JMIR Pub. Heal. Surveill. 2 (2016)
Sackett, G.P.: Lag sequential analysis as a data reduction technique in social interaction research. Except. Infant. Psychosoc. 4, 300–340 (1980)
Bakeman, R., Gottman, J.M.: Observing Interaction. Cambridge University Press, Cambridge (1997)
Anguera, M.T.: From prospective patterns in behavior to joint analysis with a retrospective perspective. In: Colloque sur invitation “Méthodologie d’analyse des interactions sociales” Université de la Sorbonne, Paris (1997)
Mendo, A.H., López, J.A.L., Paulis, J.C., Sánchez, V.M., Brincones, J.L.P.: Hoisan 1.2: Programa informático para uso en metodología observacional. Cuad. Psicol. del Deport 12, 55–78 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Rodríguez-Medina, J., Rodríguez-Triana, M.J., Eradze, M., García-Sastre, S. (2018). Observational Scaffolding for Learning Analytics: A Methodological Proposal. In: Pammer-Schindler, V., Pérez-Sanagustín, M., Drachsler, H., Elferink, R., Scheffel, M. (eds) Lifelong Technology-Enhanced Learning. EC-TEL 2018. Lecture Notes in Computer Science(), vol 11082. Springer, Cham. https://doi.org/10.1007/978-3-319-98572-5_58
Download citation
DOI: https://doi.org/10.1007/978-3-319-98572-5_58
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-98571-8
Online ISBN: 978-3-319-98572-5
eBook Packages: Computer ScienceComputer Science (R0)