Abstract
Engagement is an important aspect of effective learning. Time spent using an e-Learning system is not quality time if the learner is not engaged. Tracking the student disengagement would give the possibility to intervene for motivating the learner at appropriate time. In previous research we showed the possibility to predict engagement from log files using a web-based e-Learning system. In this paper we present the results obtained from another web-based system and compare them to the previous ones. The similarity of results across systems demonstrates that our approach is system-independent and that engagement can be elicited from basic information logged by most e-Learning systems: number of pages read, time spent reading pages, number of tests/ quizzes and time spent on test/ quizzes.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Arroyo, I., Woolf, B.P.: Inferring learning and attitudes from a Bayesian Network of log file data. In: Looi, C.K., McCalla, G., Bredeweg, B., Breuker, J. (eds.) Artificial Intelligence in Education, Supporting Learning through Intelligent and Socially Informed Technology, pp. 33–34. IOS Press, Amsterdam (2005)
Baker, R., Corbett, A., Koedinger, K.: Detecting Student Misuse of Intelligent Tutoring Systems. In: Proceedings of the Seventh International Conference on Intelligent Tutoring Systems, pp. 531–540 (2004)
Beck, J.: Engagement tracing: Using response times to model student disengagement. In: Looi, C., McCalla, G., Bredeweg, B., Breuker, J. (eds.) Artificial Intelligence in Education: Supporting Learning through Intelligent and Socially Informed Technology, pp. 88–95. IOS Press, Amsterdam (2005)
Chen, G.D., Shen, G.Y., Ou, K.L., Liu, B.: Promoting motivation and eliminating disorientation for web based courses by a multi-user game. In: Proceedings of the ED-MEDIA/ED-TELECOM 1998 World Conference on Educational Multimedia and Hypermedia and World conference on Educational Telecommunications, June 20-25, Germany (1998)
Cocea, M.: Assessment of motivation in online learning environments. In: Wade, V., Ashman, H., Smyth, B. (eds.) AH 2006. LNCS, vol. 4018, pp. 414–418. Springer, Heidelberg (2006)
Cocea, M., Weibelzahl, S.: Can Log Files Analysis Estimate Learners’ Level of Motivation? In: Proceedings of ABIS Workshop, ABIS 2006 - 14th Workshop on Adaptivity and User Modeling in Interactive Systems, Hildesheim, pp. 32–35 (2006)
Cocea, M., Weibelzahl, S.: Eliciting Motivation Knowledge from Log Files towards Motivation Diagnosis for Adaptive Systems. In: Conati, C., Mccoy, K., Paliouras, G. (eds.) UM 2007. LNCS(LNAI), vol. 4511, pp. 197–206. Springer, Berlin (2007)
Connolly, T., Stansfield, M.: Using Games-Based eLearning Technologies in Overcoming Difficulties in Teaching Information Systems. Journal of Information Technology Education 5, 459–476 (2006)
De Vicente, A., Pain, H.: Informing the Detection of the Students’ Motivational State: an empirical Study. In: Cerri, S.A., Gouardéres, G., Paraguaçu, F. (eds.) ITS 2002. LNCS, vol. 2363, pp. 933–943. Springer, Heidelberg (2002)
Farzan, R., Brusilovsky, P.: Social navigation support in E-Learning: What are real footprints. In: IJCAI 2005 Workshop on Intelligent Techniques for Web Personalization, Edinburgh, UK, pp. 49–56 (2005)
Hurley, T.: Intervention Strategies to Increase Self-efficacy and Self-regulation in Adaptive On-Line Learning. In: Wade, V., Ashman, H., Smyth, B. (eds.) AH 2006. LNCS, vol. 4018, pp. 440–444. Springer, Heidelberg (2006)
Johns, J., Woolf, B.: A Dynamic Mixture Model to Detect Student Motivation and Proficiency. In: AAAI 2006. Proceedings of the Twenty-first National Conference on Artificial Intelligence, Boston, MA (2006)
Keller, J.M.: Development and use of the ARCS model of instructional design. Journal of Instructional Development 10(3), 2–10 (1987)
Lombard, M., Snyder-Duch, J., Campanella Bracken, C.: Practical Resources for Assessing and Reporting Intercoder Reliability in Content Analysis Research (2003) (retrieved 06/11/06), from http://www.temple.edu/mmc/reliability
Mitchell, T.M.: Machine Learning. McGraw-Hill, New York (1997)
Pintrich, P.R., Schunk, D.H.: Motivation in education: theory, research and applications. Prentice Hall, Englewood Cliffs (2002)
Qu, L., Wang, N., Johnson, W.L.: Detecting the Learner’s Motivational States in an Interactive Learning Environment. In: Looi, C.-K., et al. (eds.) Artificial Intelligence in Education, pp. 547–554. IOS Press, Amsterdam (2005)
Rafter, R., Smyth, B.: Passive Profiling from Server Logs in an Online Recruitment Environment. In: ITWP 2001. Proceedings of the IJCAI Workshop on Intelligent Techniques for Web Personalization, pp. 35–41, Seattle, Washington, USA (2001)
ReadingSoft.com found at HYPERLINK, http://www.readingsoft.com
TurboRead Speed Reading found at HYPERLINK, http://www.turboread.com
Walonoski, J., Heffernan, N.T.: Detection and Analysis of Off-Task Gaming Behavior in Intelligent Tutoring Systems. In: Ikeda, M., Ashley, K.D., Chan, T.-W. (eds.) ITS 2006. LNCS, vol. 4053, pp. 382–391. Springer, Heidelberg (2006)
Walonoski, J., Heffernan, N.T.: Prevention of Off-Task Gaming Behaviour within Intelligent Tutoring Systems. In: Ikeda, M., Ashley, K.D., Chan, T.-W. (eds.) ITS 2006. LNCS, vol. 4053, pp. 722–724. Springer, Heidelberg (2006)
Witten, I.H., Frank, E.: Data mining. Practical Machine Learning Tools and Techniques, 2nd edn. Morgan Kauffman Publishers, Elsevier, Amsterdam (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cocea, M., Weibelzahl, S. (2007). Cross-System Validation of Engagement Prediction from Log Files. In: Duval, E., Klamma, R., Wolpers, M. (eds) Creating New Learning Experiences on a Global Scale. EC-TEL 2007. Lecture Notes in Computer Science, vol 4753. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75195-3_2
Download citation
DOI: https://doi.org/10.1007/978-3-540-75195-3_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-75194-6
Online ISBN: 978-3-540-75195-3
eBook Packages: Computer ScienceComputer Science (R0)