Cross-System Validation of Engagement Prediction from Log Files

  • Mihaela Cocea
  • Stephan Weibelzahl
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4753)

Abstract

Engagement is an important aspect of effective learning. Time spent using an e-Learning system is not quality time if the learner is not engaged. Tracking the student disengagement would give the possibility to intervene for motivating the learner at appropriate time. In previous research we showed the possibility to predict engagement from log files using a web-based e-Learning system. In this paper we present the results obtained from another web-based system and compare them to the previous ones. The similarity of results across systems demonstrates that our approach is system-independent and that engagement can be elicited from basic information logged by most e-Learning systems: number of pages read, time spent reading pages, number of tests/ quizzes and time spent on test/ quizzes.

Keywords

e-Learning engagement prediction log files analysis data mining 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Arroyo, I., Woolf, B.P.: Inferring learning and attitudes from a Bayesian Network of log file data. In: Looi, C.K., McCalla, G., Bredeweg, B., Breuker, J. (eds.) Artificial Intelligence in Education, Supporting Learning through Intelligent and Socially Informed Technology, pp. 33–34. IOS Press, Amsterdam (2005)Google Scholar
  2. 2.
    Baker, R., Corbett, A., Koedinger, K.: Detecting Student Misuse of Intelligent Tutoring Systems. In: Proceedings of the Seventh International Conference on Intelligent Tutoring Systems, pp. 531–540 (2004)Google Scholar
  3. 3.
    Beck, J.: Engagement tracing: Using response times to model student disengagement. In: Looi, C., McCalla, G., Bredeweg, B., Breuker, J. (eds.) Artificial Intelligence in Education: Supporting Learning through Intelligent and Socially Informed Technology, pp. 88–95. IOS Press, Amsterdam (2005)Google Scholar
  4. 4.
    Chen, G.D., Shen, G.Y., Ou, K.L., Liu, B.: Promoting motivation and eliminating disorientation for web based courses by a multi-user game. In: Proceedings of the ED-MEDIA/ED-TELECOM 1998 World Conference on Educational Multimedia and Hypermedia and World conference on Educational Telecommunications, June 20-25, Germany (1998)Google Scholar
  5. 5.
    Cocea, M.: Assessment of motivation in online learning environments. In: Wade, V., Ashman, H., Smyth, B. (eds.) AH 2006. LNCS, vol. 4018, pp. 414–418. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  6. 6.
    Cocea, M., Weibelzahl, S.: Can Log Files Analysis Estimate Learners’ Level of Motivation? In: Proceedings of ABIS Workshop, ABIS 2006 - 14th Workshop on Adaptivity and User Modeling in Interactive Systems, Hildesheim, pp. 32–35 (2006)Google Scholar
  7. 7.
    Cocea, M., Weibelzahl, S.: Eliciting Motivation Knowledge from Log Files towards Motivation Diagnosis for Adaptive Systems. In: Conati, C., Mccoy, K., Paliouras, G. (eds.) UM 2007. LNCS(LNAI), vol. 4511, pp. 197–206. Springer, Berlin (2007)Google Scholar
  8. 8.
    Connolly, T., Stansfield, M.: Using Games-Based eLearning Technologies in Overcoming Difficulties in Teaching Information Systems. Journal of Information Technology Education 5, 459–476 (2006)Google Scholar
  9. 9.
    De Vicente, A., Pain, H.: Informing the Detection of the Students’ Motivational State: an empirical Study. In: Cerri, S.A., Gouardéres, G., Paraguaçu, F. (eds.) ITS 2002. LNCS, vol. 2363, pp. 933–943. Springer, Heidelberg (2002)Google Scholar
  10. 10.
    Farzan, R., Brusilovsky, P.: Social navigation support in E-Learning: What are real footprints. In: IJCAI 2005 Workshop on Intelligent Techniques for Web Personalization, Edinburgh, UK, pp. 49–56 (2005)Google Scholar
  11. 11.
    Hurley, T.: Intervention Strategies to Increase Self-efficacy and Self-regulation in Adaptive On-Line Learning. In: Wade, V., Ashman, H., Smyth, B. (eds.) AH 2006. LNCS, vol. 4018, pp. 440–444. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  12. 12.
    Johns, J., Woolf, B.: A Dynamic Mixture Model to Detect Student Motivation and Proficiency. In: AAAI 2006. Proceedings of the Twenty-first National Conference on Artificial Intelligence, Boston, MA (2006)Google Scholar
  13. 13.
    Keller, J.M.: Development and use of the ARCS model of instructional design. Journal of Instructional Development 10(3), 2–10 (1987)CrossRefGoogle Scholar
  14. 14.
    Lombard, M., Snyder-Duch, J., Campanella Bracken, C.: Practical Resources for Assessing and Reporting Intercoder Reliability in Content Analysis Research (2003) (retrieved 06/11/06), from http://www.temple.edu/mmc/reliability
  15. 15.
    Mitchell, T.M.: Machine Learning. McGraw-Hill, New York (1997)MATHGoogle Scholar
  16. 16.
    Pintrich, P.R., Schunk, D.H.: Motivation in education: theory, research and applications. Prentice Hall, Englewood Cliffs (2002)Google Scholar
  17. 17.
    Qu, L., Wang, N., Johnson, W.L.: Detecting the Learner’s Motivational States in an Interactive Learning Environment. In: Looi, C.-K., et al. (eds.) Artificial Intelligence in Education, pp. 547–554. IOS Press, Amsterdam (2005)Google Scholar
  18. 18.
    Rafter, R., Smyth, B.: Passive Profiling from Server Logs in an Online Recruitment Environment. In: ITWP 2001. Proceedings of the IJCAI Workshop on Intelligent Techniques for Web Personalization, pp. 35–41, Seattle, Washington, USA (2001)Google Scholar
  19. 19.
    ReadingSoft.com found at HYPERLINK, http://www.readingsoft.com
  20. 20.
    TurboRead Speed Reading found at HYPERLINK, http://www.turboread.com
  21. 21.
    Walonoski, J., Heffernan, N.T.: Detection and Analysis of Off-Task Gaming Behavior in Intelligent Tutoring Systems. In: Ikeda, M., Ashley, K.D., Chan, T.-W. (eds.) ITS 2006. LNCS, vol. 4053, pp. 382–391. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  22. 22.
    Walonoski, J., Heffernan, N.T.: Prevention of Off-Task Gaming Behaviour within Intelligent Tutoring Systems. In: Ikeda, M., Ashley, K.D., Chan, T.-W. (eds.) ITS 2006. LNCS, vol. 4053, pp. 722–724. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  23. 23.
    Witten, I.H., Frank, E.: Data mining. Practical Machine Learning Tools and Techniques, 2nd edn. Morgan Kauffman Publishers, Elsevier, Amsterdam (2005)MATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Mihaela Cocea
    • 1
  • Stephan Weibelzahl
    • 1
  1. 1.National College of Ireland, School of Informatics, Mayor Street, Dublin 1Ireland

Personalised recommendations