Eliciting Motivation Knowledge from Log Files Towards Motivation Diagnosis for Adaptive Systems

  • Mihaela Cocea
  • Stephan Weibelzahl
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4511)

Abstract

Motivation is well-known for its importance in learning and its influence on cognitive processes. Adaptive systems would greatly benefit from having a user model of the learner’s motivation, especially if integrated with information about knowledge. In this paper a log file analysis for eliciting motivation knowledge is presented, as a first step towards a user model for motivation. Several data mining techniques are used in order to find the best method and the best indicators for disengagement prediction. Results show a very good level of prediction: around 87% correctly predicted instances of all three levels of engagement and 93% correctly predicted instances of disengagement. Data sets with reduced attribute sets show similar results, indicating that engagement level can be predicted from information like reading pages and taking tests, which are common to most e-Learning systems.

Keywords

e-Learning motivation log files analysis data mining adaptive systems user modeling 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Arroyo, I., Murray, T., Woolf, B.P.: Inferring unobservable learning variables from students’ help seeking behavior. In: Proceedings of the workshop Analyzing Student-Tutor Interaction Logs to Improve Educational Outcomes at ITS, pp. 29–38 (2004)Google Scholar
  2. 2.
    Bandura, A.: Social foundations of thought and action: A social cognitive theory. Prentice Hall, Englewood Cliffs, NJ (1986)Google Scholar
  3. 3.
    Beck, J.E.: Using response times to model student disengagement. In: Proceedings of the Workshop on Social and Emotional Intelligence in Learning Environments at ITS (2004)Google Scholar
  4. 4.
    Cocea, M., Weibelzahl, S.: Can Log Files Analysis Estimate Learners’ Level of Motivation. In: Schaaf, M., Althoff, K.-D.: LWA 2006. Lernen-Wissensentdeckung – Adaptivität. Universität Hildesheim, pp. 32–35 (2006)Google Scholar
  5. 5.
    Cocea, M., Weibelzahl, S.: Motivation–Included or Excluded From E-Learning. In: Kinshuk, Sampson, D.G., Spector, J.M., Isaias, P.: Cognition and Exploratory Learning in Digital Age, pp. 435–437 (2006)Google Scholar
  6. 6.
    De Vicente, A., Pain, H.: Informing the Detection of the Students’ Motivational State: an empirical Study. In: Cerri, S.A., Gouarderes, G., Paraguau, F. (eds.) Intelligent Tutoring Systems. 6th International Conference, pp. 933–943. Springer-Verlag, Berlin (2002)Google Scholar
  7. 7.
    D’Mello, S.K., Craig, S.D., Gholson, B., Franklin, S., Picard, R.W., Graesser, A.C.: Integrating Affect Sensors in an Intelligent Tutoring System. In: Affective Interactions: The Computer in the Affective Loop Workshop at 2005 International conference on Intelligent User Interfaces, pp. 7–13. AMC Press, New York (2005)Google Scholar
  8. 8.
    Fernandez, R., Picard, R.W.: Classical and Novel Discriminant Features for Affect Recognition from Speech. In: Interspeech 2005 - Eurospeech 9th European Conference on Speech Communication and Technology, Lisbon, Portugal (September 4-8, 2005)Google Scholar
  9. 9.
    Fuller, R., de Graaff, J.J.: Measuring User Motivation from Server Log Files. Retrieved on 14/03/06 from http://www.microsoft.com/usability/webconf/fuller/fuller.htm
  10. 10.
    Hayes, A.F., Krippendorff, K.: Answering the call for a standard reliability measure for coding data. Communication Methods and Measures (in press), (Retrieved on 8/11/2006) http://www.comm.ohio-state.edu/ahayes/
  11. 11.
    Heiner, C., Beck, J., Mostow, J.: Lessons on Using ITS Data to Answer Educational Research Questions. In: Proceedings of the workshop Analyzing Student-Tutor Interaction Logs to Improve Educational Outcomes at ITS, pp.1–9 (2004)Google Scholar
  12. 12.
    Hodges, C.B.: Designing to Motivate: Motivational Techniques to Incorporate in E-Learning Experiences, The Journal of Interactive Online Learning, 2(3) (2004)Google Scholar
  13. 13.
    Irizarry, R.: Self-Efficacy & Motivation Effects on Online Psychology Student Retention. USDLA Journal, 16(12) (2002)Google Scholar
  14. 14.
    Kapoor, A., Picard, R.W., Ivanov, Y.: Probabilistic Combination of Multiple Modalities to Detect Interest. In: International Conference on Pattern Recognition, Cambridge, U.K (2004)Google Scholar
  15. 15.
    Kay, J., Maisonneuve, N., Yacef, K., Zaïane, O.: Mining patterns of events in students’ teamwork data. In: Intelligent Tutoring Systems. Proceedings of the Workshop on Educational Data Mining at the 8th International Conference, pp. 45–52. Jhongli, Taiwan (2006)Google Scholar
  16. 16.
    Keller, J.M.: Development and use of the ARCS model of instructional design. Journal of Instructional Development 10(3), 2–10 (1987)CrossRefGoogle Scholar
  17. 17.
    Lombard, M., Snyder-Duch, J., Campanella Bracken, C.: Practical Resources for Assessing and Reporting Intercoder Reliability in Content Analysis Research (2003) (Retrieved on 06/11/06), http://www.temple.edu/mmc/reliability
  18. 18.
    Martinez, M.: High Attrition Rates in e-Learning: Challenges, Predictors, and Solutions. The e-Learning Developers Journal (July 2003) (Retrieved on 25/02/2006), http://www.elearningguild.com
  19. 19.
    Merceron, A., Yacef, K.: A Web-Based Tutoring Tool with Mining Facilities to Improve Learning and Teaching. In: Proceedings of the 11th International Conference on Artificial Intelligence in Education AIED, pp. 201–208. IOS Press, Amsterdam (2003)Google Scholar
  20. 20.
    Mostow, J., Beck, J., Cen, H., Cuneo, A., Gouvea, E., Heiner, C.: An Educational Data Mining Tool to Browse Tutor-Student Interactions: Time Will Tell! In: Beck, J.E.(ed.) Educational Data Mining: Papers from the AAAI Workshop, pp. 15–22 (2005)Google Scholar
  21. 21.
    Qu, L., Wang, N., Johnson, W.L.: Detecting the Learner’s Motivational States in an Interactive Learning Environment. In: Looi, C.-K., et al. (eds.) AIED, pp. 547–554. IOS Press, Amsterdam (2005)Google Scholar
  22. 22.
    Quinlan, R.: C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers, San Mateo, CA (1993)Google Scholar
  23. 23.
    Schraw, G., Brooks, D.W.: Helping Students Self-Regulate in Math and Sciences Courses: Improving the Will and the Skill (2000) (retrieved on 14/03/06) http://dwb.unl.edu/Chau/SR/Self_Reg.html
  24. 24.
    Schunk, D.H., Zimmerman, B.J.: Self-regulation of learning and performance: Issues and educational applications. Lawrence Erlbaum, Hillsdale, NJ (1994)Google Scholar
  25. 25.
    Tuckman, W.B.: A Tripartite Model of Motivation for Achievement: Attitude/Drive/ Strategy (1999) (retrieved on 14/03/06), http://dwb.unl.edu/Chau/CompMod.html
  26. 26.
    Wang, A.Y., Newlin, M.H.: Predictors of web-student performance: The role of self-efficacy and reasons for taking an on-line class. Computers in Human Behavior 18, 151–163 (2002)CrossRefGoogle Scholar
  27. 27.
    Weber, G., Kuhl, H.-C., Weibelzahl, S.: Developing adaptive internet based courses with the authoring system NetCoach. In: Reich, S., Tzagarakis, M.M., De Bra, P.M.E. (eds.) Hypermedia: Openness, Structural Awareness, and Adaptivity. LNCS, vol. 2266, pp. 226–238. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  28. 28.
    Witten, I.H., Frank, E.: Data mining. Practical Machine Learning Tools and Techniques. 2nd edn. Morgan Kauffman Publishers, Elsevier (2005)Google Scholar
  29. 29.
    Zhang, G., Cheng, Z., He, A., Huang, T.A: WWW-based Learner’s Learning Motivation Detecting System. In: Proceedings of International Workshop on Research Directions and Challenge Problems in Advanced Information Systems Engineering, Honjo City, Japan, (2003) (retrieved on 14/03/06), http://www.akita-pu.ac.jp/system/KEST2003

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Mihaela Cocea
    • 1
  • Stephan Weibelzahl
    • 1
  1. 1.National College of Ireland, School of Informatics, Mayor Street 1, Dublin 1Ireland

Personalised recommendations