An Analysis of Gaming Behaviors in an Intelligent Tutoring System

  • Kasia Muldner
  • Winslow Burleson
  • Brett Van de Sande
  • Kurt VanLehn
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6094)

Abstract

We present results from an analysis of students’ shallow behaviors, i.e., gaming, during their interaction with an Intelligent Tutoring System (ITS). The analysis is based on six college classes using the Andes ITS for homework and test preparation. Our findings show that student features are a better predictor of gaming than problem features, and that individual differences between students impact where and how students game.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    VanLehn, K.: Analogy Events: How Examples Are Used During Problem Solving. Cognitive Science 22(3), 347–388 (1998)CrossRefGoogle Scholar
  2. 2.
    Renkl, A.: Learning from Worked-Examples: A Study on Individual Differences. Cognitive Science 21(1), 1–30 (1997)CrossRefGoogle Scholar
  3. 3.
    Chi, M., Siler, S.A., Jeong, H., Yamauchi, T., Hausmann, R.G.: Learning from Human Tutoring. Cognitive Science 25, 471–533 (2001)CrossRefGoogle Scholar
  4. 4.
    Baker, d.C., Raspat, J., Aleven, V., Corbett, A.T., Koedinger, K.R.: Educational Software Features That Encourage and Discourage “Gaming the System”. In: 14th International Conference on Artificial Intelligence in Education, pp. 475–482 (2009)Google Scholar
  5. 5.
    Baker, R.S., Corbett, A., Koedinger, K., Wagner, A.Z.: Off-Task Behavior in the Cognitive Tutor Classroom: When Students “Game the System”. In: ACM CHI 2004: Computer-Human Interaction, pp. 383–390 (2004)Google Scholar
  6. 6.
    Baker, R., Corbett, A., Roll, I., Koedinger, K.: Developing a Generalizable Detector of When Students Game the System. User Modeling and User-Adapted Interaction 18(3), 287–314 (2008)CrossRefGoogle Scholar
  7. 7.
    Baker, R., Corbett, A., Koedinger, K., Roll, I.: Generalizing Detection of Gaming the System across a Tutoring Curriculum. In: 11’th International Conference on Intelligent Tutoring Systems, pp. 402–411 (2006)Google Scholar
  8. 8.
    Rodrigo, M., Baker, R., d’Mello, S., Gonzalez, M., Lagud, M., Lim, S., Macapanpan, A., Pascua, S., Santillano, J., Sugay, J., Tep, S., Viehland, N.: Comparing Learners’ Affect While Using an Intelligent Tutoring Systems and a Simulation Problem Solving Game. In: Woolf, B.P., Aïmeur, E., Nkambou, R., Lajoie, S. (eds.) ITS 2008. LNCS, vol. 5091, pp. 40–49. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  9. 9.
    Baker, R., Walonoski, J., Heffernan, N., Roll, I., Corbett, A., Koedinger, K.: Why Students Engage in “Gaming the System”. Journal of Interactive Learning Research 19(2), 185–224 (2008)Google Scholar
  10. 10.
    Murray, R.C., VanLehn, K.: Effects of Dissuading Unnecessary Help Requests While Providing Proactive Help. In: Artificial Intelligence in Education, pp. 887–889 (2005)Google Scholar
  11. 11.
    Walonoski, J., Heffernan, N.: Prevention of Off-Task Gaming Behavior in Intelligent Tutoring Systems. In: Ikeda, M., Ashley, K.D., Chan, T.-W. (eds.) ITS 2006. LNCS, vol. 4053, pp. 722–724. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  12. 12.
    VanLehn, K., Lynch, C., Schulze, K., Shapiro, J., Shelby, R., Taylor, L., Treacy, D., Weinstein, A., Wintersgill, M.: The Andes Physics Tutoring System: Lessons Learned. International Journal of Artificial Intelligence and Education 15(3), 1–47 (2005)Google Scholar
  13. 13.
    Baker, R., Corbett, A., Koedinger, K.: Detecting Student Misuse of Intelligent Tutoring Systems. In: Lester, J.C., Vicari, R.M., Paraguaçu, F. (eds.) ITS 2004. LNCS, vol. 3220, pp. 531–540. Springer, Heidelberg (2004)Google Scholar
  14. 14.
    Walonoski, J., Heffernan, N.: Detection and Analysis of Off-Task Gaming Behavior in Intelligent Tutoring Systems. In: Ikeda, M., Ashley, K.D., Chan, T.-W. (eds.) ITS 2006. LNCS, vol. 4053, pp. 382–391. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  15. 15.
    Baker, R.: Is Gaming the System State-or-Trait? Educational Data Mining through the Multi-Contextual Application of a Validated Behavioral Model. In: Workshop on Data Mining for User Modeling, pp. 76–80 (2007)Google Scholar
  16. 16.
    Baker, R.S., Roll, I., Corbett, A., Koedinger, K.: Do Performance Goals Lead Students to Game the System. In: International Conference on Artificial Intelligence and Education (AIED 2005), pp. 57–64 (2005)Google Scholar
  17. 17.
    Baker, R., Corbett, A., Koedinger, K., Evenson, E., Roll, I., Wagner, A., Naim, M., Raspat, J., Baker, D., Beck, J.: Adapting to When Students Game an Intelligent Tutoring System. In: Ikeda, M., Ashley, K.D., Chan, T.-W. (eds.) ITS 2006. LNCS, vol. 4053, pp. 392–401. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  18. 18.
    Aleven, V.: Helping Students to Become Better Help Seekers: Towards Supporting Metacognition in a Cognitive Tutor. Paper Presented at German-USA Early Career Research Exchange Program: Research on Learning Technologies and Technology-Supported Education (2001)Google Scholar
  19. 19.
    Harris, A., Bonnett, V., Luckin, R., Yuill, N., Avramides, K.: Scaffolding Effective Help-Seeking Behaviour in Mastery and Performance Oriented Learners. In: Artificial Intelligence in Education, pp. 425–432 (2009)Google Scholar
  20. 20.
    Shih, B., Koedinger, K., Scheines, R.: A Response Time Model for Bottom-out Hints as Worked Examples. In: International Conference on Educational Data Mining, pp. 117–126 (2008)Google Scholar
  21. 21.
    Beck, J., Chang, K., Mostow, J., Corbett, A.: Does Help Help? Introducing the Bayesian Evaluation and Assessment Methodology. In: Woolf, B.P., Aïmeur, E., Nkambou, R., Lajoie, S. (eds.) ITS 2008. LNCS, vol. 5091, pp. 383–394. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  22. 22.
    Gall, S.N.-L.: Help-Seeking Behavior in Learning Review of Research in Education 12, 55–90 (1985)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Kasia Muldner
    • 1
  • Winslow Burleson
    • 1
  • Brett Van de Sande
    • 1
  • Kurt VanLehn
    • 1
  1. 1.Arizona State University 

Personalised recommendations