User Modeling and User-Adapted Interaction

, Volume 18, Issue 3, pp 287–314

Developing a generalizable detector of when students game the system

Authors

    • Human-Computer Interaction InstituteCarnegie Mellon University
  • Albert T. Corbett
    • Human-Computer Interaction InstituteCarnegie Mellon University
  • Ido Roll
    • Human-Computer Interaction InstituteCarnegie Mellon University
  • Kenneth R. Koedinger
    • Human-Computer Interaction InstituteCarnegie Mellon University
Original Paper

DOI: 10.1007/s11257-007-9045-6

Cite this article as:
Baker, R.S.J.d., Corbett, A.T., Roll, I. et al. User Model User-Adap Inter (2008) 18: 287. doi:10.1007/s11257-007-9045-6

Abstract

Some students, when working in interactive learning environments, attempt to “game the system”, attempting to succeed in the environment by exploiting properties of the system rather than by learning the material and trying to use that knowledge to answer correctly. In this paper, we present a system that can accurately detect whether a student is gaming the system, within a Cognitive Tutor mathematics curricula. Our detector also distinguishes between two distinct types of gaming which are associated with different learning outcomes. We explore this detector’s generalizability, and find that it transfers successfully to both new students and new tutor lessons.

Keywords

Gaming the systemLatent response modelsCognitive tutorsBehavior detectionMachine learningGeneralizable modelsStudent modelingInteractive learning environments

Copyright information

© Springer Science+Business Media B.V. 2008