A multifactor approach to student model evaluation
- First Online:
- 173 Downloads
Creating student models for Intelligent Tutoring Systems (ITS) in novel domains is often a difficult task. In this study, we outline a multifactor approach to evaluating models that we developed in order to select an appropriate student model for our medical ITS. The combination of areas under the receiver-operator and precision-recall curves, with residual analysis, proved to be a useful and valid method for model selection. We improved on Bayesian Knowledge Tracing with models that treat help differently from mistakes, model all attempts, differentiate skill classes, and model forgetting. We discuss both the methodology we used and the insights we derived regarding student modeling in this novel domain.
KeywordsStudent modeling Intelligent tutoring systems Knowledge Tracing Methodology Decision theory Model evaluation Model selection Intelligent medical training systems Machine learning Probabilistic models Bayesian models Hidden Markov Models
Unable to display preview. Download preview PDF.