The Effect of Model Granularity on Student Performance Prediction Using Bayesian Networks
A standing question in the field of Intelligent Tutoring Systems and User Modeling in general is what is the appropriate level of model granularity (how many skills to model) and how is that granularity derived? In this paper we will explore models with varying levels of skill generality (1, 5, 39 and 106 skill models) and measure the accuracy of these models by predicting student performance within our tutoring system called ASSISTment as well as their performance on a state standardized test. We employ the use of Bayes nets to model user knowledge and to use for prediction of student responses. Our results show that the finer the granularity of the skill model, the better we can predict student performance for our online data. However, for the standardized test data we received, it was the 39 skill model that performed the best. We view this as support for fine-grained skill models despite the finest grain model not predicting the state test scores the best.
KeywordsBayesian Network Skill Model Intelligent Tutor System Slip Parameter Model Granularity
Unable to display preview. Download preview PDF.
- 1.Anozie, N., Junker, B.W.: Predicting end-of-year accountability assessment scores from monthly student records in an online tutoring system. In: Beck, J., Aimeur, E., Barnes, T. (eds.) Educational Data Mining: Papers from the AAAI Workshop, Technical Report WS-06-05, Menlo Park, pp. 1–6. AAAI Press, Stanford, California, USA (2006)Google Scholar
- 2.Ayers, E., Junker, B.W.: Do skills combine additively to predict task difficulty in eighth grade mathematics? In: Beck, J., Aimeur, E., Barnes, T. (eds.) Educational Data Mining: Papers from the AAAI Workshop, Technical Report WS-06-05, Menlo Park, pp. 14–20. AAAI Press, Stanford, California, USA (2006)Google Scholar
- 3.Carmona, C., Millán, E., Pérez-de-la-Cruz, J.L., Trella, M., Conejo, R.: Introducing Prerequisite Relations in a Multi-layered Bayesian Student Model. In: Ardissono, B., Mitrovic (eds.) User Modeling 2005. 10th International Conference, pp. 347–356. Springer, Heidelberg (2005)Google Scholar
- 5.Feng, M., Heffernan, N.T., Mani, M., Heffernan, C.: Using Mixed-Effects Modeling to Compare Different Grain-Sized Skill Models. In: Beck, J., Aimeur, E., & Barnes, T (Eds). Educational Data Mining: Papers from the AAAI Workshop. Menlo Park, CA: AAAI Press. pp. 57-66. Technical Report WS-06-05. ISBN 978-1-57735-287-7 (2006)Google Scholar
- 6.McCalla, G.I., Greer, J.E.: Granularity– based reasoning and belief revision in student models. In: Greer, J.E., McCalla, G.I. (eds.) Student Modelling: The Key to Individualized Knowledge–Based Instruction, pp. 39–62. Springer, Berlin (1994)Google Scholar
- 8.Pardos, Z.A., Heffernan, N.T., Anderson, B., Heffernan, C.L.: Using Fine-Grained Skill Models to Fit Student Performance with Bayesian Networks. In: Workshop in Educational Data Mining held at the Eight International Conference on Intelligent Tutoring Systems. Taiwan (2006)Google Scholar