A Comparison of Decision-Theoretic, Fixed-Policy and Random Tutorial Action Selection
DT Tutor (DT), an ITS that uses decision theory to select tutorial actions, was compared with both a Fixed-Policy Tutor (FT) and a Random Tutor (RT). The tutors were identical except for the method they used to select tutorial actions: FT employed a common fixed policy while RT selected randomly from relevant actions. This was the first comparison of a decision-theoretic tutor with a non-trivial competitor (FT). In a two-phase study, first DT’s probabilities were learned from a training set of student interactions with RT. Then a panel of judges rated the actions that RT took along with the actions that DT and FT would have taken in identical situations. DT was rated higher than RT and also higher than FT both overall and for all subsets of scenarios except help requests, for which DT’s and FT’s ratings were equivalent.
KeywordsAction Selection Current Step Cognitive Tutor Composite Rating Null Response
Unable to display preview. Download preview PDF.
- 4.Pearl, J.: Probabilistic reasoning in intelligent systems: Networks of plausible inference. Morgan Kaufmann, San Francisco (1988)Google Scholar
- 6.Lepper, M.R., Woolverton, M., Mumme, D.L., Gurtner, J.-L.: Motivational techniques of expert human tutors: Lessons for the design of computer-based tutors. In: Lajoie, S.P., Derry, S.J. (eds.) Computers as Cognitive Tools, pp. 75–105. Erlbaum, Mahwah (1993)Google Scholar
- 7.Reye, J.: A goal-centred architecture for intelligent tutoring systems. In: Greer, J. (ed.) 7th World Conference on Artificial Intelligence in Education, pp. 307–314 (1995)Google Scholar
- 9.Murray, R.C., VanLehn, K., Mostow, J.: Looking ahead to select tutorial actions: A decision-theoretic approach. International Journal of Artificial Intelligence in Education 14(3-4), 235–278 (2004)Google Scholar
- 10.Mayo, M., Mitrovic, A.: Optimising ITS behaviour with Bayesian networks and decision theory. International Journal of Artificial Intelligence in Education 12, 124–153 (2001)Google Scholar
- 11.Pek, P.-K.: Decision-Theoretic Intelligent Tutoring System. PhD dissertation, National University of Singapore, Department of Industrial & Systems Engineering (2003), ftp://ftp.medcomp.comp.nus.edu.sg/pub/pohkl/pekpk-thesis-2003.pdf
- 14.Anderson, J.R., Lebiere, C.: The atomic components of thought. Erlbaum, NJ (1998)Google Scholar
- 15.Koedinger, K.R., Anderson, J.R., Hadley, W.H., Mark, M.A.: Intelligent tutoring goes to school in the big city. International Journal of Artificial Intelligence in Education 8, 30–43 (1997)Google Scholar
- 16.Fox, B.A.: The Human Tutorial Dialogue Project: Issues in the Design of Instructional Systems. Lawrence Erlbaum Associates, Hillsdale (1993)Google Scholar
- 17.Murray, R.C.: An evaluation of decision-theoretic tutorial action selection. PhD dissertation, University of Pittsburgh, Intelligent Systems Program (2005), http://etd.library.pitt.edu/ETD/available/etd-08182005-131235/
- 18.Mostow, J., Huang, C., Tobin, B.: Pause the Video: Quick but quantitative ex-pert evaluation of tutorial choices in a Reading Tutor that listens. In: Moore, J.D., Red-field, C.L., Johnson, W.L. (eds.) 10th International Conference on Artificial Intelligence in Education, pp. 343–353 (2001)Google Scholar