Abstract
We present results of using inductive logic programming (ILP) to produce learner models by behavioural cloning. Models obtained using a program for supervised induction of production rules (ripper) are compared to models generated using a well-known program for ILP (foil). It is shown that the models produced by foil are either too specific or too general, depending on whether or not auxiliary relations are applied. Three possible explanations for these results are: (1) there is no way of specifying to foil the minimum number of cases each clause must cover; (2) foil requires that all auxiliary relations be defined extensionally; and (3) the application domain (control of a pole on a cart) has continuous attributes. In spite of foil’s limitations, the models it produced using auxiliary relations meet one of the goals of our exploration: to obtain more structured learner models which are easier to comprehend.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Barto A.G., Sutton R.S., Anderson C.W.: Neuronlike adaptive elements that can solve difficult learning control problems. IEEE Transactions on Systems, Man and Cybernetics SMC-13 (1983) 834–846
Bratko I., Urbančič T., Sammut C.: Behavioural cloning of control skill. In: Michalski R.S., Bratko I., Kubat M. (eds.), Machine Learning and Data Mining: Methods and Applications. John Wiley & Sons (1997) 335–351
Chiu B.C., Webb G.I., Kuzmycz M.: A comparison of first-order and zeroth-order induction for Input-Output Agent Modelling. In: Jameson A., Paris C., Tasso C. (eds.), User Modeling: Proceedings of the Sixth International Conference, UM97. Springer Wien New York (1997) 347–358
Cohen W.W.: Fast effective rule induction. In: Prieditis A., Russell S. (eds.), Machine Learning: Proceedings of the Twelfth International Conference. Morgan Kaufmann (1995) Available as a WWW document from http://www.research.att.com/~wcohen/ripperd.html
Eastwood E.: Control theory and the engineer. Proceedings of the Institution of Electrical Engineers 115 (1968) 203–211
Gordon D.F., Subramanian D.: Cognitive modeling of action selection learning. In: Cottrell G.W. (ed.), Proceedings of the Eighteenth Annual Conference of the Cognitive Science Society. Lawrence Erlbaum Associates (1996)
Karalic A., Bratko I.: First order regression. Machine Learning 26 (1997) 147–176
Michie D., Bain M., Hayes-Michie J.: Cognitive models from subcognitive skills. In: McGhee J., Grimble M.J., Mowforth P. (eds.), Knowledge-Based Systems for Industrial Control. Peter Peregrinus, London (1990) 71–99
Michie D., Chambers R.A.: BOXES: An experiment in adaptive control. In: Dale E., Michie D. (eds.), Machine Intelligence, vol. 2. Oliver and Boyd, Edinburgh (1968) 137–152
Morales R.: Exploring Participative Learner Modelling and Its Effects on Learner Behaviour. Ph.D. thesis, University of Edinburgh, Department of Artificial Intelligence (2000)
Morales R., Pain H.: Modelling of novices’ control skills with machine learning. In: Kay J. (ed.), UM99 User Modeling: Proceedings of the Seventh International Conference. No. 407 in CISM Courses and Lectures, Springer Wien New York (1999) 159–168
Morales R., Pain H., Bull S., Kay J. (eds.): Proceedings of the Workshop on Open, Interactive, and Other Overt Approaches to Learner Modelling. AI-ED’99, Le Mans, France (1999).
Morales R., Pain H., Conlon T.: Understandable learner models for a sensorimotor control task. In: Gauthier G., Frasson C., VanLehn K. (eds.), Intelligent Tutoring Systems: Fifth International Conference, ITS’2000. No. 1839 in Lecture Notes in Computer Science, Springer Verlag (2000) 222–231
Moriarty D.E., Miikkulainen R.: Efficient reinforcement learning through symbiotic evolution. Machine Learning 22 (1996) 11–32
Quinlan J.R.: Learning logical definitions from relations. Machine Learning 5 (1990) 239–266
Quinlan J.R., Cameron-Jones M.: FOIL: A midterm report. In: Brazdil P.B. (ed.), Proceedings of the European Conference on Machine Learning. No. 667 in Lecture Notes in Computer Science, Springer Verlag (1993) 3–20
Self J.: The defining characteristics of intelligent tutoring systems research: ITSs care, precisely. International Journal of Arti.cial Intelligence in Education 10 (1999) 350–364
Self J.: Open sesame?: fifteen variations on the theme of openness in learning environments (aied’99 invited talk). AIED Resources 10 (1999) 1020–1029. WWW document at http://cbl.leeds.ac.uk/ijaied/abstracts/Vol10/self.html
Subramanian D.: Inducing hybrid models of task learning from visualmotor data. In: Gleitman L.R., Joshi A.K. (eds.), Proceedings of the Twenty Second Annual Conference of the Cognitive Science Society. Lawrence Erlbaum Associates (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Quintana, M.G., Morales, R. (2002). Modelling Learners of a Control Task with Inductive Logic Programming: A Case Study. In: Coello Coello, C.A., de Albornoz, A., Sucar, L.E., Battistutti, O.C. (eds) MICAI 2002: Advances in Artificial Intelligence. MICAI 2002. Lecture Notes in Computer Science(), vol 2313. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-46016-0_24
Download citation
DOI: https://doi.org/10.1007/3-540-46016-0_24
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43475-7
Online ISBN: 978-3-540-46016-9
eBook Packages: Springer Book Archive