MC-TopLog: Complete Multi-clause Learning Guided by a Top Theory
Within ILP much effort has been put into designing methods that are complete for hypothesis finding. However, it is not clear whether completeness is important in real-world applications. This paper uses a simplified version of grammar learning to show how a complete method can improve on the learning results of an incomplete method. Seeing the necessity of having a complete method for real-world applications, we introduce a method called ⊤-directed theory co-derivation, which is shown to be correct (ie. sound and complete). The proposed method has been implemented in the ILP system MC-TopLog and tested on grammar learning and the learning of game strategies. Compared to Progol5, an efficient but incomplete ILP system, MC-TopLog has higher predictive accuracies, especially when the background knowledge is severely incomplete.
KeywordsBackground Knowledge Logic Program Hypothesis Space Common Generalisation Recursive Theory
Unable to display preview. Download preview PDF.
- 6.Kedar-Cabelli, S.T., McCarty, L.T.: Explanation-based generalization as resolution theorem proving. In: Proceedings of ICML 1987, pp. 383–389. Morgan Kaufmann, Los Altos (1987)Google Scholar
- 8.Lin, D.: Efficient, complete and declarative search in inductive logic programming. Master’s thesis, Imperial College London (September 2009)Google Scholar
- 9.Lin, D., Chen, J., Watanabe, H., Muggleton, S.H., Jain, P., Sternberg, M., Baxter, C., Currie, R., Dunbar, S., Earll, M., Salazar, D.: Does Multi-clause Learning Help in Real-world Applications? In: Muggleton, S.H., Tamaddoni-Nezhad, A., Lisi, F.A. (eds.) ILP 2011. LNCS (LNAI), vol. 7207, pp. 222–238. Springer, Heidelberg (2012)Google Scholar
- 13.Muggleton, S.H., Feng, C.: Efficient induction of logic programs. In: ALT 1990, pp. 368–381. Ohmsha, Tokyo (1990)Google Scholar
- 16.Muggleton, S.H., Xu, C.: Can ILP learn complete and correct game strategies? In: Late-breaking Proceedings of ILP. Imperial College London Press (2011)Google Scholar
- 17.Plotkin, G.D.: Automatic Methods of Inductive Inference. PhD thesis, Edinburgh University (August 1971)Google Scholar
- 19.De Raedt, L., Lavrac, N., Dzeroski, S.: Multiple predicate learning. In: IJCAI, pp. 1037–1043 (1993)Google Scholar
- 21.Reynolds, J.C.: Transformational systems and the algebraic structure of atomic formulas. In: Meltzer, B., Michie, D. (eds.) Machine Intelligence, vol. 5, pp. 135–151. Edinburgh University Press, Edinburgh (1969)Google Scholar