Learning Comprehensible Theories from Structured Data

  • J.W. Lloyd
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2600)


This tutorial discusses some knowledge representation issues in machine learning. The focus is on machine learning applications for which the individuals that are the subject of learning have complex structure. To represent such individuals,a rich knowledge representation language based on higher-order logic is introduced. The logic is also employed to construct comprehensible hypotheses that one might want to learn about the individuals. The tutorial introduces the main ideas of this approach to knowledge representation in a mostly informal way and gives a number of illustrations. The application of the ideas to decision-tree learning is also illustrated with an example.


Logic Program Knowledge Representation Relative Type Basic Term Intended Meaning 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    A.F. Bowers, C. Giraud-Carrier,and J.W. Lloyd.Classification of individuals with complex structure. In P. Langley, editor,Machine Learning:Proceedings of the Seventeenth International Conference (ICML2000), pages 81–88. Morgan Kaufmann,2000.Google Scholar
  2. 2.
    A. F. Bowers, C. Giraud-Carrier,and J.W. Lloyd. A knowledge representation framework for inductive learning., 2001.
  3. 3.
    A. Church. A formulation of the simple theory of types. Journal of Symbolic Logic, 5:56–68, 1940.zbMATHCrossRefMathSciNetGoogle Scholar
  4. 4.
    T.G. Dietterich, R.H. Lathrop, and T. Lozano-Pℰez. Solving the multiple instance problem with axis-parallel rectangles. Artificial Intelligence, 89: 31–71, 1997.zbMATHCrossRefGoogle Scholar
  5. 5.
    P. Finn, S. Muggleton, D. Page, and A. Srinivasan. Pharmacophore discovery using the inductive logic programming system PROGOL. Machine Learning, 30:241–270, 1998.CrossRefGoogle Scholar
  6. 6.
    T. Gäartner, J.W. Lloyd, and P. Flach. Kernels for structured data.In Proceeedings of the 12th International Conference on Inductive Logic Programming (ILP2002). Springer-Verlag, 2002. Lecture Notes in Computer Science.Google Scholar
  7. 7.
    D. Haussler.Convolution kernels on discrete structures. Technical Report UCSC-CRL-99-10, University of California in Santa Cruz, Department of Computer Science,1999.Google Scholar
  8. 9.
    J.W. Lloyd. Programming in an integrated functional and logic language. Journal of Functional and Logic Programming, 1999(3), March 1999.Google Scholar
  9. 10.
    J.W. Lloyd. Knowledge representation,computation, and learning in higher-order logic., 2001.
  10. 11.
    J.W. Lloyd. Higher-order computational logic. In A. Kakas and F. Sadri, editors, Computational Logic:Logic Programming and Beyond, pages 105–137. Springer-Verlag, LNAI 2407, 2002. Essays in Honour of Robert A.Kowalski, Part I.Google Scholar
  11. 12.
    J.W. Lloyd. Predicate construction in higher-order logic. Electronic Transactions on Artificial Intelligence, 4(2000): 21–51, Section B.
  12. 13.
    T.M. Mitchell.Machine Learning. McGraw-Hill, 1997.Google Scholar
  13. 14.
    S. Muggleton. Inductive logic programming. New Generation Computing, 8(4):295–318, 1991.zbMATHCrossRefGoogle Scholar
  14. 15.
    S. Muggleton and L. De Raedt. Inductive logic programming:Theory and methods. Journal of Logic Programming, 19/20: 629–679, 1994.CrossRefMathSciNetGoogle Scholar
  15. 16.
    S.H. Nienhuys-Cheng and R. deWolf. Foundations of Inductive Logic Programming. Lecture Notes in Arti.cial Intelligence,1228. Springer-Verlag, 1997.Google Scholar
  16. 17.
    B. Schölkopf and A. Smola. Learning with Kernels.MIT Press, 2002.Google Scholar
  17. 18.
    Home page of Machine Learning Group,The University of York.

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • J.W. Lloyd
    • 1
  1. 1.Research School of Information Sciences and Engineering, The Australian National UniversityCanberraAustralia

Personalised recommendations