Rule combination in inductive learning

  • Luis Torgo
Position Papers Inductive Learning and Applications
Part of the Lecture Notes in Computer Science book series (LNCS, volume 667)


This paper describes the work on methods for combining rules obtained by machine learning systems. Three methods for obtaining the classification of examples with those rules are compared. The advantages and disadvantages of each method are discussed and the results obtained on three real world domains are commented. The methods compared are: selection of the best rule; PROSPECTOR-like probabilistic approximation for rule combination; and MYCIN-like approximation. Results show significant differences between methods indicating that the problem-solving strategy is important for accuracy oflearning systems.


  1. 1.
    Bergadano, F., Matwin,S., Michalski,R. Zhang,J.: “Measuring Quality of Concept Descriptions”, in EWSL88 — European Working Session on Learning, Pitman, 1988.Google Scholar
  2. 2.
    Brazdil,P., Gams,M., Sian,S., Torgo,L., Van de Velde,W.: “Learning in Distributed Systems and Multi-Agent Environments”, in Machine Learning-EWSL91,European Working Session on Learning, Kodratoff,Y. (Ed), Lecture Notes on Artificial Intelligence, Springer Verlag, 1991.Google Scholar
  3. 3.
    Brazdil,P., Torgo,L.: “Knowledge Acquisition via Knowledge Integration”, in Current Trends in Knowledge Acquisition, IOS Press, 1990.Google Scholar
  4. 4.
    Shafer, G.: A Mathematical Theory of Evidence, Priceton University Press, Princeton, 1976.Google Scholar
  5. 5.
    Duda,R., Hart,P., Nilsson,N.: “Subjective Bayesian methods for rule-based inference systems”, in Proceedings of the AFIPS National Computer Conference, vol. 47, pp. 1075–1082.Google Scholar
  6. 6.
    Gams,M., Bohanec,M., Cestnik,B.: “A Schema for Using Multiple Knowledge”, Josef Stefan Institute, 1991.Google Scholar
  7. 7.
    Heckerman,D.: “Probabilistic interpretation for MYCIN's certainty factors”, in Uncertainty in Artificial Intelligence, Kanal,L. et al.(eds.), North-Holland, 1986.Google Scholar
  8. 8.
    Kouba,Z.: “Data Analysis and Uncertainty Processing”, in Advanced Topics in Artificial Intelligence, Marik,V. et al. (eds.), Lectures Notes in Artificial Intelligence, Springer-Verlag, 1992.Google Scholar
  9. 9.
    Mántaras,R.,: Approximate Reasoning Methods, Ellis Howood Limited, 1990.Google Scholar
  10. 10.
    Pearl, J.: Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, Morgan Kaufmann Publishers, 1988.Google Scholar
  11. 11.
    Shortliffe,E., Buchanan,B., “A Model of Inexact Reasoning in Medicine”, in Mathematical Biosciences, 23, 1975.Google Scholar
  12. 12.
    Torgo,L: YAILS an incremental learning program, LIACC-ML Group, Internal report n389-01 92.1, 1992.Google Scholar
  13. 13.
    Torgo,L.: “Controlled Redundancy in Incremtnal Rule Learning”, in this volume.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1993

Authors and Affiliations

  • Luis Torgo
    • 1
  1. 1.LIACCPortoPortugal

Personalised recommendations