This chapter begins with a brief discussion of some problems associated with input data. Then different rule types are defined. Three representative rule induction methods: LEM1, LEM2, and AQ are presented. An idea of a classification system, where rule sets are utilized to classify new cases, is introduced. Methods to evaluate an error rate associated with classification of unseen cases using the rule set are described. Finally, some more advanced methods are listed.
Key wordsRule induction algorithms LEM1 LEM2, and AQ LERS Data Mining system LERS classification system rule set types discriminant rule sets validation
Unable to display preview. Download preview PDF.
- Booker L.B., Goldberg D.E., and Holland J.F. Classifier systems and genetic algorithms. In Machine Learning. Paradigms and Methods, Carbonell, J. G. (ed.), The MIT Press, Boston, MA, 1990, 235–282.Google Scholar
- Chan C.C. and Grzymala-Busse J.W. On the attribute redundancy and the learning programs ID3, PRISM, and LEM2. Department of Computer Science, University of Kansas, TR-91-14, December 1991, 20 pp.Google Scholar
- Dietterich T.G. Machine-learning research. AI Magazine 1997: 97–136.Google Scholar
- Grzymala-Busse J.W. LERS—A system for learning from examples based on rough sets. In Intelligent Decision Support. Handbook of Applications and Advances of the Rough Sets Theory, ed. by R. Slowinski, Kluwer Academic Publishers, Dordrecht, Boston, London, 1992, 3–18.Google Scholar
- Holland J.H., Holyoak K.J., and Nisbett R.E. Induction. Processes of Inference, Learning, and Discovery, MIT Press, Boston, MA, 1986.Google Scholar
- Japkowicz N. Learning from imbalanced data sets: a comparison of various strategies. Learning from Imbalanced Data Sets, AAAI Workshop at the 17th Conference on AI, AAAI-2000, Austin, TX, July 30–31, 2000, 10–17.Google Scholar
- Michalski R.S. A Theory and Methodology of Inductive Learning. In Machine Learning. An Artificial Intelligence Approach, Michalski, R. S., J. G. Carbonell and T. M. Mitchell (eds.), Morgan Kauffman, San Mateo, CA, 1983, 83–134.Google Scholar
- Michalski R.S., Mozetic I., Hong J., Lavrac N. The AQ15 inductive learning system: An overview and experiments, Report 1260, Department of Computer Science, University of Illinois at Urbana-Champaign, 1986A.Google Scholar
- Michalski R.S., Mozetic I., Hong J., Lavrac N. The multi-purpose incremental learning system AQ 15 and its testing application to three medical domains. Proc. of the 5th Nat. Conf. on AI, 1986B, 1041–1045.Google Scholar
- Stefanowski J. Algorithms of Decision Rule Induction in Data Mining. Poznan University of Technology Press, Poznan, Poland, 2001.Google Scholar
- Weiss S. and Kulikowski C.A. Computer Systems That Learn: Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning, and Expert Systems, chapter How to Estimate the True Performance of a Learning System, pp. 17–49, San Mateo, CA: Morgan Kaufmann Publishers, Inc., 1991.Google Scholar