Summary
This chapter begins with a brief discussion of some problems associated with input data. Then different rule types are defined. Three representative rule induction methods: LEM1, LEM2, and AQ are presented. An idea of a classification system, where rule sets are utilized to classify new cases, is introduced. Methods to evaluate an error rate associated with classification of unseen cases using the rule set are described. Finally, some more advanced methods are listed.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Booker L.B., Goldberg D.E., and Holland J.F. Classifier systems and genetic algorithms. In Machine Learning. Paradigms and Methods, Carbonell, J. G. (ed.), The MIT Press, Boston, MA, 1990, 235–282.
Chan C.C. and Grzymala-Busse J.W. On the attribute redundancy and the learning programs ID3, PRISM, and LEM2. Department of Computer Science, University of Kansas, TR-91-14, December 1991, 20 pp.
Dietterich T.G. Machine-learning research. AI Magazine 1997: 97–136.
Grzymala-Busse J.W. Knowledge acquisition under uncertainty—A rough set approach. Journal of Intelligent & Robotic Systems 1988; 1: 3–16.
Grzymala-Busse J.W. LERS—A system for learning from examples based on rough sets. In Intelligent Decision Support. Handbook of Applications and Advances of the Rough Sets Theory, ed. by R. Slowinski, Kluwer Academic Publishers, Dordrecht, Boston, London, 1992, 3–18.
Grzymala-Busse J.W. A new version of the rule induction system LERS, Fundamenta Informaticae 1997; 31: 27–39.
Holland J.H., Holyoak K.J., and Nisbett R.E. Induction. Processes of Inference, Learning, and Discovery, MIT Press, Boston, MA, 1986.
Japkowicz N. Learning from imbalanced data sets: a comparison of various strategies. Learning from Imbalanced Data Sets, AAAI Workshop at the 17th Conference on AI, AAAI-2000, Austin, TX, July 30–31, 2000, 10–17.
Michalski R.S. A Theory and Methodology of Inductive Learning. In Machine Learning. An Artificial Intelligence Approach, Michalski, R. S., J. G. Carbonell and T. M. Mitchell (eds.), Morgan Kauffman, San Mateo, CA, 1983, 83–134.
Michalski R.S., Mozetic I., Hong J., Lavrac N. The AQ15 inductive learning system: An overview and experiments, Report 1260, Department of Computer Science, University of Illinois at Urbana-Champaign, 1986A.
Michalski R.S., Mozetic I., Hong J., Lavrac N. The multi-purpose incremental learning system AQ 15 and its testing application to three medical domains. Proc. of the 5th Nat. Conf. on AI, 1986B, 1041–1045.
Pawlak Z.: Rough Sets. International Journal of Computer and Information Sciences 1982; 11: 341–356.
Pawlak Z. Rough Sets. Theoretical Aspects of Reasoning about Data. Kluwer Academic Publishers, Dordrecht, Boston, London, 1991.
Pawlak Z., Grzymala-Busse J.W., Slowinski R. and Ziarko,W. Rough sets. Communications of the ACM 1995; 38: 88–95.
Rivest R.L. Learning decision lists. Machine Learning 1987; 2: 229–246.
Stefanowski J. Algorithms of Decision Rule Induction in Data Mining. Poznan University of Technology Press, Poznan, Poland, 2001.
Weiss S. and Kulikowski C.A. Computer Systems That Learn: Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning, and Expert Systems, chapter How to Estimate the True Performance of a Learning System, pp. 17–49, San Mateo, CA: Morgan Kaufmann Publishers, Inc., 1991.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
Grzymala-Busse, J.W. (2009). Rule Induction. In: Maimon, O., Rokach, L. (eds) Data Mining and Knowledge Discovery Handbook. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-09823-4_13
Download citation
DOI: https://doi.org/10.1007/978-0-387-09823-4_13
Published:
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-09822-7
Online ISBN: 978-0-387-09823-4
eBook Packages: Computer ScienceComputer Science (R0)