Abstract
Rules are a type of human-understandable knowledge, and rule-based methods are very popular in building decision support systems. However, most current rule based classification systems build small classifiers where no rules account for exceptional instances and a default prediction plays a major role in the prediction. In this paper, we discuss two schemes to build rule based classifiers using multiple and negative target rules. In such schemes, negative rules pick up exceptional instances and multiple rules provide alternative predictions. The default prediction is removed and hence all predictions relate to rules providing explanations for the predictions. One risk for building a large rule based classifier is that it may overfit training data and results in low predictive accuracy. We show experimentally that one classifier is more accurate than a benchmark rule based classifier, C4.5rules.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Blake, E.K.C., Merz, C.J.: UCI repository of machine learning databases (1998), http://www.ics.uci.edu/~mlearn/MLRepository.html
Clark, P., Boswell, R.: Rule induction with CN2: Some recent improvements. In: Machine Learning - EWSL 1991, pp. 151–163 (1991)
Clark, P., Niblett, T.: The CN2 induction algorithm. Machine Learning 3(4), 261–283 (1989)
Li, J., Shen, H., Topor, R.: Mining the optimal class association rule set. Knowledge-Based System 15(7), 399–405 (2002)
Li, W., Han, J., Pei, J.: CMAR: Accurate and efficient classification based on multiple class-association rules. In: Proceedings 2001 IEEE International Conference on Data Mining (ICDM 2001), pp. 369–376. IEEE Computer Society Press, Los Alamitos (2001)
Liu, B., Hsu, W., Ma, Y.: Integrating classification and association rule mining. In: Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining (KDD 1998), pp. 27–31 (1998)
Liu, B., Ma, Y., Wong, C.: Improving an association rule based classifier. In: 4th European Conference on Principles and Practice of Knowledge Discovery in Databases PKDD, pp. 504–509 (2000)
Michalski, R., Mozetic, I., Hong, J., Lavrac, N.: The AQ15 inductive learning system: an overview and experiments. In: Proceedings of IMAL 1986, Orsay, Université de Paris-Sud (1986)
Quinlan, J.R.: C4.5. In: Programs for Machine Learning, Morgan Kaufmann, San Mateo (1993)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Li, J., Jones, J. (2006). Classification Using Multiple and Negative Target Rules. In: Gabrys, B., Howlett, R.J., Jain, L.C. (eds) Knowledge-Based Intelligent Information and Engineering Systems. KES 2006. Lecture Notes in Computer Science(), vol 4251. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11892960_26
Download citation
DOI: https://doi.org/10.1007/11892960_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-46535-5
Online ISBN: 978-3-540-46536-2
eBook Packages: Computer ScienceComputer Science (R0)