Abstract
The article describes a method combining two widely-used empirical approaches: rule induction and instance-based learning. In our algorithm (RIONA) decision is predicted not on the basis of the whole support set of all rules matching a test case, but the support set restricted to a neighbourhood of a test case. The size of the optimal neighbourhood is automatically induced during the learning phase. The empirical study shows the interesting fact that it is enough to consider a small neighbourhood to preserve classification accuracy. The combination of k-NN and a rule-based algorithm results in a significant acceleration of the algorithm using all minimal rules. We study the significance of different components of the presented method and compare its accuracy to well-known methods.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Bazan, J. G. (1998). Discovery of decision rules by matching new objects against data tables. In: L. Polkowski, A. Skowron (eds.), Proceedings of the First International Conference on Rough Sets and Current Trends in Computing (RSCTC-98), pages 521–528, Warsaw, Poland.
Blake, C. L., Merz, C. J. (1998). UCI Repository of machine learning databases [http://www.ics.uci.edu/~mlearn/MLRepository.html], Department of Information and Computer Science, Irvine, CA: University of California.
Cost, S. and Salzberg, S. (1993). A weighted nearest neighbor algorithm for learning with symbolic features. Machine Learning, 10, pages 57–78.
Domingos, P. (1996). Unifying instance-based and rule-based induction. Machine Learning, 24(2), pages 141–168.
Duda, R. O. and Hart, P. E. (1973). Pattern classification and scene analysis. New York, NY: Wiley.
Golding, A. R., Rosenbloom, P. S. (1991). Improving rule-based systems through case-based reasoning. Proceedings of AAAI-91, pages 22–27, Anaheim, CA.
Li, J., Ramamohanarao, K. and Dong, G. (2001). Combining the strength of pattern frequency and distance for classification. The Fifth Pacific-Asia Conference On Knowledge Discovery and Data Mining, pages 455–466, Hong Kong.
Li, J., Dong, G., Ramamohanaro, K. and Wong, L. (2001). DeEPs: A new instancebased discovery and classification system. [http://sdmc.krdl.org.sg:8080/~limsoon/limsoonpapers.html], School of Computing, National University of Singapore.
Michalski, R. S., Mozetic, I., Hong, J. and Lavrac, N. (1986) The Multi-Purpose Incremental Learning System AQ15 and its Testing to Three Medical Domains. Proceedings of AAAI-86, pages 1041–1045, San Mateo: Morgan Kaufmann.
Mitchell T. M. (1997). Machine learning. Portland: McGraw-Hill.
Schaffer, C. (1994). A conservation law for generalisation performance. Proceedings of the Twelfth International Conference on Machine Learning, pages 259–265, New Brunswick, NJ: Morgan Kaufmann.
Wettschereck, D. (1994). A study of Distance-Based Machine Learning Algorithms. Doctor of Philosophy dissertation in Computer Science, Oregon State University.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Góra, G., Wojna, A. (2002). RIONA: A Classifier Combining Rule Induction and k-NN Method with Automated Selection of Optimal Neighbourhood. In: Elomaa, T., Mannila, H., Toivonen, H. (eds) Machine Learning: ECML 2002. ECML 2002. Lecture Notes in Computer Science(), vol 2430. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36755-1_10
Download citation
DOI: https://doi.org/10.1007/3-540-36755-1_10
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44036-9
Online ISBN: 978-3-540-36755-0
eBook Packages: Springer Book Archive