Abstract
This paper provides a memetic approach in order to extract comprehensible and accurate classification rules. Indeed to construct a model of classification we need to extract not only accurate rules but comprehensible also, to help the human interpretation of the model and the decision make process. In this paper we describe a purely genetic approach, then a tabu search approach and finaly a memetic algorithm to extract classification rules. The memetic approach is a hybridization of a genetic algorithm and a local search based on a tabu search algorithm. Many conducted tests on the well-known UCI (University of California Irvine) benchmarks are presented and a comparative study of the obtained results with the three approaches is also presented. The paper will conclude by giving a discussion on the obtained results for the three approaches and some future works.
Keywords
- Classification
- Extraction of Rules
- Memetic Algorithm
- Genetic Algorithm
- Tabu Search Algorithm
- Michigan Approach
This is a preview of subscription content, access via your institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Cios, K.J., Pedryecz, W., Swinniarsky, W., Kurgan, L.A.: Data Mining: A Knowledge Discovery Approach. Springer, New York (2007)
Jain, A.K., Dubes, R.C.: Algorithms for Clustering Data. Editions Prentice Hall Advanced Reference Series. Prentice Hall, New Jersey (1988)
Berry, M., Linof, G.: Data mining techniques, for Marketing, Sales and Customer Relationship Management. John Wiley Publishing, New Jersey (2004)
Blum, C., Roli, A.: Metaheuristics in Combinatorial Optimization: Overview and Conceptual Comparison. ACM Comput. Surv. 35, 268–308 (2003)
Goldberg, D.E.: Genetic Algorithms in Search, Optimization, and Machine Learning. Addison Wesley, Massachusetts (1989)
Bacardit, J.: Pittsburgh Genetic-Based Machine Learning in the Data Mining era: Representations, Generalization, and Run-time. Phd Thesis, Universitat Ramon LIul, Spain (2004)
Witten, I.H.: Data Mining: Practical Machine Learning Tools and Techniques with JAVA Implementations. Morgan Kaufman Publishers, San Mateo (2003)
Blake, C.L., Merz, C.J.: UCI Repository of Machine Learning Databases (1998)
Kohavi, R.: A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection. In: Mellosh, Cs. (ed.) Proceedings of the 14th International Joint Conf. of Artificial Intelligence, pp. 1137–1143. Morgan Kaufmann publishers, San Mateo (1995)
Weiss, S.M., Kulikowski, C.A.: Computer Systems that Learn, Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning and Expert Systems. Morgan Kaufmann Publishers, San Mateo (1991)
Holland, J.H.: Adaptation in Natural and Artificial Systems. The University of Michigan Press, Ann Arbor (1975)
Benkhider, S., Baba-Ali, A.R., Drias, H.: A New Generationless Parallel Evolutionary Approach for Combinatorial Optimization. In: IEEE Congress on Evolutionary Computation CEC, pp. 4691–4697. IEEE Press, New York (2007)
Tan, K.C., Yu, Q., Ang, J.H.: A Dual-Objective Evolutionary Algorithm for Rules Extraction in Data Mining. Comput. Optim. Appl. 34, 273–294 (2006)
Holden, N., Freitas, A.A.: A Hybrid PSO/ACO Algorithm for Discovering Classification Rules in Data Mining. J. Artif. Evol. Appl., 1–11 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Benkhider, S., Dahmri, O., Drias, H. (2012). A Memetic Approach for the Knowledge Extraction. In: Huang, T., Zeng, Z., Li, C., Leung, C.S. (eds) Neural Information Processing. ICONIP 2012. Lecture Notes in Computer Science, vol 7663. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34475-6_17
Download citation
DOI: https://doi.org/10.1007/978-3-642-34475-6_17
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34474-9
Online ISBN: 978-3-642-34475-6
eBook Packages: Computer ScienceComputer Science (R0)
