A Memetic Approach for the Knowledge Extraction

  • Sadjia Benkhider
  • Oualid Dahmri
  • Habiba Drias
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7663)


This paper provides a memetic approach in order to extract comprehensible and accurate classification rules. Indeed to construct a model of classification we need to extract not only accurate rules but comprehensible also, to help the human interpretation of the model and the decision make process. In this paper we describe a purely genetic approach, then a tabu search approach and finaly a memetic algorithm to extract classification rules. The memetic approach is a hybridization of a genetic algorithm and a local search based on a tabu search algorithm. Many conducted tests on the well-known UCI (University of California Irvine) benchmarks are presented and a comparative study of the obtained results with the three approaches is also presented. The paper will conclude by giving a discussion on the obtained results for the three approaches and some future works.


Classification Extraction of Rules Memetic Algorithm Genetic Algorithm Tabu Search Algorithm Michigan Approach 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Cios, K.J., Pedryecz, W., Swinniarsky, W., Kurgan, L.A.: Data Mining: A Knowledge Discovery Approach. Springer, New York (2007)zbMATHGoogle Scholar
  2. 2.
    Jain, A.K., Dubes, R.C.: Algorithms for Clustering Data. Editions Prentice Hall Advanced Reference Series. Prentice Hall, New Jersey (1988)zbMATHGoogle Scholar
  3. 3.
    Berry, M., Linof, G.: Data mining techniques, for Marketing, Sales and Customer Relationship Management. John Wiley Publishing, New Jersey (2004)Google Scholar
  4. 4.
    Blum, C., Roli, A.: Metaheuristics in Combinatorial Optimization: Overview and Conceptual Comparison. ACM Comput. Surv. 35, 268–308 (2003)CrossRefGoogle Scholar
  5. 5.
    Goldberg, D.E.: Genetic Algorithms in Search, Optimization, and Machine Learning. Addison Wesley, Massachusetts (1989)zbMATHGoogle Scholar
  6. 6.
    Bacardit, J.: Pittsburgh Genetic-Based Machine Learning in the Data Mining era: Representations, Generalization, and Run-time. Phd Thesis, Universitat Ramon LIul, Spain (2004)Google Scholar
  7. 7.
    Witten, I.H.: Data Mining: Practical Machine Learning Tools and Techniques with JAVA Implementations. Morgan Kaufman Publishers, San Mateo (2003)Google Scholar
  8. 8.
    Blake, C.L., Merz, C.J.: UCI Repository of Machine Learning Databases (1998)Google Scholar
  9. 9.
    Kohavi, R.: A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection. In: Mellosh, Cs. (ed.) Proceedings of the 14th International Joint Conf. of Artificial Intelligence, pp. 1137–1143. Morgan Kaufmann publishers, San Mateo (1995)Google Scholar
  10. 10.
    Weiss, S.M., Kulikowski, C.A.: Computer Systems that Learn, Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning and Expert Systems. Morgan Kaufmann Publishers, San Mateo (1991)Google Scholar
  11. 11.
    Holland, J.H.: Adaptation in Natural and Artificial Systems. The University of Michigan Press, Ann Arbor (1975)Google Scholar
  12. 12.
    Benkhider, S., Baba-Ali, A.R., Drias, H.: A New Generationless Parallel Evolutionary Approach for Combinatorial Optimization. In: IEEE Congress on Evolutionary Computation CEC, pp. 4691–4697. IEEE Press, New York (2007)CrossRefGoogle Scholar
  13. 13.
    Tan, K.C., Yu, Q., Ang, J.H.: A Dual-Objective Evolutionary Algorithm for Rules Extraction in Data Mining. Comput. Optim. Appl. 34, 273–294 (2006)MathSciNetzbMATHCrossRefGoogle Scholar
  14. 14.
    Holden, N., Freitas, A.A.: A Hybrid PSO/ACO Algorithm for Discovering Classification Rules in Data Mining. J. Artif. Evol. Appl., 1–11 (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Sadjia Benkhider
    • 1
  • Oualid Dahmri
    • 2
  • Habiba Drias
    • 1
  1. 1.LRIA, Computer Science DepartmentUniversity of Sciences and Technology USTHBAlgiersAlgeria
  2. 2.Computer Science DepartmentUniversity of Sciences and Technology USTHBAlgiersAlgeria

Personalised recommendations