Skip to main content

Advertisement

SpringerLink
Log in

Evolutionary multi objective optimization for rule mining: a review

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

Evolutionary multi objective optimization (EMOO) systems are evolutionary systems which are used for optimizing various measures of the evolving system. Rule mining has gained attention in the knowledge discovery literature. The problem of discovering rules with specific properties is treated as a multi objective optimization problem. The objectives to be optimized being the metrics like accuracy, comprehensibility, surprisingness, novelty to name a few. There are a variety of EMOO algorithms in the literature. The performance of these EMOO algorithms is influenced by various characteristics including evolutionary technique used, chromosome representation, parameters like population size, number of generations, crossover rate, mutation rate, stopping criteria, Reproduction operators used, objectives taken for optimization, the fitness function used, optimization strategy, the type of data, number of class attributes and the area of application. This study reviews EMOO systems taking the above criteria into consideration. There are other hybridization strategies like use of intelligent agents, fuzzification, meta data and meta heuristics, parallelization, interactiveness with the user, visualization, etc., which further enhance the performance and usability of the system. Genetic Algorithms (GAs) and Genetic Programming (GPs) are two widely used evolutionary strategies for rule knowledge discovery in Data mining. Thus the proposed study aims at studying the various characteristics of the EMOO systems taking into consideration the two evolutionary strategies of Genetic Algorithm and Genetic programming.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Abe H, Tsumoto S (2008) Analyzing correlation coefficients of objective rule evaluation indices on classification rules. In: Wang G, et al (eds) RSKT 2008, LNAI 5009. Springer, Berlin, pp 467–474

  • Baykasoglu A, Ozbakir L (2007) MEPAR-miner: multi-expression programming for classification rule mining. Eur J Oper Res 183:767–784

    Article  MATH  Google Scholar 

  • Berlanga F, del Jesus MJ, Gonzalez P, Herrera F, Mesonero M (2006) Multi-objective evolutionary induction of subgroup discovery fuzzy rules: a case study in marketing. In: Perner P (ed) ICDM 2006, LNAI 4065. Springer, Berlin, pp 337–349

  • Cao L (2009) Introduction to agent mining interaction and integration. In: Cao L (eds) Data mining and multiagent integration, LLC 2009. Springer, Berlin, pp 3–36

    Chapter  Google Scholar 

  • Casillas J, Orriols-Puig A, Bernad′o-Mansilla E (2008) Toward evolving consistent, complete, and compact fuzzy rule sets for classification problems. In: proceedings of 3rd international workshop on genetic and evolving fuzzy systems, Witten-Bommerholz, Germany, pp 89–94

  • Casillas J, Pedro Martinez AE, Benitez Alicia D (2009) Learning consistent, complete and compact sets of fuzzy rules in conjunctive normal form for regression problems. Soft Comput 13:419–465

    Article  Google Scholar 

  • Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast and elitist multi-objective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6(2): 182–197

    Article  Google Scholar 

  • Dehuri S, Mall R (2006) Predictive and comprehensible rule discovery using a multi-objective genetic algorithm. Knowl Syst 19:413–421

    Article  Google Scholar 

  • De la Iglesia B, Philpott MS, Bagnall AJ, Rayward-Smith VJ (2003) Data mining rules using multi-objective evolutionary algorithms. In: proceedings of 2003 IEEE congress on evolutionary computation, pp 1552–1559

  • De la Iglesia B, Reynolds Alan, Rayward-Smith Vic J (2005) Developments on a multi-objective metaheuristic (MOMH) algorithm for finding interesting sets of classification rules. In: proceedings of third international conference on evolutionary multi-criterion optimization, EMO 2005, LNCS 3410. Springer, Berlin, pp 826–840

  • Del Jesus MJ, Gonzalez P, Herrera F, Mesonero M (2005) Evolutionary induction of descriptive rules in a market problem. Stud Comput Intell (SCI) 5:267–292

    Google Scholar 

  • Del Jesus MJ, Gonzalez P, Herrera F (2007) Multi-objective genetic algorithm for extracting subgroup discovery fuzzy rules. In: proceedings of the 2007 IEEE symposium on computational intelligence in multi-criteria decision making (MCDM 2007), pp 50–57

  • Freitas AA (2004) A critical review of multi-objective optimization in data mining: a position paper. SIGKDD Explor 6(2): 77–86

    Article  MathSciNet  Google Scholar 

  • Freitas AA (2007) A review of evolutionary algorithms for data minin, soft computing for knowledge discovery and data mining. Springer, USA, pp 79–111

    Google Scholar 

  • Giusti R, Gustavo EA, Batista PA, Prati Ronaldo C (2008) Evaluating ranking composition methods for multi-objective optimization of knowledge rules. In: proceedings of eighth international conference on hybrid intelligent systems, pp 537–542

  • Ishibuchi H (2007) Evolutionary multi-objective design of fuzzy rule-based systems. In: proceedings of the 2007 IEEE symposium on foundations of computational intelligence (FOCI 2007), pp 9–16

  • Ishibuchi H, Namba S (2004) Evolutionary multiobjective knowledge extraction for high-dimensional pattern classification problems, parallel problem solving from nature—PPSN VIII, LNCS 3242. Springer, Berlin, pp 1123–1132

    Google Scholar 

  • Ishibuchi H, Nojima Y (2005) Comparison between fuzzy and interval partitions in evolutionary multi-objective design of rule-based classification systems. In: proceedings of the 2005 IEEE international conference on fuzzy systems, pp 430–435

  • Ishibuchi H, Kuwajima I, Nojima Y (2007) Multi-objective classification rule mining, natural computing series. Springer, Berlin, pp 219–240

    Google Scholar 

  • Jourdan L, Dhaenens C, Talbi E-G (2006) Using data mining techniques to help metaheuristics: a short survey, Hybrid Metaheuristics, LNCS 4030. Springer, Berlin, pp 57–69

    Google Scholar 

  • Khabzaoui M, Dhaenens C, Talbi EG (2008) Combining evolutionary algorithms and exact approaches for multi-objective knowledge discovery. RAIRO Oper Res 42: 69–83. doi:10.1051/ro:2008004

    Article  MathSciNet  MATH  Google Scholar 

  • Narukawa K, Nojima Y, Ishibuchi H (2005) Modification of evolutionary multi-objective optimization algorithms for multi-objective design of fuzzy rule-based classification systems. In: proceedings of the 2005 IEEE international conference on fuzzy systems, pp 809–814

  • Newman D, Hettich S, Blake C, Merz C (1998) UCI repository of machine learning databases, Department of Information and Computer Science, University of California at Irvine http://www.ics.%20uci.edu/?mlearn/MLRepository.html

  • Pappa GL, Freitas AA (2009) Evolving rule induction algorithms with multi-objective grammar-based genetic programming. Knowl Inf Syst 19:283–309

    Article  Google Scholar 

  • Reynolds AP, de la Iglesia B (2006) Rule induction using multi-objective metaheuristic: encouraging rule diversity, In: proceedings of IJCNN 2006, pp 6375–6382

  • Reynolds AP, de la Iglesia B (2007) Rule induction for classification using multi-objective genetic programming. In: proceedings of 4th international conference on evolutionary multi-criterion optimization, LNCS 4403. Springer, Berlin, pp 516–530

  • Reynolds AP, de la Iglesia B (2009) A multi-objective GRASP for partial classification. Soft Comput 13(3): 227–243

    Article  Google Scholar 

  • Reynolds AP, Corne David W, de la Iglesia B (2009) A multi-objective grasp for rule selection. In: proceedings of the 11th annual conference on genetic and evolutionary computation, GECCO’09, Montréal Québec, Canada, pp 643–650

  • Tsang C-H, Kwong S, Wang H (2005) Anomaly intrusion detection using multi-objective genetic fuzzy system and agent-based evolutionary computation framework. In: proceedings of the fifth IEEE international conference on data mining (ICDM’05), pp 789–792

  • Tsang C-H, Kwong S, Wang H (2007) Genetic-fuzzy rule mining approach and evaluation of feature selection techniques for anomaly intrusion detection. Pattern Recogn 40: 2373–2391

    Article  MATH  Google Scholar 

  • Wang H, Kwong S, Jin Y, Wei W, Man KF (2005) Agent based evolutionary approach for interpretable rule-based knowledge extraction. IEEE Trans Syst Man Cybern 35(2):143–155

    Article  Google Scholar 

  • Zhang Y, Rockett P (2007) A comparison of three evolutionary strategies for multi-objective genetic programming. Artif Intell Rev 27:149–163

    Article  MATH  Google Scholar 

  • Zhao H (2007) A multi-objective genetic programming approach to developing Pareto optimal decision trees. Decis Supp Syst 43: 809–826

    Article  Google Scholar 

  • Zitzler E, Laumanns M, Thiele L (2001) SPEA2: improving the strength Pareto evolutionary algorithm for multi-objective optimization. In: proceedings of evolutionary methods for design, optimization and control with applications to industrial problems (EUROGEN2001), Barcelona, pp 95–100

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, AVVM Sri Pushpam College, Poondi, Tamil Nadu, India

    Sujatha Srinivasan & Sivakumar Ramakrishnan

Authors
  1. Sujatha Srinivasan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sivakumar Ramakrishnan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sujatha Srinivasan.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Srinivasan, S., Ramakrishnan, S. Evolutionary multi objective optimization for rule mining: a review. Artif Intell Rev 36, 205–248 (2011). https://doi.org/10.1007/s10462-011-9212-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10462-011-9212-3

Keywords

Search

Navigation