Rule Discovery with a Multi Objective Cultural Algorithm

Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 178)


Cultural algorithms (CA) are evolutionary systems which utilize agent technology and which supports any evolutionary strategy like evolutionary algorithm or swarm intelligence or ant algorithms. CA uses a basic set of five knowledge sources (KS’s) which are used in various animal species to guide the search toward best solutions and thus are better than evolutionary algorithms which are memory less blind search methods. The preserved knowledge in CA is disseminated throughout the system in future generations. Cultural algorithms have been used effectively in solving optimization problems, in engineering rule based systems, and combined with data mining to study complex social systems. However application of cultural algorithm for multi objective optimization of classification rules is hardly found in the literature. Research gap exists in using Cultural Algorithm for rule mining taking the various properties of rules as objectives for optimization. In the current study a cultural algorithm framework is proposed for rule mining considering it as a multi objective optimization problem.


Cultural algorithm Classification rule Multi-objective optimization 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Berlanga, F., del Jesus, M.J., González, P., Herrera, F., Mesonero, M.: Multi-objective Evolutionary Induction of Subgroup Discovery Fuzzy Rules: A Case Study in Marketing. In: Perner, P. (ed.) ICDM 2006. LNCS (LNAI), vol. 4065, pp. 337–349. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  2. Cao, L.: Introduction to Agent Mining Interaction and Integration. In: Cao, L. (ed.) Data Mining and Multiagent Integration, LLC, pp. 3–36 (2009)Google Scholar
  3. Dehuri, S., Mall, R.: Predictive and comprehensible rule discovery using a multi-objective genetic algorithm. Knowledge-Based Systems 19, 413–421 (2006)CrossRefGoogle Scholar
  4. De la Iglesia, B., Philpott, M.S., Bagnall, A.J., Rayward-Smith, V.J.: Data mining rules using multi-objective evolutionary algorithms. In: Proceedings of 2003 IEEE Congress on Evolutionary Computation, pp. 1552–1559 (2003)Google Scholar
  5. de la Iglesia, B., Reynolds, A., Rayward-Smith, V.J.: Developments on a Multi-objective Metaheuristic (MOMH) Algorithm for Finding Interesting Sets of Classification Rules. In: Coello Coello, C.A., Hernández Aguirre, A., Zitzler, E. (eds.) EMO 2005. LNCS, vol. 3410, pp. 826–840. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  6. Del Jesus, M.J., Pedro, G., Francisco, H.: Multi-objective Genetic Algorithm for Extracting Subgroup Discovery Fuzzy Rules. In: Proceedings of the IEEE Symposium on Computational Intelligence in Multi-criteria Decision Making, pp. 50–57 (2007)Google Scholar
  7. Freitas Alex, A.: A Review of Evolutionary Algorithms for Data Mining. In: Soft Computing for Knowledge Discovery and Data Mining, pp. 79–111 (2007)Google Scholar
  8. Rafael, G., Gustavo, E.A., Batista, P.A., Cristiano, P.R.: Evaluating Ranking Composition Methods for Multi-Objective Optimization of Knowledge Rules. In: Proceedings of Eighth Int’l Conf. on Hybrid Intelligent Systems, pp. 537–542 (2008)Google Scholar
  9. Ishibuchi, H., Namba, S.: Evolutionary Multiobjective Knowledge Extraction for High-Dimensional Pattern Classification Problems. In: Yao, X., Burke, E.K., Lozano, J.A., Smith, J., Merelo-Guervós, J.J., Bullinaria, J.A., Rowe, J.E., Tiňo, P., Kabán, A., Schwefel, H.-P. (eds.) PPSN 2004. LNCS, vol. 3242, pp. 1123–1132. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  10. Ishibuchi, H.: Evolutionary multi-objective design of fuzzy rule-based systems. In: Proceedings of IEEE Symposium on Foundations of Computational Intelligence (FOCI 2007), pp. 9–16 (2007)Google Scholar
  11. Ishibuchi, H., Nojima, Y.: Comparison between fuzzy and interval partitions in evolutionary multi-objective design of rule-based classification systems. In: Proceedings of the 2005 IEEE Int’l Conf on Fuzzy Systems, pp. 430–435 (2005)Google Scholar
  12. Ishibuchi, H., Kuwajima, I., Nojima, Y.: Multi-objective classification rule mining. Natural computing series, pp. 219–240. Springer, Berlin (2007)Google Scholar
  13. Khabzaoui, M., Dhaenens, C., Talbi, E.G.: Combining evolutionary algorithms and exact approaches for multi-objective knowledge discovery. RAIRO Operations Research 42, 69–83 (2008)MathSciNetMATHCrossRefGoogle Scholar
  14. Lazar, A., Reynolds, R.G.: Heuristic Knowledge Discovery for Archaeological Data Using Cultural Algorithms and Rough Sets. In: Sarker, R.A., et al. (eds.) Heuristics and Optimization for Knowledge Discovery, vol. (2). Idea Group Publishing, USA (2002)Google Scholar
  15. Newman, D., Hettich, S., Blake, C., Merz, C.: UCI Repository of Machine Learning Databases, Dept. of Information and Computer Science, Univ. of California at Irvine, mlearn/MLRepository.htmlGoogle Scholar
  16. Reynolds, A.P., de la Iglesia, B.: Rule induction using multi-objective metaheuristic: Encouraging rule diversity. In: Proceedings of IJCNN 2006, pp. 6375–6382 (2006)Google Scholar
  17. Reynolds, A.P., de la Iglesia, B.: Rule Induction for Classification Using Multi-Objective Genetic Programming. In: Obayashi, S., Deb, K., Poloni, C., Hiroyasu, T., Murata, T. (eds.) EMO 2007. LNCS, vol. 4403, pp. 516–530. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  18. Reynolds, A.P., de la Iglesia, B.: A Multi-Objective GRASP for Partial Classification. Soft Computing 13(3), 227–243 (2009)CrossRefGoogle Scholar
  19. Reynolds, R.G.: An introduction to cultural algorithms. In: Proceedings of the 3rd Annual Conf. on Evolutionary Programming, pp. 131–139. World Scientific, River Edge (1994)Google Scholar
  20. Reynolds, R.G., Ali, M., Jayyousi, T.: Mining the Social Fabric of Archaic Urban Centers with Cultural Algorithms. IEEE Computer, 64–72 (2008)Google Scholar
  21. Reynolds, R.G., Peng, B., Ali, M.Z.: The Role of Culture in the Emergence of Decision-Making Roles, An Example using Cultural Algorithms. Complexity 13(3) (2007)Google Scholar
  22. Srinivasan, S., Ramakrishnan, S.: Evolutionary multi objective optimization for rule mining: a review. Artificial Intelligence Review 36(3), 205–248 (2011)CrossRefGoogle Scholar
  23. Sternberg, M., Reynolds, R.G.: Using cultural algorithms to support re-engineering of rule-based expert systems in dynamic environments: A case study in fraud detection. IEEE Trans. Evol. Comput. 1(4), 225–243 (1997)CrossRefGoogle Scholar
  24. Wang, H., Kwong, S., Jin, Y., Wei, W., Man, K.F.: Agent based evolutionary approach for interpretable rule-based knowledge extraction. IEEE Trans. Syst. Man Cybern. 35(2), 143–155 (2005)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  1. 1.Dept. of Computer ScienceCauvery College for WomenTrichyIndia
  2. 2.Dept. of Computer ScienceAVVM Sri Pushpam CollegePoondiIndia

Personalised recommendations