Abstract
Genetic fuzzy rule selection has been successfully used to design accurate and compact fuzzy rule-based classifiers. It is, however, very difficult to handle large data sets due to the increase in computational costs. This paper proposes a simple but effective idea to improve the scalability of genetic fuzzy rule selection to large data sets. Our idea is based on its parallel distributed implementation. Both a training data set and a population are divided into subgroups (i.e., into training data subsets and sub-populations, respectively) for the use of multiple processors. We compare seven variants of the parallel distributed implementation with the original non-parallel algorithm through computational experiments on some benchmark data sets.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abraham A, Jain L, Goldberg R (eds) (2005) Evolutionary multiobjective optimization. Springer, London
Agrawal R, Mannila H, Srikant R, Toivonen H, Verkamo AI (1996) Fast discovery of association rules. In: Fayyad UM et al (eds) Advances in knowledge discovery and data mining. AAAI Press, Menlo Park, pp 307–328
Alba E, Tomassini M (2002) Parallelism and evolutionary algorithms. IEEE Trans Evol Comput 6(5):443–462
Araujo DLA, Lopes HS, Freitas AA (2000) Rule discovery with a parallel genetic algorithm. In: Proceedings of GECCO Workshop on Data Mining with Evolutionary Computation, pp 89–92
Cano JR, Herrera F, Lozano M (2005) Stratification for scaling up evolutionary prototype selection. Pattern Recognit Lett 26(7):953–963
Cano JR, Herrera F, Lozano M (2006) On the combination of evolutionary algorithms and stratified strategies for training set selection in data mining. Appl Soft Comput 6(3):323–332
Cantu-Paz E (1997) A survey of parallel genetic algorithms, IlliGAL Report No. 95003
Casillas J, Cordon O, Herrera F, Magdalena L (eds) (2003a) Interpretability issues in fuzzy modeling. Springer, Berlin
Casillas J, Cordon O, Herrera F, Magdalena L (eds) (2003b) Accuracy improvements in linguistic fuzzy modeling. Springer, Berlin
Coello CAC (1999) A comprehensive survey of evolutionary-based multiobjective optimization techniques. Knowl Inform Syst 1(3):269–308
Coello CAC, van Veldhuizen DA, Lamont GB (2002) Evolutionary algorithms for solving multi-objective problems. Kluwer, Boston
Cordon O, del Jesus MJ, Herrera F (1999) A proposal on reasoning methods in fuzzy rule-based classification systems. Int J Approx Reason 20(1):21–45
Cordon O, Herrera F, Hoffman F, Magdalena L (2001) Genetic fuzzy systems. World Scientific, Singapore
Cordon O, Gomide F, Herrera F, Hoffmann F, Magdalena L (2004) Ten years of genetic fuzzy systems: current framework and new trends. Fuzzy Sets Syst 141(1):5–31
Deb K (2001) Multi-objective optimization using evolutionary algorithms. Wiley, Chichester
Freitas AA (2002) Data mining and knowledge discovery with evolutionary algorithms. Springer, Berlin
Herrera F (2005) Genetic fuzzy systems: Status, critical considerations and future directions. Int J Comput Intell Res 1(1):59–67
Ishibuchi H. Nojima Y, Kuwajima I (2006) Genetic rule selection as a postprocessing procedure in fuzzy data mining. In: Proceedings of 2006 International Symposium on Evolving Fuzzy Systems, pp 286–291
Ishibuchi H (2007) Evolutionary multiobjective design of fuzzy rule-based systems. In: Proceedings of First IEEE Symposium on Foundations of Computational Intelligence, pp 9–16
Ishibuchi H, Nakashima T (2001) Effect of rule weights in fuzzy rule-based classification systems. IEEE Trans Fuzzy Syst 9(4):506–515
Ishibuchi H, Yamamoto T (2004) Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining. Fuzzy Sets Syst 141(1):59–88
Ishibuchi H, Nozaki K, Tanaka H (1992) Distributed representation of fuzzy rules and its application to pattern classification. Fuzzy Sets Syst 52(1):21–32
Ishibuchi H, Nozaki K, Yamamoto N, Tanaka H (1995) Selecting fuzzy if-then rules for classification problems using genetic algorithms. IEEE Trans Fuzzy Syst 3(3):260–270
Ishibuchi H, Murata T, Turksen IB (1997) Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems. Fuzzy Sets Syst 89(2):135–150
Ishibuchi H, Nakashima T, Morisawa T (1999) Voting in fuzzy rule-based systems for pattern classification problems. Fuzzy Sets Syst 103(2):223–238
Ishibuchi H, Nakashima T, Murata T (2001) Three-objective genetics-based machine learning for linguistic rule extraction. Inform Sci 136(1–4):109–133
Ishibuchi H, Nakashima T, Nii M (2004) Classification and modeling with linguistic information granules: advanced approaches to linguistic data mining. Springer, Berlin
Ishibuchi H, Kuwajima I, Nojima Y (2007) Use of Pareto-optimal and near Pareto-optimal rules as candidate rules in genetic fuzzy rule selection. In: Melin P et al (eds) Analysis and design of intelligent systems using soft computing techniques (Advances in Soft Computing 41). Springer, Berlin, pp 387–396
Jin Y (ed) (2006) Multi-objective machine learning. Springer, Berlin
Liu H, Motoda H (1998a) Feature selection for knowledge discovery and data mining. Kluwer, Dordrecht
Liu H, Motoda H (1998b) Instance selection and construction for data mining. Kluwer, Dordrecht
Llora X, Garrell JM (2001) Knowledge-independent data mining with fine-grained parallel evolutionary algorithms. In: Proceedings of the Genetic and Evolutionary Computation Conference, pp 461–468
Llora X, Garrell JM (2002) Coevolving different knowledge representations with fine-grained parallel learning classifier systems. In: Proceedings of the Genetic and Evolutionary Computation Conference, pp 934–941
Nojima Y, Ishibuchi H (2008) Computational efficiency of parallel distributed genetic fuzzy rule selection for large data sets. In: Proceedings of Information Processing and Management of Uncertainty in Knowledge-Based Systems, pp 1137–1142
Nojima Y, Ishibuchi H, Kuwajima I (2006) Comparison of search ability between genetic fuzzy rule selection and fuzzy genetics-based machine learning In: Proceedings of 2006 International Symposium on Evolving Fuzzy Systems, pp 125–130
Sheskin D (2007) Handbook of parametric and nonparametric statistical procedures, 4th edn. Chapman & Hall, London
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Nojima, Y., Ishibuchi, H. & Kuwajima, I. Parallel distributed genetic fuzzy rule selection. Soft Comput 13, 511–519 (2009). https://doi.org/10.1007/s00500-008-0365-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-008-0365-1