# Evolutionary parallel and gradually distributed lateral tuning of fuzzy rule-based systems

- 100 Downloads
- 16 Citations

## Abstract

The tuning of Fuzzy Rule-Based Systems is often applied to improve their performance as a post-processing stage once an initial set of fuzzy rules has been extracted. This optimization problem can become a hard one when the size of the considered system in terms of the number of variables, rules and, particularly, data samples is big. Distributed Genetic Algorithms are excellent optimization algorithms which exploit the nowadays available parallel hardware (multicore microprocessors and clusters) and could help to alleviate this growth in complexity. In this work, we present a study on the use of the Distributed Genetic Algorithms for the tuning of Fuzzy Rule-Based Systems. To this end, we analyze the application of a specific Gradual Distributed Real-Coded Genetic Algorithm which employs eight subpopulations in a hypercube topology and local parallelization at each subpopulation. We tested our approach on nine real-world datasets of different sizes and with different numbers of variables. The empirical performance in solution quality and computing time is assessed by comparing its results with those from a highly effective sequential tuning algorithm. The results show that the distributed approach achieves better results in terms of quality and execution time as the complexity of the problem grows.

## Keywords

Genetic fuzzy system Fuzzy rule-based systems Distributed genetic algorithms Genetic tuning## Notes

### Acknowledgments

This work was supported by the Spanish Ministry of Science and Innovation under grant TIN2005-08386-C05-01. Authors would like the thank the UGRGrid team from the University of Granada for their continuous support.

## References

- 1.Driankow D, Hellendoorn H, Reinfrank M (1993) An introduction to fuzzy control. Springer, BerlinGoogle Scholar
- 2.Ishibuchi H, Nakashima T, Nii M (2004) Classification and modeling with linguistic information granules: advances approaches to linguistic data mining. Springer, BerlinGoogle Scholar
- 3.Palm R, Driankov D, Hellendoorn (1997) Model based fuzzy control. Springer, BerlinGoogle Scholar
- 4.Pedrycz W (1996) Fuzzy modelling: paradigms and practice. Kluwer, NorwellzbMATHGoogle Scholar
- 5.Zadeh LA (1965) Fuzzy sets. Inf Control 8: 338–353zbMATHCrossRefMathSciNetGoogle Scholar
- 6.Zadeh LA (1973) Outline of a new approach to the analysis of complex systems and decision processes. IEEE Trans Syst Man Cybern 3: 28–44zbMATHMathSciNetGoogle Scholar
- 7.Goldberg DE (1989) Genetic algorithms in search, optimization, and machine learning. Addison-Wesley, New YorkzbMATHGoogle Scholar
- 8.Holland JH (1992) Adaptation in natural and artificial systems (The University of Michigan Press 1975). MIT, LondonGoogle Scholar
- 9.Cordón O, Gomide F, Herrera F, Hoffmann F, Magdalena L (2004) Ten years of genetic fuzzy systems: current work and new trends. Fuzzy Sets Syst 141(1): 5–31zbMATHCrossRefGoogle Scholar
- 10.Cordón O, Herrera F, Hoffmann F, Magdalena L (2001) Genetic fuzzy systems: evolutionary tuning and learning of fuzzy knowledge bases. World Scientific, SingaporezbMATHGoogle Scholar
- 11.Herrera F (2008) Genetic fuzzy systems: taxonomy, current research trends and prospects. Evol Intell 1: 27–46CrossRefGoogle Scholar
- 12.Eiben AE, Smith JE (2003) Introduction to evolutionary computation. Springer, BerlinGoogle Scholar
- 13.Zadeh LA (1975) The concept of a linguistic variable and its applications to approximate reasoning, parts i, ii and iii. Inf Sci 8(8 and 9):199–249, 301–357, 43–80Google Scholar
- 14.Alcalá R, Alcalá-Fdez J, Casillas J, Cordón O, Herrera F (2006) Hybrid learning models to get the interpretability-accuracy trade-off in fuzzy modeling. Soft Comput 10(9):717–734CrossRefGoogle Scholar
- 15.Alcalá R, Alcalá-Fdez J, Herrera F (2007) A proposal for the genetic lateral tuning of linguistic fuzzy systems and its interaction with rule selection. IEEE Trans Fuzzy Syst 15(4):616–635CrossRefGoogle Scholar
- 16.Casillas J, Cordón O, del Jesus MJ, Herrera F (2003) Accuracy improvements in linguistic fuzzy modeling. Springer, BerlinzbMATHGoogle Scholar
- 17.Casillas J, Cordón O, del Jesus MJ, Herrera F (2005) Genetic tuning of fuzzy rule deep structures preserving interpretability and its interaction with fuzzy rule set reduction. IEEE Trans Fuzzy Syst 13(1):13–29CrossRefGoogle Scholar
- 18.Herrera F, Lozano M, Verdegay JL (1995) Tuning fuzzy logic controllers by genetic algorithms. Int J Approx Reason 12:299–315zbMATHCrossRefMathSciNetGoogle Scholar
- 19.Karr C (1991) Genetic algorithms for fuzzy controllers. AI Expert 6(2):26–33Google Scholar
- 20.Alba E (2005) Parallel metaheuristics: a new class of algorithms. Wiley, New YorkzbMATHGoogle Scholar
- 21.Cantu-Paz E (2000) Efficient and accurate parallel genetic algorithms. Kluwer, NorwellzbMATHGoogle Scholar
- 22.de Vega FF, Cantu-Paz E (2008) Special issue on distributed bioinspired algorithms. Soft Comput 12(12):1143–1144CrossRefGoogle Scholar
- 23.Dowd K, Severance C (1998) High performance computing. O’Reilly, SebastopolGoogle Scholar
- 24.Spector DHM (2000) Building Linux clusters. O’Reilly, SebastopolGoogle Scholar
- 25.Sterling T, Becker DJ, Savarese DF (1999) How to build a beowulf: a guide to the implementation and application of PC clusters. MIT, CambridgeGoogle Scholar
- 26.Robles I, Alcalá R, Benítez JM, Herrera F (2009) Distributed genetic tuning of fuzzy rule-based systems. In: Proceedings of the international fuzzy systems association—European society for fuzzy logic and technology (IFSA-EUSFLAT) congress (in press)Google Scholar
- 27.Herrera F, Lozano M (2000) Gradual distributed real-coded genetic algorithms. IEEE Trans Evol Comput 4(1): 43–63CrossRefGoogle Scholar
- 28.Herrera F, Martínez L (2000) A 2-tuple fuzzy linguistic representation model for computing with words. IEEE Trans Fuzzy Syst 8(6): 746–752CrossRefGoogle Scholar
- 29.Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MathSciNetGoogle Scholar
- 30.García S, Fernández A, Luengo J, Herrera F (2009) A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability. Soft Comput 13(10):959–977CrossRefGoogle Scholar
- 31.García S, Herrera F (2008) An extension on “statistical comparisons of classifiers over multiple data sets” for all pairwise comparisons. J Mach Learn Res 9: 2579–2596Google Scholar
- 32.García S, Molina D, Lozano M, Herrera F (2009) A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 special session on real parameter optimization. J Heuristics (in press). doi: 10.1007/s10732-008-9080-4
- 33.Bäck T, Beielstein T (1995) User’s group meeting. In: Proceedings of the EuroPVM95: second European PVM, pp 277–282Google Scholar
- 34.Punch W, Goodman E, Pei M, Chai-shun L, Hovland P, Enbody R (1993) Further research on feature selection and classification using genetic algorithms. In: Forrest S (ed) Proceedings of the fifth international conference on genetic algorithms, pp 557–564Google Scholar
- 35.Alba E, Dorronsoro B (2008) Cellular genetic algorithms. Springer, BerlinzbMATHGoogle Scholar
- 36.Alba E, Luna F, Nebro A, Troya JM (2004) Parallel heterogeneous genetic algorithms for continuous optimization. Parallel Comput 30(5): 699–719CrossRefGoogle Scholar
- 37.Lin SC, III, WFP, Goodman ED (1994) Coarse-grain parallel genetic algorithms: categorization and new approach. In: Proceedings of the sixth IEEE parallel and distributed processing, pp 28–37Google Scholar
- 38.Mülhlenbein H, Schomisch M, Born J (1991) The parallel genetic algorithm as function optimizer. Parallel Comput 17(6): 619–632CrossRefGoogle Scholar
- 39.Schlierkamp-Voosen D, Mülhlenbein H (1994) Strategy adaptation by competing subpopulations. In: Parallel solving from nature (PPSN III). Springer, Berlin, pp 199–208Google Scholar
- 40.Schnecke V, Vornberger O (1996) An adaptative parallel algorithm for vlsi-layout optimization. In: Parallel problem solving from nature (PPSN IV), pp 22–27Google Scholar
- 41.Tanase R (1989) Distributed genetic algorithms. In: Proceedings of the third international conference on genetic algorithms, pp 434–439Google Scholar
- 42.Cohoon JP, Hedge S, Martin W (1987) Punctuated equilibria: a parallel genetic algorithm. In: Proceedings of the 2nd international conference on genetic algorithms and their applications, pp 148–154Google Scholar
- 43.Tanase R (1987) Parallel genetic algorithm for a hypercube. In: Proceedings of the 2nd international conference on genetic algorithms and their applications, pp 177–183Google Scholar
- 44.Ryan C (1995) Niche and species formation in genetic algorithms. In: Chambers L (ed) Practical handbook of genetic algorithms: applications. CRC Press, Boca Raton, pp 57–74Google Scholar
- 45.Gürocak HB (1999) A genetic-algorithm-based method for tuning fuzzy logic controllers. Fuzzy Sets Syst 108(1): 39–47zbMATHCrossRefGoogle Scholar
- 46.Mamdani EH, Assilian S (1975) An experiment in linguistic synthesis with a fuzzy logic controller. Int J Man Mach Stud 7: 1–13zbMATHCrossRefGoogle Scholar
- 47.Eshelman LJ (1991) The CHC adaptive search algorithm: how to have safe search when engaging in nontraditional genetic recombination. In: Rawlin G (ed) Foundations of genetic algorithms, vol 1. Morgan Kaufman, pp 265–283Google Scholar
- 48.Eshelman L, Schaffer J (1993) Real-coded genetic algorithms and interval-schemata. Found Genet algorithm 2:187–202Google Scholar
- 49.Kröger B, Schwenderling P, Vornberger O (1993) Parallel genetic packing on transputers. Parallel genetic algorithms: theory and applications, pp 151–186Google Scholar
- 50.Alcalá-Fdez J, Sánchez L, García S, del Jesus M, Ventura S, Garrell J, Otero J, Romero C, Bacardit J, Rivas V, Fernández J, Herrera F (2009) KEEL: a software tool to assess evolutionary algorithms to data mining problems. Soft Comput 13(3): 307–318CrossRefGoogle Scholar
- 51.Wang LX, Mendel JM (1992) Generating fuzzy rules by learning from examples. IEEE Trans Syst Man Cybern 22(6): 1414–1427CrossRefMathSciNetGoogle Scholar
- 52.Sheskin D (2003) Handbook of parametric and nonparametric statistical procedures. Chapman & Hall/CRC, Boca RatonGoogle Scholar
- 53.Wilcoxon F (1945) Individual comparisons by ranking methods. Biometrics 1:80–83CrossRefGoogle Scholar
- 54.Zar J (1999) Biostatistical analysis. Prentice-Hall, Upper Saddle RiverGoogle Scholar