Evolutionary parallel and gradually distributed lateral tuning of fuzzy rule-based systems

  • I. Robles
  • R. Alcalá
  • J. M. Benítez
  • F. Herrera
Special Issue

Abstract

The tuning of Fuzzy Rule-Based Systems is often applied to improve their performance as a post-processing stage once an initial set of fuzzy rules has been extracted. This optimization problem can become a hard one when the size of the considered system in terms of the number of variables, rules and, particularly, data samples is big. Distributed Genetic Algorithms are excellent optimization algorithms which exploit the nowadays available parallel hardware (multicore microprocessors and clusters) and could help to alleviate this growth in complexity. In this work, we present a study on the use of the Distributed Genetic Algorithms for the tuning of Fuzzy Rule-Based Systems. To this end, we analyze the application of a specific Gradual Distributed Real-Coded Genetic Algorithm which employs eight subpopulations in a hypercube topology and local parallelization at each subpopulation. We tested our approach on nine real-world datasets of different sizes and with different numbers of variables. The empirical performance in solution quality and computing time is assessed by comparing its results with those from a highly effective sequential tuning algorithm. The results show that the distributed approach achieves better results in terms of quality and execution time as the complexity of the problem grows.

Keywords

Genetic fuzzy system Fuzzy rule-based systems Distributed genetic algorithms Genetic tuning 

References

  1. 1.
    Driankow D, Hellendoorn H, Reinfrank M (1993) An introduction to fuzzy control. Springer, BerlinGoogle Scholar
  2. 2.
    Ishibuchi H, Nakashima T, Nii M (2004) Classification and modeling with linguistic information granules: advances approaches to linguistic data mining. Springer, BerlinGoogle Scholar
  3. 3.
    Palm R, Driankov D, Hellendoorn (1997) Model based fuzzy control. Springer, BerlinGoogle Scholar
  4. 4.
    Pedrycz W (1996) Fuzzy modelling: paradigms and practice. Kluwer, NorwellMATHGoogle Scholar
  5. 5.
    Zadeh LA (1965) Fuzzy sets. Inf Control 8: 338–353MATHCrossRefMathSciNetGoogle Scholar
  6. 6.
    Zadeh LA (1973) Outline of a new approach to the analysis of complex systems and decision processes. IEEE Trans Syst Man Cybern 3: 28–44MATHMathSciNetGoogle Scholar
  7. 7.
    Goldberg DE (1989) Genetic algorithms in search, optimization, and machine learning. Addison-Wesley, New YorkMATHGoogle Scholar
  8. 8.
    Holland JH (1992) Adaptation in natural and artificial systems (The University of Michigan Press 1975). MIT, LondonGoogle Scholar
  9. 9.
    Cordón O, Gomide F, Herrera F, Hoffmann F, Magdalena L (2004) Ten years of genetic fuzzy systems: current work and new trends. Fuzzy Sets Syst 141(1): 5–31MATHCrossRefGoogle Scholar
  10. 10.
    Cordón O, Herrera F, Hoffmann F, Magdalena L (2001) Genetic fuzzy systems: evolutionary tuning and learning of fuzzy knowledge bases. World Scientific, SingaporeMATHGoogle Scholar
  11. 11.
    Herrera F (2008) Genetic fuzzy systems: taxonomy, current research trends and prospects. Evol Intell 1: 27–46CrossRefGoogle Scholar
  12. 12.
    Eiben AE, Smith JE (2003) Introduction to evolutionary computation. Springer, BerlinGoogle Scholar
  13. 13.
    Zadeh LA (1975) The concept of a linguistic variable and its applications to approximate reasoning, parts i, ii and iii. Inf Sci 8(8 and 9):199–249, 301–357, 43–80Google Scholar
  14. 14.
    Alcalá R, Alcalá-Fdez J, Casillas J, Cordón O, Herrera F (2006) Hybrid learning models to get the interpretability-accuracy trade-off in fuzzy modeling. Soft Comput 10(9):717–734CrossRefGoogle Scholar
  15. 15.
    Alcalá R, Alcalá-Fdez J, Herrera F (2007) A proposal for the genetic lateral tuning of linguistic fuzzy systems and its interaction with rule selection. IEEE Trans Fuzzy Syst 15(4):616–635CrossRefGoogle Scholar
  16. 16.
    Casillas J, Cordón O, del Jesus MJ, Herrera F (2003) Accuracy improvements in linguistic fuzzy modeling. Springer, BerlinMATHGoogle Scholar
  17. 17.
    Casillas J, Cordón O, del Jesus MJ, Herrera F (2005) Genetic tuning of fuzzy rule deep structures preserving interpretability and its interaction with fuzzy rule set reduction. IEEE Trans Fuzzy Syst 13(1):13–29CrossRefGoogle Scholar
  18. 18.
    Herrera F, Lozano M, Verdegay JL (1995) Tuning fuzzy logic controllers by genetic algorithms. Int J Approx Reason 12:299–315MATHCrossRefMathSciNetGoogle Scholar
  19. 19.
    Karr C (1991) Genetic algorithms for fuzzy controllers. AI Expert 6(2):26–33Google Scholar
  20. 20.
    Alba E (2005) Parallel metaheuristics: a new class of algorithms. Wiley, New YorkMATHGoogle Scholar
  21. 21.
    Cantu-Paz E (2000) Efficient and accurate parallel genetic algorithms. Kluwer, NorwellMATHGoogle Scholar
  22. 22.
    de Vega FF, Cantu-Paz E (2008) Special issue on distributed bioinspired algorithms. Soft Comput 12(12):1143–1144CrossRefGoogle Scholar
  23. 23.
    Dowd K, Severance C (1998) High performance computing. O’Reilly, SebastopolGoogle Scholar
  24. 24.
    Spector DHM (2000) Building Linux clusters. O’Reilly, SebastopolGoogle Scholar
  25. 25.
    Sterling T, Becker DJ, Savarese DF (1999) How to build a beowulf: a guide to the implementation and application of PC clusters. MIT, CambridgeGoogle Scholar
  26. 26.
    Robles I, Alcalá R, Benítez JM, Herrera F (2009) Distributed genetic tuning of fuzzy rule-based systems. In: Proceedings of the international fuzzy systems association—European society for fuzzy logic and technology (IFSA-EUSFLAT) congress (in press)Google Scholar
  27. 27.
    Herrera F, Lozano M (2000) Gradual distributed real-coded genetic algorithms. IEEE Trans Evol Comput 4(1): 43–63CrossRefGoogle Scholar
  28. 28.
    Herrera F, Martínez L (2000) A 2-tuple fuzzy linguistic representation model for computing with words. IEEE Trans Fuzzy Syst 8(6): 746–752CrossRefGoogle Scholar
  29. 29.
    Demšar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30MathSciNetGoogle Scholar
  30. 30.
    García S, Fernández A, Luengo J, Herrera F (2009) A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability. Soft Comput 13(10):959–977CrossRefGoogle Scholar
  31. 31.
    García S, Herrera F (2008) An extension on “statistical comparisons of classifiers over multiple data sets” for all pairwise comparisons. J Mach Learn Res 9: 2579–2596Google Scholar
  32. 32.
    García S, Molina D, Lozano M, Herrera F (2009) A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 special session on real parameter optimization. J Heuristics (in press). doi:10.1007/s10732-008-9080-4
  33. 33.
    Bäck T, Beielstein T (1995) User’s group meeting. In: Proceedings of the EuroPVM95: second European PVM, pp 277–282Google Scholar
  34. 34.
    Punch W, Goodman E, Pei M, Chai-shun L, Hovland P, Enbody R (1993) Further research on feature selection and classification using genetic algorithms. In: Forrest S (ed) Proceedings of the fifth international conference on genetic algorithms, pp 557–564Google Scholar
  35. 35.
    Alba E, Dorronsoro B (2008) Cellular genetic algorithms. Springer, BerlinMATHGoogle Scholar
  36. 36.
    Alba E, Luna F, Nebro A, Troya JM (2004) Parallel heterogeneous genetic algorithms for continuous optimization. Parallel Comput 30(5): 699–719CrossRefGoogle Scholar
  37. 37.
    Lin SC, III, WFP, Goodman ED (1994) Coarse-grain parallel genetic algorithms: categorization and new approach. In: Proceedings of the sixth IEEE parallel and distributed processing, pp 28–37Google Scholar
  38. 38.
    Mülhlenbein H, Schomisch M, Born J (1991) The parallel genetic algorithm as function optimizer. Parallel Comput 17(6): 619–632CrossRefGoogle Scholar
  39. 39.
    Schlierkamp-Voosen D, Mülhlenbein H (1994) Strategy adaptation by competing subpopulations. In: Parallel solving from nature (PPSN III). Springer, Berlin, pp 199–208Google Scholar
  40. 40.
    Schnecke V, Vornberger O (1996) An adaptative parallel algorithm for vlsi-layout optimization. In: Parallel problem solving from nature (PPSN IV), pp 22–27Google Scholar
  41. 41.
    Tanase R (1989) Distributed genetic algorithms. In: Proceedings of the third international conference on genetic algorithms, pp 434–439Google Scholar
  42. 42.
    Cohoon JP, Hedge S, Martin W (1987) Punctuated equilibria: a parallel genetic algorithm. In: Proceedings of the 2nd international conference on genetic algorithms and their applications, pp 148–154Google Scholar
  43. 43.
    Tanase R (1987) Parallel genetic algorithm for a hypercube. In: Proceedings of the 2nd international conference on genetic algorithms and their applications, pp 177–183Google Scholar
  44. 44.
    Ryan C (1995) Niche and species formation in genetic algorithms. In: Chambers L (ed) Practical handbook of genetic algorithms: applications. CRC Press, Boca Raton, pp 57–74Google Scholar
  45. 45.
    Gürocak HB (1999) A genetic-algorithm-based method for tuning fuzzy logic controllers. Fuzzy Sets Syst 108(1): 39–47MATHCrossRefGoogle Scholar
  46. 46.
    Mamdani EH, Assilian S (1975) An experiment in linguistic synthesis with a fuzzy logic controller. Int J Man Mach Stud 7: 1–13MATHCrossRefGoogle Scholar
  47. 47.
    Eshelman LJ (1991) The CHC adaptive search algorithm: how to have safe search when engaging in nontraditional genetic recombination. In: Rawlin G (ed) Foundations of genetic algorithms, vol 1. Morgan Kaufman, pp 265–283Google Scholar
  48. 48.
    Eshelman L, Schaffer J (1993) Real-coded genetic algorithms and interval-schemata. Found Genet algorithm 2:187–202Google Scholar
  49. 49.
    Kröger B, Schwenderling P, Vornberger O (1993) Parallel genetic packing on transputers. Parallel genetic algorithms: theory and applications, pp 151–186Google Scholar
  50. 50.
    Alcalá-Fdez J, Sánchez L, García S, del Jesus M, Ventura S, Garrell J, Otero J, Romero C, Bacardit J, Rivas V, Fernández J, Herrera F (2009) KEEL: a software tool to assess evolutionary algorithms to data mining problems. Soft Comput 13(3): 307–318CrossRefGoogle Scholar
  51. 51.
    Wang LX, Mendel JM (1992) Generating fuzzy rules by learning from examples. IEEE Trans Syst Man Cybern 22(6): 1414–1427CrossRefMathSciNetGoogle Scholar
  52. 52.
    Sheskin D (2003) Handbook of parametric and nonparametric statistical procedures. Chapman & Hall/CRC, Boca RatonGoogle Scholar
  53. 53.
    Wilcoxon F (1945) Individual comparisons by ranking methods. Biometrics 1:80–83CrossRefGoogle Scholar
  54. 54.
    Zar J (1999) Biostatistical analysis. Prentice-Hall, Upper Saddle RiverGoogle Scholar

Copyright information

© Springer-Verlag 2009

Authors and Affiliations

  • I. Robles
    • 1
  • R. Alcalá
    • 1
  • J. M. Benítez
    • 1
  • F. Herrera
    • 1
  1. 1.Dept. of Computer Sciences and Artificial IntelligenceUniversity of GranadaGranadaSpain

Personalised recommendations