Encyclopedia of Complexity and Systems Science

2009 Edition
| Editors: Robert A. Meyers (Editor-in-Chief)

Evolving Fuzzy Systems

  • Plamen Angelov
Reference work entry
DOI: https://doi.org/10.1007/978-0-387-30440-3_192

Definition of the Subject

Evolving Fuzzy Systems (EFS) are a class of Fuzzy Rule‐based (FRB) andNeuro‐Fuzzy (NF) systems that have both their parameters and underlying structure self‐adapting, self‐developing, self‐learningfrom the data in on‐line mode and, possibly, in real‐time. The concept was conceived at the beginning of this century [2,5]. Parallel investigations have led to similar developments inneural networks (NN) [41,42]. EFS have thesignificant advantage compared to the evolving NN of being linguistically tractable and transparent. EFS have been instrumental in the emergence of newbranches of evolving clustering algorithms [3], evolving classifiers [16,51], evolving time‐seriespredictors  [9,47], evolving fuzzy controllers [4], evolving fault detectors  [30] etc. Over the last years EFS has demonstrated a wide range of applications spanningrobotics [76] and defense [24] tobiomedical [70] and industrial process [29]data processing in real‐time, new generations of...

This is a preview of subscription content, log in to check access.

Notes

Acknowledgments

The author would like to thank Mr. Xiaowei Zhou for his assistance in producing the illustrative material, Dr. Jose Macias Hernandez forkindly providing real data from the oil refinery CEPSA, Santa Cruz, Tenerife, Spain, Dr. Richard Buswell, Loughborough University and ASHRAE(RP‐1020) for the real air conditioning data, and Dr. Edwin Lughofer from Johannes Kepler University of Linz, Austria for providing real data fromcar engines.

Bibliography

Primary Literature

  1. 1.
    Andersen HC, Teng FC, Tsoi AC (1994) Single Net Indirect Learning Architecture. IEEE Trans Neural Netw 5:1003–1005Google Scholar
  2. 2.
    Angelov P (2002) Evolving Rule‐based Models: A Tool for Design of Flexible Adaptive Systems. Springer, HeidelbergGoogle Scholar
  3. 3.
    Angelov P (2004) An Approach for Fuzzy Rule‐base Adaptation using On‐line Clustering. Int J Approx Reason 35(3):275–289MathSciNetzbMATHGoogle Scholar
  4. 4.
    Angelov PP (2004) A Fuzzy Controller with Evolving Structure. Inf Sci 161:21–35MathSciNetzbMATHGoogle Scholar
  5. 5.
    Angelov P, Buswell R (2001) Evolving Rule‐based Models: A Tool for Intelligent Adaptation. In: Proc of the Joint 9th IFSA World Congress and 20th NAFIPS Intern Conf, Vancouver, 25–28 July 2001. IEEE Press, USA, pp 1062–1066Google Scholar
  6. 6.
    Angelov P, Buswell R (2002) Identification of Evolving Rule‐based Models. IEEE Trans Fuzzy Syst 10(5):667–677Google Scholar
  7. 7.
    Angelov P, Buswell R (2003) Automatic Generation of Fuzzy Rule‐based Models from Data by Genetic Algorithms. Inf Sci 150(1/2):17–31Google Scholar
  8. 8.
    Angelov P, Everett M (2005) EvoMap: On‐Chip Implementation of Intelligent Information Modelling using EVOlving MAPping. Lancaster University, Lancaster, pp 1–15Google Scholar
  9. 9.
    Angelov P, Filev D (2004) An approach to on‐line identification of evolving Takagi–Sugeno models. IEEE Trans Syst Man Cybern part B Cybern 34(1):484–498Google Scholar
  10. 10.
    Angelov P, Filev D (2005) Simpl_eTS: A Simplified Method for Learning Evolving Takagi–Sugeno Fuzzy Models. In: Proc of The 2005 IEEE Intern. Conf. on Fuzzy Systems FUZZ-IEEE – 2005, Reno 2005, pp 1068–1073Google Scholar
  11. 11.
    Angelov P, Filev D, Kasabov N, Cordon O (eds) (2006) Evolving Fuzzy Systems. Proc of the 2nd Int Symposium on Evolving Fuzzy Systems, Ambleside, 7–9 Sept 2006. pp 1–350Google Scholar
  12. 12.
    Angelov P, Kordon A, Zhou X (2008) Adaptive Inferential Sensors based on Evolving Fuzzy Models: An Industrial Case Study. IEEE Trans Fuzzy Syst (under review)Google Scholar
  13. 13.
    Angelov P, Lughofer E, Klement PE (2005) Two Approaches for Data – Driven Design of Evolving Fuzzy Systems: eTS and FLEXFIS. In: Proc of The 2005 North American Fuzzy Information Processing Society, NAFIPS Annual Conference, Ann Arbor, June 2005, pp 31–35Google Scholar
  14. 14.
    Angelov P, Victor J, Dourado A, Filev D (2004) On‐line evolution of Takagi–Sugeno Fuzzy Models. In: Proc of the 2nd IFAC Workshop on Advanced Fuzzy and Neural Control, Oulu, 16–17 Sept 2004, pp 67–72Google Scholar
  15. 15.
    Angelov P, Xydeas C, Filev D (2004) On‐line Identification of MIMO Evolving Takagi–Sugeno Fuzzy Models. In: Proc of the Intern. Joint Conf. on Neural Networks and Intern. Conf. on Fuzzy Systems, IJCNN-FUZZ-IEEE, Budapest, 25–29 July 2004, pp 55–60Google Scholar
  16. 16.
    Angelov P, Zhou X, Klawonn F (2007) Evolving Fuzzy Rule‐based Classifiers. In: Proc of the First 2007 IEEE International Conference on Computational Intelligence Applications for Signal and Image Processing – a part of the IEEE Symposium Series on Computational Intelligence, SSCI-2007, Honolulu, 1–5 April 2007, pp 220–225Google Scholar
  17. 17.
    Angelov P, Zhou X, Lughofer E, Filev D (2007) Architectures of Evolving Fuzzy Rule‐based Classifiers. In: Proc of the 2007 IEEE International Conference on Systems, Man, and Cybernetics, Montreal, 7–10 Oct 2007, pp 2050–2055Google Scholar
  18. 18.
    Arulampalam MS, Maskell S, Gordon N (2002) A Tutorial on Particle Filters for On‐line Nonlinear Non‐Gaussian Bayesian Tracking. IEEE Trans Signal Process 50(2):174–188ADSGoogle Scholar
  19. 19.
    Astroem KJ, Wittenmark B (1994) Adaptive Control. Prentice Hall, Upper Saddle RiverGoogle Scholar
  20. 20.
    Azimi‐Sadjadi MR, Yao D, Jamshidi AA, Dobeck GJ (2002) Underwater Target Classification in Changing Environments Using an Adaptive Feature Mapping. IEEE Trans Neural Netw 13(5):1099–1111Google Scholar
  21. 21.
    Badami VV, Chbat NW (1998) Home appliances get smart. IEEE Spectrum 35(8):36–43Google Scholar
  22. 22.
    Bezdek J (1974) Cluster Validity with Fuzzy Sets. J Cybern 3(3):58–71MathSciNetGoogle Scholar
  23. 23.
    Bonarini A, Lazaric A, Restelli M, Vitali P (2006) Self‐Development Framework for Reinforcement Learning Agents. In: Proc of the 5th Intern. Conf. on Development and Learning, ICDL-06 New DelhiGoogle Scholar
  24. 24.
    Carline D, Angelov PP, Clifford R (2005) Agile Collaborative Autonomous Agents for Robust Underwater Classification Scenarios. In: the Proceedings of the Underwater Defense Technology Conference, Amsterdam, June 2005Google Scholar
  25. 25.
    Carpenter GA, Grossberg S (2003) Adaptive Resonance Theory. In: Arbib MA (ed) The Handbook of Brain Theory and Neural Networks, 2nd edn. MIT Press, Cambridge, pp 87–90Google Scholar
  26. 26.
    Chiu SL (1994) Fuzzy model identification based on cluster estimation. J Intell Fuzzy Syst 2:267–278MathSciNetGoogle Scholar
  27. 27.
    Cordon O, Gomide F, Herrera F, Hoffmann F, Magdalena L (2004) Ten years of genetic fuzzy systems: Current framework and new trends. Fuzzy Sets Syst 141(1):5–31MathSciNetzbMATHGoogle Scholar
  28. 28.
    Domingos P, Hulten G (2001) Catching up with the data: Research issues in mining data streams. In: Proc of the Workshop on Research Issues in Data Mining and Knowledge Discovery, Santa BarbaraGoogle Scholar
  29. 29.
    Filev D, Larson T, Ma L (2000) Intelligent Control for Automotive Manufacturing – Rule-based Guided Adaptation. In: Proc of the IEEE Conference on Industrial Electronics, IECON-2000, Nagoya Oct 2000, pp 283–288Google Scholar
  30. 30.
    Filev D, Tseng F (2006) Novelty detection‐based Machine Health Prognostics. In: Proc of the 2006 Int Symposium on Evolving Fuzzy Systems. IEEE Press, USA, pp 193–199Google Scholar
  31. 31.
    Fortuna L, Graziani S, Rizzo A, Xibilia MG (2007) Soft sensors for Monitoring and Control of In Industrial Processes. Springer, LondonGoogle Scholar
  32. 32.
    Goldberg DE (1989) Genetic Algorithms in Search, Optimization and Machine Learning. Addison‐Wesley, ReadingzbMATHGoogle Scholar
  33. 33.
    Hastie T, Tibshirani R, Friedman J (2001) The Elements of Statistical Learning: Data Mining, Inference and Prediction. Springer, HeidelbergzbMATHGoogle Scholar
  34. 34.
    Hornby AS (1974) Oxford Advance Learner's Dictionary. Oxford University Press, OxfordGoogle Scholar
  35. 35.
    HuangG-B, Saratchandran P, Sundarajan N (2005) A generalized growing and pruning RBF (GGAP – RBF) neural network for function approximation. IEEE Trans Neural Netw 16(1):57–67Google Scholar
  36. 36.
    Ishibuchi H, Nakashima T, Nii M (2004) Classification and Modeling with Linguistic Granules: Advanced Information Processing. Springer, BerlinGoogle Scholar
  37. 37.
    JonesE, Angelov P, Xydeas C (2006) Recovery of LSP Coefficients in VoIP Systems using Evolving Takagi–Sugeno Fuzzy MIMO Models. In: Proc of the 2006 Intern. Symposium on Evolving Fuzzy Systems, Ambelside, 7–9 Sept 2006, pp 208–214Google Scholar
  38. 38.
    Kailath T, Sayed AH, Hassibi B (2000) Linear Estimation. Prentice Hall, Upper Saddle RiverGoogle Scholar
  39. 39.
    Kalman RE (1960) A New Approach to linear filtering and prediction problem. Transactions of the American Society of Mechanical Engineering, ASME, Ser. D. J Basic Eng 8:34–45Google Scholar
  40. 40.
    Kanakakis V, Valavanis KP, Tsourveloudis NC (2004) Fuzzy‐Logic Based Navigation of Underwater Vehicles. J Intell Robotic Syst 40:45–88Google Scholar
  41. 41.
    Kasabov N (2001) Evolving fuzzy neural networks for on‐line supervised/unsupervised, knowledge‐based learning. IEEE Trans. on Systems, Man and Cybernetics – part B. Cybernetics 31:902–918Google Scholar
  42. 42.
    Kasabov N, Song Q (2002) DENFIS: Dynamic Evolving Neural‐Fuzzy Inference System and Its Application for Time‐Series Prediction. IEEE Trans Fuzzy Syst 10(2):144–154Google Scholar
  43. 43.
    Klir G, Folger T (1988) Fuzzy Sets, Uncertainty and Information. Prentice Hall, Englewood CliffszbMATHGoogle Scholar
  44. 44.
    Kohonen T (1995) Self‐Organizing Maps. Series in Inf Sci, vol 30. Springer, HeidelbergGoogle Scholar
  45. 45.
    Kordon A (2006) Inferential Sensors as Potential Application Area of Intelligent Evolving Systems. 2006 International Symposium on Evolving Fuzzy Systems, Ambleside, 7–9 September 2006, key note presentationGoogle Scholar
  46. 46.
    Kuncheva L (2000) Fuzzy Classifiers. Physica, HeidelbergGoogle Scholar
  47. 47.
    Leng G, McGuinty TM, Prasad G (2005) An approach for on‐line extraction of fuzzy rules using a self‐organizing fuzzy neural network. Fuzzy Sets Syst 150(2):211–243zbMATHGoogle Scholar
  48. 48.
    Lin F-J, Lin C-H, Shen P-H (2001) Self‐constructing fuzzy neural network speed controller for permanent‐magnet synchronous motor drives. IEEE Trans Fuzzy Syst 9(5):751–759Google Scholar
  49. 49.
    Liu PX, Meng MQ-X (2004) On‐line Data‐Driven Fuzzy Clustering with Applications to Real‐time Robotic Tracking. IEEE Trans Fuzzy Syst 12(4):516–523Google Scholar
  50. 50.
    Ljung L (1987) System Identification: Theory for the User. Prentice‐Hall, New JerseyzbMATHGoogle Scholar
  51. 51.
    Lughofer E, Angelov P, Zhou X (2007) Evolving Single‐ and Multi‐Model Fuzzy Classifiers with FLEXFIS‐Class. In: Proc of the 2007 IEEE International Conference on Fuzzy Systems, London, 23–26 July 2007, pp 363–368Google Scholar
  52. 52.
    Macias J, Angelov P, Zhou X (2006) Predicting quality of the crude oil distillation using evolving Takagi–Sugeno fuzzymodels. In: Proc of the 2006 International Symposium on Evolving Fuzzy Systems, Ambleside, 7–9 Sept 2006, pp 201–207Google Scholar
  53. 53.
    Macias‐Hernandez JJ, Angelov P, Zhou X (2007) Soft Sensor for Predicting Crude Oil Distillation Side Streams using Takagi Sugeno Evolving Fuzzy Models. In: Proc of the 2007 IEEE Int Conf on Syst, Man, and Cybernetics, Montreal, 7–10 Oct. 2007, pp 3305–3310Google Scholar
  54. 54.
    Mamdani EH, Assilian S (1975) An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller. Int J Man‐Mach Stud 7:1–13zbMATHGoogle Scholar
  55. 55.
    Massaro DW (1991) Integration versus Interactive Activation: The Joint Influence of Stimulus and Context in Perception. Cogn Psychol 23:558–614Google Scholar
  56. 56.
    Memon MA, Angelov P, Ahmed H (2006) An Approach to Real‐Time Color‐based Object Tracking. In: Proc 2006 International Symposium on Evolving Fuzzy Systems, Ambleside, 7–9 Sept 2006, pp 81–87Google Scholar
  57. 57.
    Nauck D, Kruse R (1997) A Neuro‐fuzzy method to learn fuzzy classification rules from data. Fuzzy Sets Syst 89:277–288MathSciNetGoogle Scholar
  58. 58.
    Pioneer‐3DX (2004) User Guide. ActiveMedia Robotics, AmherstGoogle Scholar
  59. 59.
    Procyk TJ, Mamdani EH (1979) A linguistic self‐organizing process controller. Automatica 15:15–30zbMATHGoogle Scholar
  60. 60.
    PsaltisD, Sideris A, Yamamura AA (1988) A Multilayered Neural Network Controller. IEEE Trans Control Syst Manag 8:17–21Google Scholar
  61. 61.
    Qin SJ, Yue H, Dunia R (1997) Self‐validating inferential sensors with application to air emission monitoring. Ind Eng Chem Res 36:1675–1685Google Scholar
  62. 62.
    Setnes M, Roubos H (2000) Ga‐fuzzy modeling and classification: complexity and performance. IEEE Trans Fuzzy Syst 8(5):509–522Google Scholar
  63. 63.
    Shimojima K, Fukuda T, Hashegawa Y (1995) Self‐Tuning Modeling with Adaptive Membership Function, Rules, and Hierarchical Structure based on Genetic Algorithm. Fuzzy Sets Syst 71:295–309Google Scholar
  64. 64.
    Sifalakis M, Hutchison D (2004) From Active Networks to Cognitive Networks. In: Proc of the ICRC Dagstuhl Seminar 04411 on Service Management and Self‐Organization in IP‐based Networks. Waden, October 2004Google Scholar
  65. 65.
    Takagi T, Sugeno M (1985) Fuzzy identification of systems and its application to modeling and control. IEEE Trans Syst Man Cybern B – Cybern 15:116–132Google Scholar
  66. 66.
    Valavanis K (2006) Unmanned Vehicle Navigation and Control: A Fuzzy Logic Perspective. In: Proc of the 2006 InternationalSymposium on Evolving Fuzzy Systems. Ambleside, 7–9 Sept. 2006, pp 200–207Google Scholar
  67. 67.
    Vapnik VN (1998) The Statistical Learning Theory. Springer, BerlinGoogle Scholar
  68. 68.
    Wang L-X (1992) Fuzzy Systems are Universal Approximators. In: Proc of the First IEEE International Conference on Fuzzy Systems, FUZZ-IEEE – 1992, San Diego, pp 1163–1170Google Scholar
  69. 69.
    Widrow B, Stearns S (1985) Adaptive Signal Processing. Prentice Hall, Englewood CliffszbMATHGoogle Scholar
  70. 70.
    Xydeas C, Angelov P, Chiao S, Reoullas M (2006) Advances in EEG Signals Classification via Dependant HMM models and Evolving Fuzzy Classifiers. Int J Comput Biol Medicine, special issue on Intell Technol Bio‐Inform Medicine 36(10):1064–1083Google Scholar
  71. 71.
    Yager R (2006) Learning Methods for Intelligent Evolving Systems. In: Proc 2006 International Symposium on Evolving Fuzzy Systems. Ambelside, 7–9 Sept. 2006, pp 3–7Google Scholar
  72. 72.
    Yager RR, Filev DP (1993) Learning of Fuzzy Rules by Mountain Clustering. In: Proc of the SPIE Conf. on Application of Fuzzy Logic Technology, Boston, pp 246–254Google Scholar
  73. 73.
    Yager RR, Filev DP (1994) Essentials of Fuzzy Modeling and Control. Wiley, New YorkGoogle Scholar
  74. 74.
    Zadeh LA (1993) Soft Computing. Introductory Lecture for the 1st European Congress on Fuzzy and Intelligent Technologies EUFIT'93, Aachen, pp vi–viiGoogle Scholar
  75. 75.
    Zhou X-W, Angelov P (2006) Real‐Time joint Landmark Recognition and Classifier Generation by an Evolving Fuzzy System. In: Proc of the 2006 IEEE World Congress on Computational Intelligence, WCCI-2006, Vancouver, 16–21 July 2006, pp 6314–6321Google Scholar
  76. 76.
    Zhou X, Angelov P (2007) An approach to autonomous self‐localization of a mobile robot in completely unknown environment using evolving fuzzy rule‐based classifier. In: Proc of the First 2007 IEEE Int Symposium on Computational Intelligence Applications for Defense and Security – a part of the IEEE Symposium Series on Computational Intelligence, SSCI-2007, Honolulu, 1–5 April 2007, pp 131–138Google Scholar

Books and Reviews

  1. 77.
    Angelov P, Xydeas C (2006) Fuzzy Systems Design: Direct and Indirect Approaches. Int J Soft Comput, special issue on New Trends in Fuzzy Modeling part I: Novel Approaches 10(9):836–849Google Scholar
  2. 78.
    Angelov P, Zhou X (2006) Evolving fuzzy systems from data streams in real‐time. Proc 2006 International Symposium on Evolving Fuzzy Systems, Ambleside, 7–9 Sept. 2006, pp 29–35Google Scholar
  3. 79.
    Bentley PJ (2000) Evolving Fuzzy Detectives: An Investigation into the Evolution of Fuzzy Rules. In: Suzuki, Roy, Ovasks, Furuhashi, Dote (eds) Soft Computing in Industrial Applications. Springer, LondonGoogle Scholar
  4. 80.
    Chan Z, Kasabov N (2004) Evolutionary computation for on‐line and off‐line parameter tuning of evolving fuzzy neural networks. Int J Comput Intell Appl 4(3):309–319Google Scholar
  5. 81.
    Fayyad UM, Piatetsky‐Shapiro G, Smyth P (1996) From Data Mining to Knowledge Discovery: An Overview, Advances in Knowledge Discovery and Data Mining. MIT Press, BostonGoogle Scholar
  6. 82.
    Fritzke B (1994) Growing cell structures – a self‐organizing network for unsupervised and supervised learning. Neural Netw 7(9):1441–1460Google Scholar
  7. 83.
    Futschik M, Reeve A, Kasabov N (2003) Evolving connectionist systems for knowledge discovery from gene expression data of cancer tissue. Artif Intell Med 28:165–189Google Scholar
  8. 84.
    Hopner F, Klawonn F (2000) Obtaining interpretable fuzzy models from fuzzy clustering and fuzzy regression. In: Proc of the 4th Intern Conf on Knowledge‐based Intelligent Engineering Systems (KES), Brighton, pp 162–165Google Scholar
  9. 85.
    Huang G-B, Saratchandran P, Sundarajan N (2005) A generalized growing and pruning RBF (GGAP‐RBF) neural network for function approximation. IEEE Trans Neural Netw 16(1):57–67Google Scholar
  10. 86.
    Huang L, Song Q, Kasabov N (2005) Evolving Connectionist Systems Based Role Allocation of Robots for Soccer Playing. In: Proc of the Joint 2005 International Symposium on Intelligent Control and 13th Mediterranean Conference on Control and Automation, ISIC – MED – 2005, Limassol, 27–29 June 2005Google Scholar
  11. 87.
    Jang JSR (1993) ANFIS: Adaptive Network‐based Fuzzy Inference Systems. IEEE Trans. on Syst Man Cybernt B – Cybern 23(3):665–685Google Scholar
  12. 88.
    Juang C-F, Lin X-T (1999) A recurrent self‐organizing neural fuzzy inference network. IEEE Trans Neural Netw 10:828–845Google Scholar
  13. 89.
    Kasabov N (2006) Adaptation and Interaction in Dynamical Systems: Modelling and Rule Discovery Through Evolving Connectionist Systems. Appl Soft Comput 6(3):307–322Google Scholar
  14. 90.
    Kasabov N (2006) Evolving connectionist systems: Brain-, gene-, and, quantum inspired computational intelligence. Springer, LondonGoogle Scholar
  15. 91.
    Kasabov N, Chan Z, Song Q, Greer D (2005) Evolving neuro‐fuzzy systems with evolutionary parameter self‐optimisation. In: Do Adaptive Smart Systems exist? Series Study in Fuzziness, vol 173. Physica, HeidelbergGoogle Scholar
  16. 92.
    Kim K, Baek J, Kim E, Park M (2005) TSK Fuzzy model based on‐line identification. In: Proc of the 11th International Fuzzy Systems Association, IFSA World Congress, Beijing, pp 1435–1439Google Scholar
  17. 93.
    Klinkenberg R, Joachims T (2000) Detection concept drift with support vector machines. Proc of the 7th International Conference on Machine Learning (ICML). Morgan Kaufman, Stanford University, pp 487–494Google Scholar
  18. 94.
    Marin‐Blazquez JG, Shen Q (2002) From approximative to descriptive fuzzy classifiers. IEEE Trans Fuzzy Syst 10(4):484–497Google Scholar
  19. 95.
    Marshall MR, Song Q, Ma TM, MacDonell S, Kasabov N (2005) Evolving Connectionist System versus Algebraic Formulae for Prediction of Renal Function from Serum Creatinine. Kidney Int 6:1944–1954Google Scholar
  20. 96.
    Ozawa S, Pang S, Kasabov N (2004) A Modified Incremental Principal Component Analysis for On‐Line Learning of Feature Space and Classifier. Lecture Notes in Artificial Intelligence LNAI, vol 3157. Springer, Berlin, pp 231–240Google Scholar
  21. 97.
    Pang S, Ozawa S, Kasabov N (2005) Incremental Linear Discriminant Analysis for Classification of Data Streams. IEEE Trans Syst Man Cybern B – Cybern 35(5):905–914Google Scholar
  22. 98.
    Plat J (1991) A resource allocation network for function interpolation. Neural Comput 3(2):213–225Google Scholar
  23. 99.
    Widmer G, Kubat M (1996) Learning in the presence of concept drift and hidden contexts. Mach Learn 23(1):69–101Google Scholar

Copyright information

© Springer-Verlag 2009

Authors and Affiliations

  • Plamen Angelov
    • 1
  1. 1.Intelligent Systems Research Laboratory, Digital Signal Processing Research Group, Communication Systems DepartmentLancaster UniversityLancasterUK