A Hybrid Self-learning Approach for Generating Fuzzy Inference Systems

  • Yi Zhou
  • Meng Joo Er
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4234)


In this paper, a novel hybrid self-learning approach termed Enhanced Dynamic Self-Generated Fuzzy Q-Learning (EDSGFQL) for automatically generating a Fuzzy Inference System (FIS) is presented. In the EDSGFQL approach, the structure of an FIS is generated via Reinforcement Learning (RL) while the centers of Membership Functions (MFs) are updated by an extended Self Organizing Map (SOM) algorithm. The proposed EDSGFQL methodology can automatically create, delete and adjust fuzzy rules without any priori knowledge. In the EDSGFQL approach, fuzzy rules of an FIS are regarded as agents of the entire system and all of the rules are recruited, adjusted and terminated according to their contributions and participation. At the mean time, the centers of MFs are adjusted to move to the real centers in the sense of feature representation by the extended SOM approach. Comparative studies on a wall-following task by a mobile robot have been done for the proposed EDSGFQL approach and other current methodologies and the demonstration results show that the proposed EDSGFQL approach is superior.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Jang, J.S.R.: ANFIS: adaptive-network-based fuzzy inference system. IEEE Trans. System, Man and Cybernetics 23, 665–684 (1993)CrossRefGoogle Scholar
  2. 2.
    Wu, S., Er, M.J., Gao, Y.: A fast approach for automatic generation of fuzzy rules by generailized dynamic fuzzy neural networks. IEEE Trans. Fuzzy Systems 9, 578–594 (2001)CrossRefGoogle Scholar
  3. 3.
    Jouffe, L.: Fuzzy inference system learning by reinforcement methods. IEEE Trans. Systems, Man, and Cybernetics, Part C 28, 338–355 (1998)CrossRefGoogle Scholar
  4. 4.
    Er, M.J., Deng, C.: Online tuning of fuzzy inference systems using dynamic fuzzy Q-learning. IEEE Trans on Systems, Man and Cybernetics, Part B 34(3), 1478–1489 (2004)CrossRefGoogle Scholar
  5. 5.
    Juang, C.F.: Combination of online clustering and Q-value based GA for reinforcement fuzzy systems. IEEE Trans on Fuzzy Systems 13(3), 289–302 (2005)CrossRefGoogle Scholar
  6. 6.
    Er, M.J., Zhou, Y.: Dynamic self-generated fuzzy systems for reinforcement learning. In: Proc. International Conference on Computational Intelligence for Modelling Control and Automation, CIMCA 2005, Vienna, Austria, pp. 193–198 (2005)Google Scholar
  7. 7.
    Er, M.J., Li, Z., Cai, H., Chen, Q.: Adaptive noise cancellation using enhanced dynamic fuzzy neural networks. IEEE Trans. Fuzzy Systems 13(3), 331–342 (2005)CrossRefGoogle Scholar
  8. 8.
    Ritthiprava, P., Maneewarn, T., Laowattana, D., Wyatt, J.: A modified approach to fuzzy-Q learning for mobile robots. In: Proc. IEEE International Conference on Systems, Man and Cybernetics, vol. 3, pp. 2350–2356 (2004)Google Scholar
  9. 9.
    Cho, K.B., Wang, B.H.: Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction. Fuzzy Set Systems 6, 12–32 (1998)Google Scholar
  10. 10.
    Kohonen, T.: Self-organized formation of topologically correct feature maps. Biological Cybernetics 43, 59–69 (1982)CrossRefMATHMathSciNetGoogle Scholar
  11. 11.
    S. A. K-Team, Khepera 2 user manual, Switzerland (2002)Google Scholar
  12. 12.
    Nilsson, T.: [Online] Avaiable: http://www.kiks.f2s.com
  13. 13.
    Millan, J.D.R., Posenato, D., Dedieu, E.: Continuous-action Q-learning. Machine Learning 49(2-3), 247–265 (2002)CrossRefMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Yi Zhou
    • 1
  • Meng Joo Er
    • 1
  1. 1.School of Electrical and Electronic EngineeringNanyang Technological UniversitySingapore

Personalised recommendations