Abstract
In this paper, a novel hybrid self-learning approach termed Enhanced Dynamic Self-Generated Fuzzy Q-Learning (EDSGFQL) for automatically generating a Fuzzy Inference System (FIS) is presented. In the EDSGFQL approach, the structure of an FIS is generated via Reinforcement Learning (RL) while the centers of Membership Functions (MFs) are updated by an extended Self Organizing Map (SOM) algorithm. The proposed EDSGFQL methodology can automatically create, delete and adjust fuzzy rules without any priori knowledge. In the EDSGFQL approach, fuzzy rules of an FIS are regarded as agents of the entire system and all of the rules are recruited, adjusted and terminated according to their contributions and participation. At the mean time, the centers of MFs are adjusted to move to the real centers in the sense of feature representation by the extended SOM approach. Comparative studies on a wall-following task by a mobile robot have been done for the proposed EDSGFQL approach and other current methodologies and the demonstration results show that the proposed EDSGFQL approach is superior.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Jang, J.S.R.: ANFIS: adaptive-network-based fuzzy inference system. IEEE Trans. System, Man and Cybernetics 23, 665–684 (1993)
Wu, S., Er, M.J., Gao, Y.: A fast approach for automatic generation of fuzzy rules by generailized dynamic fuzzy neural networks. IEEE Trans. Fuzzy Systems 9, 578–594 (2001)
Jouffe, L.: Fuzzy inference system learning by reinforcement methods. IEEE Trans. Systems, Man, and Cybernetics, Part C 28, 338–355 (1998)
Er, M.J., Deng, C.: Online tuning of fuzzy inference systems using dynamic fuzzy Q-learning. IEEE Trans on Systems, Man and Cybernetics, Part B 34(3), 1478–1489 (2004)
Juang, C.F.: Combination of online clustering and Q-value based GA for reinforcement fuzzy systems. IEEE Trans on Fuzzy Systems 13(3), 289–302 (2005)
Er, M.J., Zhou, Y.: Dynamic self-generated fuzzy systems for reinforcement learning. In: Proc. International Conference on Computational Intelligence for Modelling Control and Automation, CIMCA 2005, Vienna, Austria, pp. 193–198 (2005)
Er, M.J., Li, Z., Cai, H., Chen, Q.: Adaptive noise cancellation using enhanced dynamic fuzzy neural networks. IEEE Trans. Fuzzy Systems 13(3), 331–342 (2005)
Ritthiprava, P., Maneewarn, T., Laowattana, D., Wyatt, J.: A modified approach to fuzzy-Q learning for mobile robots. In: Proc. IEEE International Conference on Systems, Man and Cybernetics, vol. 3, pp. 2350–2356 (2004)
Cho, K.B., Wang, B.H.: Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction. Fuzzy Set Systems 6, 12–32 (1998)
Kohonen, T.: Self-organized formation of topologically correct feature maps. Biological Cybernetics 43, 59–69 (1982)
S. A. K-Team, Khepera 2 user manual, Switzerland (2002)
Nilsson, T.: [Online] Avaiable: http://www.kiks.f2s.com
Millan, J.D.R., Posenato, D., Dedieu, E.: Continuous-action Q-learning. Machine Learning 49(2-3), 247–265 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhou, Y., Er, M.J. (2006). A Hybrid Self-learning Approach for Generating Fuzzy Inference Systems. In: King, I., Wang, J., Chan, LW., Wang, D. (eds) Neural Information Processing. ICONIP 2006. Lecture Notes in Computer Science, vol 4234. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11893295_110
Download citation
DOI: https://doi.org/10.1007/11893295_110
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-46484-6
Online ISBN: 978-3-540-46485-3
eBook Packages: Computer ScienceComputer Science (R0)