A Hybrid Self-learning Approach for Generating Fuzzy Inference Systems
In this paper, a novel hybrid self-learning approach termed Enhanced Dynamic Self-Generated Fuzzy Q-Learning (EDSGFQL) for automatically generating a Fuzzy Inference System (FIS) is presented. In the EDSGFQL approach, the structure of an FIS is generated via Reinforcement Learning (RL) while the centers of Membership Functions (MFs) are updated by an extended Self Organizing Map (SOM) algorithm. The proposed EDSGFQL methodology can automatically create, delete and adjust fuzzy rules without any priori knowledge. In the EDSGFQL approach, fuzzy rules of an FIS are regarded as agents of the entire system and all of the rules are recruited, adjusted and terminated according to their contributions and participation. At the mean time, the centers of MFs are adjusted to move to the real centers in the sense of feature representation by the extended SOM approach. Comparative studies on a wall-following task by a mobile robot have been done for the proposed EDSGFQL approach and other current methodologies and the demonstration results show that the proposed EDSGFQL approach is superior.
Unable to display preview. Download preview PDF.
- 6.Er, M.J., Zhou, Y.: Dynamic self-generated fuzzy systems for reinforcement learning. In: Proc. International Conference on Computational Intelligence for Modelling Control and Automation, CIMCA 2005, Vienna, Austria, pp. 193–198 (2005)Google Scholar
- 8.Ritthiprava, P., Maneewarn, T., Laowattana, D., Wyatt, J.: A modified approach to fuzzy-Q learning for mobile robots. In: Proc. IEEE International Conference on Systems, Man and Cybernetics, vol. 3, pp. 2350–2356 (2004)Google Scholar
- 9.Cho, K.B., Wang, B.H.: Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction. Fuzzy Set Systems 6, 12–32 (1998)Google Scholar
- 11.S. A. K-Team, Khepera 2 user manual, Switzerland (2002)Google Scholar
- 12.Nilsson, T.: [Online] Avaiable: http://www.kiks.f2s.com