Soft Computing

, Volume 10, Issue 9, pp 796–804 | Cite as

Construction of fuzzy knowledge bases incorporating feature selection

  • Ning XiongEmail author
  • Peter Funk


Constructing concise fuzzy rule bases from databases containing many features present an important yet challenging goal in the current researches of fuzzy rule-based systems. Utilization of all available attributes is not realistic due to the “curse of dimensionality” with respect to the rule number as well as the overwhelming computational costs. This paper proposes a general framework to treat this issue, which is composed of feature selection as the first stage and fuzzy modeling as the second stage. Feature selection serves to identify significant attributes to be employed as inputs of the fuzzy system. The choice of key features for inclusion is equivalent to the problem of searching for hypotheses that can be numerically assessed by means of case-based reasoning. In fuzzy modeling, the genetic algorithm is applied to explore general premise structure and optimize fuzzy set membership functions at the same time. Finally, the merits of this work have been demonstrated by the experiment results on a real data set


Fuzzy rule-based systems Feature selection Case-based reasoning Fuzzy modelling Genetic algorithm 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aamodt A., Plaza E. (1994). Case-based reasoning: foundational issues, methodological variations and system approaches. Artif Intell Commun 7(1):39–59Google Scholar
  2. 2.
    Casillas J. et al. (2001). Genetic feature selection in a fuzzy rule-based classification system learning process for high-dimensional problems. Inform Sci 136:135–157zbMATHCrossRefGoogle Scholar
  3. 3.
    Chi Z., Yan H., Pham T. (1996). Fuzzy algorithms with application to image processing and pattern recognition. World Scientific, SingaporeGoogle Scholar
  4. 4.
    Corcoran AL., Sen S (1994) Using real-valued genetic algorithms to evolve rule sets for classification. In: Proceeding of 1st IEEE international conference on evolutionary computation, Orlando, FL, June 27–29, 1994, pp 120–124Google Scholar
  5. 5.
    Goldberg DE. (1989). Genetic algorithms in search, optimization and machine learning. Addison-Wesley, New YorkzbMATHGoogle Scholar
  6. 6.
    Hong T-P., Chen J-B. (1999). Finding relevant attributes and membership functions. Fuzzy Sets and Systems 103:389–404CrossRefGoogle Scholar
  7. 7.
    Ishibuchi H., Nakashima T., Murata T. (1999). Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems. IEEE Trans Syst Man Cybern B 29(5):601–618CrossRefGoogle Scholar
  8. 8.
    Kolodner J. (1993). Case-based reasoning. Morgan Kaufmann, San Francisco, CAGoogle Scholar
  9. 9.
    Lee CC. (1990). Fuzzy logic in control systems: Fuzzy logic controller. IEEE Trans Syst Man Cybern 20:404–435zbMATHCrossRefGoogle Scholar
  10. 10.
    Lee H-M. et al. (2001) An efficient fuzzy classifier with feature selection based on fuzzy entropy. IEEE Trans Syst Man Cybern B 31(3):426–432CrossRefGoogle Scholar
  11. 11.
    Nakashima T. et al. (1997). Input selection in fuzzy rule-based classification systems. In: Proceeding of IEEE International Conference Fuzzy Systems, pp 1457–1462Google Scholar
  12. 12.
    Pedrycz W. (ed). (1996). Fuzzy modeling: paradigms and practice. Kluwer, Norwell, MA, USAGoogle Scholar
  13. 13.
    Silipo R., Berthold M. (2000). Input features’ impact on fuzzy decision processes. IEEE Trans Syst Man Cybern B 30(6):821–834CrossRefGoogle Scholar
  14. 14.
    Sugeno M., Yasukawa T. (1993). A fuzzy-logic-based approach to qualitative modeling. IEEE Trans Fuzzy Syst 1:7–31CrossRefGoogle Scholar
  15. 15.
    Takagi H., Hayashi I. (1991). NN-driven fuzzy reasoning. Int J Approx Reason 5:191–212zbMATHCrossRefGoogle Scholar
  16. 16.
    Xiong N., Litz L. (2002). Reduction of fuzzy control rules by means of premise learning – method and case study. Fuzzy Sets Syst 132:217–231zbMATHCrossRefMathSciNetGoogle Scholar
  17. 17.
    Xiong N., Litz L., Ressom H. (2002). Learning premises of fuzzy rules for knowledge acquisition in classification problems. Knowledge Inform Syst 4(1):96–111zbMATHCrossRefGoogle Scholar
  18. 18.
    Yager RR. (1996). A unified view of case based reasoning and fuzzy modeling. In: Ruan D (eds). Fuzzy logic foundations and industrial applications. Kluwer, Boston, pp. 5–26Google Scholar
  19. 19.
    Zadeh LA. (1973). Outline of a new approach to the analysis of complex systems and decision processes. IEEE Trans Syst Man Cybern 3:28–44zbMATHMathSciNetGoogle Scholar

Copyright information

© Springer-Verlag 2005

Authors and Affiliations

  1. 1.Department of Computer Science and ElectronicsMälardalen UniversityVästeråsSweden

Personalised recommendations