An Efficient Fuzzy Rough Approach for Feature Selection

  • Feifei Xu
  • Weiguo Pan
  • Lai Wei
  • Haizhou Du
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6954)

Abstract

Rough set theory is a powerful tool for feature selection. To avoid the information loss by discretization in rough sets, fuzzy rough sets are used to deal with the continuous values. However, the cost of computation of the approach is too high to be worked out as the number of selected features increases. In this paper, a new computational method is proposed to approximate the conditional mutual information between the selected features and the decision feature, and thus improve the efficiency and decrease the complexity of the classical fuzzy rough approach based on mutual information. Extensive experiments are conducted on the large-sized coal-fired power units dataset with steady state, and the experimental results confirm the efficiency and effectiveness of the proposed algorithm.

Keywords

Fuzzy rough sets Feature selection Mutual information Large-sized coal-fired power units 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Yu, L., Liu, H.: Feature Selection for High-Dimensional Data: A Fast Correlation-Based Filter Solution. In: Proceedings of the Twentieth International Conference on Machine Learning (ICML-2003), Washington DC (2003)Google Scholar
  2. 2.
    Jensen, R., Shen, Q.: New Approaches to Fuzzy-Rough Feature Selection. IEEE Transactions on Fuzzy Systems 17(4), 824–838 (2009)CrossRefGoogle Scholar
  3. 3.
    Hu, Q.H., Xie, Z.X., Yu, D.R.: Hybrid Attribute Reduction Based on A Novel Fuzzy-rough Model and Information Granulation. Pattern Recognition 40, 3509–3521 (2007)CrossRefMATHGoogle Scholar
  4. 4.
    Jensen, R., Shen, Q.: Computational Intelligence and Feature Selection: Rough and Fuzzy Approaches. Wiley-IEEE Press (2008)Google Scholar
  5. 5.
    Pawlak, Z.: Rough Sets: Theoretical Aspects of Reasoning About Data. Kluwer, Norwell (1991)CrossRefMATHGoogle Scholar
  6. 6.
    Xu, F.F., Miao, D.Q., Wei, L.: Fuzzy-rough Attribute Reduction via Mutual Information with An Application to Cancer Classification. Computer and Mathematics with Applications 57, 1010–1017 (2009)CrossRefMATHGoogle Scholar
  7. 7.
    Peng, H., Long, F., Ding, C.: Feature Selection Based on Mutual Information: Criteria of Max-Dependency, Max-Relevance, and Min-Redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(8), 1226–1238 (2005)CrossRefGoogle Scholar
  8. 8.
    Maji, P., Paul, S.: Rough Set Based Maximum Relevance-Maximum Significance Criterion and Gene Selection from Microarray Data. Int. J. Approx. Reason. (2010) (in press)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Feifei Xu
    • 1
  • Weiguo Pan
    • 1
  • Lai Wei
    • 2
  • Haizhou Du
    • 1
  1. 1.Shanghai University of Electric PowerShanghaiChina
  2. 2.College of Information EngineeringShanghai Maritime UniversityShanghaiChina

Personalised recommendations