Journal of Intelligent Information Systems

, Volume 16, Issue 3, pp 199–214

Using Rough Sets with Heuristics for Feature Selection

  • Ning Zhong
  • Juzhen Dong
  • Setsuo Ohsuga
Article

DOI: 10.1023/A:1011219601502

Cite this article as:
Zhong, N., Dong, J. & Ohsuga, S. Journal of Intelligent Information Systems (2001) 16: 199. doi:10.1023/A:1011219601502

Abstract

Practical machine learning algorithms are known to degrade in performance (prediction accuracy) when faced with many features (sometimes attribute is used instead of feature) that are not necessary for rule discovery. To cope with this problem, many methods for selecting a subset of features have been proposed. Among such methods, the filter approach that selects a feature subset using a preprocessing step, and the wrapper approach that selects an optimal feature subset from the space of possible subsets of features using the induction algorithm itself as a part of the evaluation function, are two typical ones. Although the filter approach is a faster one, it has some blindness and the performance of induction is not considered. On the other hand, the optimal feature subsets can be obtained by using the wrapper approach, but it is not easy to use because of the complexity of time and space. In this paper, we propose an algorithm which is using rough set theory with greedy heuristics for feature selection. Selecting features is similar to the filter approach, but the evaluation criterion is related to the performance of induction. That is, we select the features that do not damage the performance of induction.

feature selection rough sets heuristics inductive learning knowledge discovery in databases 

Copyright information

© Kluwer Academic Publishers 2001

Authors and Affiliations

  • Ning Zhong
    • 1
  • Juzhen Dong
    • 1
  • Setsuo Ohsuga
    • 2
  1. 1.Department of Information EngineeringMaebashi Institute of TechnologyMaebashi-CityJapan
  2. 2.Department of Information and Computer ScienceWaseda UniversityTokyoJapan

Personalised recommendations