Rough Feature Selection for Intelligent Classifiers
The last two decades have seen many powerful classification systems being built for large-scale real-world applications. However, for all their accuracy, one of the persistent obstacles facing these systems is that of data dimensionality. To enable such systems to be effective, a redundancy-removing step is usually required to pre-process the given data. Rough set theory offers a useful, and formal, methodology that can be employed to reduce the dimensionality of datasets. It helps select the most information rich features in a dataset, without transforming the data, all the while attempting to minimise information loss during the selection process. Based on this observation, this paper discusses an approach for semantics-preserving dimensionality reduction, or feature selection, that simplifies domains to aid in developing fuzzy or neural classifiers. Computationally, the approach is highly efficient, relying on simple set operations only. The success of this work is illustrated by applying it to addressing two real-world problems: industrial plant monitoring and medical image analysis.
Unable to display preview. Download preview PDF.
- 2.Dudois, D., Prade, H.: Putting rough sets and fuzzy sets together. In: Slowinski, R. (ed.) Intelligent Decision Support, pp. 203–232. Kluwer Academic Publishers, Dordrecht (1992)Google Scholar
- 3.Lozowski, A., Cholewo, T., Zurada, J.: Crisp rule extraction from perceptron network classifiers. In: Proceedings of International Conference on Neural Networks, vol. Plenary, Panel and Special Sessions, pp. 94–99 (1996)Google Scholar
- 6.Orlowska, E.: Incomplete Information: Rough Set Analysis. Springer, Heidelberg (1997)Google Scholar
- 9.Pawlak, Z., Skowron, A.: Rough set rudiments. Bulletin of International Rough Set Society 3(4), 43–47 (2000)Google Scholar
- 10.Quinlan, J.R.: C4.5: Programs for Machine Learning. The Morgan Kaufmann Series in Machine Learning. Morgan Kaufmann, San Francisco (1993)Google Scholar
- 11.Rumelhant, D., Hinton, E., Williams, R.: Learning internal representations by error propagating. In: Rumelhant, E., McClelland, J. (eds.) Parallel Distributed Processing, MIT Press, Cambridge (1986)Google Scholar
- 13.Shen, Q.: Semantics-preserving dimensionality reduction in intelligent modelling. In: Shanahan, L.J., Ralescu, A. (eds.) Modelling with Words, Springer, Heidelberg (2003)Google Scholar