Feature Selection Based on Mutual Correlation
Feature selection is a critical procedure in many pattern recognition applications. There are two distinct mechanisms for feature selection namely the wrapper methods and the filter methods. The filter methods are generally considered inferior to wrapper methods, however wrapper methods are computationally more demanding than filter methods. A novel filter feature selection method based on mutual correlation is proposed. We assess the classification performance of the proposed filter method by using the selected features to the Bayes classifier. Alternative filter feature selection methods that optimize either the Bhattacharrrya distance or the divergence are also tested. Furthermore, wrapper feature selection techniques employing several search strategies such as the sequential forward search, the oscillating search, and the sequential floating forward search are also included in the comparative study. A trade off between the classification accuracy and the feature set dimensionality is demonstrated on both two benchmark datasets from UCI repository and two emotional speech data collections.
KeywordsFeature Selection Feature Selection Method Feature Selection Algorithm Mutual Correlation Forward Search
Unable to display preview. Download preview PDF.
- 4.Somol, P., Pudil, P.: Oscillating search algorithms for feature selection. In: 15th Int. Conf. on Pattern Recognition, Barcelona, Spain, pp. 406–409 (2000)Google Scholar
- 5.Murphy, P., Aha, D.: Uci repository of machine learning databases [ftp.ics.uci.edu] (1994)Google Scholar
- 6.Engberg, I., Hansen, A.: Documentation of the danish emotional speech database DES. Technical report, Center for Person Kommunikation, Aalborg Univ., Aalborg (1996)Google Scholar
- 7.Womack, B., Hansen, J.: N-channel hidden markov models for combined stressed speech classification and recognition. IEEE Trans. Speech and Audio Processing 6, 667–668 (1999)Google Scholar
- 9.Ververidis, D., Kotropoulos, C.: Sequential forward feature selection with low computational cost. In: Proc 13th European Signal Processing Conf., Antalya, Turkey (2005)Google Scholar
- 10.Efron, B., Tibshirani, R.: An Introduction to the Bootstrap. Chapman & Hall/CRC (1993)Google Scholar
- 12.Ferri, F.J., Pudil, P., Hatef, M., Kittler, J.: Comparative Study of Techniques for Large-Scale Feature Selection with Nonmonotonic Criterion Functions. In: Pattern Recognition in Practice IV, pp. 403–414. Elsevier, Amsterdam (1994)Google Scholar
- 16.Theodoridis, S., Koutroumbas, K.: Pattern Recognition. Elsevier, Amsterdam (2003)Google Scholar