Classifier Ensemble Generation for the Majority Vote Rule
This paper addresses the problem of classifier ensemble generation. The goal is to obtain an ensemble to achieve maximum recognition gains with the lowest number of classifiers. The final decision is taken following a majority vote rule. If the classifiers make independent errors, the majority vote outperforms the best classifier. Therefore, the ensemble should be formed by classifiers exhibiting individual accuracy and diversity. To account for the quality of the ensemble, this work uses a sigmoid function to measure the behavior of the ensemble in relation to the majority vote rule, over a test labelled data set.
KeywordsCombining classifiers Ensemble generation Majority vote
- 3.Zhou, Z., Wu, J., Tang, W.: On the Relation between Dependence and Diversity in Multiple Classifier Systems. In: Proceedings of the International Conference on Information Technology, ITCC 2005, Las Vegas, USA, pp. 134–139 (2005)Google Scholar
- 5.Meynet, J.: Information theoretic combination of classifiers with application to face detection, Ph.D. Thesis (2007)Google Scholar
- 6.Pudil, P., Ferri, F.J., Novovicova, J., Kittler, J.: Floating search methods for feature selection with nonmonotoniccriterion functions. In: Conference on Pattern Recognition, 1994, vol. 2, pp. 279–283 (1994)Google Scholar
- 8.The Xm2VTSDB, http://www.ee.surrey.ac.uk/Research/VSSP/xm2vtsdb/