Classifier Ensemble Generation for the Majority Vote Rule

  • Carlos Orrite
  • Mario Rodríguez
  • Francisco Martínez
  • Michael Fairhurst
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5197)

Abstract

This paper addresses the problem of classifier ensemble generation. The goal is to obtain an ensemble to achieve maximum recognition gains with the lowest number of classifiers. The final decision is taken following a majority vote rule. If the classifiers make independent errors, the majority vote outperforms the best classifier. Therefore, the ensemble should be formed by classifiers exhibiting individual accuracy and diversity. To account for the quality of the ensemble, this work uses a sigmoid function to measure the behavior of the ensemble in relation to the majority vote rule, over a test labelled data set.

Keywords

Combining classifiers Ensemble generation Majority vote 

References

  1. 1.
    Kuncheva, L.I.: Combining Pattern Classifiers: Methods and Algorithms. Wiley InterScience, Chichester (2004)CrossRefMATHGoogle Scholar
  2. 2.
    Oh, S.: On the relationship between majority vote accuracy and dependency in multiple classifier systems. Pattern Recog. Letters 24, 359–363 (2003)CrossRefMATHGoogle Scholar
  3. 3.
    Zhou, Z., Wu, J., Tang, W.: On the Relation between Dependence and Diversity in Multiple Classifier Systems. In: Proceedings of the International Conference on Information Technology, ITCC 2005, Las Vegas, USA, pp. 134–139 (2005)Google Scholar
  4. 4.
    Narasimhamurthy, A.: Evaluation of diversity measures for binary classifier ensembles. In: Oza, N.C., Polikar, R., Kittler, J., Roli, F. (eds.) MCS 2005. LNCS, vol. 3541, pp. 267–277. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  5. 5.
    Meynet, J.: Information theoretic combination of classifiers with application to face detection, Ph.D. Thesis (2007)Google Scholar
  6. 6.
    Pudil, P., Ferri, F.J., Novovicova, J., Kittler, J.: Floating search methods for feature selection with nonmonotoniccriterion functions. In: Conference on Pattern Recognition, 1994, vol. 2, pp. 279–283 (1994)Google Scholar
  7. 7.
    Shen, L., Bai, L., Fairhurst, F.: Gabor wavelets and General Discriminat Analysis for face identification and verification. Image and Vision Computing 25(5), 553–563 (2007)CrossRefGoogle Scholar
  8. 8.
  9. 9.
  10. 10.
    Martinez, F., Orrite, C., Herrero, E.: Biometric Hand Recognition using Neural Networks. In: Cabestany, J., Gonzalez Prieto, A., Sandoval, F. (eds.) IWANN 2005. LNCS, vol. 3512, pp. 1164–1171. Springer, Heidelberg (2005)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Carlos Orrite
    • 1
  • Mario Rodríguez
    • 1
  • Francisco Martínez
    • 1
  • Michael Fairhurst
    • 2
  1. 1.Aragon Institute for Engineering ResearchUniversity of ZaragozaSpain
  2. 2.Electronics DepartmentUniversity of KentUK

Personalised recommendations