Comparing Diversity and Training Accuracy in Classifier Selection for Plurality Voting Based Fusion

  • H. Altinçay
Conference paper


Selection of an optimal subset of classifiers in designing classifier ensembles is an important problem. The search algorithms used for this purpose maximize an objective function which may be the combined training accuracy or diversity of the selected classifiers. Taking into account the fact that there is no benefit in using multiple copies of the same classifier, it is generally argued that the classifiers should be diverse and several measures of diversity are proposed for this purpose. In this paper, the relative strengths of combined training accuracy and diversity based approaches are investigated for the plurality voting based combination rule. Moreover, we propose a diversity measure where the difference in classification behavior exploited by the plurality voting combination rule is taken into account.


Radial Basis Function Neural Network Classifier Ensemble Weak Classifier Classifier Selection Training Accuracy 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    G. Giacinto and F. Roli. Design of effective neural network ensembles for image classification purposes. Image, Vision and Computing Journal, 19(9–10):669–707, 2001.Google Scholar
  2. [2]
    A. Krogh and J. Vedelsby. Neural network ensembles, cross validation, and active learning. In Advances in Neural Information Processing Systems, volume 7, pages 231–238. The MIT Press, 1995.Google Scholar
  3. [3]
    G. Zenobi and P. Cunningham. Using diversity in preparing ensembles of classifiers based on different feature subsets to minimize generalization error. Lecture Notes in Computer Science, 2167, 2001.Google Scholar
  4. [4]
    L. I. Kuncheva and C. J. Whitaker. Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Machine Learning, 51:181–207, 2003.CrossRefGoogle Scholar
  5. [5]
    D. Partridge et al. MCS diversity and classifier confidence: A Bayesian approach. http://www. dcs. ex., 2004.Google Scholar
  6. [6]
    R. P. W. Duin. PRTOOLS (version 3.0). A Matlab toolbox for pattern recognition. Pattern Recognition Group, Delft University, Netherlands, January 2000.Google Scholar

Copyright information

© Springer-Verlag/Wien 2005

Authors and Affiliations

  • H. Altinçay
    • 1
  1. 1.Department of Computer EngineeringEastern Mediterranean University KKTCMersin 10Turkey

Personalised recommendations