Methods of Learning Classifier Competence Applied to the Dynamic Ensemble Selection

  • Maciej KrysmannEmail author
  • Marek Kurzynski
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 226)


In the design of dynamic ensemble selection system (DES) based on competence measure of base classifiers, two steps can be distinguished. The first step consists in calculating the set of competences of a classifier at all points of validation set. In the second step this set is generalized to the whole feature space or - in other words - the procedure of learning competence function using the competence set is performed. In the paper different methods of learning competence function are developed using the concept of randomized reference classifier as a basis for determining the competence set. The methods developed are: potential function method, linear regression, neural network, radial basis neural network, generalized regression neural network and 1-Nearest Neighbor method. Performance of DES systems for different learning methods were experimentally investigated using 9 benchmark data sets from the UCI Machine Repository and results of comparative analysis are presented.


Generalize Regression Neural Network Pattern Recognition Letter Radial Basis Neural Network Class Support Competence Measure 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Buhmann, M.D.: Radial Basis Functions: Theory and Implementations. Cambridge University (2003)Google Scholar
  2. 2.
    Canuto, A., Abreu, M., Oliveira, L.: Investigating the influence of the choice of the ensamble members in accuracy and diversity of selection and fusion methods for ensambles. Pattern Recognition Letters 28, 472–486 (2007)CrossRefGoogle Scholar
  3. 3.
    Demsar, J.: Statistical comparison of classifiers over multiple data sets. Journal of Machine Learning Research 7, 1–30 (2006)MathSciNetzbMATHGoogle Scholar
  4. 4.
    Didaci, L., Giacinto, G., Roli, F., Marcialis, G.: A study on the performance of dynamic classifier selection based on local accuracy estimation. Pattern Recognition 38, 2188–2191 (2005)zbMATHCrossRefGoogle Scholar
  5. 5.
    Giacinto, G., Roli, F.: Dynamic classifier selection based on multiple classifier behaviour. Pattern Recognition 34, 1879–1881 (2001)zbMATHCrossRefGoogle Scholar
  6. 6.
    Huenupan, F., Yoma, N., Molina, C., Garreton, C.: Confidence based multiple classifier fusion in speaker verification. Pattern Recognition Letters 29, 957–966 (2008)CrossRefGoogle Scholar
  7. 7.
    Kuncheva, L.: Combining Pattern Classifiers: Methods and Algorithms. Wiley Interscience, New Jersey (2004)zbMATHCrossRefGoogle Scholar
  8. 8.
    PRTools (2012),
  9. 9.
    Smits, P.C.: Multiple classifier systems for supervised remote sensing image classification based on dynamic classifier selection. IEEE Trans. on Geoscience and Remote Sensing 40(4), 801–813 (2002)CrossRefGoogle Scholar
  10. 10.
    Specht, D.F.: A general regression neural network. IEEE Trans. Neural Networks 2, 568–576 (1991)CrossRefGoogle Scholar
  11. 11.
    UCI Machine Learning repository,
  12. 12.
    Woods, K., Kegelmeyer, W., Bowyer, K.: Combination of multiple classifiers using local accuracy estimates. IEEE TRans. on Pattern Analysis and Machine Learning 19(4), 405–410 (1997)CrossRefGoogle Scholar
  13. 13.
    Woloszynski, T., Kurzynski, M.: On a new measure of classifier competence in the feature space. In: Kurzynski, M., Wozniak, M. (eds.) Computer Recognition Systems 3. AISC, vol. 57, pp. 285–292. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  14. 14.
    Woloszynski, T., Kurzynski, M.: A probabilistic model of classifier competence for dynamic ensemble selection. Pattern Recognition 44, 2656–2668 (2011)zbMATHCrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2013

Authors and Affiliations

  1. 1.Department of Systems and Computer NetworksWroclaw University of TechnologyWroclawPoland

Personalised recommendations