Error Rejection in Linearly Combined Multiple Classifiers

  • Giorgio Fumera
  • Fabio Roli
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2096)


In this paper, the error-reject trade-off of linearly combined multiple classifiers is analysed in the framework of the minimum risk theory. Theoretical analysis described in [12,13] is extended for handling reject option and the optimality of the error-reject trade-off is analysed under the assumption of independence among the errors of the individual classifiers. Improvements of the error-reject trade-off obtained by linear classifier combination are quantified. Finally, a method for computing the coefficients of the linear combination and the value of the reject threshold is proposed. Experimental results on four different data sets are reported.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Battiti, R., Colla, A.M.: Democracy in neural nets: voting schemes for classification. Neural Networks 7 (1994) 691–707CrossRefGoogle Scholar
  2. 2.
    Chow, C.K.: An optimum character recognition system using decision functions. IRE Trans. on Electronic Computers 6 (1957) 247–254CrossRefGoogle Scholar
  3. 3.
    Chow, C.K.: On optimum error and reject tradeoff. IEEE Trans. on Information Theory 16 (1970) 41–46zbMATHCrossRefGoogle Scholar
  4. 4.
    Fumera, G., Roli, F.: Error Rejection in Linearly Combined Multiple Classifiers. Int. Report n. 2001-113, Dept. of Electrical and Electronic Eng., Univ. of Cagliari (2001)Google Scholar
  5. 5.
    Fumera, G., Roli, F., Giacinto, G.: Reject option with multiple thresholds. Pattern Recognition 33 (2000) 2099–2101CrossRefGoogle Scholar
  6. 6.
    Giacinto, G., Roli, F., Bruzzone, L.: Combination of neural and statistical algorithms for supervised classification of remote-sensing images. Pattern Recognition Letters 21 (2000) 385–397CrossRefGoogle Scholar
  7. 7.
    Hashem, S., Schmeiser, B.: Improving model accuracy using optimal linear combinations of trained neural networks. IEEE Trans. on Neural Networks 6 (1995) 792–794CrossRefGoogle Scholar
  8. 8.
    Lam., L., Suen, C.Y.: Optimal combination of pattern classifiers. Pattern Recognition Letters 16 (1995) 945–954CrossRefGoogle Scholar
  9. 9.
    Lam, L., Suen, C.Y.: Application of Majority Voting to Pattern Recognition: An Analysis of Its Behavior and Performance. IEEE Trans. on Systems, Man and Cybernetics–Part A 27 (1997) 553–568CrossRefGoogle Scholar
  10. 10.
    Perrone, M., Cooper, L.N.: When networks disagree: ensemble methods for hybrid neural networks. In: Mammone, R.J. (ed.): Neural Networks for Speech and Image Processing. Chapman-Hall, New York (1993)Google Scholar
  11. 11.
    Roli, F.: Multisensor image recognition by neural networks with understandable behaviour. Int. Journal of Pattern Recognition and Artificial Intelligence 10 (1996) 887–917CrossRefGoogle Scholar
  12. 12.
    Tumer, K., Ghosh, J.: Analysis of decision boundaries in linearly combined neural classifiers. Pattern Recognition 29 (1996) 341–348CrossRefGoogle Scholar
  13. 13.
    Tumer, K., Ghosh, J.: Linear and order statistics combiners for pattern classification. In: Sharkey, A.J.C. (ed.): Combining Artificial Neural Nets. Springer, London (1999)Google Scholar
  14. 14.
    Ueda, N.: Optimal linear combination of neural networks for improving classification performance. IEEE Trans. on Pattern Analisys and Machine Intelligence 22 (2000) 207–215CrossRefGoogle Scholar
  15. 15.
    Xu, L., Krzyzak, A., Suen, C.Y.: Methods of combining multiple classifiers and their applications to handwriting recognition. IEEE Trans. on Systems, Man, and Cybernetics 22 (1992) 418–435CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • Giorgio Fumera
    • 1
  • Fabio Roli
    • 1
  1. 1.Dept. of Electrical and Electronic Eng.University of CagliariCagliariItaly

Personalised recommendations