SSPR /SPR 2000: Advances in Pattern Recognition pp 641-649 | Cite as

Confidence Combination Methods in Multi-expert Systems

  • Yingquan Wu
  • K. Ianakiev
  • V. Govindaraju
Conference paper
First Online:
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1876)

Abstract

In the proposed paper, we investigate the combination of the multi-expert system in which each expert outputs a class label as well as a corresponding confidence measure. We create a special confidence measurement which is common for all experts and use it as a basis for the combination. We develop three combination methods. The first method is theoretically optimal but requires very large representative training data and storage memory for look-up table. It is actually impractical. The second method is suboptimal and reduces greatly the required training data and memory space. The last method is a simplified version of the second and needs the least training data and memory space. All three methods demand no mutual independence of the experts, thus should be useful in many applications.

Keywords

Expert classifier combination method OCR confidences Bayes rule 
Download to read the full conference paper text

References

  1. 1.
    F. Kimura, M. Shridhar, “Handwritten numerical recognition based on multiple algorithms”, Pattern Recognition vol. 24, no. 10, pp. 969–983, 1991.CrossRefGoogle Scholar
  2. 2.
    C.Y. Suen, R. Legault, C. Nodel, M. Cheriet, L. Lam, “Building a new generation of handwriting recognition systems”, Patterns Recognition Letters. vol. 16, no. 1, pp. 66–75, 1994.Google Scholar
  3. 3.
    K. Al-ghoneim and B. V. V. Kumar, “Unified decision combination framework”, Pattern Recognition, vol. 31, no. 12, pp. 2077–2089, 1998.CrossRefGoogle Scholar
  4. 4.
    S. C. Bagui and N. R. Pal, “A multi-stage generation of the rank nearest neighbour classification rule”, Pattern Recognition Letters, vol. 16, no. 6, pp. 601–614, 1995.CrossRefGoogle Scholar
  5. 5.
    T. K. Ho, J. J. Hull, and S. N. Srihari, “Decision combination in multiple classifier systems”, IEEE Trans. Patterns Analysis and Machine Intelligence, vol. 16, no. 1, pp. 66–75, 1995.Google Scholar
  6. 6.
    L. Xu, A. Krzyzak, and C. Y. Suen, “Methods of combining multiple classifiers and their application to the handwritten numerical recognition”, IEEE Trans. on System, Man, and Cybernetics, vol. SHC-22, no. 3, pp. 418–435, 1992.CrossRefGoogle Scholar
  7. 7.
    Y. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Interference, San Mateo, CA: Morgan Kaufmann Publishers, 1988.Google Scholar
  8. 8.
    S. B. Cho, J. H. Kim, “Combining multiple neural networks by fuzzy integral for robust classification”, IEEE Trans. Systems, Man, and Cybernetics, vol. 25, no. 2, pp. 380–384, 1995.CrossRefGoogle Scholar
  9. 9.
    S. B. Cho, J. H. Kim, “Multiple network fusion using fuzzy logic”, IEEE Trans. Neural Networks, vol. 6, no. 2, pp. 497–501, 1995.CrossRefGoogle Scholar
  10. 10.
    G. Rogaua, “Combining the results of several neural network classifiers”, Neural Networks, vol. 7, no. 5, pp. 777–781, 1994.CrossRefGoogle Scholar
  11. 11.
    M. D. Meteish, P. Yao, T. Stirtzinger, “A study on the use of believe functions for medical expert systems”, J, Appl. Statistics, vol. 18, no. 1, 99. 155–174, 1991.CrossRefGoogle Scholar
  12. 12.
    D. H. Wolpert, “Stacked Generalization”, Neural Networks, vol. 5, no. 2, pp. 241–260, 1992.CrossRefGoogle Scholar
  13. 13.
    T. S. Huang, and C. Y. Suen, “A method of Combining multiple experts for the recognition of unconstrained handwritten numerals”, IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 17, no. 1, pp. 90–94, 1995.CrossRefGoogle Scholar
  14. 14.
    J. Kittler, M. Hatef, R. P. Duin, and J. Matas, “On combining classifiers”, Trans, on Pattern Analysis and Machine Intelligence, vol. 20, no. 3, pp. 226–239, 1998.CrossRefGoogle Scholar
  15. 15.
    L. Lam and C. Y. Suen, “Optimal combinations of pattern classifiers”, Pattern Recognition Letters, vol 16, pp. 945–954, 1995.CrossRefGoogle Scholar
  16. 16.
    U. Srinivasan, “Polynomial discriminant method for Handwritten digital recognition”, Tech. Rep., SUNY Buffalo, December 14, 1989.Google Scholar
  17. 17.
    G. Srikantan, “Image sampling rate and image pattern recognition”, Dissertation, SUNY Buffalo, 1994.Google Scholar
  18. 18.
    S. W. Lam, G. Srikantan, and S. N. Srihari, “Gradient-based contour encoding for character recognition”, Pattern Recognition, vol. 29, no. 7, pp. 1147–1160, 1996.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2000

Authors and Affiliations

  • Yingquan Wu
    • 1
  • K. Ianakiev
    • 1
  • V. Govindaraju
    • 1
  1. 1.Center for Excellence in Document Analysis and Recognition (CEDAR) Department of Computer Science & EngineeringUniversity at BuffaloAmherstUSA

Personalised recommendations