Skip to main content

An Experimental Comparison of Classifier Fusion Rules for Multimodal Personal Identity Verification Systems

  • Conference paper
  • First Online:
Multiple Classifier Systems (MCS 2002)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2364))

Included in the following conference series:

Abstract

In this paper, an experimental comparison between fixed and trained fusion rules for multimodal personal identity verification is reported. We focused on the behaviour of the considered fusion methods for ensembles of classifiers exhibiting significantly different performance, as this is one of the main characteristics of multimodal biometrics systems. The experiments were carried out on the XM2VTS database, using eight experts based on speech and face data. As fixed fusion methods, we considered the sum, majority voting, and order statistics based rules. The considered trained methods are the Behaviour Knowledge Space and the weighted averaging of classifiers outputs.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ben-Yacoub, S., Abdeljaoued, Y., Mayoraz, E.: Fusion of face and speech data for personal identity verification. IEEE Trans. on Neural Networks 10 (1999) 1065–1074

    Article  Google Scholar 

  2. Ben-Yacoub, S., Luettin, J., Jonsson, K., Matas, J., Kittler, J.: Audio-visual person verification. In: Computer Vision and Pattern Recognition. IEEE Computer Society, Los Alamitos, California (1999) 580–585

    Google Scholar 

  3. Kittler, J., Hatef, M., Duin, R., Matas, J.: On combining classifiers. IEEE Trans. on Pattern Analysis and Machine Intelligence 20 (1998) 226–239

    Article  Google Scholar 

  4. Bigun, J., Borgerforce, G., Sanniti di Baja, G. (Eds.): Audio-and Video-Based Biometric Person Authentication. Springer (1997)

    Google Scholar 

  5. Proc. of Int. Conf. on Audio-and Video-Based Biometric Person Authentication, Springer (1999)

    Google Scholar 

  6. Bigun, J., Smeraldi, F. (Eds.): Audio-and Video-Based Biometric Person Authentication. Springer (2001)

    Google Scholar 

  7. Poh, N., Korczak, J.: Hybrid biometric person authentication using face and voice features. Proc. of 3rd Int. Conf. on Audio-and Video-Based Biometric Person Authentication (2001) 348–351

    Google Scholar 

  8. Ross, A., Jain, A.K., Qian, J.Z.: Information fusion in biometrics. Proc. of 3rd Int. Conf. on Audio-and Video-Based Biometric Person Authentication (2001) 354–359

    Google Scholar 

  9. Kittler, J., Roli, F. (Eds.): Multiple Classifier Systems. Springer-Verlag, LNCS, Vol. 1857 (2000), and Vol. 2096 (2001)

    MATH  Google Scholar 

  10. Xu, L., Krzyzak, A., Suen, C.Y.: Methods of Combining Multiple Classifiers and Their Applications to Handwriting Recognition. IEEE Trans. on Systems, Man, and Cybernetics 22 (1992) 418–435

    Article  Google Scholar 

  11. Kittler, J.: Combining Classifiers. Pattern Analysis and Applications 1 (1998) 18–27

    Article  Google Scholar 

  12. Huang, Y.S., Suen, C.Y.: A Method of Combining Multiple Experts for the Recognition of Unconstrained Handwritten Numerals. IEEE Transactions on Pattern Analysis and Machine Intelligence 17 (1995) 90–94

    Article  Google Scholar 

  13. Tumer, K., Ghosh, J.: Linear and Order Statistics Combiners for Pattern Classification. In: Sharkey, AJ.C. (ed.): Combining Artificial Neural Nets. Springer (1999) 127–161

    Google Scholar 

  14. Luettin, J., Matre, G.: Evaluation protocol for the extended m2vts database (xm2vtsdb). Technical Report IDIAP-COM 98-05, Dalle Mole Institute for Perceptual Artificial Intelligence, http://www.idiap.ch (1998)

  15. Kittler, J., Ballette, M., Roli, F.: Decision level fusion in multimodal personal identity verification systems. Submitted to the Information Fusion journal, special issue on Fusion of Multiple Classifiers.

    Google Scholar 

  16. Duc, B., Maitre, G., Fisher, S., Bigun, J.: Person authentication by fusing face and speech information. Proc. 1st Int. Conf. on Audio-and Video-based Biometric Person Authentication (1997) 311–318

    Google Scholar 

  17. Kittler, J., Li, Y.P., Matas, J.: On matching scores for Ida-based face verification. Proc. of British Machine Vision Conference (2000) 42–51

    Google Scholar 

  18. Tefas, A., Koutrpoulos, C., Pitas, I.: Morphological elastic graph matching applied to frontal face authentication under well controlled and real conditions. Proc. of IEEE ICASSP (1999)

    Google Scholar 

  19. The extended m2vts database. http://www.ee.surrey.ac.uk/Research/VSSP/xm2vtsdb/ (2000)

  20. Roli, F., Fumera, G.: Analysis of linear and order statistics combiners for fusion of imbalanced classifiers. 3rd Int. Workshop on Multiple Classifier Systems (MCS 2002), Cagliari, Italy, June 2002, Springer-Verlag, LNCS, in press.

    Google Scholar 

  21. Roli, F., Raudys, S., Marcialis, G.L.: An experimental comparison of fixed and trained fusion rules for crisp classifier outputs. 3rd Int. Workshop on Multiple Classifier Systems (MCS 2002), Cagliari, Italy, June 2002, Springer-Verlag, LNCS, in press.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2002 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Roli, F., Kittler, J., Fumera, G., Muntoni, D. (2002). An Experimental Comparison of Classifier Fusion Rules for Multimodal Personal Identity Verification Systems. In: Roli, F., Kittler, J. (eds) Multiple Classifier Systems. MCS 2002. Lecture Notes in Computer Science, vol 2364. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45428-4_32

Download citation

  • DOI: https://doi.org/10.1007/3-540-45428-4_32

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-43818-2

  • Online ISBN: 978-3-540-45428-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics