A Score-Level Fusion Benchmark Database for Biometric Authentication

  • Norman Poh
  • Samy Bengio
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3546)

Abstract

Fusing the scores of several biometric systems is a very promising approach to improve the overall system’s accuracy. Despite many works in the literature, it is surprising that there is no coordinated effort in making a benchmark database available. It should be noted that fusion in this context consists not only of multimodal fusion, but also intramodal fusion, i.e., fusing systems using the same biometric modality but different features, or same features but using different classifiers. Building baseline systems from scratch often prevents researchers from putting more efforts in understanding the fusion problem. This paper describes a database of scores taken from experiments carried out on the XM2VTS face and speaker verification database. It then proposes several fusion protocols and provides some state-of-the-art tools to evaluate the fusion performance.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Jain, A.K., Bolle, R., Pankanti, S.: Biometrics: Person Identification in a Networked Society. Kluwer Publications, Dordrecht (1999)Google Scholar
  2. 2.
    Kittler, J., Matas, G., Jonsson, K., Sanchez, M.: Combining Evidence in Personal Identity Verification Systems. Pattern Recognition Letters 18(9), 845–852 (1997)CrossRefGoogle Scholar
  3. 3.
    Kittler, J., Messer, K., Czyz, J.: Fusion of Intramodal andMultimodal Experts in Personal Identity Authentication Systems. In: Proc. Cost 275 Workshop, Rome, pp. 17–24 (2002)Google Scholar
  4. 4.
    Fierrez-Aguilar, J., Ortega-Garcia, J., Garcia-Romero, D., Gonzalez-Rodriguez, J.: A Comparative Evaluation of Fusion Strategies for Multimodal Biometric Verification. In: Kittler, J., Nixon, M.S. (eds.) AVBPA 2003. LNCS, vol. 2688, pp. 830–837. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  5. 5.
    Dugelay, J.-L., Junqua, J.-C., Rose, K., Turk, M.(Organizers): Workshop on Multimodal User Authentication (MMUA 2003), Santa Barbara, CA, December 11–12 (2003)Google Scholar
  6. 6.
    Indovina, M., Uludag, U., Snelick, R., Mink, A., Jain, A.: Multimodal Biometric Authentication Methods: A COTS Approach. In: Workshop on Multimodal User Authentication (MMUA 2003), Santa Barbara, pp. 99–106 (2003)Google Scholar
  7. 7.
    Bailly-Baillière, E., Bengio, S., Bimbot, F., Hamouz, M., Kittler, J., Mariéthoz, J., Matas, J., Messer, K., Popovici, V., Porée, F., Ruiz, B., Thiran, J.-P.: The BANCA Database and Evaluation Protocol. In: Kittler, J., Nixon, M.S. (eds.) AVBPA 2003. LNCS, vol. 2688, Springer, Heidelberg (2003)Google Scholar
  8. 8.
    Lüttin, J.: Evaluation Protocol for the XM2FDB Database (Lausanne Protocol). Communication 98-05, IDIAP, Martigny, Switzerland (1998)Google Scholar
  9. 9.
    Carcia-Salicetti, S., Beumier, C., Chollet, G., Dorizzi, B., Leroux, J.: BIOMET: A Multimodal Person Authentication Database Including Face, Voice, Fingerprint, Hand and Signature Modalities. In: Kittler, J., Nixon, M.S. (eds.) AVBPA 2003. LNCS, vol. 2688, pp. 845–853. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  10. 10.
    Ortega-Garcia, J., Fierrez-Aguilar, J., Simon, D., Gonzalez, J., Faundez-Zanuy, M., Espinosa, V., Satue, A., Hernaez, I., Igarza, J.-J., Vivaracho, C., Escudero, D., Moro, Q.-I.: Biometric on the Internet MCYT Baseline Corpus: a Bimodal Biometric Database. IEE Proc. Visual Image Signal Processing 150(6), 395–401 (2003)CrossRefGoogle Scholar
  11. 11.
    Martin, A., Doddington, G., Kamm, T., Ordowsk, M., Przybocki, M.: The DET Curve in Assessment of Detection Task Performance. In: Proc. Eurospeech 1997, Rhodes, pp. 1895–1898 (1997)Google Scholar
  12. 12.
    Bengio, S., Mariéthoz, J.: The Expected Performance Curve: a New Assessment Measure for Person Authentication. In: The Speaker and Language Recognition Workshop (Odyssey), Toledo, pp. 279–284 (2004)Google Scholar
  13. 13.
    Bengio, S., Mariéthoz, J.: A Statistical Significance Test for Person Authentication. In: The Speaker and Language Recognition Workshop (Odyssey), Toledo, pp. 237–244 (2004)Google Scholar
  14. 14.
    Schuckers, M.E., Knickerbocker, C.J.: Documentation for Program for Rate Estimation and Statistical Summaries PRESS, Department of Mathematics, Computer Science and Statistics St Lawrence University, Canton, NY 13617 and Center for Identification Technology Research, West Virginia UniversityGoogle Scholar
  15. 15.
    Matas, J., Hamouz, M., Jonsson, K., Kittler, J., Li, Y., Kotropoulos, C., Tefas, A., Pitas, I., Tan, T., Yan, H., Smeraldi, F., Begun, J., Capdevielle, N., Gerstner, W., Ben-Yacoub, S., Abdeljaoued, Y., Mayoraz, E.: Comparison of Face Verification Results on the XM2VTS Database. In: Proc. 15th Int’l Conf. Pattern Recognition, Barcelona, vol. 4, pp. 858–863 (2000)Google Scholar
  16. 16.
    Saeta, J.R., Hernando, J.: On the Use of Score Pruning in Speaker Verification for Speaker Dependent Threshold Estimation. In: The Speaker and Language Recognition Workshop (Odyssey), Toledo, pp. 215–218 (2004)Google Scholar
  17. 17.
    Fierrez-Aguilar, J., Ortega-Garcia, J., Gonzalez-Rodriguez, J.: Target Dependent Score Normalisation Techniques and Their Application to Signature Verification. In: Zhang, D., Jain, A.K. (eds.) ICBA 2004. LNCS, vol. 3072, pp. 498–504. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  18. 18.
    Jain, A., Ross, A.: Learning User-Specific Parameters in Multibiometric System. In: Proc. Int’l Conf. of Image Processing (ICIP 2002), New York, pp. 57–70 (2002)Google Scholar
  19. 19.
    Kumar, A., Zhang, D.: Integrating Palmprint with Face for User Authentication. In: Workshop on Multimodal User Authentication (MMUA 2003), Santa Barbara, pp. 107–112 (2003)Google Scholar
  20. 20.
    Poh, N., Bengio, S.: Database, Protocol and Tools for Evaluating Score-Level Fusion Algorithms in Biometric Authentication. Research Report 04-44, IDIAP, Martigny, Switzerland (2004)Google Scholar
  21. 21.
    Marcel, S., Bengio, S.: Improving Face Verification Using Skin Color Information. In: Proc. 16th Int. Conf. on Pattern Recognition, Quebec (2002)Google Scholar
  22. 22.
    Sanderson, C., Paliwal, K.K.: Fast Features for Face Authentication Under Illumination Direction Changes. Pattern Recognition Letters 24(14), 2409–2419 (2003)CrossRefGoogle Scholar
  23. 23.
    Rabiner, L., Juang, B.-H.: Fundamentals of Speech Recognition. Oxford University Press, Oxford (1993)Google Scholar
  24. 24.
    Ikbal, S., Misra, H., Bourlard, H.: Phase Auto-Correlation (PAC) derived Robust Speech Features. In: Proc. IEEE Int’l Conf. Acoustics, Speech, and Signal Processing (ICASSP 2003), Hong Kong, pp. 133–136 (2003)Google Scholar
  25. 25.
    Paliwal, K.K.: Spectral Subband Centroids Features for Speech Recognition. In: Proc. Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), Seattle, vol. 2, pp. 617–620 (1998)Google Scholar
  26. 26.
    Poh, N., Sanderson, C., Bengio, S.: An Investigation of Spectral Subband Centroids For Speaker Authentication. In: Zhang, D., Jain, A.K. (eds.) ICBA 2004. LNCS, vol. 3072, pp. 631–639. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  27. 27.
    Poh, N., Sanderson, C., Bengio, S.: An Investigation of Spectral Subband Centroids For Speaker Authentication. Research Report 03-62, IDIAP, Martigny, Switzerland (2003)Google Scholar
  28. 28.
    Bishop, C.: Neural Networks for Pattern Recognition. Oxford University Press, Oxford (1999)Google Scholar
  29. 29.
    Gauvain, J.L., Lee, C.-H.: Maximum a Posteriori Estimation for Multivariate Gaussian Mixture Obervation of Markov Chains. IEEE Tran. Speech Audio Processing 2, 290–298 (1994)Google Scholar
  30. 30.
    Cardinaux, F., Sanderson, C., Marcel, S.: Comparison of MLP and GMM Classifiers for Face Verification on XM2VTS. In: Kittler, J., Nixon, M.S. (eds.) AVBPA 2003. LNCS, vol. 2688, pp. 911–920. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  31. 31.
    Poh, N., Bengio, S.: Noise-Robust Multi-Stream Fusion for Text-Independent Speaker Authentication. In: The Speaker and Language Recognition Workshop (Odyssey), Toledo, pp. 199–206 (2004)Google Scholar
  32. 32.
    Poh, N., Bengio, S.: Non-Linear Variance Reduction Techniques in Biometric Authentication. In: Workshop on Multimodal User Authentication (MMUA 2003), Santa Barbara, pp. 123–130 (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Norman Poh
    • 1
  • Samy Bengio
    • 1
  1. 1.IDIAP Research InstituteMartignySwitzerland

Personalised recommendations