Advertisement

On the Results of the First Mobile Biometry (MOBIO) Face and Speaker Verification Evaluation

  • Sébastien Marcel
  • Chris McCool
  • Pavel Matějka
  • Timo Ahonen
  • Jan Černocký
  • Shayok Chakraborty
  • Vineeth Balasubramanian
  • Sethuraman Panchanathan
  • Chi Ho Chan
  • Josef Kittler
  • Norman Poh
  • Benoît Fauve
  • Ondřej Glembek
  • Oldřich Plchot
  • Zdeněk Jančík
  • Anthony Larcher
  • Christophe Lévy
  • Driss Matrouf
  • Jean-François Bonastre
  • Ping-Han Lee
  • Jui-Yu Hung
  • Si-Wei Wu
  • Yi-Ping Hung
  • Lukáš Machlica
  • John Mason
  • Sandra Mau
  • Conrad Sanderson
  • David Monzo
  • Antonio Albiol
  • Hieu V. Nguyen
  • Li Bai
  • Yan Wang
  • Matti Niskanen
  • Markus Turtinen
  • Juan Arturo Nolazco-Flores
  • Leibny Paola Garcia-Perera
  • Roberto Aceves-Lopez
  • Mauricio Villegas
  • Roberto Paredes
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6388)

Abstract

This paper evaluates the performance of face and speaker verification techniques in the context of a mobile environment. The mobile environment was chosen as it provides a realistic and challenging test-bed for biometric person verification techniques to operate. For instance the audio environment is quite noisy and there is limited control over the illumination conditions and the pose of the subject for the video. To conduct this evaluation, a part of a database captured during the “Mobile Biometry” (MOBIO) European Project was used. In total there were nine participants to the evaluation who submitted a face verification system and five participants who submitted speaker verification systems. The results have shown that the best performing face and speaker verification systems obtained the same level of performance, respectively 10.9% and 10.6% of HTER.

Keywords

mobile biometric face recognition speaker recognition evaluation 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Visidon ltd., http://www.visidon.fi
  2. 2.
    Ahonen, T., Hadid, A., Pietikainen, M.: Face Recognition with Local Binary Patterns. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3021, pp. 469–481. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  3. 3.
    Albiol, A., Monzo, D., Martin, A., Sastre, J., Albiol, A.: Face recognition using hog-ebgm. Pattern Recognition Letters 29(10), 1537–1543 (2008)CrossRefGoogle Scholar
  4. 4.
    Bengio, S., Mariéthoz, J., Keller, M.: The Expected Performance Curve. In: Intl Conf. On Machine Learning, ICML (2005)Google Scholar
  5. 5.
    Bledsoe, W.W.: The model method in facial recognition. Tech. rep., Panoramic Research Inc (1966)Google Scholar
  6. 6.
    Campbell, J.P.: Speaker recognition: A tutorial. In: Proceedings of the IEEE 85(9) (September 1997)Google Scholar
  7. 7.
    Campbell, W.: Generalized linear discriminant sequence kernels for speaker recognition. In: IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2002, vol. 1, pp. I–161–I–164 (2002)Google Scholar
  8. 8.
    Campbell, W., Sturim, D., Reynolds, D.: Support vector machines using gmm supervectors for speaker verification. IEEE Signal Processing Letters 13(5), 308–311 (2006)CrossRefGoogle Scholar
  9. 9.
    Campbell, W., Sturim, D., Reynolds, D., Solomonoff, A.: Svm based speaker verification using a gmm supervector kernel and nap variability compensation. In: Acoustics, Speech and Signal Processing ICASSP 2006 Proceedings, vol. 1, pp. I–I (2006)Google Scholar
  10. 10.
    Cardinaux, F., Sanderson, C., Marcel, S.: Comparison of mlp and gmm classifiers for face verification on xm2vts. In: International Conference on Audio- and Video-based Biometric Person Authentication, pp. 1058–1059 (2003)Google Scholar
  11. 11.
    Chan, C., Kittler, J., Poh, N., Ahonen, T., Pietikäinen, M.: (multiscale) local phase quantization histogram discriminant analysis with score normalisation for robust face recognition. In: VOEC, pp. 633–640 (2009)Google Scholar
  12. 12.
    Chan, C.H., Kittler, J., Messer, K.: Multi-scale local binary pattern histograms for face recognition. In: Lee, S.-W., Li, S.Z. (eds.) ICB 2007. LNCS, vol. 4642, pp. 809–818. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  13. 13.
    Comaniciu, D., Ramesh, V., Meer, P.: Real-time tracking of non-rigid objects using mean shift. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2000), pp. 142–149 (2000)Google Scholar
  14. 14.
    Das, A.: Audio visual person authentication by multiple nearest neighbor classifiers. In: SpringerLink (2007)Google Scholar
  15. 15.
    Dehak, N.., Dehak, R.., Kenny, P., Brümmer, N., Ouellet, P., Dumouchel, P.:.Support vector machines versus fast scoring in the low-dimensional total variability space for speaker verification. In: Proc. International Conferences on Spoken Language Processing (ICSLP). pp. 1559–1562 (September 2009)Google Scholar
  16. 16.
    Ekenel, H., Fischer, M., Jin, Q., Stiefelhagen, R.: Multi-modal person identification in a smart environment. In: IEEE CVPR (2007)Google Scholar
  17. 17.
    Fauve, B., Bredin, H., Karam, W., Verdet, F., Mayoue, A., Chollet, G., Hennebert, J., Lewis, R., Mason, J., Mokbel, C., Petrovska, D.: Some results from the biosecure talking face evaluation campaign. In: Proceedings of International Conference on Acoustics Speech and Signal Processing, ICASSP (2008)Google Scholar
  18. 18.
    Hadid, A., Pietikäinen, M.: Manifold learning for video-to-video face recognition. In: COST 2101/2102 Conference, pp. 9–16 (2009)Google Scholar
  19. 19.
    Hieu, N., Bai, L., Shen, L.: Local gabor binary pattern whitened pca: A novel approach for face recognition from single image per person. In: Proceedings of The 3rd IAPR/IEEE International Conference on Biometrics 2009 (2009)Google Scholar
  20. 20.
    Kenny, P., Ouellet, P., Dehak, N., Gupta, V., Dumouchel, P.: A study of inter-speaker variability in speaker verification. In: IEEE Transactions on Audio, Speech and Language Processing (July 2008)Google Scholar
  21. 21.
    Lee, P.H., Hsu, G.S., Hung, Y.P.: Face verification and identification using facial trait code. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1613–1620 (2009)Google Scholar
  22. 22.
    Lienhart, R., Kuranov, A., Pisarevsky, V.: Empirical analysis of detection cascades of boosted classifiers for rapid object detection. In: Michaelis, B., Krell, G. (eds.) DAGM 2003. LNCS, vol. 2781, pp. 297–304. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  23. 23.
    Liu, C.: Capitalize on dimensionality increasing techniques for improving face recognition grand challenge performance. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 725–737 (2006)CrossRefGoogle Scholar
  24. 24.
    Marcel, S., McCool, C., Matějka, P., Ahonen, T., Černocký, J., Chakraborty, S., Balasubramanian, V., Panchanathan, S., Chan, C.H., Kittler, J., Poh, N., Fauve, B., Glembek, O., Plchot, O., Jančík, Z., Larcher, A., Lévy, C., Matrouf, D., Bonastre, J.F., Lee, P.H., Hung, J.Y., Wu, S.W., Hung, Y.P., Machlica, L., Mason, J., Mau, S., Sanderson, C., Monzo, D., Albiol, A., Albiol, A., Nguyen, H., Li, B., Wang, Y., Niskanen, M., Turtinen, M., Nolazco-Flores, J.A., Garcia-Perera, L.P., Aceves-Lopez, R., Villegas, M., Paredes, R.: Mobile biometry (MOBIO) face and speaker verification evaluation. Idiap-RR Idiap-RR-09-2010. Idiap Research Institute (May 2010)Google Scholar
  25. 25.
    Messer, K., Kittler, J., Sadeghi, M., Hamouz, M., Kostin, A., Cardinaux, F., Marcel, S., Bengio, S., Sanderson, C., Poh, N., Rodriguez, Y., Czyz, J., Vandendorpe, L., McCool, C., Lowther, S., Sridharan, S., Chandran, V., Palacios, R.P., Vidal, E., Bai, L., Shen, L., Wang, Y., Yueh-Hsuan, C., Hsien-Chang, L., Yi-Ping, H., Heinrichs, A., Muller, M., Tewes, A., von der Malsburg, C., Wurtz, R., Wang, Z., Xue, F., Ma, Y., Yang, Q., Fang, C., Ding, X., Lucey, S., Goss, R., Schneiderman, H.: Face authentication test on the banca database. In: Proceedings of the 17th International Conference on Pattern Recognition, vol. 4, pp. 523–532 (2004)Google Scholar
  26. 26.
    Neurotechnologija: Verilook SDK, neurotechnologija Biometrical and Artificial Intelligence Technologies, http://www.neurotechnologija.com
  27. 27.
    Phillips, J., Flynn, P., Scruggs, T., Bowyer, K., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.: Overview of the face recognition grand challenge. In: IEEE Conference of Computer Vision and Pattern Recognition, vol. 1, pp. 947–954 (2005)Google Scholar
  28. 28.
    Phillips, J.P., Moon, H., Rizv, S., Rauss, P.J.: The FERET evaluation methodology for face-recognition algorithms. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(10), 1090–1104 (2000)CrossRefGoogle Scholar
  29. 29.
    Reynolds, D.A., Quatieri, T.F., Dunn, R.B.: Speaker verification using adapted gaussian mixture models. Digital Signal Processing 10(1-3), 19–41 (2000)CrossRefGoogle Scholar
  30. 30.
    Rodriguez, Y.: Face Detection and Verification using Local Binary Patterns. Ph.D. thesis, EPFL (2006)Google Scholar
  31. 31.
    Sanderson, C., Lovell, B.C.: Multi-region probabilistic histograms for robust and scalable identity inference. In: Tistarelli, M., Nixon, M.S. (eds.) ICB 2009. LNCS, vol. 5558, pp. 199–208. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  32. 32.
    Shriberg, E., Ferrer, L., Kajarekar, S.: Svm modeling of snerf-grams for speaker recognition. In: International Conference on Spoken Language Processing (ICSLP), Jeju Island, Korea (October 2004)Google Scholar
  33. 33.
    Stolcke, A., Ferrer, L., Kajarekar, S., Shriberg, E., Venkataraman, A.: MLLR transforms as features in speaker recognition. In: International Conference on Spoken Language Processing (ICSLP), Lisbon, Portugal, pp. 2425–2428 (September 2005)Google Scholar
  34. 34.
    Tan, X., Chen, S., Zhou, Z.H., Zhang, F.: Face recognition from a single image per person: A survey. Pattern Recognition 39(9), 1725–1745 (2006)CrossRefzbMATHGoogle Scholar
  35. 35.
    Tistarelli, M., Bicego, M., Grosso, E.: Dynamic face recognition: From human to machine vision. Image and Vision Computing 27(3), 222–232 (2009)CrossRefGoogle Scholar
  36. 36.
    Villegas, M., Paredes, R.: Simultaneous learning of a discriminative projection and prototypes for nearest-neighbor classification. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1–8 (2008)Google Scholar
  37. 37.
    Villegas, M., Paredes, R., Juan, A., Vidal, E.: Face verification on color images using local features. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition CVPR Workshops 2008, pp. 1–6 (June 2008)Google Scholar
  38. 38.
    Wolf, L., Hassner, T., Taigman, Y.: Descriptor based methods in the wild. In: Real-Life Images workshop at the European Conference on Computer Vision, (ECCV) (October 2008)Google Scholar
  39. 39.
    Zhang, W., Shan, S., Gao, W., Chen, X., Zhang, H.: Local Gabor Binary Pattern Histogram Sequence (LGBPHS): A Novel Non-Statistical Model for Face Representation and Recognition. In: Proc. ICCV, pp. 786–791 (2005)Google Scholar
  40. 40.
    Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: A literature survey. ACM Computing Surveys 35(4), 399–458 (2003)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Sébastien Marcel
    • 1
  • Chris McCool
    • 1
  • Pavel Matějka
    • 3
  • Timo Ahonen
    • 2
  • Jan Černocký
    • 3
  • Shayok Chakraborty
    • 4
  • Vineeth Balasubramanian
    • 4
  • Sethuraman Panchanathan
    • 4
  • Chi Ho Chan
    • 5
  • Josef Kittler
    • 5
  • Norman Poh
    • 5
  • Benoît Fauve
    • 6
  • Ondřej Glembek
    • 3
  • Oldřich Plchot
    • 3
  • Zdeněk Jančík
    • 3
  • Anthony Larcher
    • 7
  • Christophe Lévy
    • 7
  • Driss Matrouf
    • 7
  • Jean-François Bonastre
    • 7
  • Ping-Han Lee
    • 8
  • Jui-Yu Hung
    • 8
  • Si-Wei Wu
    • 8
  • Yi-Ping Hung
    • 8
  • Lukáš Machlica
    • 9
  • John Mason
    • 10
  • Sandra Mau
    • 11
  • Conrad Sanderson
    • 11
  • David Monzo
    • 12
  • Antonio Albiol
    • 12
  • Hieu V. Nguyen
    • 13
  • Li Bai
    • 13
  • Yan Wang
    • 13
  • Matti Niskanen
    • 14
  • Markus Turtinen
    • 14
  • Juan Arturo Nolazco-Flores
    • 15
  • Leibny Paola Garcia-Perera
    • 15
  • Roberto Aceves-Lopez
    • 15
  • Mauricio Villegas
    • 16
  • Roberto Paredes
    • 16
  1. 1.Idiap Research InstituteSwitzerland
  2. 2.University of OuluFinland
  3. 3.Brno University of TechnologyCzech Republic
  4. 4.Center for Cognitive Ubiquitous ComputingArizona State UniversityUSA
  5. 5.Centre for Vision, Speech and Signal ProcessingUniversity of SurreyUK
  6. 6.Validsoft Ltd.UK
  7. 7.University of AvignonFrance
  8. 8.National Taiwan UniversityTaiwan
  9. 9.University of West BohemiaCzech Republic
  10. 10.Swansea UniversityUK
  11. 11.NICTAAustralia
  12. 12.iTEAM, Universidad Politecnica de ValenciaSpain
  13. 13.University of NottinghamUK
  14. 14.Visidon LtdFinland
  15. 15.Tecnologico de MonterreyMexico
  16. 16.Instituto Tecnológico de InformáticaUniversidad Politécnica de ValenciaSpain

Personalised recommendations