Multimodal Authentication Using Asynchronous HMMs

  • Samy Bengio
Conference paper

DOI: 10.1007/3-540-44887-X_89

Part of the Lecture Notes in Computer Science book series (LNCS, volume 2688)
Cite this paper as:
Bengio S. (2003) Multimodal Authentication Using Asynchronous HMMs. In: Kittler J., Nixon M.S. (eds) Audio- and Video-Based Biometric Person Authentication. AVBPA 2003. Lecture Notes in Computer Science, vol 2688. Springer, Berlin, Heidelberg


It has often been shown that using multiple modalities to authenticate the identity of a person is more robust than using only one. Various combination techniques exist and are often performed at the level of the output scores of each modality system. In this paper, we present a novel HMM architecture able to model the joint probability distribution of pairs of asynchronous sequences (such as speech and video streams) describing the same event. We show how this model can be used for audio-visual person authentication. Results on the M2VTS database show robust performances of the system under various audio noise conditions, when compared to other state-of-the-art techniques.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Samy Bengio
    • 1
  1. 1.Dalle Molle Institute for Perceptual Artificial Intelligence (IDIAP)MartignySwitzerland

Personalised recommendations