Learning to Fuse 3D+2D Based Face Recognition at Both Feature and Decision Levels

  • Stan Z. Li
  • ChunShui Zhao
  • Meng Ao
  • Zhen Lei
Conference paper

DOI: 10.1007/11564386_5

Part of the Lecture Notes in Computer Science book series (LNCS, volume 3723)
Cite this paper as:
Li S.Z., Zhao C., Ao M., Lei Z. (2005) Learning to Fuse 3D+2D Based Face Recognition at Both Feature and Decision Levels. In: Zhao W., Gong S., Tang X. (eds) Analysis and Modelling of Faces and Gestures. AMFG 2005. Lecture Notes in Computer Science, vol 3723. Springer, Berlin, Heidelberg

Abstract

2D intensity images and 3D shape models are both useful for face recognition, but in different ways. While algorithms have long been developed using 2D or 3D data, recently has seen work on combining both into multi-modal face biometrics to achieve higher performance. However, the fusion of the two modalities has mostly been at the decision level, based on scores obtained from independent 2D and 3D matchers.

In this paper, we propose a systematic framework for fusing 2D and 3D face recognition at both feature and decision levels, by exploring synergies of the two modalities at these levels. The novelties are the following. First, we propose to use Local Binary Pattern (LBP) features to represent 3D faces and present a statistical learning procedure for feature selection and classifier learning. This leads to a matching engine for 3D face recognition. Second, we propose a statistical learning approach for fusing 2D and 3D based face recognition at both feature and decision levels. Experiments show that the fusion at both levels yields significantly better performance than fusion at the decision level.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Stan Z. Li
    • 1
  • ChunShui Zhao
    • 1
  • Meng Ao
    • 1
  • Zhen Lei
    • 1
  1. 1.Center for Biometrics and Security Research & National Laboratory of Pattern Recognition, Institute of AutomationChinese Academy of SciencesBeijingChina

Personalised recommendations