Fast and Precise Face Alignment and 3D Shape Reconstruction from a Single 2D Image

  • Ruiqi Zhao
  • Yan Wang
  • C. Fabian Benitez-Quiroz
  • Yaojie Liu
  • Aleix M. Martinez
Conference paper

DOI: 10.1007/978-3-319-48881-3_41

Part of the Lecture Notes in Computer Science book series (LNCS, volume 9914)
Cite this paper as:
Zhao R., Wang Y., Benitez-Quiroz C.F., Liu Y., Martinez A.M. (2016) Fast and Precise Face Alignment and 3D Shape Reconstruction from a Single 2D Image. In: Hua G., Jégou H. (eds) Computer Vision – ECCV 2016 Workshops. ECCV 2016. Lecture Notes in Computer Science, vol 9914. Springer, Cham

Abstract

Many face recognition applications require a precise 3D reconstruction of the shape of the face, even when only a single 2D image is available. We present a novel regression approach that learns to detect facial landmark points and estimate their 3D shape rapidly and accurately from a single face image. The main idea is to regress a function f(.) that maps 2D images of faces to their corresponding 3D shape from a large number of sample face images under varying pose, illumination, identity and expression. To model the non-linearity of this function, we use a deep neural network and demonstrate how it can be efficiently trained using a large number of samples. During testing, our algorithm runs at more than 30 frames/s on an i7 desktop. This algorithm was the top 2 performer in the 3DFAW Challenge.

Keywords

3D modeling and reconstruction of faces Fine-grained detection 3D shape from a single 2D image Precise and detailed detections 

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Ruiqi Zhao
    • 1
  • Yan Wang
    • 1
  • C. Fabian Benitez-Quiroz
    • 1
  • Yaojie Liu
    • 1
  • Aleix M. Martinez
    • 1
  1. 1.The Ohio State UniversityColumbusUSA

Personalised recommendations