V-Head: Face Detection and Alignment for Facial Augmented Reality Applications

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10133)


Efficient and accurate face detection and alignment are key techniques for facial augmented reality (AR) applications. In this paper, we introduce V-Head, a facial AR system which consists of three major components: (1) joint face detection and shape initialization which can efficiently localize facial regions based on the proposed face probability map and a multipose classifier and meanwhile explicitly produces a roughly aligned initial shape, (2) cascade face alignment to locate 2D facial landmarks on the detected face, and (3) 3D head pose estimation based on the perspective-n-point (PnP) algorithm so as to overlay 3D virtual objects on the detected faces. The demonstration can be accessed from


Face detection Face initialization Face alignment AR 


  1. 1.
    Cao, X., Wei, Y., Wen, F., Sun, J.: Face alignment by explicit shape regression. Int. J. Comput. Vis. 107(2), 177–190 (2014)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Chen, D., Ren, S., Wei, Y., Cao, X., Sun, J.: Joint cascade face detection and alignment. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8694, pp. 109–122. Springer, Heidelberg (2014). doi: 10.1007/978-3-319-10599-4_8 Google Scholar
  3. 3.
    Ren, S., Cao, X., Wei, Y., Sun, J.: Face alignment at 3000 FPS via regressing local binary features. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2014Google Scholar
  4. 4.
    Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., Pantic, M.: 300 faces in-the-wild challenge: the first facial landmark localization challenge. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp. 397–403 (2013)Google Scholar
  5. 5.
    Yang, H., Mou, W., Zhang, Y., Patras, I., Gunes, H., Robinson, P.: Face alignment assisted by head pose estimation. In: Proceedings of the British Machine Vision Conference (BMVC), pp. 130.1–130.13. BMVA Press, September 2015Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Shool of Electronic Information and CommunicationsHuazhong University of Science and TechnologyWuhanChina

Personalised recommendations