Skip to main content
SpringerLink
Log in

Face Modeling

  • Living reference work entry
  • First Online:
Computer Vision

  • 25 Accesses

Synonyms

Face reconstuction; Structure-from-Motion (SfM); Three dimensional face modeling

Definition

Face modeling usually refers to the problem of recovering 3D face geometries from one or more images, though the recovery of lighting and skin reflectance is sometimes considered as face modeling as well.

Background

Because the face is a special type of object which people are all familiar with, there have been tremendous interests among researchers in the problem of 3D face reconstruction. The most reliable and accurate way to obtain face geometries is by using active sensors such as laser scanners and structured light systems. So far, laser scanners are the most commonly used and most accurate active sensors. Structured light systems are becoming more popular because they are capable of capturing continuous motions. Some structured light systems use visible light sources, while others use invisible light sources such as infrared lights. Visible light systems give better signals, but...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

References

  1. Fua P, Miccio C (1998) From regular images to animated heads: a least squares approach. In: European conference on computer vision (ECCV), pp 188–202, Freiburg

    Google Scholar 

  2. Zhang Z, Liu Z, Adler D, Cohen M, Hanson E, Shan Y (2004) Robust and rapid generation of animated faces from video images: a model-based modeling approach. Int J Comput Vis 58(7):743–756

    Google Scholar 

  3. Dimitrijevic M, Ilic S, Fua P (2004) From regular images to animated heads: a least squares approach. In: Computer vision and pattern recognition (CVPR), pp II:1034–1041, Washington DC

    Google Scholar 

  4. Amberg B, Blake A, Fitzgibbon A, Romdhani S (2007) Reconstructing high quality face-surfaces using model based stereo. In: Internaional conference on computer vision (ICCV), Rio de Janeiro

    Google Scholar 

  5. Blanz V, Vetter T (1999) A morphable model for the synthesis of 3D faces. In: Computer graphics, annual conference series, pp 187–194. Siggraph, Aug 1999

    Google Scholar 

  6. Zhang L, Wang S, Samaras D (2005) Face synthesis and recognition under arbitrary unknown lighting using a spherical harmonic basis morphable model. In: Computer vision and pattern recognition (CVPR), vol II, pp 209–216

    Google Scholar 

  7. Lee J, Moghaddam B, Pfister H, Machiraju R (2005) A bilinear illumination model for robust face recognition. In: Internaional conference on computer vision (ICCV), vol II, pp 1177–1184

    Google Scholar 

  8. Wang Y, Zhang L, Liu Z, Hua G, Wen Z, Zhang Z, Samaras D (2009) Face re-lighting from a single image under arbitrary unknown lighting conditions. IEEE Trans Pattern Recogn Mach Intell 31(11):1968–1984

    Article  Google Scholar 

  9. Liu Z, Zhang Z (2011) Face geometry and appearance modeling: concepts and applications. Cambridge University Press, Cambridge

    Book  Google Scholar 

  10. Liu Z, Zhang Z, Jacobs C, Cohen M (2000) Rapid modeling of animated faces from video. In: Proceedings of visual 2000, pp 58–67

    MATH  Google Scholar 

  11. Chen Q, Medioni G (2001) Building 3-D human face models from two photographs. J VLSI Signal Process 27(1–2):127–140

    Article  Google Scholar 

  12. Shan Y, Liu Z, Zhang Z (2001) Model-based boundle adjustment with application to face modeling. In: Internaional conference on computer vision (ICCV), pp 644–651

    Google Scholar 

  13. Akimoto T, Suenaga Y, Wallace RS (1993) Automatic 3D facial models. IEEE Comput Graph Appl 13(5):16–22

    Article  Google Scholar 

  14. Ip HH, Yin L (1996) Constructing a 3D individualized head model from two orthogonal views. Vis Comput (12):254–266

    Article  Google Scholar 

  15. Dariush B, Kang SB, Waters K (1998) Spatiotemporal analysis of face profiles: detection, segmentation, and registration. In: Proceedings of the 3rd international conference on automatic face and gesture recognition, pp 248–253. IEEE, April 1998

    Google Scholar 

  16. Ramamoorthi R, Hanrahan P A signal-processing framework for inverse rendering. In: SIGGRAPH’01, pp 117–128

    Google Scholar 

  17. Basri R, Jacobs DW (2003) Lambertian reflectance and linear subspaces. vol 25, pp 218–233

    Google Scholar 

  18. Deng Y, Yang J, Xu S, Chen D, Jia Y, Tong X (2019) Accurate 3D face reconstruction with weakly-supervised learning: from single image to image set. In: IEEE computer vision and pattern recognition workshop (CVPRW) on analysis and modeling of faces and gestures (AMFG)

    Google Scholar 

  19. Sengupta S, Kanazawa A, Castillo CD, Jacobs DW (2018) SfSNet: learning shape, reflectance and illuminance of facesin the wild. In: Computer vision and pattern recognition (CVPR), pp 6296–6305

    Google Scholar 

  20. Richardson E, Sela M, Or-El R, Kimmel R (2017) Learning detailed face reconstruction from a single image. In: Computer vision and pattern recognition (CVPR), pp 5553–5562

    Google Scholar 

  21. Tran AT, Hassner T, Masi I, Medioni G (2017) Regressing robust and discriminative 3D morphable models with a very deep neural network. In: Computer vision and pattern recognition (CVPR), pp 1493–1502

    Google Scholar 

  22. Dou P, Shah SK, Kakadiaris IA (2017) End-to-end 3D face reconstruction with deep neural networks. In: Computer vision and pattern recognition (CVPR)

    Google Scholar 

  23. Richardson E, Sela M, Kimmel R (2016) 3D face reconstruction by learning from synthetic data. In: International conferenec on 3D vision (3DV), pp 460–469

    Google Scholar 

  24. Feng Y, Wu F, Shao X, Wang Y, Zhou X (2018) Joint 3D face reconstruction and dense alignment with position map regression network. In: European conference on computer vision (ECCV)

    Google Scholar 

  25. Wang L, Wu Y-J, Zhuang X, Soong FK (2011) Synthesizing visual speech trajectory with minimum generation error. In: IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 4580–4583

    Google Scholar 

  26. Wang L, Soong FK (2015) Hmm trajectory-guided sample selection for photo-realistic talking head. Multimed Tools Appl 74(22):9849–9869

    Article  Google Scholar 

  27. Sato K, Nose T, Ito A (2017) Hmm-based photo-realistic talking face synthesis using facial expression parameter mapping with deep neural networks. J Comput Commun 5(10)

    Google Scholar 

  28. Suwajanakorn S, Seitz SM, Kemelmacher-Shlizerman I (2017) Synthesizing Obama: learning lip sync from audio. In: SIGGRAPH

    Book  Google Scholar 

  29. Yang R, Zhang Z (2002) Eye gaze correction with stereovision for video tele-conferencing. In: European conference on computer vision (ECCV), vol II, pp 479–494, Copenhagen

    Google Scholar 

  30. Romdhani S, Blanz V, Vetter T (2002) Face identification by fitting a 3D morphable model using linear shape and texture error functions. In: European conference on computer vision (ECCV), vol II, pp 3–19, Copenhagen

    Google Scholar 

  31. Qing L, Shan S, Gao W, Du B (2005) Face recognition under generic illumination based on harmonic relighting. Int J Pattern Recogn Artif Intell 19(4):513–531

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Microsoft Cloud+ AI, Redmond, WA, USA

    Zicheng Liu

  2. Tencent Robotics X+ AI Labs, Shenzhen, China

    Zhengyou Zhang

Authors
  1. Zicheng Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhengyou Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zicheng Liu .

Section Editor information

  1. No affiliation provided

    Xiaoou Tang

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Liu, Z., Zhang, Z. (2021). Face Modeling. In: Computer Vision. Springer, Cham. https://doi.org/10.1007/978-3-030-03243-2_355-1

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-03243-2_355-1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-03243-2

  • Online ISBN: 978-3-030-03243-2

  • eBook Packages: Springer Reference Computer SciencesReference Module Computer Science and Engineering

Publish with us

Policies and ethics

Search

Navigation