3-Dimensional Face from a Single Face Image with Various Expressions

  • Yu-Jin Hong
  • Gi Pyo Nam
  • Heeseung Choi
  • Junghyun Cho
  • Ig-Jae KimEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9749)


Generating a user-specific 3D face model is useful for a variety of applications, such as facial animation, games or movie industries. Recently, there have been spectacular developments in 3D sensors, however, accurately recovering the 3D shape model from a single image is a major challenge of computer vision and graphics. In this paper, we present a method that can not only acquire a 3D shape from only a single face image but also reconstruct facial expression. To accomplish this, a 3D face database with a variety of identities and facial expressions was restructured as a data array which was decomposed for the acquisition of bilinear models. With this model, we represent facial variances as two kinds of elements: expressions and identities. Then, target face image is fitted to 3D model while estimating its expression and shape parameters. As application example, we transferred expressions to reconstructed 3D models and naturally applied new facial expressions to show the efficiency of the proposed method.


3D face reconstruction Bilinear models Facial animation 



This work was supported by the KIST Institutional Program (Project No. 2E26450 & No. 2E25930)


  1. 1.
    Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: ACM SIGGRAPH, pp. 187–194 (1999)Google Scholar
  2. 2.
    Asthana, A., Marks, T.K., Jones, M.J., Tieu, K.H., Rohith, M.V.: Fully automatic pose-invariant face recognition via 3D pose normalization. In: IEEE International Conference on Computer Vision, pp. 937–944 (2011)Google Scholar
  3. 3.
    Ding, C., Xu, C., Tao, D.: Multi-task pose-invariant face recognition. IEEE Trans. Image Process. 24(3), 980–993 (2015)MathSciNetCrossRefGoogle Scholar
  4. 4.
    Ding, L., Ding, X.: Continuous pose normalization for pose-robust face recognition. IEEE Signal Process. Lett. 19(11), 721–724 (2012)CrossRefGoogle Scholar
  5. 5.
    Qu, C., Monari, E., Schuchert, T., Jeyerer, J.: Fast, robust and automatic 3D face model reconstruction from videos. In: Advanced Video and Signal Based Surveillance, pp. 113–118 (2014)Google Scholar
  6. 6.
    Hassner, T.: Viewing real-world faces in 3D. In: IEEE International Conference on Computer Vision (2013)Google Scholar
  7. 7.
    Kemelmacher-Shlizerman, I., Seitz, S.M.: Face reconstruction in the wild. In: IEEE International Conference on Computer Vision (2011)Google Scholar
  8. 8.
    Tenenbaum, J.B., Freeman, W.: Separating style and content with bilinear models. Neural Comput. J. 12, 1247–1283 (1999)CrossRefGoogle Scholar
  9. 9.
    Tucker, L.R.: Some mathematical notes on three-mode factor analysis. Psychometrika 31(3), 279–311 (1966)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Kroonenberg, P.M., Leeuw, J.D.: Principal component analysis of three-mode data by means of alternating least squares algorithms. Psychometrika 45(1), 69–97 (1980)MathSciNetCrossRefzbMATHGoogle Scholar
  11. 11.
    Vasilescu, M.A.O., Terzopoulos, D.: Multilinear analysis of image ensembles: TensorFaces. In: European Conference on Computer Vision, pp. 447–460 (2002)Google Scholar
  12. 12.
    Cao, C., Weng, Y., Zhou, S., Tong, Y., Zhou, K.: FacewareHouse: a 3D facial expression database for visual computing. IEEE Trans. Visual Comput. Graph. 20, 413–425 (2014)CrossRefGoogle Scholar
  13. 13.
    Liu, D.C., Nocedal, J.: On the limited memory BFGS method for large scale optimization. Math. Program 45, 503–528 (1989)MathSciNetCrossRefzbMATHGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Yu-Jin Hong
    • 1
    • 2
  • Gi Pyo Nam
    • 2
  • Heeseung Choi
    • 2
  • Junghyun Cho
    • 2
  • Ig-Jae Kim
    • 1
    • 2
    Email author
  1. 1.Department of HCI and RoboticsUniversity of Science and TechnologyDaejeonKorea
  2. 2.Imaging Media Research CenterKorea Institute of Science and TechnologyDaejeonKorea

Personalised recommendations