Face synthesis with arbitrary pose and expression from several images

An integration of image-based and model-based approaches
  • Yasuhiro Mukaigawa
  • Yuichi Nakamura
  • Yuichi Ohta
Session F3A: Face and Hand Posture Recognition
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1351)


We propose a method for synthesizing face views with arbitrary poses and expressions combining multiple face images. In this method, arbitrary views of a 3-D face can be generated without explicit reconstruction of its 3-D shape. The 2-D coordinate values of a set of feature points in an arbitrary facial pose and expression can be represented as a linear combination of those in the input images. Face images are synthesized by mapping the blended texture from multiple input images. By using the input images which have the actual facial expressions, realistic face views can be synthesized.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    T.Akimoto and Y.Suenaga, “Automatic Creation of 3D Facial Models”. IEEE Computer Graphics and Applications, September 1993, pp.16–22, 1993.Google Scholar
  2. 2.
    P.Ekman, and W.V.Friesen, “Facial action coding system”. Consulting Psychologists Press, 1977.Google Scholar
  3. 3.
    S.M.Seitz, and C.R.Dyer, “View Morphing”. Proc. SIGGRAPH'96, pp.21–30, 1996.Google Scholar
  4. 4.
    T.Vetter and T.Poggio, “Linear object classes and image synthesis from a single example image,” A.I.Memo No.1531, Artificial Intelligence Laboratory, Massachusetts Institute of Technology, 1995.Google Scholar
  5. 5.
    D.Beymer, A.Shashua, and T.Poggio, “Example based image analysis and synthesis,” A.I.Memo No.1431, Artificial Intelligence Laboratory, Massachusetts Institute of Technology, 1993.Google Scholar
  6. 6.
    S.Ullman, and R.Basri, “Recognition by linear combinations of models”. IEEE Trans. PAMI, vol.13, no.10, pp. 992–1006, 1991.Google Scholar
  7. 7.
    Y.Mukaigawa, Y.Nakamura, and Y.Ohta, “Synthesis of Arbitrarily Oriented Face Views from Two Images”. Proc. ACCV'95, Vol.3, pp.718–722, 1995.Google Scholar
  8. 8.
    C.Tomasi, and T.Kanade, “The factorization method for the recovery of shape and motion from image streams”. In Proceedings of Image Understanding Workshop, pp. 459–472, 1992. *** DIRECT SUPPORT *** A0008188 00023Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1997

Authors and Affiliations

  • Yasuhiro Mukaigawa
    • 1
  • Yuichi Nakamura
    • 2
  • Yuichi Ohta
    • 2
  1. 1.Department of Information Technology, Faculty of EngineeringOkayama UniversityOkayamaJapan
  2. 2.Institute of Information Sciences and ElectronicsUniversity of TsukubaTsukubaJapan

Personalised recommendations