Image Based Active Model Adaptation Method for Face Reconstruction and Sketch Generation

  • Yuehu Liu
  • Yunfeng Zhu
  • Yuanqi Su
  • Zejian Yuan
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3942)


A uniform active model adaptation is proposed for some specific applications related with realistic face reconstruction and sketch generation, which is separated into tow phases: global adaptation and local adaptation. During the global adaptation, a coarse matching is used for adjusting the facial contour and five sense organs according to the correspondence of feature points both in 2D facial image and 3D model. An interpolation is processed on the global adjusted 3D model for a fine matching, which forms the local adaptation. A personalized facial sketch generation method is present based on the similar idea of 3D facial model adaptation. By comparison between the feature points of specific person’s face and those of a predefined generic face, metamorphosis can be drawn for generating a personalized cartoon facial sketch. Two systems are built, and face reconstruction and sketch results show that proposed method is efficient and desirable.


Feature Point Facial Image Facial Model Texture Mapping Global Adaptation 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Lee, Y., et al.: Realistic modeling for facical animation. In: Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, New Orleans, Louisiana, pp. 55–62 (1996)Google Scholar
  2. 2.
    Noma, T., Oishi, K., Futsuhara, H.: Motion Generator Approach to Translating Human Motion from Video to Animation. In: Pro.CAPTECH 1999, HongKong, pp. 50–58 (1999)Google Scholar
  3. 3.
    Blanz, V., Vetter, T.: A Morphable Model for the Synthesis of 3D Faces. In: SIGGRAPH 1999, pp. 187–194 (1999)Google Scholar
  4. 4.
    Ip, H.H.S., Yin, L.: Constructing a 3D individual head model from two orthogonal views. The Visual Computer 12(5), 254–266 (1996)CrossRefGoogle Scholar
  5. 5.
    Patel, M., Willis, P.J.: FACES: Facial Animation, Construction and Editing System. In: EUROGRAPH 1991, pp. 33–45 (1991)Google Scholar
  6. 6.
    Chen, H., Xu, Y.-Q., Shum, H.-Y., Zhu, S.-C., Zheng, N.-N.: Example-based facial sketch generation with non-parametric sampling. In: ICCV 2001, vol. 2, pp. 433–438 (2001)Google Scholar
  7. 7.
    Hsu, R.-L., Jain, A.K.: Generating discriminating cartoon faces using interacting snakes. IEEE Transactions on Pattern Analysis and Machine Intelligence 25(11), 1388–1398 (2003)CrossRefGoogle Scholar
  8. 8.
    Gooch, B., Reinhard, E., Gooch, A.: Human facial illustrations: Creation and psychophysical evaluation. ACM Transactions on Graphics (TOG) 23(1), 27–44 (2004)CrossRefGoogle Scholar
  9. 9.
    Pighin, F., et al.: Synthesizing Realistic Facial Expressions from Photographs. In: Proceeding Siggraph 1998, pp. 75–84 (1998)Google Scholar
  10. 10.
    Cohen, M., Massara, D.: Modeling co-articulation in synthetic visual speech. In: Model and Technique in Computer Animation, Tokyo, pp. 139–156. Springer, Heidelberg (1993)Google Scholar
  11. 11.
    Waters, K.: A Muscle Model for Animation Three-Dimensional Facial Expression. Computer Graphics 21(4), 17–24 (1987)CrossRefMathSciNetGoogle Scholar
  12. 12.
    Kalra, P., Magnenat-Thanmann, N.: Modeling of Vascular Expression in Facial Animation. Computer Animation, 50–58 (1994)Google Scholar
  13. 13.
    Powell, M.J.D.: Radial basis functions for multivariate interpolation, Algorithms for Approximation. Clarendon Press, Oxford (1987)Google Scholar
  14. 14.
    Lee, W.-S., Thalmann, N.M.: Head Modeling from Pictures and Morphing in 3D with Image Metamorphosis Based on Triangulation. In: Magnenat-Thalmann, N., Thalmann, D. (eds.) CAPTECH 1998. LNCS (LNAI), vol. 1537, pp. 254–267. Springer, Heidelberg (1998)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Yuehu Liu
    • 1
  • Yunfeng Zhu
    • 1
  • Yuanqi Su
    • 1
  • Zejian Yuan
    • 1
  1. 1.Institute of Artificial Intelligence and RoboticsXi’an Jiaotong UniversityXi’anP.R. China

Personalised recommendations