A Fast Individual Face Modeling and Facial Animation System

  • Bin Ding
  • Yangsheng Wang
  • Jian Yao
  • Peng Lu
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3942)


In this paper, we present a fast individual face modeling and animation system. The input of the system is a single frontal face image, which is captured by an ordinary video camera. And the output is 3D individual facial animation. Firstly, an Adaboost method is used to detect the face in the image. Then the key points of the face are located with the inverse compositional algorithm based active appearance models (AAM). The 3D geometry mesh of the individual face is then generated with morphable models. Finally, the direction and magnitude of existed motion vectors are adjusted according to different 3D face shapes using expression cloning technique. With this system, we can achieve realistic 3D facial animation with minimal and often no manual tuning. The experiments show that our system is fast enough for common applications.


Motion Vector Local Coordinate System Face Modeling Active Appearance Model Facial Animation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Lee, Y.C., Terzopoulos, D., Waters, K.: Constructing Physics-based Facial Models of Individuals. In: Proceedings of Graphics Interface, pp. 1–8 (1993)Google Scholar
  2. 2.
    Lee, Y.C., Terzopoulos, D., Waters, K.: Realistic Face Modeling for Animation. In: Siggraph proceedings, pp. 55–62 (1995)Google Scholar
  3. 3.
    Faugeras, O., Quan, L., Sturn, P.: Self-calibration of a 1D Projective Camera and its Application to the Selfcalibration of a 2D Projective Camera. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 22(10), 1179–1185 (2000)CrossRefGoogle Scholar
  4. 4.
    Beumier, C., Acheroy, M.: 3D Facial Surface Acquisition by Structured Light. In: International Workshop on Synthetic-Natural Hybrid Coding and Three Dimensional Imaging, Santorini, Greece, September 15-17, pp. 103–106 (1999)Google Scholar
  5. 5.
    Liu, Z.C., Zhang, Z.Y., Jacobs, C., Cohen, M.: Rapid Modeling of Animated Faces from Video. Technical Report, MSR-TR 2000-11 (2000)Google Scholar
  6. 6.
    Gao, W., Yan, J., Shan, S.G., Chen, X.L.: Individual 3D Face Synthesis Based on Orthogonal Photos and Speech-Driven Facial Animation. In: 7th IEEE International Conference on Image Processing (ICIP 2000), Vancouver, British Columbia, Canada, September 10-13 (2000)Google Scholar
  7. 7.
    Lee, W., Magnenat-Thalmann, N.: Fast Head Modeling for Animation. Journal Image and Vision Computing 18(4), 355–364 (2000)CrossRefGoogle Scholar
  8. 8.
    Ip, H.H.S., Yin, L.J.: Constructing a 3D Individual Head Model from two Orthogonal Views. In: the Visual Computer, pp. 254–266. Springer, Heidelberg (1996)Google Scholar
  9. 9.
    Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: Proceedings of the 26th annual conference on Computer graphics and interactive techniques, pp. 187–194 (July 1999)Google Scholar
  10. 10.
    Zhang, Y., Prakashb, E.C., Sunga, E.: Constructing a Realistic Face Model of an Individual for Expression Animation. Animation International Journal of Information Technology 8(2), 10–25 (2002)Google Scholar
  11. 11.
    Williams, L.: Performance-Driven Facial Animation. SIGGRAPH Computer Graphics 24, 235–242 (1990)CrossRefGoogle Scholar
  12. 12.
    Noh, J.-Y., Neumann, U.: Expression Cloning. In: Proceedings of the 28th annual conference on Computer graphics and interactive techniques (August 2001)Google Scholar
  13. 13.
    Matthews, I., Baker, S.: Active Appearance Models Revisited. International Journal of Computer Vision 60(2), 135–164 (2004)CrossRefGoogle Scholar
  14. 14.
    Freund, Y., Schapire, R.E.: A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences 55(1), 119–139 (1997)MATHCrossRefMathSciNetGoogle Scholar
  15. 15.
    Viola, P., Jones, M.: Rapid Object Detection using a Boosted Cascade of Simple Features. In: IEEE CVPR (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Bin Ding
    • 1
  • Yangsheng Wang
    • 1
  • Jian Yao
    • 1
  • Peng Lu
    • 1
  1. 1.Institute of AutomationChinese Academy of SciencesBeijingChina

Personalised recommendations