Geometric Model-Based 3D Face Tracking

Summary

In this chapter, a robust real-time 3D geometric face tracking system is presented. The proposed motion-capture-based geometric motion model is adopted in the tracking system to replace the original handcrafted facial motion model. Therefore, extensive manual editing of the motion model can be avoided. Using the estimated geometric motion parameters, we conduct experiments on video-driven face animation and very low bit-rate face animation. The experimental results show that geometric facial motions can be effectively captured in the tracking results. The presented tracking system can be used in many other HCI applications, such as facial expressions recognition, human behavior understanding, and etc.