A Fast Individual Face Modeling and Facial Animation System
In this paper, we present a fast individual face modeling and animation system. The input of the system is a single frontal face image, which is captured by an ordinary video camera. And the output is 3D individual facial animation. Firstly, an Adaboost method is used to detect the face in the image. Then the key points of the face are located with the inverse compositional algorithm based active appearance models (AAM). The 3D geometry mesh of the individual face is then generated with morphable models. Finally, the direction and magnitude of existed motion vectors are adjusted according to different 3D face shapes using expression cloning technique. With this system, we can achieve realistic 3D facial animation with minimal and often no manual tuning. The experiments show that our system is fast enough for common applications.
KeywordsMotion Vector Local Coordinate System Face Modeling Active Appearance Model Facial Animation
Unable to display preview. Download preview PDF.
- 1.Lee, Y.C., Terzopoulos, D., Waters, K.: Constructing Physics-based Facial Models of Individuals. In: Proceedings of Graphics Interface, pp. 1–8 (1993)Google Scholar
- 2.Lee, Y.C., Terzopoulos, D., Waters, K.: Realistic Face Modeling for Animation. In: Siggraph proceedings, pp. 55–62 (1995)Google Scholar
- 4.Beumier, C., Acheroy, M.: 3D Facial Surface Acquisition by Structured Light. In: International Workshop on Synthetic-Natural Hybrid Coding and Three Dimensional Imaging, Santorini, Greece, September 15-17, pp. 103–106 (1999)Google Scholar
- 5.Liu, Z.C., Zhang, Z.Y., Jacobs, C., Cohen, M.: Rapid Modeling of Animated Faces from Video. Technical Report, MSR-TR 2000-11 (2000)Google Scholar
- 6.Gao, W., Yan, J., Shan, S.G., Chen, X.L.: Individual 3D Face Synthesis Based on Orthogonal Photos and Speech-Driven Facial Animation. In: 7th IEEE International Conference on Image Processing (ICIP 2000), Vancouver, British Columbia, Canada, September 10-13 (2000)Google Scholar
- 8.Ip, H.H.S., Yin, L.J.: Constructing a 3D Individual Head Model from two Orthogonal Views. In: the Visual Computer, pp. 254–266. Springer, Heidelberg (1996)Google Scholar
- 9.Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: Proceedings of the 26th annual conference on Computer graphics and interactive techniques, pp. 187–194 (July 1999)Google Scholar
- 10.Zhang, Y., Prakashb, E.C., Sunga, E.: Constructing a Realistic Face Model of an Individual for Expression Animation. Animation International Journal of Information Technology 8(2), 10–25 (2002)Google Scholar
- 12.Noh, J.-Y., Neumann, U.: Expression Cloning. In: Proceedings of the 28th annual conference on Computer graphics and interactive techniques (August 2001)Google Scholar
- 15.Viola, P., Jones, M.: Rapid Object Detection using a Boosted Cascade of Simple Features. In: IEEE CVPR (2001)Google Scholar