3D estimation of facial muscle parameter from the 2D marker movement using neural network
Muscle based face image synthesis is one of the most realistic approach to realize life-like agent in computer. Facial muscle model is composed of facial tissue elements and muscles. In this model, forces are calculated effecting facial tisssue element by contraction of each muscle strength, so the combination of each muscle parameter decide a specific facial expression. Now each muscle parameter is decided on trial and error procedure comparing the sample photograph and generated image using our Muscle-Editor to generate a specific face image.
In this paper, we propose the strategy of automatic estimation of facial muscle parameters from 2D marker movements using neural network. This corresponds to the non-realtime 3D facial motion tracking from 2D image under the physics based condition.
Unable to display preview. Download preview PDF.
- Hajime Sera, Shigeo Morishima, Demetri Terzopolus, “Physics-based Muscle Model for Mouth Shape Control”, Proceedings of Robot and Human Communication '96(ROMAN'96), pp. 207–212(1996)Google Scholar
- Yuencheng Lee, Demetri Terzopoulos, and Keith Waters, “Realistic Modeling for Facial Animation”, Proceedings of SIGGRAPH '95, pp.55–62, (1995)Google Scholar
- Shigeo Morishima, etc. “Life-Like, Believable Communication Agents”, Course Notes #25, Siggraph (1996)Google Scholar
- Sincher and Tandler, “Anatomie Zahnarzte”Google Scholar
- Demetri Terzopoulos and Keith Waters, “Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15, No.6, pp.569–579 (1993)Google Scholar
- S.Morishima and H.Harashima, “A Media Conversion from Speech to Facial Image for Intelligent Man-Machine Interface”, IEEE JSAC, Vol.9, No.4(1991)Google Scholar
- Manabu Sudo, Shigeo morishima and Hiroshi Harashima, “A Media Conversion from English Text to Face Image for Pronunciation CAI System”,Proceedings of the 1992 MICE spring conference A-276(1992)Google Scholar