Abstract
Accurate localization and tracking of facial features are crucial for developing high quality model-based coding (MPEG-4) systems. For teleconferencing applications at very low bit rates, it is necessary to track eye and lip movements accurately over time. These movements can be coded and transmitted to a remote site, where animation techniques can be used to synthesize facial movements on a model of a face. In this paper we describe the integration of simple heuristics which are effective in improving the results of well-known facial feature detection with robust techniques for adapting a dynamic mesh for animation. A new method of generating a self-adaptive mesh using an extended dynamic mesh (EDM) is proposed to overcome the convergence problem of the dynamic-motion-equation method (DMM). The new method consisting of two-step mesh adaptation (called coarse-to-fine adaptation) can enhance the stability of the DMM and improve the performance of the adaptive process. The accuracy of the proposed approach is demonstrated by experiments on eye model animation. In this paper, we focus our discussion only on the detection, tracking, modeling and animation of eye movements.
This work is supported in part by the Canadian Natural Sciences and Engineering Research Council.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
S. Bernoegger, L. Yin, A. Basu, and A. Pinz. Eye tracking and animation for MPEG-4 coding. In Proceedings of ICPR’98, Australia, pages 1281–1284, August 1998.
R. Brunelli and T. Poggio. Face recognition: features versus templates. IEEE Trans. on PAMI, 15(10):1042–1052, October 1993.
T. C. Chang and T. S. Huang. Facial feature extraction from color images. In Proceedings of ICPR’94, Jerusalem, Israel, pages 39–43, October 9-13 1994.
C. Choi, K. Aizawa, H. Harashima, and T. Takebe. Analysis and synthesis of facial image sequences in model-based image coding. IEEE Trans. on Circuit and System for Video Technology, 4(3):257–275, June 1994.
G. Chow and X. Li. Towards a system for automatic facial feature detection. Pattern Recognition, 26(12):1739–1755, December 1993.
E. R. Davies. A modified hough scheme for general circle location. Pattern Recognition, 7:37–43, January 1988.
D. J. Dawe. Matrix and Finite Element Displacement Analysis of Structures. Clarendon Press, Oxford, UK., 1984.
J. Y. Deng and F. Lai. Region-based template deformation and masking for eyefeature extraction and description. Pattern Recognition, 30(3):403–419, March 1997.
I. A. Essa and A. P. Pentland. Coding, analysis, interpretation, and recognition of facial expressions. IEEE Trans. on PAMI, 19(7):757–763, July 1997.
B. Guenter, C. Grimm, D. Wood, H. Malvar, and F. Pighin. Making faces. In SIGGRAPH’98 Proceedings, Orlando, FL., pages 55–66, July 1998.
W. Huang and D. Goldgof. Adaptive-size meshes for rigid and non-rigid shape analysis and synthesis. IEEE Trans. on PAMI, 15(6):611–616, June 1993.
P. Kierkegaard. A method for detection of circular arcs based on the hough transform. Machine Vision and Applications, 5:249–263, 1992.
D. E. Pearson. Developments in model-based video coding. Proceedings of the IEEE, 83(6):892–906, June 1995.
F. Pighin, J. Hecker, D. Linchinski, R. Szeliski, and D. Salesin. Synthesizing realistic facial expressions from photographs. In SIGGRAPH’98 Proceedings, Orlando, FL., p75–84, July 1998.
W. Press, S. Teukolsky, W. Vetterling, and B. Flannery. Numerical Recipes in C; The Art of Scientific Computing. Cambridge University Press, 1988.
M. Reinders. Model adaptation for image coding. In Ph.D Thesis, Delft Univ. of Tech., 1995.
D. Terzopoulos and M. Vasilescu. Sampling and reconstruction with adaptive meshes. In Proceedings of IEEE CVPR’91, pages 70–75, 1991.
D. Terzopoulos and M. Vasilescu. Adaptive mesh and shells: irregular triangulation, discontinuities and hierarchical subdivision. In Proceedings of IEEE CVPR’92, pages 829–832, 1992.
D. Terzopoulos and K. Waters. Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Trans. on PAMI, 15(6):569–579, June 1993.
MPEG Video&SNHC. Final text for FCD 14496-2:visual. Doc. ISO/MPEG N2202, Tokyo MPEG Meeting, March 1998. 271, 281
H. Wu, T. Yokoyama, D. Pramadihanto, and M. Yachida. Face and facial feature extraction from color image. In Proceedings 2nd IEEE International Conference on Automatic Face and Gesture Recognition, Killington, USA, pp345–350, Oct. 1996.
Y. Yacoob and L. S. Davis. Recognizing human facial expressions from long image sequences using optical flow. IEEE Trans. on PAMI, 18(6):636–642, June 1996. 270
L. Yin and A. Basu. MPEG4 face modeling using fiducial points. In Proceedings of IEEE International Conference on Image Processing, Santa Barbara, CA, pages 109–112, Oct. 1997.
A. L. Yuille, P. W. Hallinan, and D. S. Cohen. Feature extraction from faces using deformable templates. International Journal of Computer Vision, 8(2):99–111, 1992.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yin, L., Basu, A. (1999). Realistic Animation Using Extended Adaptive Mesh for Model Based Coding. In: Hancock, E.R., Pelillo, M. (eds) Energy Minimization Methods in Computer Vision and Pattern Recognition. EMMCVPR 1999. Lecture Notes in Computer Science, vol 1654. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48432-9_19
Download citation
DOI: https://doi.org/10.1007/3-540-48432-9_19
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-66294-5
Online ISBN: 978-3-540-48432-5
eBook Packages: Springer Book Archive