Abstract
This paper addresses the real-time tracking of head and facial motion in monocular image sequences using 3D deformable models. It introduces two methods. The first method only tracks the 3D head pose using a cascade of two stages: the first stage utilizes a robust feature-based pose estimator associated with two consecutive frames, the second stage relies on a Maximum a Posteriori inference scheme exploiting the temporal coherence in both the 3D head motions and facial textures. The facial texture is updated dynamically in order to obtain a simple on-line appearance model. The implementation of this method is kept simple and straightforward. In addition to the 3D head pose tracking, the second method tracks some facial animations using an Active Appearance Model search. Tracking experiments and performance evaluation demonstrate the robustness and usefulness of the developed methods that retain the advantages of both feature-based and appearance-based methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ahlberg, J.: An active model for facial feature tracking. EURASIP Journal on Applied Signal Processing 2002(6), 566–571 (2002)
Aloimonos, Y.: Perspective approximations. Image and Vision Computing 8(3), 177–192 (1990)
Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: Proc. SIGGRAPH 1999 Conference (1999)
Cascia, M.L., Sclaroff, S., Athitsos, V.: Fast, reliable head tracking under varying illumination: An approach based on registration of texture-mapped 3D models. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(4), 322–336 (2000)
Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(6), 681–684 (2001)
Cootes, T.F., Taylor, C.J., Cooper, D., Graham, J.: Active shape models–their training and application. Computer Vision and Image Understanding 61(1), 38–59 (1995)
Dornaika, F., Ahlberg, J.: Face and facial feature tracking using deformable models. International Journal of Image and Graphics (July 2004)
Ekman, P., Friesen, W.V.: Facial Action Coding System. Consulting Psychology Press, Palo Alto (1977)
Fischler, M.A., Bolles, R.C.: Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communication ACM 24(6), 381–395 (1981)
Gokturk, S.B., Bouguet, J.Y., Tomasi, C., Girod, B.: Model-based face tracking for view-independent facial expression recognition. In: Proc. Face and Gesture Recognition (2002)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2000)
Olivier, N., Pentland, A., Berard, F.: Lafter: Lips and face real time tracker. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition (1997)
Preteux, F., Malciu, M.: Model-based head tracking and 3D pose estimation. In: Proc. SPIE Conference on Mathematical Modeling and Estimation Techniques in Computer Vision (1998)
Reynard, D., Wildenberg, A., Blake, A., Marchant, J.: Learning the dynamics of complex motions from image sequences. In: Proc. European Conference on Computer Vision (1996)
Ström, J.: Model-based real-time head tracking. EURASIP Journal on Applied Signal Processing 2002(10), 1039–1052 (2002)
Tao, H., Huang, T.: Explanation-based facial motion tracking using a piecewise Bezier volume deformation model. In: Proc. IEEE Computer Vision and Pattern Recognition (1999)
Yang, M.H., Kriegman, D.J., Ahuja, N.: Detecting faces in images: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(1), 34–58 (2002)
Yuille, A.L., Cohen, D.S., Hallinan, P.: Feature extraction from faces using deformable templates. International Journal of Computer Vision 8(2), 99–112 (1992)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Dornaika, F., Ahlberg, J. (2004). Model-Based Head and Facial Motion Tracking. In: Sebe, N., Lew, M., Huang, T.S. (eds) Computer Vision in Human-Computer Interaction. CVHCI 2004. Lecture Notes in Computer Science, vol 3058. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24837-8_21
Download citation
DOI: https://doi.org/10.1007/978-3-540-24837-8_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22012-1
Online ISBN: 978-3-540-24837-8
eBook Packages: Springer Book Archive