Abstract
In this paper we present a method for the estimation of rigid body motion parameters from a monocular image sequence for MPEG-4 applications, such as SNHC face animation. Based on feature extractions in every frame the motion parameters of a human face are estimated with an extended Kalman filter that performs a prediction and correction loop at every timestep. With this recursive structure of the estimation process the temporal redundancies of the motion are taken into account. The non-linear motion equation is linearized at every timestep within the extended Kalman filter and therefore the rotation is not restricted to be small and the motion model can be based on the first frame and must not describe the frame to frame motion. Results are presented which demonstrate the accuracy of our estimation method on synthetic data as well as on a real image sequence where we estimated the motion parameters of a human face.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
K. Aizawa, H. Harashima and T. Saito, “Model-Based Analysis Synthesis Image Coding (MBASIC) System for a Person's face”, Signal Processing: Image Communication 1, 1989, Elsevier Science Publishers B. V.
C. S. Choi, K. Aizawa, H. Harashima and T. Takebe, “Analysis and Synthesis of Facial Image Sequences in Model-Based Image Coding”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 4, No. 3, June 1994.
H. Li, P. Roivainen and R. Forchheimer, “3-D Motion Estimation in Model-Based Facial Image 'Coding”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 15, No. 6, June 1993.
H. Li and R. Forchheimer, “Two-View Facial Movement Estimation”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 4, No. 3, June 1994.
G. Bozdagi, M. Tekalp and L. Onural, “3-D Motion Estimation and Wireframe Adaptation Including Photometric Effects for Model-Based Coding of Facial Image Sequences”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 4, No. 3, June 1994.
D. Terzopoulos and K. Waters, “Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 15, No. 6, June 1993.
I. Essa, T. Darrel and A. Pentland, “Tracking Facial Motion”, Proc. of the IEEE Workshop on Nonrigid and Articulate Motion, Austin, Texas, November 1994.
B. Moghaddam and A. Pentland, “An Automatic System for Model-Based Coding of Faces”, Proc. of the IEEE Data Compression Conference, Snowbird, Utah, March 1995.
A. Azarbayejani, T. Starner, B. Horowitz and A. Pentland, “Visually Controlled Graphics”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 15, No. 6, June 1993.
V. Krebs, “Nichtlineare Filterung”, R. Oldenbourg Verlag, München, Wien, 1980.
P. Ekman and W. Friesen, “Facial Action Coding System”, Consulting Psychologists Press, Palo Alto, California, 1977.
M. Rydfalk, “CANDIDE: A Parametrized Face”, Dep. Elec. Eng. Rep. LiTH-ISY-I-0866, Linköping Univ., October 1987.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1997 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Smolic, A., Makai, B., Lin, G., Sikora, T. (1997). Estimation of motion parameters of a rigid body from a monocular image sequence for MPEG-4 applications. In: Steinmetz, R., Wolf, L.C. (eds) Interactive Distributed Multimedia Systems and Telecommunication Services. IDMS 1997. Lecture Notes in Computer Science, vol 1309. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0000335
Download citation
DOI: https://doi.org/10.1007/BFb0000335
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-63519-2
Online ISBN: 978-3-540-69590-5
eBook Packages: Springer Book Archive