Advertisement

Estimation of motion parameters of a rigid body from a monocular image sequence for MPEG-4 applications

  • A. Smolic
  • B. Makai
  • G. Lin
  • T. Sikora
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1309)

Abstract

In this paper we present a method for the estimation of rigid body motion parameters from a monocular image sequence for MPEG-4 applications, such as SNHC face animation. Based on feature extractions in every frame the motion parameters of a human face are estimated with an extended Kalman filter that performs a prediction and correction loop at every timestep. With this recursive structure of the estimation process the temporal redundancies of the motion are taken into account. The non-linear motion equation is linearized at every timestep within the extended Kalman filter and therefore the rotation is not restricted to be small and the motion model can be based on the first frame and must not describe the frame to frame motion. Results are presented which demonstrate the accuracy of our estimation method on synthetic data as well as on a real image sequence where we estimated the motion parameters of a human face.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    K. Aizawa, H. Harashima and T. Saito, “Model-Based Analysis Synthesis Image Coding (MBASIC) System for a Person's face”, Signal Processing: Image Communication 1, 1989, Elsevier Science Publishers B. V.Google Scholar
  2. [2]
    C. S. Choi, K. Aizawa, H. Harashima and T. Takebe, “Analysis and Synthesis of Facial Image Sequences in Model-Based Image Coding”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 4, No. 3, June 1994.Google Scholar
  3. [3]
    H. Li, P. Roivainen and R. Forchheimer, “3-D Motion Estimation in Model-Based Facial Image 'Coding”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 15, No. 6, June 1993.Google Scholar
  4. [4]
    H. Li and R. Forchheimer, “Two-View Facial Movement Estimation”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 4, No. 3, June 1994.Google Scholar
  5. [5]
    G. Bozdagi, M. Tekalp and L. Onural, “3-D Motion Estimation and Wireframe Adaptation Including Photometric Effects for Model-Based Coding of Facial Image Sequences”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 4, No. 3, June 1994.Google Scholar
  6. [6]
    D. Terzopoulos and K. Waters, “Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 15, No. 6, June 1993.Google Scholar
  7. [7]
    I. Essa, T. Darrel and A. Pentland, “Tracking Facial Motion”, Proc. of the IEEE Workshop on Nonrigid and Articulate Motion, Austin, Texas, November 1994.Google Scholar
  8. [8]
    B. Moghaddam and A. Pentland, “An Automatic System for Model-Based Coding of Faces”, Proc. of the IEEE Data Compression Conference, Snowbird, Utah, March 1995.Google Scholar
  9. [9]
    A. Azarbayejani, T. Starner, B. Horowitz and A. Pentland, “Visually Controlled Graphics”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 15, No. 6, June 1993.Google Scholar
  10. [10]
    V. Krebs, “Nichtlineare Filterung”, R. Oldenbourg Verlag, München, Wien, 1980.Google Scholar
  11. [11]
    P. Ekman and W. Friesen, “Facial Action Coding System”, Consulting Psychologists Press, Palo Alto, California, 1977.Google Scholar
  12. [12]
    M. Rydfalk, “CANDIDE: A Parametrized Face”, Dep. Elec. Eng. Rep. LiTH-ISY-I-0866, Linköping Univ., October 1987.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1997

Authors and Affiliations

  • A. Smolic
    • 1
    • 2
  • B. Makai
    • 1
  • G. Lin
    • 1
    • 3
  • T. Sikora
    • 1
  1. 1.Heinrich-Hertz-Institute Berlin GmbH (HHI)Germany
  2. 2.RTL plus Deutschland Fernsehen GmbH & Co. Betriebs-KGGermany
  3. 3.Department of Electronics EngineeringXiamen UniversityPR China

Personalised recommendations