3D Human Body Tracking Using Deterministic Temporal Motion Models

  • Raquel Urtasun
  • Pascal Fua
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3023)


There has been much effort invested in increasing the robustness of human body tracking by incorporating motion models. Most approaches are probabilistic in nature and seek to avoid becoming trapped into local minima by considering multiple hypotheses, which typically requires exponentially large amounts of computation as the number of degrees of freedom increases.

By contrast, in this paper, we use temporal motion models based on Principal Component Analysis to formulate the tracking problem as one of minimizing differentiable objective functions. The differential structure of these functions is rich enough to yield good convergence properties using a deterministic optimization scheme at a much reduced computational cost. Furthermore, by using a multi-activity database, we can partially overcome one of the major limitations of approaches that rely on motion models, namely the fact they are limited to one single type of motion.

We will demonstrate the effectiveness of the proposed approach by using it to fit full-body models to stereo data of people walking and running and whose quality is too low to yield satisfactory results without motion models.


Joint Angle Motion Vector Motion Model Motion Capture Principal Component Analysis Component 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Isard, M., Blake, A.: CONDENSATION - conditional density propagation for visual tracking. International Journal of Computer Vision 29, 5–28 (1998)CrossRefGoogle Scholar
  2. 2.
    Deutscher, J., Blake, A., Reid, I.: Articulated Body Motion Capture by Annealed Particle Filtering. In: CVPR, Hilton Head Island, SC (2000)Google Scholar
  3. 3.
    Davison, A.J., Deutscher, J., Reid, I.D.: Markerless motion capture of complex fullbody movement for character animation. In: Eurographics Workshop on Computer Animation and Simulation. LNCS. Springer, Heidelberg (2001)Google Scholar
  4. 4.
    Choo, K., Fleet, D.: People tracking using hybrid monte carlo filtering. In: International Conference on Computer Vision, Vancouver, Canada (2001)Google Scholar
  5. 5.
    Sminchisescu, C., Triggs, B.: Covariance Scaled Sampling for Monocular 3D Body Tracking. In: Conference on Computer Vision and Pattern Recognition, Hawaii (2001)Google Scholar
  6. 6.
    Sminchisescu, C., Triggs, B.: Kinematic Jump Processes for Monocular 3D Human Tracking. In: Conference on Computer Vision and Pattern Recognition, Madison, WI (2003)Google Scholar
  7. 7.
    Sidenbladh, H., Black, M.J., Fleet, D.J.: Stochastic tracking of 3D human figures using 2D image motion. In: Vernon, D. (ed.) ECCV 2000. LNCS, vol. 1843, pp. 702–718. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  8. 8.
    Sidenbladh, H., Black, M.J., Sigal, L.: Implicit Probabilistic Models of Human Motion for Synthesis and Tracking. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2350, pp. 784–800. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  9. 9.
    Ormoneit, D., Sidenbladh, H., Black, M.J., Hastie, T.: Learning and tracking cyclic human motion. Advances in Neural Information Processing Systems 13, 894–900 (2001)Google Scholar
  10. 10.
    Bregler, C., Malik, J.: Tracking People with Twists and Exponential Maps. In: Conference on Computer Vision and Pattern Recognition, Santa Barbara, CA (1998)Google Scholar
  11. 11.
    Gavrila, D.: The Visual Analysis of Human Movement: A Survey. Computer Vision and Image Understanding 73 (1999)Google Scholar
  12. 12.
    Moeslund, T., Granum, E.: A Survey of Computer Vision-Based Human Motion Capture. Computer Vision and Image Understanding 81 (2001)Google Scholar
  13. 13.
    Alexa, M., Mueller, W.: Representing animations by principal components. In: Eurographics, vol. 19 (2000)Google Scholar
  14. 14.
    Brand, M., Hertzmann, A.: Style Machines. In: Proceedings Computer Graphics, SIGGRAPH, pp. 183–192 (2000)Google Scholar
  15. 15.
    Blanz, V., Basso, C., Poggio, T., Vetter, T.: Reanimating Faces in Images and Video. In: Eurographics, Granada, Spain (2003)Google Scholar
  16. 16.
    Press, W., Flannery, B., Teukolsky, S., Vetterling, W.: Numerical Recipes, the Art of Scientific Computing. Cambridge U. Press, Cambridge (1992)Google Scholar
  17. 17.
    Yacoob, Y., Davis, L.S.: Learned Models for Estimation of Rigid and Articulated Human Motion from Stationary or Moving Camera. International Journal of Computer Vision 36, 5–30 (2000)CrossRefGoogle Scholar
  18. 18.
    Plänkers, R., Fua, P.: Articulated Soft Objects for Multi-View Shape and Motion Capture. IEEE Transactions on Pattern Analysis and Machine Intelligence (2003)Google Scholar
  19. 19.
    Shoemake, K.: Animating Rotation with Quaternion Curves. In: Proceedings Computer Graphics, SIGGRAPH, vol. 19, pp. 245–254 (1985)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Raquel Urtasun
    • 1
  • Pascal Fua
    • 1
  1. 1.Computer Vision LaboratoryEPFLLausanneSwitzerland

Personalised recommendations