Towards Real-Time Monocular Video-Based Avatar Animation

  • Utkarsh Gaur
  • Amrita Jain
  • Sanjay Goel
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5359)


Most of the commercial motion capture techniques, be they marker-based or marker-free, are either expensive or require complex laboratory setup. These constraints limit their use for home entertainment or interactive gaming oriented applications. In this paper we present a real-time system for color marker-based human motion capture in a monocular image space for avatar animation. The proposed system requires a single webcam and cheap color markers for its operation resulting in low cost and user friendliness. Real-time efficiency is achieved by tracking through variable-sized window search based on a process noise-adaptive Kalman filter. The depth information is recovered with the aid of human anthropometric information in a perspective projection model. Finally experimental results of the system are presented as tested with a number of video sequences.


Kalman Filter Motion Capture Color Marker Kalman Gain Orthographic Projection 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Chapman, D.: Vision, instruction and action. MIT Press, Cambridge (1991)Google Scholar
  2. Liu, F., Zhuang, Y., Luo, Z., Pan, Y.: A Robust Algorithm for Video Based Human Motion Tracking. In: Chen, Y.-C., Chang, L.-W., Hsu, C.-T. (eds.) PCM 2002. LNCS, vol. 2532, pp. 1161–1168. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  3. Pylkko, H., Riekki, J., Roning, J.: Real-time color-based tracking via a marker interface. In: Proc. of IEEE International Conference on Robotics and Automation, ICRA, pp. 1214–1219. IEEE Computer Society, Washington (2001)Google Scholar
  4. Zhuang, Y., Zhu, Q., Pan, Y.: Hierarchical model based human motion tracking. In: Proc. of IEEE International Conference on Image Processing, vol. 3, pp. 86–89. IEEE Computer Society, Washington (2000)Google Scholar
  5. Tao, Y., Hu, H.: Colour based human motion tracking for home-based rehabilitation. In: Proc. of IEEE International Conference on Systems, Man and Cybernetics, 2004, vol. 1, pp. 773–778. IEEE Computer Society, Washington (2004)Google Scholar
  6. Ukida, H., Kaji, S., Tanimoto, Y., Yamamoto, H.: Human Motion Capture System using Color Markers and Silhouette. In: Proc. of IEEE Instrumentation and Measurement Technology Conference, IMTC 2006, pp. 151–156. IEEE Computer Society, Washington (2006)CrossRefGoogle Scholar
  7. Remondino, F., Roditakis, A.: Human figure reconstruction and modeling from single image or monocular video sequence. In: Proc. of Fourth International Conference on 3-D Digital Imaging and Modeling, 3DIM 2003, pp. 116–123. IEEE Computer Society, Washington (2003)CrossRefGoogle Scholar
  8. Dreyfuss, H.: The Measure of Man: human factors in design, Whitney Library of Design, New York (1959-1967)Google Scholar
  9. Welch, G., Bishop, G.: An introduction to the Kalman filter, from,UNC-ChapelHill, TR95-041 (November 2000),
  10. Michoud, B., Guillou, E., Briceño, H., Bouakaz, S.: Real-Time and Marker-Free 3D Motion Capture for Home Entertainment Oriented Applications. In: Yagi, Y., Kang, S.B., Kweon, I.S., Zha, H. (eds.) ACCV 2007, Part I. LNCS, vol. 4843, pp. 678–687. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  11. Nguyen, H.T., Worring, M., van den Boomgaard, R.: Occlusion robust adaptive template tracking. In: Proc. IEEE Conf. on Computer Vision, ICCV 2001, vol. 1, pp. 678–683 (July 2001)Google Scholar
  12. Remondino, F.: 3-D reconstruction of static human body shape from image sequence. In: Proc.of Computer Vision and Image Understanding, vol. 93, pp. 65–68. Elsevier Science Inc., New York (2004)Google Scholar
  13. TrueVision3D Commercial Game Engine,

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Utkarsh Gaur
    • 1
    • 3
  • Amrita Jain
    • 2
    • 3
  • Sanjay Goel
    • 3
  1. 1.University of CaliforniaRiversideUSA
  2. 2.Cornell University, IthacaNYUSA
  3. 3.Jaypee Institute of Information Technology UniversityNoidaIndia

Personalised recommendations