Towards Real-Time Monocular Video-Based Avatar Animation
Most of the commercial motion capture techniques, be they marker-based or marker-free, are either expensive or require complex laboratory setup. These constraints limit their use for home entertainment or interactive gaming oriented applications. In this paper we present a real-time system for color marker-based human motion capture in a monocular image space for avatar animation. The proposed system requires a single webcam and cheap color markers for its operation resulting in low cost and user friendliness. Real-time efficiency is achieved by tracking through variable-sized window search based on a process noise-adaptive Kalman filter. The depth information is recovered with the aid of human anthropometric information in a perspective projection model. Finally experimental results of the system are presented as tested with a number of video sequences.
KeywordsKalman Filter Motion Capture Color Marker Kalman Gain Orthographic Projection
Unable to display preview. Download preview PDF.
- Chapman, D.: Vision, instruction and action. MIT Press, Cambridge (1991)Google Scholar
- Pylkko, H., Riekki, J., Roning, J.: Real-time color-based tracking via a marker interface. In: Proc. of IEEE International Conference on Robotics and Automation, ICRA, pp. 1214–1219. IEEE Computer Society, Washington (2001)Google Scholar
- Zhuang, Y., Zhu, Q., Pan, Y.: Hierarchical model based human motion tracking. In: Proc. of IEEE International Conference on Image Processing, vol. 3, pp. 86–89. IEEE Computer Society, Washington (2000)Google Scholar
- Tao, Y., Hu, H.: Colour based human motion tracking for home-based rehabilitation. In: Proc. of IEEE International Conference on Systems, Man and Cybernetics, 2004, vol. 1, pp. 773–778. IEEE Computer Society, Washington (2004)Google Scholar
- Dreyfuss, H.: The Measure of Man: human factors in design, Whitney Library of Design, New York (1959-1967)Google Scholar
- Welch, G., Bishop, G.: An introduction to the Kalman filter, from,UNC-ChapelHill, TR95-041 (November 2000), http://www.cs.unc.edu
- Nguyen, H.T., Worring, M., van den Boomgaard, R.: Occlusion robust adaptive template tracking. In: Proc. IEEE Conf. on Computer Vision, ICCV 2001, vol. 1, pp. 678–683 (July 2001)Google Scholar
- Remondino, F.: 3-D reconstruction of static human body shape from image sequence. In: Proc.of Computer Vision and Image Understanding, vol. 93, pp. 65–68. Elsevier Science Inc., New York (2004)Google Scholar
- TrueVision3D Commercial Game Engine, http://www.truevision3d.com