Combining Template Matching and Model Fitting for Human Body Segmentation and Tracking with Applications to Sports Training

  • Hao-Jie Li
  • Shou-Xun Lin
  • Yong-Dong Zhang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4142)


This paper present a method for extracting and automatic tracking of human body using template matching and human body model fitting for specific activity. The method includes training and testing stages. For training, the body shapes are manually segmented from image sequences as templates and are clustered. The 2D joint locations of each cluster center are labeled and the dynamical models of the templates are learned. For testing, a “seed” frame is first selected from the sequence according to the reliability of motion segmentation and several most matched templates to it are obtained. Then, a template tracking process within a probabilistic framework integrating the learnt dynamical model is started forwards and afterwards until the entire sequence is matched. Thirdly, a articulated 2D human body model is initialized from the matched template and then iteratively fit to the image features. Thus, the human body segmentation results and 2D body joints are got. Experiments are performed on broadcasted diving sequences and promising results are obtained. We also demonstrate two applications of the proposed method for sports training.


Template Match Motion Segmentation Knee Joint Angle Human Body Model Neighboring Frame 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Moeslund, T.B., Granum, E.: A survey of computer vision-based human motion capture. Computer Vision and Image Understanding 81(3), 231–268 (2001)MATHCrossRefGoogle Scholar
  2. 2.
    Wang, L., Hu, W., Tan, T.: Recent developments in human motion analysis. Pattern Recognition 36(3), 585–601 (2003)CrossRefGoogle Scholar
  3. 3.
    Stauffer, C., Grimson, W.: Adaptive background mixture models for real-time tracking. In: Proc. of CVPR, pp. 246–252 (1999)Google Scholar
  4. 4.
    Lipton, A.J., Fujiyoshi, H., Patil, R.S.: Moving target classification and tracking from real-time video. In: Proc. of WACV, pp. 8–14 (1998)Google Scholar
  5. 5.
    Meyer, D., Denzler, J., Niemann, H.: Model based extraction of articulated objects in image sequences for gait analysis. In: Proc. of ICIP, pp. 78–81 (1997)Google Scholar
  6. 6.
    Gavrila, D.M., Philomin, V.: Real-time Object Detection for Smart Vehicles. In: Proc. of ICCV, pp. 87–93 (1999)Google Scholar
  7. 7.
    Ju, S., Black, M., Yacoob, Y.: Cardboard people: A parameterized model of articulated motion. In: Proc. of AFGR, pp. 38–44 (1996)Google Scholar
  8. 8.
    Deutscher, J., Blake, A., et al.: Articulated body motion capture by annealed particle filtering. In: Proc. of CVPR, pp. 1144–1149 (2000)Google Scholar
  9. 9.
    Sidenbladh, H., Black, M.J., Fleet, D.J.: Stochastic tracking of 3D human figures using 2D image motion. In: Vernon, D. (ed.) ECCV 2000. LNCS, vol. 1843, pp. 702–718. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  10. 10.
    Si, W., Yong-Dong, Z., Shou-Xun, L.: An automatic segmentation algorithm for moving objects in video sequences under multi-constraints. In: Proc of ICME, pp. 555–558 (2004)Google Scholar
  11. 11.
    Isard, M., Blake, A.: Contour tracking by stochastic propagation of conditional density. In: Proc. ECCV, pp. 343–356 (1996)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Hao-Jie Li
    • 1
    • 2
  • Shou-Xun Lin
    • 1
  • Yong-Dong Zhang
    • 1
  1. 1.Institute of Computing TechnologyChinese Academy of SciencesBeijingChina
  2. 2.Graduate School of the Chinese Academy of SciencesBeijingChina

Personalised recommendations