Video-Based Motion Capturing for Skeleton-Based 3D Models

  • Liang-Yu Shih
  • Bing-Yu Chen
  • Ja-Ling Wu
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5414)


In this paper, a semi-automatic method to capture motion data from a single-camera video is proposed. The input video is first segmented and analyzed, and a 3D character model with skeleton rigged is used as a reference model. Then, the reference model is modified to fit the subject’s contour in the starting frame, and the body’s and limbs’ contours of the subject are also specified by the user. Our system then extracts the motion from the video by estimating the reference model’s poses automatically in each video frame forwardly. Finally, the user can help to refine the result through a friendly user interface.


Video-based motion capture user-aid reference model 


  1. 1.
    Howe, N.R., Leventon, M.E., Freeman, W.T.: Bayesian reconstruction of 3d human motion from single-camera video. In: Proceedings of 1999 Neural Information Processing Systems, pp. 820–826 (1999)Google Scholar
  2. 2.
    Sidenbladh, H., Black, M.J., Fleet, D.J.: Stochastic tracking of 3d human figures using 2d image motion. In: Vernon, D. (ed.) ECCV 2000. LNCS, vol. 1843, pp. 702–718. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  3. 3.
    Gleicher, M., Ferrier, N.: Evaluating video-based motion capture. In: Proceedings of 2002 Computer Animation, pp. 75–80 (2002)Google Scholar
  4. 4.
    de Aguiar, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H.P., Thrun, S.: Performance capture from sparse multi-view video. ACM Transactions on Graphics 27(3) (2008) (SIGGRAPH 2008 Conference Proceedings)Google Scholar
  5. 5.
    Vlasic, D., Baran, I., Matusik, W., Popovic̀, J.: Articulated mesh animation from multi-view silhouettes. ACM Transactions on Graphics 27(3) (2008)(SIGGRAPH 2008 Conference Proceedings)Google Scholar
  6. 6.
    Wilhelms, J., Gelder, A.V.: Combining vision and computer graphics for video motion capture. The Visual Computer 19(6), 360–376 (2003)CrossRefGoogle Scholar
  7. 7.
    Favreau, L., Reveret, L., Depraz, C., Cani, M.P.: Animal gaits from video. In: Proceedings of 2004 ACM SIGGRAPH/Eurographics Symposium on Computer animation, pp. 277–286 (2004)Google Scholar
  8. 8.
    Rother, C., Kolmogorov, V., Blake, A.: ”grabcut”: interactive foreground extraction using iterated graph cuts. ACM Transactions on Graphics 23(3), 309–314 (2004) (SIGGRAPH 2004 Conference Proceedings)CrossRefGoogle Scholar
  9. 9.
    Pollefeys, M., Van Gool, L., Vergauwen, M., Verbiest, F., Cornelis, K., Tops, J., Koch, R.: Visual modeling with a hand-held camera. International Journal of Computer Vision 59(3), 207–232 (2004)CrossRefGoogle Scholar
  10. 10.
    Agarwala, A., Hertzmann, A., Salesin, D.H., Seitz, S.M.: Keyframe-based tracking for rotoscoping and animation. ACM Transactions on Graphics 23(3), 584–591 (2004) (SIGGRAPH 2004 Conference Proceedings)CrossRefGoogle Scholar
  11. 11.
    Huang, J., Shi, X., Liu, X., Zhou, K., Wei, L.Y., Teng, S.H., Bao, H., Guo, B., Shum, H.Y.: Subspace gradient domain mesh deformation. ACM Transactions on Graphics 25(3), 1126–1134 (2006) (SIGGRAPH 2006 Conference Proceedings)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Liang-Yu Shih
    • 1
  • Bing-Yu Chen
    • 1
  • Ja-Ling Wu
    • 1
  1. 1.National Taiwan UniversityTaiwan

Personalised recommendations