Cloth X-Ray: MoCap of People Wearing Textiles

  • Bodo Rosenhahn
  • Uwe G. Kersting
  • Katie Powell
  • Hans-Peter Seidel
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4174)


The contribution presents an approach for motion capturing (MoCap) of dressed people. A cloth draping method is embedded in a silhouette based MoCap system and an error functional is formalized to minimize image errors with respect to silhouettes, pose and kinematic chain parameters, the cloth draping components and external wind forces. We report on various experiments with two types of clothes, namely a skirt and a pair of shorts. Finally we compare the angles of the MoCap system with results from a commercially available marker based tracking system. The experiments show, that we are basically within the error range of marker based tracking systems, though body parts are occluded with cloth.


Surface Mesh Kinematic Chain Knee Angle Wind Force Free Point 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bregler, C., Malik, J., Pullen, K.: Twist based acquisition and tracking of animal and human kinetics. International Journal of Computer Vision 56(3), 179–194 (2004)CrossRefGoogle Scholar
  2. 2.
    Brox, T., Rousson, M., Deriche, R., Weickert, J.: Unsupervised Segmentation Incorporating Colour, Texture, and Motion. In: Petkov, N., Westenberg, M.A. (eds.) CAIP 2003. LNCS, vol. 2756, pp. 353–360. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  3. 3.
    Dervieux, A., Thomasset, F.: A finite element method for the simulation of Rayleigh–Taylor instability. In: Rautman, R. (ed.) Approximation Methods for Navier–Stokes Problems. Lecture Notes in Mathematics, vol. 771, pp. 145–158. Springer, Berlin (1979)CrossRefGoogle Scholar
  4. 4.
    Fua, P., Plänkers, R., Thalmann, D.: Tracking and modeling people in video sequences. Computer Vision and Image Understanding 81(3), 285–302 (2001)MATHCrossRefGoogle Scholar
  5. 5.
    Gavrilla, D.M.: The visual analysis of human movement: A survey. Computer Vision and Image Understanding 73(1), 82–92 (1999)CrossRefGoogle Scholar
  6. 6.
    Haddon, J., Forsyth, D., Parks, D.: The appearance of clothing (June 2005),
  7. 7.
    Herda, L., Urtasun, R., Fua, P.: Hierarchical Implicit Surface Joint Limits to Constrain Video-Based Motion Capture. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3022, pp. 405–418. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  8. 8.
    House, D.H., DeVaul, R.W., Breen, D.E.: Towards simulating cloth dynamics using interacting particles. Clothing Science and Technology 8(3), 75–94 (1996)CrossRefGoogle Scholar
  9. 9.
    Magnenat-Thalmann, N., Volino, P.: From early draping to haute cotoure models: 20 years of research. Visual Computing 21, 506–519 (2005)CrossRefGoogle Scholar
  10. 10.
    Mikic, I., Trivedi, M., Hunter, E., Cosman, P.: Human body model acquisition and tracking using voxel data. International Journal of Computer Vision 53(3), 199–223 (2003)CrossRefGoogle Scholar
  11. 11.
    MoCap-System. Motion analysis: A marker based tracking system (June 2005),
  12. 12.
    Moeslund, T.B., Granum, E.: A survey of computer vision based human motion capture. Computer Vision and Image Understanding 81(3), 231–268 (2001)MATHCrossRefGoogle Scholar
  13. 13.
    Murray, R.M., Li, Z., Sastry, S.S.: Mathematical Introduction to Robotic Manipulation. CRC Press, Baton Rouge (1994)MATHGoogle Scholar
  14. 14.
    Osher, S., Sethian, J.A.: Fronts propagating with curvature-dependent speed: Algorithms based on Hamilton–Jacobi formulations. Computational Physics 79, 12–49 (1988)MATHCrossRefMathSciNetGoogle Scholar
  15. 15.
    Richards, J.: The measurement of human motion: A comparison of commercially available systems. Human Movement Science 18, 589–602 (1999)CrossRefGoogle Scholar
  16. 16.
    Rosenhahn, B., Kersting, U.G., Smith, A.W., Gurney, J.K., Brox, T., Klette, R.: A System for Marker-Less Human Motion Estimation. In: Kropatsch, W.G., Sablatnig, R., Hanbury, A. (eds.) DAGM 2005. LNCS, vol. 3663, pp. 230–237. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  17. 17.
    Weil, J.: The synthesis of cloth objects. Computer Graphics (Proc. SigGraph) 20(4), 49–54 (1986)CrossRefMathSciNetGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Bodo Rosenhahn
    • 1
  • Uwe G. Kersting
    • 2
  • Katie Powell
    • 2
  • Hans-Peter Seidel
    • 1
  1. 1.Max Planck Institute for InformaticsSaarbrückenGermany
  2. 2.Department of Sport and Exercise ScienceThe University of AucklandNew Zealand

Personalised recommendations