Advertisement

Estimation of Human Body Shape in Motion with Wide Clothing

  • Jinlong Yang
  • Jean-Sébastien Franco
  • Franck Hétroy-Wheeler
  • Stefanie WuhrerEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9908)

Abstract

Estimating 3D human body shape in motion from a sequence of unstructured oriented 3D point clouds is important for many applications. We propose the first automatic method to solve this problem that works in the presence of loose clothing. The problem is formulated as an optimization problem that solves for identity and posture parameters in a shape space capturing likely body shape variations. The automation is achieved by leveraging a recent robust pose detection method [1]. To account for clothing, we take advantage of motion cues by encouraging the estimated body shape to be inside the observations. The method is evaluated on a new benchmark containing different subjects, motions, and clothing styles that allows to quantitatively measure the accuracy of body shape estimates. Furthermore, we compare our results to existing methods that require manual input and demonstrate that results of similar visual quality can be obtained.

Keywords

Human body modeling Shape and motion estimation Statistical shape space 

Notes

Acknowledgements

Funded by France National Research grant ANR-14-CE24-0030 ACHMOV. We thank Yannick Marion for help with code to efficiently fit an S-SCAPE model to a single frame, Leonid Pishchulin for helpful discussions, Alexandros Neophytou and Adrian Hilton for providing comparison data, and Mickaël Heudre, Julien Pansiot and volunteer subjects for help acquiring the database.

Supplementary material

Supplementary material 1 (mp4 27474 KB)

References

  1. 1.
    Zuffi, S., Black, M.: The stitched puppet: a graphical model of 3D human shape and pose. In: Conference on Computer Vision and Pattern Recognition, pp. 3537–3546 (2015)Google Scholar
  2. 2.
    Newcombe, R.A., Fox, D., Seitz, S.M.: Dynamicfusion: reconstruction and tracking of non-rigid scenes in real-time. In: Conference on Computer Vision and Pattern Recognition, pp. 343–352 (2015)Google Scholar
  3. 3.
    Bogo, F., Black, M.J., Loper, M., Romero, J.: Detailed full-body reconstructions of moving people from monocular RGB-D sequences. In: ICCV (2015)Google Scholar
  4. 4.
    Weiss, A., Hirshberg, D., Black, M.: Home 3D body scans from noisy image and range data. In: International Conference on Computer Vision, pp. 1951–1958 (2011)Google Scholar
  5. 5.
    Helten, T., Baak, A., Bharai, G., Müller, M., Seidel, H.P., Theobalt, C.: Personalization and evaluation of a real-time depth-based full body scanner. In: International Conference on 3D Vision, pp. 279–286 (2013)Google Scholar
  6. 6.
    Wuhrer, S., Pishchulin, L., Brunton, A., Shu, C., Lang, J.: Estimation of human body shape and posture under clothing. Comput. Vis. Image Underst. 127, 31–42 (2014)CrossRefGoogle Scholar
  7. 7.
    Neophytou, A., Hilton, A.: A layered model of human body and garment deformation. In: International Conference on 3D Vision, pp. 171–178 (2014)Google Scholar
  8. 8.
    Pishchulin, L., Wuhrer, S., Helten, T., Theobalt, C., Schiele, B.: Building statistical shape spaces for 3D human modeling. Technical report 1503.05860, arXiv (2015)Google Scholar
  9. 9.
    Balan, A.O., Black, M.J.: The naked truth: estimating body shape under clothing. In: European Conference on Computer Vision, pp. 15–29 (2008)Google Scholar
  10. 10.
    Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., Davis, J.: SCAPE: shape completion and animation of people. In: Proceedings of SIGGRAPH ACM Transactions on Graphics, vol. 24, no. 3, pp. 408–416 (2005)Google Scholar
  11. 11.
    Chen, Y., Liu, Z., Zhang, Z.: Tensor-based human body modeling. In: Conference on Computer Vision and Pattern Recognition, pp. 105–112 (2013)Google Scholar
  12. 12.
    Hasler, N., Stoll, C., Sunkel, M., Rosenhahn, B., Seidel, H.P.: A statistical model of human pose and body shape. In: Proceedings of Eurographics Computer Graphics Forum, vol. 28, no. 2, pp. 337–346 (2009)Google Scholar
  13. 13.
    Jain, A., Thormählen, T., Seidel, H.P., Theobalt, C.: MovieReshape: tracking and reshaping of humans in videos. In: Proceedings of SIGGRAPH Asia ACM Transactions on Graphics, vol. 29, no. 148, pp. 1–10 (2010)Google Scholar
  14. 14.
    Neophytou, A., Hilton, A.: Shape and pose space deformation for subject specific animation. In: International Conference on 3D Vision, pp. 334–341 (2013)Google Scholar
  15. 15.
    Loper, M., Mahmood, N., Romero, J., Pons-Moll, G., Black, M.: SMPL: A skinned multi-person linear model. In: Proceedings of SIGGRAPH Asia Transactions on Graphics, vol. 34, no. 6, pp. 248:1–248:16 (2015)Google Scholar
  16. 16.
    Pons-Moll, G., Romero, J., Mahmood, N., Black, M.: DYNA: a model of dynamic human shape in motion. In: Proceedings of SIGGRAPH Transactions on Graphics, vol. 34, no. 4, pp. 120:1–120:14 (2015)Google Scholar
  17. 17.
    Hasler, N., Stoll, C., Rosenhahn, B., Thormählen, T., Seidel, H.P.: Estimating body shape of dressed humans. In: Proceedings of Shape Modeling International Computers and Graphics, vol. 33, no. 3, pp. 211–216 (2009)Google Scholar
  18. 18.
    Wuhrer, S., Shu, C., Xi, P.: Posture-invariant statistical shape analysis using Laplace operator. In: Proceedings of Shape Modeling International Computers and Graphics, vol. 36, no. 5, pp. 410–416 (2012)Google Scholar
  19. 19.
    Stoll, C., Gall, J., de Aguiar, E., Thrun, S., Theobalt, C.: Video-based reconstruction of animatable human characters. In: Proceedings of SIGGRAPH Asia ACM Transactions on Graphics, vol. 29, no. 6, pp. 139:1–139:10 (2010)Google Scholar
  20. 20.
    de Aguiar, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H.P., Thrun, S.: Performance capture from sparse multi-view video. In: Proceedings of SIGGRAPH ACM Transactions on Graphics, vol. 27, no. 3, pp. 98:1–98:10 (2008)Google Scholar
  21. 21.
    Vlasic, D., Baran, I., Matusik, W., Popović, J.: Articulated mesh animation from multi-view silhouettes. In: Proceedings of SIGGRAPH ACM Transactions on Graphics, vol. 27, no. 3, pp. 97:1–97:10 (2008)Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  • Jinlong Yang
    • 1
    • 2
  • Jean-Sébastien Franco
    • 1
    • 2
  • Franck Hétroy-Wheeler
    • 1
    • 2
  • Stefanie Wuhrer
    • 1
    • 2
    Email author
  1. 1.Inria Grenoble Rhône-AlpesGrenobleFrance
  2. 2.Laboratoire Jean KuntzmannUniversité Grenoble AlpesGrenobleFrance

Personalised recommendations