The Naked Truth: Estimating Body Shape Under Clothing

  • Alexandru O. Bălan
  • Michael J. Black
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5303)

Abstract

We propose a method to estimate the detailed 3D shape of a person from images of that person wearing clothing. The approach exploits a model of human body shapes that is learned from a database of over 2000 range scans. We show that the parameters of this shape model can be recovered independently of body pose. We further propose a generalization of the visual hull to account for the fact that observed silhouettes of clothed people do not provide a tight bound on the true 3D shape. With clothed subjects, different poses provide different constraints on the possible underlying 3D body shape. We consequently combine constraints across pose to more accurately estimate 3D body shape in the presence of occluding clothing. Finally we use the recovered 3D shape to estimate the gender of subjects and then employ gender-specific body models to refine our shape estimates. Results on a novel database of thousands of images of clothed and “naked” subjects, as well as sequences from the HumanEva dataset, suggest the method may be accurate enough for biometric shape analysis in video.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Supplementary material

978-3-540-88688-4_2_MOESM1_ESM.avi (23.1 mb)
Supplementary material (23,610 KB)

References

  1. 1.
    Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., Davis, J.: SCAPE: Shape completion and animation of people. SIGGRAPH 24, 408–416 (2005)CrossRefGoogle Scholar
  2. 2.
    Bălan, A.O., Sigal, L., Black, M.J., Davis, J.E., Haussecker, H.W.: Detailed human shape and pose from images. In: CVPR (2007)Google Scholar
  3. 3.
    Bălan, A.O., Black, M.J., Sigal, L., Haussecker, H.W.: Shining a light on human pose: On shadows, shading and the estimation of pose and shape. In: ICCV (2007)Google Scholar
  4. 4.
    Mündermann, L., Corazza, S., Andriacchi, T.: Accurately measuring human movement using articulated ICP with soft-joint constraints and a repository of articulated models. In: CVPR (2007)Google Scholar
  5. 5.
    Cheung, K.M., Baker, S., Kanade, T.: Visual hull alignment and refinement across time: A 3D reconstruction algorithm combining shape-from-silhouette with stereo. In: CVPR, vol. 2, pp. 375–382 (2003)Google Scholar
  6. 6.
    Laurentini, A.: The visual hull concept for silhouette-based image understanding. PAMI 16, 150–162 (1994)CrossRefGoogle Scholar
  7. 7.
    Rosenhahn, B., Kersting, U., Powell, K., Klette, R., Klette, G., Seidel, H.P.: A system for articulated tracking incorporating a clothing model. Machine Vision and Applications (MVA) 18, 25–40 (2007)CrossRefGoogle Scholar
  8. 8.
    Salzmann, M., Pilet, J., Ilic, S., Fua, P.: Surface deformation models for nonrigid 3D shape recovery. PAMI 29, 1481–1487 (2007)CrossRefGoogle Scholar
  9. 9.
    White, R., Crane, K., Forsyth, D.: Capturing and animating occluded cloth. In: ACM Transactions on Graphics (TOG), SIGGRAPH (2007)Google Scholar
  10. 10.
    de Aguiar, E., Theobalt, C., Stoll, C., Seidel, H.P.: Marker-less deformable mesh tracking for human shape and motion capture. In: CVPR, pp. 2502–2509 (2007)Google Scholar
  11. 11.
    Stark, J., Hilton, A.: Surface capture for performance-based animation. IEEE Comp. Graphics and Applications 27, 21–31 (2007)CrossRefGoogle Scholar
  12. 12.
    Franco, J.S., Lapierre, M., Boyer, E.: Visual shapes of silhouette sets. In: Proc. 3rd Int. Symp. on 3D Data Processing, Visualization and Transmission (2006)Google Scholar
  13. 13.
    Cheung, K.M., Baker, S., Kanade, T.: Shape-from-silhouette across time: Part II: Applications to human modeling and markerless motion tracking. IJCV 63, 225–245 (2005)CrossRefGoogle Scholar
  14. 14.
    Grauman, K., Shakhnarovich, G., Darrell, T.: A Bayesian approach to image-based visual hull reconstruction. In: CVPR, vol. 1, pp. 187–194 (2003)Google Scholar
  15. 15.
    Grauman, K., Shakhnarovich, G., Darrell, T.: Inferring 3D structure with a statistical image-based shape model. In: ICCV, pp. 641–648 (2003)Google Scholar
  16. 16.
    Moghaddam, B., Yang, M.: Learning gender with support faces. PAMI 24, 707–711 (2002)CrossRefGoogle Scholar
  17. 17.
    Li, X., Maybank, S., Yan, S., Tao, D., Xu, D.: Gait components and their application to gender recognition. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 38, 145–155 (2008)CrossRefGoogle Scholar
  18. 18.
    Bouguet, J.Y.: Camera calibration toolbox for Matlab. Technical report (CalTech)Google Scholar
  19. 19.
    Sigal, L., Black, M.J.: HumanEva: Synchronized video and motion capture dataset for evaluation of articulated human motion. Technical Report CS-06-08, Brown University (2006)Google Scholar
  20. 20.
    Brand, M.: Incremental singular value decomposition of uncertain data with missing values. In: ECCV, pp. 707–720 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Alexandru O. Bălan
    • 1
  • Michael J. Black
    • 1
  1. 1.Department of Computer ScienceBrown University, ProvidenceUSA

Personalised recommendations