Abstract
Three-dimensional (3D) shape models are powerful because they enable the inference of object shape from incomplete, noisy, or ambiguous 2D or 3D data. For example, realistic parameterized 3D human body models have been used to infer the shape and pose of people from images. To train such models, a corpus of 3D body scans is typically brought into registration by aligning a common 3D human-shaped template to each scan. This is an ill-posed problem that typically involves solving an optimization problem with regularization terms that penalize implausible deformations of the template. When aligning a corpus, however, we can do better than generic regularization. If we have a model of how the template can deform then alignments can be regularized by this model. Constructing a model of deformations, however, requires having a corpus that is already registered. We address this chicken-and-egg problem by approaching modeling and registration together. By minimizing a single objective function, we reliably obtain high quality registration of noisy, incomplete, laser scans, while simultaneously learning a highly realistic articulated body model. The model greatly improves robustness to noise and missing data. Since the model explains a corpus of body scans, it captures how body shape varies across people and poses.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
References
Hasler, N., Stoll, C., Sunkel, M., Rosenhahn, B., Seidel, H.-P.: A statistical model of human pose and body shape. Comp. Graphics Forum 28(2), 337–346 (2009)
Wuhrer, S., Shu, C., Xi, P.: Landmark-free posture invariant human shape correspondence. The Visual Computer 27, 843–852 (2011)
Allen, B., Curless, B., Popović, Z.: The space of human body shapes: Reconstruction and parameterization from range scans. ACM ToG, 587–594 (2003)
Hirshberg, D.A., Loper, M., Rachlin, E., Tsoli, A., Weiss, A., Corner, B., Black, M.J.: Evaluating the automated alignment of 3D human body scans. In: 2nd Int. Conf. 3D Body Scanning Technologies, pp. 76–86 (2011)
Xi, P., Lee, W.S., Shu, C.: A data-driven approach to human-body cloning using a segmented body database. In: Proc. 15th Pacific Conf. Comp. Graph. and Apps., pp. 139–147 (2007)
Li, H., Adams, B., Guibas, L.J., Pauly, M.: Robust single-view geometry and motion reconstruction. In: ACM SIGGRAPH Asia, vol. 28, pp. 175:1–175:10 (2009)
Granger, S., Pennec, X.: Multi-scale EM-ICP: A Fast and Robust Approach for Surface Registration. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part IV. LNCS, vol. 2353, pp. 418–432. Springer, Heidelberg (2002)
Li, H., Sumner, R.W., Pauly, M.: Global correspondence optimization for non-rigid registration of depth scans. Comp. Graphics Forum 27(5), 1421–1430 (2008)
Amberg, B.: Editing Faces in Videos. PhD thesis, University of Basel (2011)
Breidt, M., Bülthoff, H.H., Curio, C.: Face models from noisy 3D cameras. In: ACM SIGGRAPH Asia Sketches, pp. 12:1–12:2 (2010)
Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. ACM ToG SIGGRAPH, 187–194 (1999)
Sorkine, O., Alexa, M.: As-rigid-as-possible surface modeling. In: Proc. 5th Euro. Symp. Geom. Proc., vol. 26, pp. 109–116 (2007)
Sumner, R.W., Schmid, J., Pauly, M.: Embedded deformation for shape manipulation. ACM ToG 26(3), 80:1–80:7 (2007)
Paysan, P., Knothe, R., Amberg, B., Romdhani, S., Vetter, T.: A 3D face model for pose and illumination invariant face recognition. In: Proc. 6th IEEE Int. Conf. Adv. Video Signal Based Surveillance (AVSS), pp. 296–301 (2009)
Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., Davis, J.: SCAPE: Shape completion and animation of people. ACM ToG 24, 408–416 (2005)
Allen, B., Curless, B., Popović, Z., Hertzmann, A.: Learning a correlated model of identity and pose-dependent body shape variation for real-time synthesis. In: Proc. ACM SIGGRAPH/Eurographics Symp. on Comp. Anim., pp. 147–156 (2006)
Sumner, R.W., Popović, J.: Deformation transfer for triangle meshes. ACM ToG 23, 399–405 (2004)
Balan, A.: Detailed Human Shape and Pose from Images. PhD thesis, Brown University, Providence, RI (2010)
Geman, S., McClure, D.: Statistical methods for tomographic image reconstruction. Bul. Int. Stat. Inst. 52, 5–21 (1987)
Hirshberg, D.A., Loper, M., Rachlin, E., Black, M.J.: Coregistration: Supplemental material. MPI-IS-TR-004, Max Planck Institute for Intelligent Systems (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hirshberg, D.A., Loper, M., Rachlin, E., Black, M.J. (2012). Coregistration: Simultaneous Alignment and Modeling of Articulated 3D Shape. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds) Computer Vision – ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol 7577. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33783-3_18
Download citation
DOI: https://doi.org/10.1007/978-3-642-33783-3_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33782-6
Online ISBN: 978-3-642-33783-3
eBook Packages: Computer ScienceComputer Science (R0)