Computer Vision – ECCV 2012

Volume 7577 of the series Lecture Notes in Computer Science pp 242-255

Coregistration: Simultaneous Alignment and Modeling of Articulated 3D Shape

  • David A. HirshbergAffiliated withMax Planck Institute for Intelligent Systems
  • , Matthew LoperAffiliated withMax Planck Institute for Intelligent Systems
  • , Eric RachlinAffiliated withMax Planck Institute for Intelligent Systems
  • , Michael J. BlackAffiliated withMax Planck Institute for Intelligent Systems

* Final gross prices may vary according to local VAT.

Get Access


Three-dimensional (3D) shape models are powerful because they enable the inference of object shape from incomplete, noisy, or ambiguous 2D or 3D data. For example, realistic parameterized 3D human body models have been used to infer the shape and pose of people from images. To train such models, a corpus of 3D body scans is typically brought into registration by aligning a common 3D human-shaped template to each scan. This is an ill-posed problem that typically involves solving an optimization problem with regularization terms that penalize implausible deformations of the template. When aligning a corpus, however, we can do better than generic regularization. If we have a model of how the template can deform then alignments can be regularized by this model. Constructing a model of deformations, however, requires having a corpus that is already registered. We address this chicken-and-egg problem by approaching modeling and registration together. By minimizing a single objective function, we reliably obtain high quality registration of noisy, incomplete, laser scans, while simultaneously learning a highly realistic articulated body model. The model greatly improves robustness to noise and missing data. Since the model explains a corpus of body scans, it captures how body shape varies across people and poses.