The Alignment Between 3-D Data and Articulated Shapes with Bending Surfaces

  • Guillaume Dewaele
  • Frédéric Devernay
  • Radu Horaud
  • Florence Forbes
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3953)


In this paper we address the problem of aligning 3-D data with articulated shapes. This problem resides at the core of many motion tracking methods with applications in human motion capture, action recognition, medical-image analysis, etc. We describe an articulated and bending surface representation well suited for this task as well as a method which aligns (or registers) such a surface to 3-D data. Articulated objects, e.g., humans and animals, are covered with clothes and skin which may be seen as textured surfaces. These surfaces are both articulated and deformable and one realistic way to model them is to assume that they bend in the neighborhood of the shape’s joints. We will introduce a surface-bending model as a function of the articulated-motion parameters. This combined articulated-motion and surface-bending model better predicts the observed phenomena in the data and therefore is well suited for surface registration. Given a set of sparse 3-D data (gathered with a stereo camera pair) and a textured, articulated, and bending surface, we describe a register-and-fit method that proceeds as follows. First, the data-to-surface registration problem is formalized as a classifier and is carried out using an EM algorithm. Second, the data-to-surface fitting problem is carried out by minimizing the distance from the registered data points to the surface over the joint variables. In order to illustrate the method we applied it to the problem of hand tracking. A hand model with 27 degrees of freedom is successfully registered and fitted to a sequence of 3-D data points gathered with a stereo camera pair.


Model Point Kinematic Chain Alignment Method Joint Parameter Surface Registration 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Gavrila, D.M.: The visual analysis of human movement: A survey. Computer Vision and Image Understanding 73, 82–98 (1999)zbMATHCrossRefGoogle Scholar
  2. 2.
    Plaenkers, R., Fua, P.: Articulated soft objects for multi-view shape and motion capture. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 (2003)Google Scholar
  3. 3.
    Herda, L., Urtasun, R., Fua, P.: Hierarchical implicit surface joint limits for human body tracking. Computer Vision and Image Understanding 99, 189–209 (2005)CrossRefGoogle Scholar
  4. 4.
    Deutscher, J., Blake, A., Reid, I.: Articulated body motion capture by annealed particle filtering. Computer Vision and Pattern Recognition, 2126–2133 (2000)Google Scholar
  5. 5.
    Sminchisescu, C., Triggs, B.: Estimating articulated human motion with covariance scaled sampling. International Journal of Robotics Research 22, 371–379 (2003)CrossRefGoogle Scholar
  6. 6.
    Delamarre, Q., Faugeras, O.: 3d articulated models and multi-view tracking with physical forces. Computer Vision and Image Understanding 81, 328–357 (2001)zbMATHCrossRefGoogle Scholar
  7. 7.
    Dewaele, G., Devernay, F., Horaud, R.: Hand motion from 3d point trajectories and a smooth surface model. In: Pajdla, T., Matas, J. (eds.) ECCV 2004. LNCS, vol. 3021, pp. 495–507. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  8. 8.
    Athitsos, V., Sclaroff, S.: Estimating 3D hand pose from a cluttered image. In: CVPR 2003: Proceedings of Conference in Computer Vision and Pattern Recognition (2003)Google Scholar
  9. 9.
    Zhang, Z.: Iterative point matching for registration of free-form curves and surfaces. International Journal on Computer Vision 13, 119–152 (1994)CrossRefGoogle Scholar
  10. 10.
    Ferrie, F.P., Lagarde, J., Whaite, P.: Darboux Frames, Snakes, and Super-Quadrics:Geometry from the Bottom Up. IEEE Transactions on Pattern Analysis and Machine Intelligence 15, 771–784 (1993)CrossRefGoogle Scholar
  11. 11.
    Gold, S., Rangarajan, A.: A Graduated Assignment Algorithm for Graph Matching. IEEE Transactions on Pattern Analysis and Machine Intelligence 18, 377–388 (1996)Google Scholar
  12. 12.
    Rangarajan, A., Chui, H., Bookstein, F.L.: The softassign procrustes matching algorithm. In: Duncan, J.S., Gindi, G. (eds.) IPMI 1997. LNCS, vol. 1230, pp. 29–42. Springer, Heidelberg (1997)Google Scholar
  13. 13.
    Chui, H., Rangarajan, A.: A new point matching algorithm for non-rigid registration. Computer Vision and Image Understanding 89, 114–141 (2003)zbMATHCrossRefGoogle Scholar
  14. 14.
    Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood estimation from incomplete data via the EM algorithm (with discussion). Journal of the Royal Statistical Society, Series B 39, 1–38 (1977)zbMATHMathSciNetGoogle Scholar
  15. 15.
    Cross, A.D.J., Hancock, E.R.: Graph Matching With a Dual-Step EM Algorithm. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 1236–1253 (1998)CrossRefGoogle Scholar
  16. 16.
    Luo, B., Hancock, E.: A unified framework for alignment and correspondence. CVIU 92, 26–55 (2003)Google Scholar
  17. 17.
    Granger, S., Pennec, X.: Multi-scale em-icp: A fast and robust approach for surface registration. In: ECCV 2002. LNCS, vol. 2353, pp. 418–432. Springer, Heidelberg (2002)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Guillaume Dewaele
    • 1
  • Frédéric Devernay
    • 1
  • Radu Horaud
    • 1
  • Florence Forbes
    • 1
  1. 1.INRIA Rhône-AlpesMontbonnot Saint-MartinFrance

Personalised recommendations