Structure Estimation and Surface Triangulation of Deformable Objects

  • Charlotte Svensson
  • Henrik Aanæs
  • Fredrik Kahl
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2749)


A system is developed that from an image sequence of a deformable object automatically extracts features and tracks them through the sequence, estimates the non-rigid 3D structure and finally computes a surface triangulation. Also the camera motion is acquired. The object is supposed to deform according to a linear model, while the motion of the camera can be arbitrary. No domain specific prior of the object is required.

For the structure estimation a two-step approach is used, where we first obtain an initial estimate of the structure and motion, and then obtain an optimal solution via a non-linear optimization scheme. The triangulation is optimized to yield a non-rigid faceted surface that well approximates the true 3D surface.


  1. 1.
    H. Aanæs and F. Kahl. Estimation of deformable structure and motion. Workshop on Vision and Modelling of Dynamic Scenes, ECCV’02, Copenhagen, Denmark, 2002.Google Scholar
  2. 2.
    H. Aanæs and F. Kahl. Estimation of deformable structure and motion. Technical report, Centre for Mathematical Sciences, Lund University, January 2002.Google Scholar
  3. 3.
    H. Akaike. A new look at the statistical model identification. IEEE Trans. on Automatic Control, 19(6):716–723, 1974.zbMATHCrossRefMathSciNetGoogle Scholar
  4. 4.
    C. Bregler, A. Hertzmann, and H. Biermann. Recovering non-rigid 3d shape from image streams. Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662), pages 690–6 vol.2, 2000.Google Scholar
  5. 5.
    T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham. Active shape models — their training and application. Computer Vision, Graphics and Image Processing, 61(1):38–59, January 1995.CrossRefGoogle Scholar
  6. 6.
    J.D. Foley, A. van Dam, S.K. Feiner and J.F. Hughes Computer Graphics: Principles and Practice in C (2nd Edition). Addison-Wesley Pub Co., 1995.Google Scholar
  7. 7.
    R. Hartley and A. Zisserman. Multiple View Geometry. Cambridge University Press, The Edinburgh Building, Cambridge CB2 2RU, UK, 2000.zbMATHGoogle Scholar
  8. 8.
    M. Irani. Multi-frame optical flow estimation using subspace constraints. IEEE International Conference on Computer Vision (ICCV), Corfu, September 1999Google Scholar
  9. 9.
    A. Lanitis, C.J. Taylor and T.F. Cootes. Automatic interpretation of human faces and hand gestures using flexible models. In International Workshop on Automatic Face-and Gesture-Recognition, 1995Google Scholar
  10. 10.
    B. Lucas and T. Kanade An iterative image registration technique with an application to stereo vision. Proceedings 7th International Joint Conference on Artificial Intelligence, 1981Google Scholar
  11. 11.
    D.D. Morris and T. Kanade. Image-consistent surface triangulation. IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000, vol 1, pp 332–338, 2000.Google Scholar
  12. 12.
    H. Sidenbladh, M. J. Black, and D. J. Fleet. Stochastic tracking of 3d human figures using 2d image motion. In European Conf, Computer Vision’2000, volume 2, pages 702–718, 2000.Google Scholar
  13. 13.
    C.C. Slama, editor. Manual of Photogrammetry. American Society of Photogrammetry, Falls Church, VA, 4:th edition, 1984.Google Scholar
  14. 14.
    C. Sminchisescu and B. Triggs. Covariance scaled sampling for monocular 3d body tracking. In IEEE Conf. Computer Vision and Pattern Recognition’2001, volume I, pages 447–454, 2001.Google Scholar
  15. 15.
    C. Tomasi and T. Kanade. Shape and motion from image streams under orthography: a factorization method. Int’l J. Computer Vision’92, 9(2):137–154, November 1992.CrossRefGoogle Scholar
  16. 16.
    L. Torresani, D.B. Yang, E.J. Alexander, and C. Bregler. Tracking and modeling non-rigid objects with rank constraints. Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on, 1:493–500, 2001.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Charlotte Svensson
    • 1
  • Henrik Aanæs
    • 2
  • Fredrik Kahl
    • 1
  1. 1.Centre for Mathematical SciencesLund UniversityLundSweden
  2. 2.Informatics and Mathematical ModellingTechnical University of DenmarkKongens LyngbyDenmark

Personalised recommendations