Reconstruction of Animated Models from Images Using Constrained Deformable Surfaces

  • J. Starck
  • A. Hilton
  • J. Illingworth
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2301)


In this paper we present a technique to generate animated 3D models from a limited set of images. We adopt a model-based approach to shape recovery to obtain a specific model parameterisation for animation. A generic animatable 3D mesh model is first manually posed to match the pose in the images. Shape information from multiple 2D image silhouettes is integrated by reconstructing the occupied volume of an object. The mesh is then deformed to match the reconstructed volume using a robust coarse to fine matching technique. We formulate an irregularly parameterised generic mesh as a shape constrained deformable surface to preserve the prior shape information and specific parameterisation in the model. Our interest lies in the generation of animated human models in a multi-camera studio. We assess the technique using artificial test cases and present results for a dancer in a studio.


Deformable Model Visual Hull Medical Image Analysis Deformable Surface Image Silhouette 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    H. Chui and A. Rangarajan. A New Algorithm for Non-Rigid Point Matching. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, volume 2, pages 44–51, 2000.Google Scholar
  2. 2.
    P. Cignoni, C. Rocchini, and R. Scopigno. Metro: measuring error on simplified surfaces. Computer Graphics Forum, 17(2):167–174, 1998.CrossRefGoogle Scholar
  3. 3.
    L. Davis, E. Borovikov, R. Cutler, D. Harwood, and T. Horprasert. Multi-perspective analysis of human action. In Proceedings of the 3rd International Workshop on Cooperative Distributed Vision, Kyoto, Japan, 1999.Google Scholar
  4. 4.
    P. Fua, R. Plankers, C. Miccio, and D. Thalmann. From Image Synthesis to Image Analysis: Using Human Animation Models to Guide Feature Extraction. EPFLLIG Computer Graphics Lab, Switzerland, 1998.Google Scholar
  5. 5.
    A. Hilton, D. Beresford, T. Gentils, R. Smith, and W. Sun. Virtual people: Capturing human models to populate virtual worlds. In IEEE International Conference on Computer Animation, May 1999.Google Scholar
  6. 6.
    I.A. Kakadiaris and D. Metaxas. Three-dimensional human body model acquisition from multiple views. International Journal of Computer Vision, 30(3):191–218, 1998.CrossRefGoogle Scholar
  7. 7.
    T. Kanade, P. Rander, and P.J. Narayanan. Virtualized reality: Constructing virtual worlds from real scenes. IEEE Multimedia, 4(1):34–47, 1997.CrossRefGoogle Scholar
  8. 8.
    L. Kobbelt, S. Campagna, J. Vorsatz, and H.P. Seidel. Interactive Multi-Resolution Modeling on Arbitrary Meshes. In SIGGRAPH Conference Proceedings, pages 105–114, August 1998.Google Scholar
  9. 9.
    W.N. Martin and J.K. Aggarwal. Volumetric descriptions of objects from multiple views. IEE Transactions on Pattern Analysis and Machine Intelligence, 5(2):150–158, 1983.CrossRefGoogle Scholar
  10. 10.
    W. Matusik, C. Buehler, R. Raskar, S.J. Gortler, and L. McMillan. Image-based visual hulls. In SIGGRAPH Conference Proceedings. ACM SIGGRAPH, 2000.Google Scholar
  11. 11.
    T. McInerney and D. Terzopoulos. Deformable models in medical image analysis: a survey. Medical Image Analysis, 1(2):91–108, 1996.CrossRefGoogle Scholar
  12. 12.
    J. Montagnat and H. Delingette. Volumetric Medical Images Segmentation using Shape Constrained Deformable Models. In First Joint Conference CVRMed-MRCAS, volume Lecture Notes in Computer Science 1205, pages 13–22, March 1997.Google Scholar
  13. 13.
    A. Rangarajan, H. Chui, E. Mjolsness, S. Pappu, L. Davachi, P. Goldman-Rakic, and J. Duncan. A robust point matching algorithm for autoradiograph alignment. Medical Image Analysis, 4(1):379–398, 1997.CrossRefGoogle Scholar
  14. 14.
    L.H. Staib and J.S. Duncan. Model-Based Deformable Surface Finding for Medical Images. IEEE Transactions on Medical Imaging, 15(5):720–731, 1996.CrossRefGoogle Scholar
  15. 15.
    J. Starck, A. Hilton, and J. Illingworth. Human Shape Estimation in a Multi-Camera Studio. In BMVC, volume 2, pages 573–582, September 2001.Google Scholar
  16. 16.
    D. Terzopoulos, A. Witkin, and M. Kass. Symmetry-seeking models and 3D object reconstruction. International Journal of Computer Vision, 1:211–221, 1987.CrossRefGoogle Scholar
  17. 17.
    D. Thalmann, J. Shen, and E. Chauvineau. Fast human body deformations for animation and VR applications. In Proceedings of Computer Graphics International, pages 166–174. IEEE Computer Society Press, June 1996.Google Scholar
  18. 18.
    VRML Humanoid Animation Working Group, H-ANIM 1.1 Specification, 1999.

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • J. Starck
    • 1
  • A. Hilton
    • 1
  • J. Illingworth
    • 1
  1. 1.Centre for Vision, Speech and Signal ProcessingUniversity of SurreyGuildfordUK

Personalised recommendations