Reconstruction of Animated Models from Images Using Constrained Deformable Surfaces
In this paper we present a technique to generate animated 3D models from a limited set of images. We adopt a model-based approach to shape recovery to obtain a specific model parameterisation for animation. A generic animatable 3D mesh model is first manually posed to match the pose in the images. Shape information from multiple 2D image silhouettes is integrated by reconstructing the occupied volume of an object. The mesh is then deformed to match the reconstructed volume using a robust coarse to fine matching technique. We formulate an irregularly parameterised generic mesh as a shape constrained deformable surface to preserve the prior shape information and specific parameterisation in the model. Our interest lies in the generation of animated human models in a multi-camera studio. We assess the technique using artificial test cases and present results for a dancer in a studio.
KeywordsDeformable Model Visual Hull Medical Image Analysis Deformable Surface Image Silhouette
- 1.H. Chui and A. Rangarajan. A New Algorithm for Non-Rigid Point Matching. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, volume 2, pages 44–51, 2000.Google Scholar
- 3.L. Davis, E. Borovikov, R. Cutler, D. Harwood, and T. Horprasert. Multi-perspective analysis of human action. In Proceedings of the 3rd International Workshop on Cooperative Distributed Vision, Kyoto, Japan, 1999.Google Scholar
- 4.P. Fua, R. Plankers, C. Miccio, and D. Thalmann. From Image Synthesis to Image Analysis: Using Human Animation Models to Guide Feature Extraction. EPFLLIG Computer Graphics Lab, Switzerland, 1998.Google Scholar
- 5.A. Hilton, D. Beresford, T. Gentils, R. Smith, and W. Sun. Virtual people: Capturing human models to populate virtual worlds. In IEEE International Conference on Computer Animation, May 1999.Google Scholar
- 8.L. Kobbelt, S. Campagna, J. Vorsatz, and H.P. Seidel. Interactive Multi-Resolution Modeling on Arbitrary Meshes. In SIGGRAPH Conference Proceedings, pages 105–114, August 1998.Google Scholar
- 10.W. Matusik, C. Buehler, R. Raskar, S.J. Gortler, and L. McMillan. Image-based visual hulls. In SIGGRAPH Conference Proceedings. ACM SIGGRAPH, 2000.Google Scholar
- 12.J. Montagnat and H. Delingette. Volumetric Medical Images Segmentation using Shape Constrained Deformable Models. In First Joint Conference CVRMed-MRCAS, volume Lecture Notes in Computer Science 1205, pages 13–22, March 1997.Google Scholar
- 15.J. Starck, A. Hilton, and J. Illingworth. Human Shape Estimation in a Multi-Camera Studio. In BMVC, volume 2, pages 573–582, September 2001.Google Scholar
- 17.D. Thalmann, J. Shen, and E. Chauvineau. Fast human body deformations for animation and VR applications. In Proceedings of Computer Graphics International, pages 166–174. IEEE Computer Society Press, June 1996.Google Scholar
- 18.VRML Humanoid Animation Working Group, http://www.h-anim.org/. H-ANIM 1.1 Specification, 1999.