Nonrigid Shape and Motion from Multiple Perspective Views
We consider the problem of nonrigid shape and motion recovery from point correspondences in multiple perspective views. It is well known that the constraints among multiple views of a rigid shape are multilinear on the image points and can be reduced to bilinear (epipolar) and trilinear constraints among two and three views, respectively. In this paper, we generalize this classic result by showing that the constraints among multiple views of a nonrigid shape consisting of K shape bases can be reduced to multilinear constraints among K + ⌈ (K + 1)/2⌉, ⋯, 2K + 1 views. We then present a closed form solution to the reconstruction of a nonrigid shape consisting of two shape bases. We show that point correspondences in five views are related by a nonrigid quintifocal tensor, from which one can linearly compute nonrigid shape and motion. We also demonstrate the existence of intrinsic ambiguities in the reconstruction of camera translation, shape coefficients and shape bases. Examples show the effectiveness of our method on nonrigid scenes with significant perspective effects.
KeywordsNull Space Camera Motion Multiple View Shape Base Point Correspondence
Unable to display preview. Download preview PDF.
- 1.Aanaes, H., Kahl, F.: Estimation of deformable structure and motion. In: ECCV Workshop on Vision and Modelling of Dynamic Scenes (2002)Google Scholar
- 2.Brand, M.: Morphable 3D models from video. In: IEEE Conf. on Computer Vision & Pattern Recognition, pp. 456–463 (2001)Google Scholar
- 3.Brand, M., Bhotika, R.: Flexible flow for 3D nonrigid tracking and shape recovery. In: IEEE Conf. on Computer Vision & Pattern Recognition, pp. 315–322 (2001)Google Scholar
- 4.Bregler, C., Hertzmann, A., Biermann, H.: Recovering non-rigid 3D shape from image streams. In: IEEE Conf. on Computer Vision & Pattern Recognition, pp. 2690–2696 (2000)Google Scholar
- 6.Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, Cambridge (2000)Google Scholar
- 10.Torresani, L., Yang, D., Alexander, E., Bregler, C.: Tracking and modeling non-rigid objects with rank constraints. In: IEEE Conf. on Computer Vision and Pattern Recognition, pp. 493–500 (2001)Google Scholar
- 11.Vidal, R., Ma, Y., Soatto, S., Sastry, S.: Two-view multibody structure from motion. International Journal of Computer Vision (2006)Google Scholar
- 12.Vidal, R., Ravichandran, A.: Optical flow estimation and segmentation of multiple moving dynamic textures. In: IEEE Conf. on Computer Vision & Pattern Recognition, pp. 516–521 (2005)Google Scholar