Non-rigid Self-calibration of a Projective Camera
Rigid structure-from-motion (SfM) usually consists of two steps: First, a projective reconstruction is computed which is then upgraded to Euclidean structure and motion in a subsequent step. Reliable algorithms exist for both problems. In the case of non-rigid SfM, on the other hand, especially the Euclidean upgrading has turned out to be difficult. A few algorithms have been proposed for upgrading an affine reconstruction, and are able to obtain successful 3D-reconstructions. For upgrading a non-rigid projective reconstruction, however, either simple sequences are used, or no 3D-reconstructions are shown at all.
In this article, an algorithm is proposed for estimating the self-calibration of a projectively reconstructed non-rigid scene. In contrast to other algorithms, neither prior knowledge of the non-rigid deformations is required, nor a subsequent step to align different motion bases. An evaluation with synthetic data reveals that the proposed algorithm is robust to noise and it is able to accurately estimate the 3D-reconstructions and the intrinsic calibration. Finally, reconstructions of a challenging real image with strong non-rigid deformation are presented.
Unable to display preview. Download preview PDF.
- 1.Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press (2004) ISBN: 0521540518Google Scholar
- 2.Bregler, C., Hertzmann, A., Biermann, H.: Recovering non-rigid 3d shape from image streams. In: IEEE Computer Vision and Pattern Recognition (CVPR), Hilton Head, SC, USA, pp. 690–696 (2000)Google Scholar
- 3.Triggs, B.: Autocalibration and the absolute quadric. In: Conf. Comp. Vis. and Pat. Recog. (CVPR) (1997)Google Scholar
- 6.Chandraker, M., Agarwal, S., Kahl, F., Nistér, D., Kriegman, D.: Autocalibration via rank-constrained estimation of the absolute quadric. In: Conf. Comp. Vis. and Pat. Recog. (CVPR) (2007)Google Scholar
- 8.Brand, M.: A direct method for 3D factorization of nonrigid motion observed in 2d. In: IEEE Computer Vision and Pattern Recognition (CVPR), Washington, DC, USA, pp. 122–128 (2005)Google Scholar
- 11.Paladini, M., Del Bue, A., Stosic, M., Dodig, M., Xavier, J., Agapito, L.: Factorization for non-rigid and articulated structure using metric projections. In: IEEE Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA, pp. 2898–2905 (2009)Google Scholar
- 12.Xiao, J., Kanade, T.: Uncalibrated perspective reconstruction of deformable structures. In: Proceedings of the 10th International Conference on Computer Vision (ICCV), vol. 2, pp. 1075–1082 (2005)Google Scholar
- 14.Brand, M.: Morphable 3D models from video. In: IEEE Computer Vision and Pattern Recognition (CVPR), pp. 456–463 (2001)Google Scholar
- 16.Mahamud, S., Hebert, M.: Iterative projective reconstruction from multiple views. In: The Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 430–437 (2000)Google Scholar
- 17.Akhter, I., Sheikh, Y., Khan, S.: In defense of orthonormality constraints for nonrigid structure from motion. In: IEEE Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA, pp. 1534–1541 (2009)Google Scholar