A Domain Reduction Algorithm for Incremental Projective Reconstruction
In this paper we address the problem of recovering the three-dimensional shape of an object and the motion of the camera based on multiple feature correspondences from an image sequence. We present a new incremental projective factorization algorithm using a perspective camera model. The original projective factorization method produces robust results. However, the method can not be applied to real-time applications since it is based on a batch processing pipeline and the size of the data matrix grows with each additional frame. The proposed algorithm obtains an estimate of shape and motion for each additional frame adding a dimension reduction step. A subset of frames is selected analyzing the contribution of frames to the reconstruction quality. The main advantage of the novel algorithm is the reduction of the computational cost while keeping the robustness of the original method. Experiments with synthetic and real images illustrate the accuracy and performance of the new algorithm.
KeywordsSingular Value Decomposition Factorization Method Measurement Matrix Bundle Adjustment Epipolar Geometry
Unable to display preview. Download preview PDF.
- 1.Mahamud, S., Hebert, M., Omori, Y., Ponce, J.: Provably-convergent iterative methods for projective structure from motion. CVPR 1, 1018–1025 (2001)Google Scholar
- 2.Sturm, P., Triggs, B.: A factorization based algorithm for multi-image projective structure and motion. In: Buxton, B.F., Cipolla, R. (eds.) ECCV 1996. LNCS, vol. 1065, pp. 709–720. Springer, Heidelberg (1996)Google Scholar
- 3.Repko, J., Marc, P.: 3d models from extended uncalibrated video sequences: Addressing key-frame selection and projective drift. 3DIM, 150–157 (2005)Google Scholar
- 4.Martinec, D., Pajdla, T.: 3d reconstruction by fitting low-rank matrices with missing data. CVPR 1, 198–205 (2005)Google Scholar
- 5.Hartley, R., Zisserman, A.: Multiple View Geometry in computer Vision, 1st edn., Cambiridge (2000)Google Scholar
- 6.Grossman, E., Santos-Victor, J.: Algebraic aspects of reconstruction of structured scenes from one or more views. In: Proceedings of the BMVC, vol. 2, pp. 633–642 (2001)Google Scholar
- 10.Morita, T.: A sequential factorization method for recovering shape and motion from image streams. In: Proceedings of ARPA Image Understanding Workshop, vol. 2, pp. 1177–1188 (1994)Google Scholar
- 12.Tomasi, C., Kanade, T.: Detection and tracking of point features. CMU Technical Report, CMU–CS–91–132 (1991)Google Scholar
- 14.Torr, P., Fitzgibbon, A.: Maintaining multiple motion model hypotheses through many views to recover matching and structure. ICCV 1, 485–491 (1998)Google Scholar
- 15.Nistér, D.: Preemptive ransac for live structure and motion estimation. ICCV, 199–206 (2003)Google Scholar
- 16.Pollefeys, M., Van Gool, L., Vergauwen, M., Cornelis, K., Verbiest, F., Tops, J.: Video-to-3d. In: Proceedings of Photogrammetric Computer Vision 2002 (ISPRS Commission III Symposium), International Archive of Photogrammetry and Remote Sensing, pp. 247–252 (2002)Google Scholar
- 17.Gibson, S., Cook, J., Howard, T., Hybbold, R., Oram, D.: Accurate camera calibration for off-line, video-based augmented reality. In: ISMAR, pp. 37–46 (2002)Google Scholar