Abstract
We present a batch method for recovering Euclidian camera motion from sparse image data. The main purpose of the algorithm is to recover the motion parameters using as much of the available information and as few computational steps as possible. The algorithm thus places itself in the gap between factorisation schemes, which make use of all available information in the initial recovery step, and sequential approaches which are able to handle sparseness in the image data. Euclidian camera matrices are approximated via the affine camera model, thus making the recovery direct in the sense that no intermediate projective reconstruction is made. Using a little known closure constraint, the F A -closure, we are able to formulate the camera coefficients linearly in the entries of the affine fundamental matrices. The novelty of the presented work is twofold: Firstly the presented formulation allows for a particularly good conditioning of the estimation of the initial motion parameters but also for an unprecedented diversity in the choice of possible regularisation terms. Secondly, the new autocalibration scheme presented here is in practice guaranteed to yield a Least Squares Estimate of the calibration parameters.
As a bi-product, the affine camera model is rehabilitated as a useful model for most cameras and scene configurations, e.g. wide angle lenses observing a scene at close range. Experiments on real and synthetic data demonstrate the ability to reconstruct scenes which are very problematic for previous structure from motion techniques due to local ambiguities and error accumulation.
Similar content being viewed by others
References
Aanaes, H., Fisker, R., Astrom, K., and Carstensen J.M. 2002. Robust factorization. IEEE Trans. Pattern Analysis and Machine Intelligence, 24(9):1215–1225.
Beardsley, P., Zisserman, A., and Murray D.W. 1997. Sequential updating of projective and affine structure from motion. Int. Journal of Computer Vision, 23(3):235–259.
Björck, AA. 1996. Numerical methods for least squares problems. Society for Industrial and Applied Mathematics.
Christy, S., and Horaud, R. 1996. Euclidean shape and motion from multiple perspective views by affine iterations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(11):1098–1104.
Faugeras, O. 1992. What can be seen in three dimensions with an uncalibrated stereo rig? In Sandini, G. editor, Computer Vision - ECCV92, volume 588 of Lecture Notes in Computer Science, pages 563–578. Springer Verlag.
Faugeras, O. 1993. Three-dimensional vomputer vision. MIT Press, Cambridge, Mass.
Griffel, D.H. 1985. Applied functional analysis. Dover Publications.
Guilbert, N. 2006. A structure from motion system in octave. http://www.maths.lth.se/~nicolas.
Guilbert, N., and Bartoli, A. 2003. Batch recovery of multiple views with missing data using direct sparse solvers. In Proc. British Machine Vision Conference, volume 1, pages 63–72.
Guilbert, N., Kahl, F., Oskarsson, M., AA ström, K., Johansson, M., and Heyden A. 2004. Constraint enforcement in structure from motion applied to closing an open sequence. In Proc. Asian Conf. on Computer Vision, Jeju Island, Korea.
Hartley, R.I. 1994. Euclidean reconstruction from uncalibrated views. In Joseph L. Mundy, Andrew Zisserman, and David Forsyth, editors, Applications of Invariance in Computer Vision, volume 825 of Lecture notes in Computer Science, pages 237–256. Springer-Verlag.
Hartley, R.I., and Zisserman, A. 2000. Multiple view geometry in computer vision. Cambridge University Press.
Heyden, A., and AA kern-. ström, K. 1999. Flexible calibration: Minimal cases for auto-calibration. In Proc. 7th Int. Conf. on Computer Vision, Kerkyra, Greece.
Jacobs, D. 1997. Linear fitting with missing data: Applications to structure-from-motion and to characterizing intensity images. In Proc. Conf. Computer Vision and Pattern Recognition, pages 206–212.
Kahl, F., and Heyden, A. 1999. Affine structure and motion from points, lines and conics. Int. Journal of Computer Vision.
Kanade, T., and Morris, D. 1998. Factorization methods for structure from motion. Phil. Trans. R. Soc. Lond., A(356):1153–1173.
Longuet-Higgins, H.C. 1981. A computer algorithm for reconstructing a scene from two projections. Nature, 293:133–135.
Martinec, D., and Pajdla, T. 2002. Structure from many perspective images with occclusions. In Proc. 7th European Conf. on Computer Vision, Copenhagen, Denmark.
Nistér, D. 2001. Automatic dense reconstruction from uncalibrated video sequences. PhD thesis, Dept. of Numerical Analysis and Computer Science, Royal Institute of Technology, Stockholm, Sweden.
Poelman, C.J., and Kanade, T. 1997. A paraperspective factorization method for shape and motion recovery. IEEE Trans. Pattern Analysis and Machine Intelligence, 19(3):206–218.
Pollefeys, M., Koch, R., and Van Gool, L. 1999. Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters. Int. Journal of Computer Vision, 32(1):7–25.
Quan, L. 1996. Self-calibration of an affine camera from multiple views. Int. Journal of Computer Vision, 19(1):93–105.
Jianbo, Shi, and Carlo, Tomasi. 1994. Good features to track. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR’94), Seattle.
Tomasi, C., and Kanade, T. 1992. Shape and motion from image streams under orthography: a factorization method. Int. Journal of Computer Vision, 9(2):137–154.
Triggs, B. 1997. Linear projective reconstruction from matching tensors. Image and Vision Computing, 15(8):617–625.
Xu G., and Zhang, Z. 1996. Epipolar geometry in stereo, motion and object recognition. A unified approach. Springer Verlag.
Zhang, and Xu. 1998. A unified theory of uncalibrated stereo for both perspective and affine cameras. Journal of Mathematical Imaging and Vision, 9(3):213–229.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Guilbert, N., Bartoli, A. & Heyden, A. Affine Approximation for Direct Batch Recovery of Euclidian Structure and Motion from Sparse Data. Int J Comput Vision 69, 317–333 (2006). https://doi.org/10.1007/s11263-006-8113-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11263-006-8113-4