Skip to main content
Log in

Affine Approximation for Direct Batch Recovery of Euclidian Structure and Motion from Sparse Data

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

We present a batch method for recovering Euclidian camera motion from sparse image data. The main purpose of the algorithm is to recover the motion parameters using as much of the available information and as few computational steps as possible. The algorithm thus places itself in the gap between factorisation schemes, which make use of all available information in the initial recovery step, and sequential approaches which are able to handle sparseness in the image data. Euclidian camera matrices are approximated via the affine camera model, thus making the recovery direct in the sense that no intermediate projective reconstruction is made. Using a little known closure constraint, the F A -closure, we are able to formulate the camera coefficients linearly in the entries of the affine fundamental matrices. The novelty of the presented work is twofold: Firstly the presented formulation allows for a particularly good conditioning of the estimation of the initial motion parameters but also for an unprecedented diversity in the choice of possible regularisation terms. Secondly, the new autocalibration scheme presented here is in practice guaranteed to yield a Least Squares Estimate of the calibration parameters.

As a bi-product, the affine camera model is rehabilitated as a useful model for most cameras and scene configurations, e.g. wide angle lenses observing a scene at close range. Experiments on real and synthetic data demonstrate the ability to reconstruct scenes which are very problematic for previous structure from motion techniques due to local ambiguities and error accumulation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Aanaes, H., Fisker, R., Astrom, K., and Carstensen J.M. 2002. Robust factorization. IEEE Trans. Pattern Analysis and Machine Intelligence, 24(9):1215–1225.

    Article  Google Scholar 

  • Beardsley, P., Zisserman, A., and Murray D.W. 1997. Sequential updating of projective and affine structure from motion. Int. Journal of Computer Vision, 23(3):235–259.

    Article  Google Scholar 

  • Björck, AA. 1996. Numerical methods for least squares problems. Society for Industrial and Applied Mathematics.

  • Christy, S., and Horaud, R. 1996. Euclidean shape and motion from multiple perspective views by affine iterations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(11):1098–1104.

    Article  Google Scholar 

  • Faugeras, O. 1992. What can be seen in three dimensions with an uncalibrated stereo rig? In Sandini, G. editor, Computer Vision - ECCV92, volume 588 of Lecture Notes in Computer Science, pages 563–578. Springer Verlag.

  • Faugeras, O. 1993. Three-dimensional vomputer vision. MIT Press, Cambridge, Mass.

    Google Scholar 

  • Griffel, D.H. 1985. Applied functional analysis. Dover Publications.

  • Guilbert, N. 2006. A structure from motion system in octave. http://www.maths.lth.se/~nicolas.

  • Guilbert, N., and Bartoli, A. 2003. Batch recovery of multiple views with missing data using direct sparse solvers. In Proc. British Machine Vision Conference, volume 1, pages 63–72.

    Google Scholar 

  • Guilbert, N., Kahl, F., Oskarsson, M., AA ström, K., Johansson, M., and Heyden A. 2004. Constraint enforcement in structure from motion applied to closing an open sequence. In Proc. Asian Conf. on Computer Vision, Jeju Island, Korea.

  • Hartley, R.I. 1994. Euclidean reconstruction from uncalibrated views. In Joseph L. Mundy, Andrew Zisserman, and David Forsyth, editors, Applications of Invariance in Computer Vision, volume 825 of Lecture notes in Computer Science, pages 237–256. Springer-Verlag.

  • Hartley, R.I., and Zisserman, A. 2000. Multiple view geometry in computer vision. Cambridge University Press.

  • Heyden, A., and AA kern-. ström, K. 1999. Flexible calibration: Minimal cases for auto-calibration. In Proc. 7th Int. Conf. on Computer Vision, Kerkyra, Greece.

  • Jacobs, D. 1997. Linear fitting with missing data: Applications to structure-from-motion and to characterizing intensity images. In Proc. Conf. Computer Vision and Pattern Recognition, pages 206–212.

  • Kahl, F., and Heyden, A. 1999. Affine structure and motion from points, lines and conics. Int. Journal of Computer Vision.

  • Kanade, T., and Morris, D. 1998. Factorization methods for structure from motion. Phil. Trans. R. Soc. Lond., A(356):1153–1173.

    Article  MathSciNet  Google Scholar 

  • Longuet-Higgins, H.C. 1981. A computer algorithm for reconstructing a scene from two projections. Nature, 293:133–135.

    Article  Google Scholar 

  • Martinec, D., and Pajdla, T. 2002. Structure from many perspective images with occclusions. In Proc. 7th European Conf. on Computer Vision, Copenhagen, Denmark.

  • Nistér, D. 2001. Automatic dense reconstruction from uncalibrated video sequences. PhD thesis, Dept. of Numerical Analysis and Computer Science, Royal Institute of Technology, Stockholm, Sweden.

  • Poelman, C.J., and Kanade, T. 1997. A paraperspective factorization method for shape and motion recovery. IEEE Trans. Pattern Analysis and Machine Intelligence, 19(3):206–218.

    Article  Google Scholar 

  • Pollefeys, M., Koch, R., and Van Gool, L. 1999. Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters. Int. Journal of Computer Vision, 32(1):7–25.

    Article  Google Scholar 

  • Quan, L. 1996. Self-calibration of an affine camera from multiple views. Int. Journal of Computer Vision, 19(1):93–105.

    Article  Google Scholar 

  • Jianbo, Shi, and Carlo, Tomasi. 1994. Good features to track. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR’94), Seattle.

  • Tomasi, C., and Kanade, T. 1992. Shape and motion from image streams under orthography: a factorization method. Int. Journal of Computer Vision, 9(2):137–154.

    Article  Google Scholar 

  • Triggs, B. 1997. Linear projective reconstruction from matching tensors. Image and Vision Computing, 15(8):617–625.

    Article  Google Scholar 

  • Xu G., and Zhang, Z. 1996. Epipolar geometry in stereo, motion and object recognition. A unified approach. Springer Verlag.

  • Zhang, and Xu. 1998. A unified theory of uncalibrated stereo for both perspective and affine cameras. Journal of Mathematical Imaging and Vision, 9(3):213–229.

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Guilbert, N., Bartoli, A. & Heyden, A. Affine Approximation for Direct Batch Recovery of Euclidian Structure and Motion from Sparse Data. Int J Comput Vision 69, 317–333 (2006). https://doi.org/10.1007/s11263-006-8113-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11263-006-8113-4

Keywords

Navigation