International Journal of Computer Vision

, Volume 33, Issue 3, pp 163–180 | Cite as

Affine Structure and Motion from Points, Lines and Conics

  • Fredrik Kahl
  • Anders Heyden

Abstract

In this paper several new methods for estimating scene structure and camera motion from an image sequence taken by affine cameras are presented. All methods can incorporate both point, line and conic features in a unified manner. The correspondence between features in different images is assumed to be known.

Three new tensor representations are introduced describing the viewing geometry for two and three cameras. The centred affine epipoles can be used to constrain the location of corresponding points and conics in two images. The third order, or alternatively, the reduced third order centred affine tensors can be used to constrain the locations of corresponding points, lines and conics in three images. The reduced third order tensors contain only 12 components compared to the 16 components obtained when reducing the trifocal tensor to affine cameras.

A new factorization method is presented. The novelty lies in the ability to handle not only point features, but also line and conic features concurrently. Another complementary method based on the so-called closure constraints is also presented. The advantage of this method is the ability to handle missing data in a simple and uniform manner. Finally, experiments performed on both simulated and real data are given, including a comparison with other methods.

reconstruction affine cameras matching constraints closure constraints factorization methods multiple view tensors 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Atkinson, K.B. 1996. Close Range Photogrammetry and Machine Vision. Whittles Publishing.Google Scholar
  2. Bretzner, L. and Lindeberg, T. 1998. Use your hand as a 3-d mouse, or, relative orientation from extended sequences of sparse point and line correspondences using the affine trifocal tensor. In Proc. 5th European Conf. on Computer Vision, Freiburg, Germany.Google Scholar
  3. Faugeras, O.D. 1992. What can be seen in three dimensions with an uncalibrated stereo rig? In Proc. 2nd European Conf. on Computer Vision, G. Sandini (Ed.), Springer-Verlag: Santa Margherita Ligure, Italy, pp. 563–578.Google Scholar
  4. Heyden, A. 1995. Geometry and Algebra of Multipe Projective Transformations. Ph.D. Thesis, Lund Institute of Technology, Sweden.Google Scholar
  5. Jacobs, D. 1997. Linear fitting with missing data: Applications to structure-from-motion and to characterizing intensity images. In Proc. Conf. Computer Vision and Pattern Recognition, Puerto Rico, USA, pp. 206–212.Google Scholar
  6. Kahl, F. and Heyden, A. 1998. Structure and motion from points, lines and conics with affine cameras. In Proc. 5th European Conf. on Computer Vision, Freiburg, Germany.Google Scholar
  7. Koenderink, J.J. and van Doorn, A.J. 1991. Affine structure from motion. J. Opt. Soc. America, 8(2):377–385.Google Scholar
  8. Ma, S.D. 1993. Conic-based stereo, motion estimation, and pose determination. Int. Journal of Computer Vision, 10(1):7–25.Google Scholar
  9. Maybank, S. 1993. Theory of Reconstruction from Image Motion. Springer-Verlag: Berlin, Heidelberg, New York.Google Scholar
  10. McLauchlan, P.F. and Murray, D.W. 1995. A unifying framework for structure and motion recovery from image sequences. In Proc. 5th Int. Conf. on Computer Vision, MIT, Boston, MA, IEEE Computer Society Press, Los Alamitos, California, pp. 314–320.Google Scholar
  11. Mundy, J.L. and Zisserman, A. (Eds). 1992. Geometric Invariance in Computer Vision. MIT Press, Cambridge Ma, USA.Google Scholar
  12. Quan, L. and Kanade, T. 1997. Affine structure from line correspondences with uncalibrated affine cameras. IEEE Trans. Pattern Analysis and Machine Intelligence, 19(8).Google Scholar
  13. Quan, L. and Ohta, Y. 1998. A new linear method for euclidean motion/structure from three calibrated affine views. In Proc. Conf. Computer Vision and Pattern Recognition, Santa Barbara, USA, pp. 172–177.Google Scholar
  14. Semple, J.G. and Kneebone, G.T. 1952. Algebraic Projective Geometry. Clarendon Press, Oxford.Google Scholar
  15. Shapiro, L.S. 1995. Affine Analysis of Image Sequences. Cambridge University Press.Google Scholar
  16. Shapiro, L.S., Zisserman, A., and Brady, M. 1995. 3d motion recovery via affine epipolar geometry. Int. Journal of Computer Vision, 16(2):147–182.Google Scholar
  17. Shashua, A. and Navab, N. 1996. Relative affine structure: Canonical model for 3d from 2d geometry and applications. IEEE Trans. Pattern Anal. Machine Intell, 18(9):873–883.CrossRefGoogle Scholar
  18. Sparr, G. 1996. Simultaneous reconstruction of scene structure and camera locations from uncalibrated image sequences. In Proc. Int. Conf. on Pattern Recognition, Vienna, Austria.Google Scholar
  19. Sturm, P. and Triggs, B. 1996. A factorization based algorithm for multi-image projective structure and motion. In Proc. 4th European Conf. on Computer Vision, Cambridge, UK, pp. 709–720.Google Scholar
  20. Tomasi, C. and Kanade, T. 1992. Shape and motion from image streams under orthography: A factorization method. Int. Journal of Computer Vision, 9(2):137–154.Google Scholar
  21. Torr, P. 1995. Motion Segmentation and Outlier Detection. Ph.D. Thesis, Department of Engineering Science, University of Oxford.Google Scholar
  22. Triggs, B. 1996. Factorization methods for projective structure and motion. In Proc. Conf. Computer Vision and Pattern Recognition, San Francisco, USA.Google Scholar
  23. Triggs, B. 1997. Linear projective reconstruction from matching tensors. Image and Vision Computing, 15(8):617–625.Google Scholar
  24. Weng, J., Huang, T.S., and Ahuja, N. 1992. Motion and structure from line correspondences: Closed-form solution, uniqueness, and optimization. IEEE Trans. Pattern Analysis and Machine Intelligence, 14(3):318–336.Google Scholar

Copyright information

© Kluwer Academic Publishers 1999

Authors and Affiliations

  • Fredrik Kahl
    • 1
  • Anders Heyden
    • 1
  1. 1.Centre for Mathematical SciencesLund UniversityLundSweden

Personalised recommendations