Advertisement

Threading Fundamental matrices

  • Shai Avidan
  • Amnon Shashua
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1406)

Abstract

We present a new function that operates on Fundamental matrices across a sequence of views. The operation, we call “threading”, connects two consecutive Fundamental matrices using the Trilinear tensor as the connecting thread. The threading operation guarantees that consecutive camera matrices are consistent with a unique 3D model, without ever recovering a 3D model. Applications include recovery of camera ego-motion from a sequence of views, image stabilization (plane stabilization) across a sequence, and multi-view image-based rendering.

Keywords

Computer Vision Optical Flow Camera Motion Reference Plane Fundamental Matrix 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    S. Avidan and A. Shashua. Tensorial transfer: On the representation of n > 3 views of a 3D scene. In Proceedings of the ARPA Image Understanding Workshop, Palm Springs, CA, February 1996.Google Scholar
  2. 2.
    S. Avidan and A. Shashua. Unifying two-view and three-view geometry. In ARPA, Image Understanding Workshop, 1997.Google Scholar
  3. 3.
    S. Avidan and A. Shashua. View synthesis in tensor space. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Puerto Rico, June 1997.Google Scholar
  4. 4.
    P.A. Beardsley, A. Zisserman, and D.W. Murray. Sequential updating of projective and affine structure from motion. International Journal of Computer Vision, 23(3):235–260, 1997.CrossRefGoogle Scholar
  5. 5.
    O.D. Faugeras. What can be seen in three dimensions with an uncalibrated stereo rig? In Proceedings of the European Conference on Computer Vision, pages 563–578, Santa Margherita Ligure, Italy, June 1992.Google Scholar
  6. 6.
    O.D. Faugeras and B. Mourrain. On the geometry and algebra of the point and line correspondences between N images. In Proceedings of the International Conference on Computer Vision, Cambridge, MA, June 1995.Google Scholar
  7. 7.
    R. Hartley. Lines and points in three views — a unified approach. In Proceedings of the ARPA Image Understanding Workshop, Monterey, CA, November 1994.Google Scholar
  8. 8.
    R. Hartley. In defence of the 8-point algorithm. In Proceedings of the International Conference on Computer Vision, 1995.Google Scholar
  9. 9.
    R. Hartley. A linear method for reconstruction from lines and points. In Proceedings of the International Conference on Computer Vision, pages 882–887, Cambridge, MA, June 1995.Google Scholar
  10. 10.
    A. Heyden. Reconstruction from image sequences by means of relative depths. In Proceedings of the International Conference on Computer Vision, pages 1058–1063, Cambridge, MA, June 1995.Google Scholar
  11. 11.
    M. Irani, B. Rousso, and S. Peleg. Recovery of ego-motion using image stabilization'. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 454–460, Seattle, Washington, June 1994.Google Scholar
  12. 12.
    H.C. Longuet-Higgins. A computer algorithm for reconstructing a scene from two projections. Nature, 293:133–135, 1981.CrossRefGoogle Scholar
  13. 13.
    B. Rousso, S. Avidan, A. Shashua, and S. Peleg. Robust recovery of camera rotation from three frames. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 1996.Google Scholar
  14. 14.
    A. Shashua. Algebraic functions for recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(8):779–789, 1995.CrossRefGoogle Scholar
  15. 15.
    A. Shashua. Trilinear tensor: The fundamental construct of multiple-view geometry and its applications. Submitted for journal publication. A short version has appeared in International Workshop on Algebraic Frames For The Perception Action Cycle (AFPAC97), Kiel Germany Sep. 8–9, 1997, 1997.Google Scholar
  16. 16.
    A. Shashua and P. Anandan. The generalized trilinear constraints and the uncertainty tensor. In Proceedings of the ARPA Image Understanding Workshop, Palm Springs, CA, February 1996.Google Scholar
  17. 17.
    A. Shashua and S. Avidan. The rank4 constraint in multiple view geometry. In Proceedings of the European Conference on Computer Vision, Cambridge, UK, April 1996.Google Scholar
  18. 18.
    A. Shashua and N. Navab. Relative affine structure: Canonical model for 3D from 2D geometry and applications. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(9):873–883, 1996.CrossRefGoogle Scholar
  19. 19.
    A. Shashua and M. Werman. Trilinearity of three perspective views and its associated tensor. In Proceedings of the International Conference on Computer Vision, June 1995.Google Scholar
  20. 20.
    M.E. Spetsakis and J. Aloimonos. Structure from motion using line correspondences. International Journal of Computer Vision, 4(3):171–183, 1990.CrossRefGoogle Scholar
  21. 21.
    M.E. Spetsakis and J. Aloimonos. A unified theory of structure from motion. In Proceedings of the ARPA Image Understanding Workshop, 1990.Google Scholar
  22. 22.
    G. Stein and A. Shashua. Model based brightness constraints: On direct estimation of structure and motion. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Puerto Rico, June 1997.Google Scholar
  23. 23.
    P. Sturm and B. Triggs. A factorization based algorithm for multi-image projective structure and motion. In Proceedings of the European Conference on Computer Vision, 1996.Google Scholar
  24. 24.
    B. Triggs. Matching constraints and the joint image. In Proceedings of the International Conference on Computer Vision, pages 338–343, Cambridge, MA, June 1995.Google Scholar
  25. 25.
    T. Vieville, O. Faugeras, and Q.T. Loung. Motion of points and lines in the uncalibrated case. International Journal of Computer Vision, 17(1):7–42, 1996.CrossRefGoogle Scholar
  26. 26.
    J. Weng, T.S. Huang, and N. Ahuja. Motion and structure from line correspondences: Closed form solution, uniqueness and optimization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(3), 1992.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1998

Authors and Affiliations

  • Shai Avidan
    • 1
  • Amnon Shashua
    • 1
  1. 1.Institute of Computer ScienceThe Hebrew UniversityJerusalemIsrael

Personalised recommendations