Optimal Estimation of Matching Constraints
We describe work in progress on a numerical library for estimating multi-image matching constraints, or more precisely the multi-camera geometry underlying them. The library will cover several variants of homographic, epipolar, and trifocal constraints, using various different feature types. It is designed to be modular and open-ended, so that (i) new feature types or error models, (ii) new constraint types or parametrizations, and (iii) new numerical resolution methods, are relatively easy to add. The ultimate goal is to provide practical code for stable, reliable, statistically optimal estimation of matching geometry under a choice of robust error models, taking full account of any nonlinear constraints involved. More immediately, the library will be used to study the relative performance of the various competing problem parametrizations, error models and numerical methods. The paper focuses on the overall design, parametrization and numerical optimization issues. The methods described extend to many other geometric estimation problems in vision, e.g. curve and surface fitting.
KeywordsMatching constraints multi-camera geometry geometric fitting statistical estimation constrained optimization
Unable to display preview. Download preview PDF.
- S. Avidan and A. Shashua. Threading fundamental matrices. In European Conf. Computer Vision, pages 124–140, Freiburg, 1998.Google Scholar
- åke Björk. Numerical Methods for Least Squares Problems. SIAM Press, Philadelphia, PA, 1996.Google Scholar
- B. Boufama and R. Mohr. Epipole and fundamental matrix estimation using the virtual parallax property. In E. Grimson, editor, IEEE Int. Conf. Computer Vision, pages 1030–1036, Cambridge, MA, June 1995.Google Scholar
- O. Faugeras. Three-dimensional computer vision: a geometric viewpoint. MIT Press, 1993.Google Scholar
- O. Faugeras and B. Mourrain. On the geometry and algebra of the point and line correspondences between n images. In IEEE Int. Conf. Computer Vision, pages 951–6, Cambridge, MA, June 1995.Google Scholar
- O. Faugeras and T. Papadopoulo. Grassmann-Cayley algebra for modeling systems of cameras and the algebraic equations of the manifold of trifocal tensors. Transactions of the Royal society A, 1998.Google Scholar
- R. Fletcher. Practical Methods of Optimization. John Wiley, 1987.Google Scholar
- Anders Heyden. Geometry and Algebra of Multiple Projective Transformations. Ph.D. Thesis, University of Lund, 1995.Google Scholar
- Q.-T. Luong, R. Deriche, O. Faugeras, and T. Papadopoulo. On determining the fundamental matrix: Analysis of different methods and experimental results. Technical Report RR-1894, INRIA, Sophia Antipolis, France, 1993.Google Scholar
- Q.-T. Luong and T. Viéville. Canonic representations for the geometries of multiple projective views. In European Conf. Computer Vision, pages 589–599, 1994.Google Scholar
- P. Sturm and B. Triggs. A factorization based algorithm for multi-image projective structure and motion. In European Conf. Computer Vision, pages 709–20, Cambridge, U.K., 1996. Springer-Verlag.Google Scholar
- B. Triggs. Matching constraints and the joint image. In E. Grimson, editor, IEEE Int. Conf. Computer Vision, pages 338–43, Cambridge, MA, June 1995.Google Scholar
- B. Triggs. Linear projective reconstruction from matching tensors. In British Machine Vision Conference, pages 665–74, Edinburgh, September 1996.Google Scholar
- B. Triggs. A new approach to geometric fitting. Available from http://www.inrialpes.fr/movi/people/triggs, 1997.