The distortion varieties of a given projective variety are parametrized by duplicating coordinates and multiplying them with monomials. We study their degrees and defining equations. Exact formulas are obtained for the case of one-parameter distortions. These are based on Chow polytopes and Gröbner bases. Multi-parameter distortions are studied using tropical geometry. The motivation for distortion varieties comes from multi-view geometry in computer vision. Our theory furnishes a new framework for formulating and solving minimal problems for camera models with image distortion.
KeywordsDistortion varieties Toric varieties Image distortion Minimal problems
Mathematics Subject Classification14Q15 13P15 68T45 14M25 13P25 14T05 68U10
This project started at the Algebraic Vision workshop (May 2016) at the American Institute of Mathematics (AIM) in San Jose. We are grateful to the organizers, Sameer Agarwal, Max Lieblich and Rekha Thomas, for bringing us together. Joe Kileel and Bernd Sturmfels were supported by the US National Science Foundation (DMS-1419018). Zuzana Kukelova was supported by the Czech Science Foundation (GACR P103/12/G084). Part of this study was carried out while she worked for Microsoft Research, Cambridge, UK. Tomas Pajdla was supported by H2020-ICT-731970 LADIO, the Robotics for Industry 4.0 Project CZ.02.1.01/0.0/0.0/15_003/0000470 and the European Regional Development Fund.
- 3.M. Bujnak, Algebraic solutions to absolute pose problems, Doctoral Thesis, Czech Technical University in Prague, 2012.Google Scholar
- 4.M. Bujnak, Z. Kukelova, and T. Pajdla, 3D reconstruction from image collections with a single known focal length, in Proceedings of the 2009 IEEE International Conference on Computer Vision (ICCV 2009), pp. 351–358.Google Scholar
- 5.M. Bujnak, Z. Kukelova and T. Pajdla, Making minimal solvers fast, in Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2012), pp. 1506–1513.Google Scholar
- 6.M. Byrod, Z. Kukelova, K. Josephson, T. Pajdla and K. Åström, Fast and robust numerical solutions to minimal problems for cameras with radial distortion, in Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2008), pp. 1–8.Google Scholar
- 8.D. Cox, J. Little and H. Schenck, Toric varieties, Graduate Studies in Mathematics 124, American Mathematical Society, Providence, 2011.Google Scholar
- 9.J. Dalbec and B. Sturmfels, Introduction to Chow forms, in Invariant methods in discrete and computational geometry (N. White, ed.), Springer, New York, 1995, pp. 37–58.Google Scholar
- 10.M. Démazure, Sur deux problèmes de reconstruction, Technical Report 882, INRIA, Rocquencourt, 1988.Google Scholar
- 11.S. Di Rocco, Linear toric fibrations, in Combinatorial algebraic geometry, Lecture Notes in Mathematics 2108, Springer, Cham, 2014, pp. 119–147.Google Scholar
- 12.D. Eisenbud and J. Harris, On varieties of minimal degree (a centennial account), in Algebraic geometry, Bowdoin 1985, Part 1, Proceedings of Symposia in Pure Mathematics 46 (S.J. Bloch, ed.), American Mathematics Society, Providence, 1987, pp. 3–13.Google Scholar
- 15.A. Fitzgibbon, Simultaneous linear estimation of multiple view geometry and lens distortion, in Proceedings of the 2001 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2001), pp. 125–132.Google Scholar
- 16.G. Fløystad, J. Kileel and G. Ottaviani, The Chow form of the essential variety in computer vision, J. Symbolic Comput., to appear.Google Scholar
- 18.D. Grayson and M. Stillman, Macaulay2, a software system for research in algebraic geometry, available at www.math.uiuc.edu/Macaulay2/.
- 20.R. Hartley and A. Zisserman, Multiple view geometry in computer vision, Cambridge University Press, 2nd ed., Cambridge, 2003.Google Scholar
- 21.A. Jensen, Gfan, a software system for Gröbner fans and tropical varieties, Available at http://home.imf.au.dk/jensen/software/gfan/gfan.html.
- 22.F. Jiang, Y. Kuang, J.E. Solem and K. Åström, A minimal solution to relative pose with unknown focal length and radial distortion, in Proceedings of the 2014 Asian Conference on Computer Vision (ACCV 2014), pp. 443–456.Google Scholar
- 24.Y. Kuang, J.E. Solem, F. Kahl and K. Åström, Minimal solvers for relative pose with a single unknown radial distortion, in Proceedings of 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2014), pp. 33–40.Google Scholar
- 25.Z. Kukelova, Algebraic Methods in Computer Vision, Doctoral Thesis, Czech Technical University in Prague, 2013.Google Scholar
- 26.Z. Kukelova, M. Bujnak and T. Pajdla, Automatic Generator of Minimal Problem Solvers, in Proceedings of the 2008 European Conference on Computer Vision (ECCV 2008), Lecture Notes in Computer Science 5304, Springer 2008, pp. 302–315.Google Scholar
- 27.D. Maclagan and B. Sturmfels, Introduction to Tropical Geometry, Graduate Studies in Mathematics 161, American Mathematical Society, 2015.Google Scholar
- 29.G. Newsam, D. Q. Huynh, M. Brooks and H. P. Pan, Recovering unknown focal lengths in self-calibration: an essentially linear algorithm and degenerate configurations. ISPRS J. Photogramm., vol. XXXI-B3 (1996), 575–580.Google Scholar
- 32.H. Stewenius, D. Nistér, F. Kahl and F. Schaffalitzky, A minimal solution for relative pose with unknown focal length, in Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), pp. 789–794.Google Scholar
- 33.P. Sturm, On focal length calibration from two views, in Proceedings of the 2001 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2001), pp. 145–150.Google Scholar
- 34.B. Sturmfels, Gröbner bases and convex polytopes, American Mathematical Society, University Lectures Series 8, Providence, 1996.Google Scholar
- 35.B. Sturmfels, Solving systems of polynomial equations, American Mathematical Society, CBMS Regional Conferences Series 97, Providence, 2002.Google Scholar
- 36.C. Traverso, Gröbner trace algorithms, in Proceedings of the 1988 International Symposium of Symbolic and Algebraic Computation (ISSAC 1988), Lecture Notes in Computer Science 358 (P. Gianni, ed.), Springer-Verlag, Berlin Heidelberg, 1989, pp. 125–138.Google Scholar