Skip to main content
Log in

Generalized Camera Calibration Including Fish-Eye Lenses

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

A method is described for accurately calibrating cameras including radial lens distortion, by using known points such as those measured from a calibration fixture. Both the intrinsic and extrinsic parameters are calibrated in a single least-squares adjustment, but provision is made for including old values of the intrinsic parameters in the adjustment. The distortion terms are relative to the optical axis, which is included in the model so that it does not have to be orthogonal to the image sensor plane. These distortion terms represent corrections to the basic lens model, which is a generalization that includes the perspective projection and the ideal fish-eye lens as special cases. The position of the entrance pupil point as a function of off-axis angle also is included in the model. (The complete camera model including all of these effects often is called CAHVORE.) A way of adding decentering distortion also is described. A priori standard deviations can be used to apply weight to given initial approximations (which can be zero) for the distortion terms, for the difference between the optical axis and the perpendicular to the sensor plane, and for the terms representing movement of the entrance pupil, so that the solution for these is well determined when there is insufficient information in the calibration data. For the other parameters, initial approximations needed for the nonlinear least-squares adjustment are obtained in a simple manner from the calibration data and other known information. (Weight can be given to these also, if desired.) Outliers among the calibration points that disagree excessively with the other data are removed by means of automatic editing based on analysis of the residuals. The use of the camera model also is described, including partial derivatives for propagating both from object space to image space and vice versa. These methods were used to calibrate the cameras on the Mars Exploration Rovers.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Bard, Y. 1974. Nonlinear Parameter Estimation, Academic Press.

  • Brown, D.C. 1966. Decentering distortion of lenses. Photogrammetric Engineering, 32:444–462.

    Google Scholar 

  • Brown, D.C. 1971. Close-range camera calibration. Photogrammetric Engineering, 37:855–866.

    Google Scholar 

  • Carpino, M., Milani, A., and Chesley, S.R. 2003. Error statistics of asteroid optical astrometric observations. Icarus, 166:248–270.

    Article  Google Scholar 

  • Clarke, T.A. and Fryer, J.G. 1998. The development of camera calibration methods and models. Photogrammetric Record, 16:51–66.

    Article  Google Scholar 

  • Eisenman, A.R., Liebe, C.C., Maimone, M.W., Schwochert, M.A., and Willson, R.G. 2001. Mars exploration rover engineering cameras. In Proceedings of the SPIE #4540: Sensors, Systems, and Next-Generation Satellites V, Toulouse, France, pp. 288–297.

  • Fischler, M.A. and Bolles, R.C. 1981. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Comm. ACM, 24:381–395.

    Article  MathSciNet  Google Scholar 

  • Fraser, C.S. 2001. Photogrammetric camera calibration: A review of analytical techniques. In Calibration and Orientation of Cameras in Computer Vision, A. Gruen and T.S. Huang (Eds.), Springer-Verlag, pp. 95–121.

  • Gennery, D.B. 1977. A stereo vision system for an autonomous vehicle. In Proc. 5th Int. Joint Conf. Artif. Intell., Cambridge, MA, pp. 576–582.

  • Gennery, D.B. 1980. Modelling the environment of an exploring vehicle by means of stereo vision. Computer Science Dept., Stanford University, AIM-339 (STAN-CS-80-805).

  • Gennery, D.B. 1986. Stereo vision for the acquisition and tracking of moving three-dimensional objects. In Techniques for 3-D Machine Perception, A. Rosenfeld (Ed). Elsevier Science Publishers B.V.: North-Holland, pp. 53–74.

  • Gennery, D.B. 1991. Camera calibration including lens distortion. Jet Propulsion Laboratory, Pasadena, CA, JPL internal report D-8580.

  • Gennery, D.B. 2001. Least-squares camera calibration including lens distortion and automatic editing of calibration points. In Calibration and Orientation of Cameras in Computer Vision, A. Gruen and T.S. Huang (Eds.), Springer-Verlag, pp. 123–136.

  • Gennery, D.B., Litwin, T., Wilcox, B., and Bon, B. 1987. Sensing and perception research for space telerobotics at JPL. In Proc. IEEE Int. Conf. on Robotics and Automation, Raleigh, NC, pp. 311–317.

  • Grossberg, M.D. and Nayar, S.K. 2001. A general imaging model and a method for finding its parameters. In Proc. IEEE Int. Conf. on Computer Vision, Vancouver, B.C.: Canada, vol. 2, pp. 108–115.

  • Gruen, A. and Beyer, H.A. 2001. System calibration through self-calibration. In Calibration and Orientation of Cameras in Computer Vision A. Gruen and T.S. Huang (Eds.), Springer-Verlag, pp. 163–193.

  • Gruen, A. and Huang, T.S. (Eds.) 2001. Calibration and Orientation of Cameras in Computer Vision, Springer-Verlag.

  • Heikkilä, J. 2000. Geometric camera calibration using circular control points. IEEE Trans. Pattern Analysis and Machine Intelligence, 22:1066–1077.

    Article  Google Scholar 

  • Jenkins, F.A. and White, H.E. 1976. Fundamentals of Optics, 4th edition, McGraw-Hill.

  • Kenefick, J.F., Gyer, M.S., and Harp, B.F. 1972. Analytical self-calibration. Photogrammetric Engineering, 38:1117–1126.

    Google Scholar 

  • Laikin, M. 2001. Lens Design, 3rd edition, Marcel Dekker.

  • Maki, J.N. and 21 coauthors. 2003. Mars exploration rover engineering cameras. J. Geophysical Research, 108(E12).

    Google Scholar 

  • Mikhail, E.M. 1970. Parameter constraints in least squares. Photogrammetric Engineering, 36:1277–1291.

    Google Scholar 

  • Mikhail, E.M. (with contributions by F. Ackermann) 1976. Observations and Least Squares, Harper and Row

  • Miyamoto, K. 1964. Fish eye lens. Journal of the Optical Society of America, 54:1060–1061.

    Article  Google Scholar 

  • Pope, A.J. 1976. The statistics of residuals and the detection of outliers. Geodetic Research and Development Laboratory, National Oceanic and Atmospheric Administration, NOAA Technical Report NOS 65 NGS 1.

  • Ryan, T.P. 1997. Modern Regression Methods, Wiley.

  • Shah, S. and Aggarwal, J.K. 1996. Intrinsic parameter calibration procedure for a (high-distortion) fish-eye lens camera with distortion model and accuracy estimation. Pattern Recognition, 29:1775–1788.

    Article  Google Scholar 

  • Smith, G.H., Hagerott, E.C., Scherr, L.M., Herkenhoff, K.E., and Bell, J.F. III. 2001. Optical designs for the Mars ’03 rover cameras. In Proceedings of the SPIE #4441: Current Developments in Lens Design and Optical Engineering II, San Diego, CA, pp. 118–131.

  • Stein, G.P. 1997. Lens distortion calibration using point correspondences. In Proc. Conf. on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, pp. 602–608.

  • Stevenson, D.E. and Fleck, M.M. 1995. Nonparametric correction of distortion. Computer Science Dept., University of Iowa, Technical Report 95-07.

  • Swaminathan, R., Grossberg, M.D., and Nayar, S.K. 2001. Caustics of catadioptric cameras. In Proc. IEEE Int. Conf. on Computer Vision, Vancouver, B.C., Canada, vol. 2, pp. 2–9.

  • Swaminathan, R. and Nayar, S.K. 2000. Nonmetric calibration of wide-angle lenses and polycameras. IEEE Trans. Pattern Analysis and Machine Intelligence, 22:1172–1178.

    Article  Google Scholar 

  • Willson, R. and Shafer, S.A. 2001. Modeling and calibration of variable-parameter camera systems. In Calibration and Orientation of Cameras in Computer Vision, A. Gruen and T.S. Huang, (Eds.), Springer-Verlag, pp. 137–161.

  • Yakimovsky, Y. and Cunningham, R.T. 1978. A system for extracting three-dimensional measurements from a stereo pair of TV cameras. Computer Graphics and Image Processing, 7:195–210.

    Article  Google Scholar 

  • Zhang, Z. 1999. Flexible camera calibration by viewing a plane from unknown orientations. In Proc. 7th Int. Conf. on Computer Vision, Kerkyra, Greece, pp. 666–673.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Donald B. Gennery.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gennery, D.B. Generalized Camera Calibration Including Fish-Eye Lenses. Int J Comput Vision 68, 239–266 (2006). https://doi.org/10.1007/s11263-006-5168-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11263-006-5168-1

Keywords

Navigation