Abstract
A method is described for accurately calibrating cameras including radial lens distortion, by using known points such as those measured from a calibration fixture. Both the intrinsic and extrinsic parameters are calibrated in a single least-squares adjustment, but provision is made for including old values of the intrinsic parameters in the adjustment. The distortion terms are relative to the optical axis, which is included in the model so that it does not have to be orthogonal to the image sensor plane. These distortion terms represent corrections to the basic lens model, which is a generalization that includes the perspective projection and the ideal fish-eye lens as special cases. The position of the entrance pupil point as a function of off-axis angle also is included in the model. (The complete camera model including all of these effects often is called CAHVORE.) A way of adding decentering distortion also is described. A priori standard deviations can be used to apply weight to given initial approximations (which can be zero) for the distortion terms, for the difference between the optical axis and the perpendicular to the sensor plane, and for the terms representing movement of the entrance pupil, so that the solution for these is well determined when there is insufficient information in the calibration data. For the other parameters, initial approximations needed for the nonlinear least-squares adjustment are obtained in a simple manner from the calibration data and other known information. (Weight can be given to these also, if desired.) Outliers among the calibration points that disagree excessively with the other data are removed by means of automatic editing based on analysis of the residuals. The use of the camera model also is described, including partial derivatives for propagating both from object space to image space and vice versa. These methods were used to calibrate the cameras on the Mars Exploration Rovers.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bard, Y. 1974. Nonlinear Parameter Estimation, Academic Press.
Brown, D.C. 1966. Decentering distortion of lenses. Photogrammetric Engineering, 32:444–462.
Brown, D.C. 1971. Close-range camera calibration. Photogrammetric Engineering, 37:855–866.
Carpino, M., Milani, A., and Chesley, S.R. 2003. Error statistics of asteroid optical astrometric observations. Icarus, 166:248–270.
Clarke, T.A. and Fryer, J.G. 1998. The development of camera calibration methods and models. Photogrammetric Record, 16:51–66.
Eisenman, A.R., Liebe, C.C., Maimone, M.W., Schwochert, M.A., and Willson, R.G. 2001. Mars exploration rover engineering cameras. In Proceedings of the SPIE #4540: Sensors, Systems, and Next-Generation Satellites V, Toulouse, France, pp. 288–297.
Fischler, M.A. and Bolles, R.C. 1981. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Comm. ACM, 24:381–395.
Fraser, C.S. 2001. Photogrammetric camera calibration: A review of analytical techniques. In Calibration and Orientation of Cameras in Computer Vision, A. Gruen and T.S. Huang (Eds.), Springer-Verlag, pp. 95–121.
Gennery, D.B. 1977. A stereo vision system for an autonomous vehicle. In Proc. 5th Int. Joint Conf. Artif. Intell., Cambridge, MA, pp. 576–582.
Gennery, D.B. 1980. Modelling the environment of an exploring vehicle by means of stereo vision. Computer Science Dept., Stanford University, AIM-339 (STAN-CS-80-805).
Gennery, D.B. 1986. Stereo vision for the acquisition and tracking of moving three-dimensional objects. In Techniques for 3-D Machine Perception, A. Rosenfeld (Ed). Elsevier Science Publishers B.V.: North-Holland, pp. 53–74.
Gennery, D.B. 1991. Camera calibration including lens distortion. Jet Propulsion Laboratory, Pasadena, CA, JPL internal report D-8580.
Gennery, D.B. 2001. Least-squares camera calibration including lens distortion and automatic editing of calibration points. In Calibration and Orientation of Cameras in Computer Vision, A. Gruen and T.S. Huang (Eds.), Springer-Verlag, pp. 123–136.
Gennery, D.B., Litwin, T., Wilcox, B., and Bon, B. 1987. Sensing and perception research for space telerobotics at JPL. In Proc. IEEE Int. Conf. on Robotics and Automation, Raleigh, NC, pp. 311–317.
Grossberg, M.D. and Nayar, S.K. 2001. A general imaging model and a method for finding its parameters. In Proc. IEEE Int. Conf. on Computer Vision, Vancouver, B.C.: Canada, vol. 2, pp. 108–115.
Gruen, A. and Beyer, H.A. 2001. System calibration through self-calibration. In Calibration and Orientation of Cameras in Computer Vision A. Gruen and T.S. Huang (Eds.), Springer-Verlag, pp. 163–193.
Gruen, A. and Huang, T.S. (Eds.) 2001. Calibration and Orientation of Cameras in Computer Vision, Springer-Verlag.
Heikkilä, J. 2000. Geometric camera calibration using circular control points. IEEE Trans. Pattern Analysis and Machine Intelligence, 22:1066–1077.
Jenkins, F.A. and White, H.E. 1976. Fundamentals of Optics, 4th edition, McGraw-Hill.
Kenefick, J.F., Gyer, M.S., and Harp, B.F. 1972. Analytical self-calibration. Photogrammetric Engineering, 38:1117–1126.
Laikin, M. 2001. Lens Design, 3rd edition, Marcel Dekker.
Maki, J.N. and 21 coauthors. 2003. Mars exploration rover engineering cameras. J. Geophysical Research, 108(E12).
Mikhail, E.M. 1970. Parameter constraints in least squares. Photogrammetric Engineering, 36:1277–1291.
Mikhail, E.M. (with contributions by F. Ackermann) 1976. Observations and Least Squares, Harper and Row
Miyamoto, K. 1964. Fish eye lens. Journal of the Optical Society of America, 54:1060–1061.
Pope, A.J. 1976. The statistics of residuals and the detection of outliers. Geodetic Research and Development Laboratory, National Oceanic and Atmospheric Administration, NOAA Technical Report NOS 65 NGS 1.
Ryan, T.P. 1997. Modern Regression Methods, Wiley.
Shah, S. and Aggarwal, J.K. 1996. Intrinsic parameter calibration procedure for a (high-distortion) fish-eye lens camera with distortion model and accuracy estimation. Pattern Recognition, 29:1775–1788.
Smith, G.H., Hagerott, E.C., Scherr, L.M., Herkenhoff, K.E., and Bell, J.F. III. 2001. Optical designs for the Mars ’03 rover cameras. In Proceedings of the SPIE #4441: Current Developments in Lens Design and Optical Engineering II, San Diego, CA, pp. 118–131.
Stein, G.P. 1997. Lens distortion calibration using point correspondences. In Proc. Conf. on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, pp. 602–608.
Stevenson, D.E. and Fleck, M.M. 1995. Nonparametric correction of distortion. Computer Science Dept., University of Iowa, Technical Report 95-07.
Swaminathan, R., Grossberg, M.D., and Nayar, S.K. 2001. Caustics of catadioptric cameras. In Proc. IEEE Int. Conf. on Computer Vision, Vancouver, B.C., Canada, vol. 2, pp. 2–9.
Swaminathan, R. and Nayar, S.K. 2000. Nonmetric calibration of wide-angle lenses and polycameras. IEEE Trans. Pattern Analysis and Machine Intelligence, 22:1172–1178.
Willson, R. and Shafer, S.A. 2001. Modeling and calibration of variable-parameter camera systems. In Calibration and Orientation of Cameras in Computer Vision, A. Gruen and T.S. Huang, (Eds.), Springer-Verlag, pp. 137–161.
Yakimovsky, Y. and Cunningham, R.T. 1978. A system for extracting three-dimensional measurements from a stereo pair of TV cameras. Computer Graphics and Image Processing, 7:195–210.
Zhang, Z. 1999. Flexible camera calibration by viewing a plane from unknown orientations. In Proc. 7th Int. Conf. on Computer Vision, Kerkyra, Greece, pp. 666–673.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Gennery, D.B. Generalized Camera Calibration Including Fish-Eye Lenses. Int J Comput Vision 68, 239–266 (2006). https://doi.org/10.1007/s11263-006-5168-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11263-006-5168-1