Abstract
Many computer vision algorithms rely on the assumptions of the pinhole camera model, but lens distortion with off-the-shelf cameras is usually significant enough to violate this assumption. Many methods for radial distortion estimation have been proposed, but they all have limitations. Robust automatic radial distortion estimation from a single natural image would be extremely useful for many applications, particularly those in human-made environments containing abundant lines. For example, it could be used in place of an extensive calibration procedure to get a mobile robot or quadrotor experiment up and running quickly in an indoor environment. We propose a new method for automatic radial distortion estimation based on the plumb-line approach. The method works from a single image and does not require a special calibration pattern. It is based on Fitzgibbon’s division model, robust estimation of circular arcs, and robust estimation of distortion parameters. We perform an extensive empirical study of the method on synthetic images. We include a comparative statistical analysis of how different circle fitting methods contribute to accurate distortion parameter estimation. We finally provide qualitative results on a wide variety of challenging real images. The experiments demonstrate the method’s ability to accurately identify distortion parameters and remove distortion from images.
Similar content being viewed by others
References
Al-Sharadqah, A., Chernov, N.: Error analysis for circle fitting algorithms. The Electron. J. Stat. 3, 886–911 (2009)
Alvarez, L., Gomez, L., Sendra, J.R.: An algebraic approach to lens distortion by line rectification. J. Math. Imaging Vis. 35(1), 36–50 (2009)
Alvarez, L., Gomez, L., Sendra, J.R.: Algebraic lens distortion model estimation (2010). http://www.ipol.im/pub/algo/ags_algebraic_lens_distortion_estimation/
Barreto, J.P., Daniilidis, K.: Fundamental matrix for cameras with radial distortion. In: International Conference on Computer Vision (ICCV), pp. 625–632 (2005)
Bockaert, V.: Pincushion distortion. http://www.dpreview.com/learn/?/Glossary/Optical/Pincushion_Distortion_01.htm
Bradski, G.: The OpenCV library. Dr. Dobb’s J. 25(11), 120–125 (2000)
Braüer-Burchardt, C.: A simple new method for precise lens distortion correction of low cost camera systems. In: German Pattern Recognition Symposium, pp. 570–577 (2004)
Brauer-Burchardt, C., Voss, K.: A new algorithm to correct fish-eye- and strong wide-angle-lens-distortion from single images. In: IEEE International Conference on Image Processing, vol. 1, pp. 225–228 (2001)
Brown, D.C.: Close-range camera calibration. Photogramm. Eng. 37(8), 855–866 (1971)
Bucket, P.: Nikon 16 mm fisheye photos. http://photobucket.com/images/Nikon+16mm+fisheye/
Bukhari, F., Dailey, M.N.: Robust radial distortion from a single image. In: Proceedings of the 6th International Conference on Advances in Visual Computing. ISVC’10, vol. II, pp. 11–20 (2010)
Wood, C.: How to fake the fisheye effect. http://chanelwood.com/how-to/photoshop/how-to-fake-the-fisheye-effect/
Chen, P.Y., Huang, C.C., Shiau, Y.H., Chen, Y.T.: A VLSI implementation of barrel distortion correction for wide-angle camera images. IEEE Trans. Circuits Syst. II, Express Briefs 56, 51–55 (2009)
Chernov, N.: Matlab code for circle fitting algorithms (1997). http://www.math.uab.edu/~chernov/cl/MATLABcircle.html
Chernov, N.: Circular and Linear Regression: Fitting Circles and Lines by Least Squares. Chapman & Hall, London (2010)
Chernov, N., Lesort, C.: Least squares fitting of circles. J. Math. Imaging Vis. 23, 239–252 (2005)
Devernay, F., Faugeras, O.: Straight lines have to be straight: Automatic calibration and removal of distortion from scenes of structured environments. Mach. Vis. Appl. 13(1), 14–24 (2001)
Dyer, D.: Wide angle adapters for digital cameras. http://www.andromeda.com/people/ddyer/photo/wideangle.html
El-Melegy, M.T., Farag, A.A.: Nonmetric lens distortion calibration: Closed-form solutions, robust estimation and model selection. In: IEEE International Conference on Computer Vision, vol. 1. (2003)
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981). http://doi.acm.org/10.1145/358669.358692
Fitzgibbon, A.W.: Simultaneous linear estimation of multiple view geometry and lens distortion. In: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), pp. 125–132 (2001)
Friel, M., Hughes, C., Denny, P., Jones, E., Glavin, M.: Automatic calibration of fish-eye cameras from automotive video sequences. IET Intell. Transp. Syst. 4(2), 136–148 (2010)
Gonzalez-Aguilera, D., Gomez-Lahoz, J., Rodriguez-Gonzalvez, P.: An automatic approach for radial lens distortion correction from a single image. IEEE Sens. J. 11(4), 956–965 (2011)
Hartley, R., Kang, S.: Parameter-free radial distortion correction with center of distortion estimation. IEEE Trans. Pattern Anal. Mach. Intell. 29(8), 1309–1321 (2007)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2004)
Hughes, C., Glavin, M., Jones, E., Denny, P.: Wide-angle camera technology for automotive applications: A review. IET Intell. Transp. Syst. 3(1), 19–31 (2009)
Kbh3rd: Camelback locomotive (2008). http://en.wikipedia.org/wiki/File:B
Kukelova, Z., Pajdla, T.: A minimal solution to radial distortion autocalibration. IEEE Trans. Pattern Anal. Mach. Intell. 33(12), 2410–2422 (2011)
Kukush, A., Markovsky, I., Van Huffel, S.: Consistent estimation in an implicit quadratic measurement error model. Comput. Stat. Data Anal. 47(1), 123–147 (2004)
Laksi, L.: Motorcycle taxi. http://leolaksi.wordpress.com/2009/12/28/more-photos-with-the-nikkor-16mm-f2-8-fisheye-lens/
MATLAB: Edge—find edges in grayscale image (2009). http://www.mathworks.com/help/toolbox/images/ref/edge.html
Moré, J.J.: The Levenberg-Marquardt algorithm: Implementation and theory. In: Lecture Notes in Mathematics, pp. 105–116 (1978)
Ociepka, R.: Raynox DCR-720 with barrel distortion (2003). http://www.pbase.com/ociepka/image/32663644
Oleson, R.: Full-circle examples. http://rick_oleson.tripod.com/index-105.html
Pratt, V.: Direct least-squares fitting of algebraic surfaces. SIGGRAPH Comput. Graph. 21, 145–152 (1987)
Ramalingam, S., Sturm, P., Lodha, S.K.: Generic self-calibration of central cameras. Comput. Vis. Image Underst. 114(2), 210–219 (2010)
Rideout, S.: 10 ninjas Steve’s photostream (2002). http://www.flickr.com/photos/steverideout/50185284/
Rosten, E., Loveland, R.: Camera distortion self-calibration using the plumb-line constraint and minimal hough entropy. Mach. Vis. Appl. 22, 77–85 (2011)
Sarge: Misc. http://sarge.wheresthebeef.co.uk/Misc/350D_misc_100/IMG_2797.jpg
Skewes, K.: Real estate photo tip: Wide angle lens correction. http://blogonlineed.com/2011/01/14/real-estate-photo-tip-wide-angle-lens-correction/
Solheim, E.: How to remove distortion on a fisheye image. http://eirikso.com/2008/12/14/how-to-remove-distortion-on-a-fisheye-image/
Stein, G.P.: Lens distortion calibration using point correspondences. In: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), pp. 602–608 (1996)
Strand, R., Hayman, E.: Correcting radial distortion by circle fitting. In: British Machine Vision Conference (BMVC) (2005)
Swaminathan, R., Nayar, S.: Non-metric calibration of wide-angle lenses and polycameras. IEEE Trans. Pattern Anal. Mach. Intell. 22(10), 1172–1178 (2000)
Taubin, G.: Estimation of planar curves, surfaces, and nonplanar space curves defined by implicit equations with applications to edge and range image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 13(11), 1115–1138 (1991)
Tavakoli, H.R., Pourreza, H.R.: Automated center of radial distortion estimation, using active targets. In: Asian Conference on Computer Vision (ACCV) (2010)
Thormählen, T., Broszio, H., Wassermann, I.: Robust line-based calibration of lens distortion from a single view. In: Computer Vision/Computer Graphics Collaboration for Model-based Imaging Rendering, Image Analysis and Graphical Special Effects, pp. 105–112 (2003)
Tomasi, C.: Sample image for CPS 296.1 homework assignment (2007). http://www.cs.duke.edu/courses/spring06/cps296.1/homework/1/lab.gif
Tsai, R.Y.: A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. In: Radiometry, pp. 221–244 (1992)
Wang, A., Qiu, T., Shao, L.: A simple method of radial distortion correction with centre of distortion estimation. J. Math. Imaging Vis. 35(3), 165–172 (2009)
Wang, J., Shi, F., Zhang, J., Liu, Y.: A new calibration model of camera lens distortion. Pattern Recognit. 41, 607–615 (2008)
Whittaker, G.: Wide angles. https://picasaweb.google.com/gmw3027/WideAngles#5276761797451570738
Yusuf: Correcting barrel distortion of wide and ultrawide lenses. http://www.photos-of-the-year.com/articles/barrel-distortion/
Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)
Acknowledgements
Faisal Bukhari was supported by graduate fellowships from the Higher Education Commission of Pakistan and the Asian Institute of Technology (AIT), Thailand. We are grateful to Irshad Ali and Waheed Iqbal for comments on this work.
Author information
Authors and Affiliations
Corresponding author
Additional information
The authors are with the Computer Science and Information Management program.
Rights and permissions
About this article
Cite this article
Bukhari, F., Dailey, M.N. Automatic Radial Distortion Estimation from a Single Image. J Math Imaging Vis 45, 31–45 (2013). https://doi.org/10.1007/s10851-012-0342-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10851-012-0342-2