KSEM 2017: Knowledge Science, Engineering and Management pp 249-257 | Cite as
Super-Resolution for Images with Barrel Lens Distortions
Abstract
Camera lens distortions are widely observed in different applications for achieving specific optical effects, such as wide angle captures. Moreover, the image with lens distortion is often limited in resolution due to the cost of camera, limited bandwidth, etc. In this paper, we present a learning-based image super-resolution method for improving the resolution of images captured by cameras with barrel lens distortions. The key to the significant improvement of the resolution loss due to lens distortions is to learn a sparse dictionary with a post-processing step. During the training stage, the training images are used to learn the sparse dictionary and projection matrixes. During the testing stage, the observed low-resolution image uses the projection matrixes for two step super-resolution reconstructions of the final high-resolution image. Experimental results show that the proposed method outperforms the conventional learning-based super-resolution methods in terms of PSNR and SSIM values using the same set of training images for algorithm trainings.
Keywords
Super-resolution Learning-based Barrel distortionNotes
Acknowledgments
This work was supported in part by the Shenzhen Emerging Industries of the Strategic Basic Research Project (No. JCYJ20160226191842793), and the National Natural Science Foundation of China (Nos. 61602312, 61602314, 61620106008).
References
- 1.Takano, T., Ono, S., Matsushita, Y., Kawasaki, H., Lkeuchi, K.: Super resolution of fisheye images captured by on-vehicle camera for visibility support. In: IEEE International Conference on Vehicular Electronics and Safety, pp. 120–125 (2015)Google Scholar
- 2.Hongzhi, W., Meijing, L., Liwei, Z.: The distortion correction of large view wide-angle lens for image mosaic based on OpenCV. In: International Conference on Mechatronic Science, Electric Engineering and Computer (MEC), pp. 1074–1077 (2011)Google Scholar
- 3.Timofte, R., De Smet, V., Van Gool, L.: A+: adjusted anchored neighborhood regression for fast super-resolution. In: Cremers, D., Reid, I., Saito, H., Yang, M.-H. (eds.) ACCV 2014. LNCS, vol. 9006, pp. 111–126. Springer, Cham (2015). doi: 10.1007/978-3-319-16817-3_8 Google Scholar
- 4.Zeyde, R., Elad, M., Protter, M.: On Single Image Scale-Up Using Sparse-Representations. In: Boissonnat, J.-D., Chenin, P., Cohen, A., Gout, C., Lyche, T., Mazure, M.-L., Schumaker, L. (eds.) Curves and Surfaces 2010. LNCS, vol. 6920, pp. 711–730. Springer, Heidelberg (2012). doi: 10.1007/978-3-642-27413-8_47 CrossRefGoogle Scholar
- 5.Timofte, R., De Smet, V., Van Gool, L.: Anchored neighborhood regression for fast example-based super-resolution. ICCV 2013, 1920–1927 (2013)Google Scholar
- 6.Yang, J., Wright, J., Huang, T.S., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010)MathSciNetCrossRefGoogle Scholar
- 7.Kun, L., Jingyu, Y., Jianmin, J.: Nonrigid structure from motion via sparse representation. IEEE Trans. Cybern. 45(8), 1401–1403 (2015)CrossRefGoogle Scholar
- 8.Tsai, R.: A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE J. Robot. Autom. 3(4), 323–344 (1987)CrossRefGoogle Scholar
- 9.Ahmed, M., Farag, A.: Nonmetric calibration of camera lens distortion: differential methods and robust estimation. IEEE Trans. Image Process. 14(8), 1215–1230 (2005)CrossRefGoogle Scholar
- 10.Mallon, J., Whelan, P.F.: Precise radial un-distortion of images. In: Proceedings of the 17th International Conference on Pattern Recognition, pp. 18–21 (2004)Google Scholar
- 11.Mei, S., Sheng-hua, Z., Jianmin, J.: Transfer learning based on A+ for image super-resolution. In: KSEM 2016, pp. 325–336 (2016)Google Scholar
- 12.Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE TIP 13(4), 600–612 (2004)Google Scholar