Skip to main content
SpringerLink
Log in

Restoration for Out-of-Focus Color Image Based on Gradient Profile Sharpness

  • Published:
Circuits, Systems, and Signal Processing Aims and scope Submit manuscript

Abstract

In color images, out-of-focus problems often occur when different wavelengths of rays are focused at different positions in the focal plane. This occurs because of lenses that have different refractive indices for different wavelengths of light. These color images in turn become blurred, and noticeable colored edges appear around objects. These misaligned edges thus degrade the overall quality of the images. In this study, we propose a restoration algorithm for misaligned edges in color images. This algorithm is based on the assumption that the gradients of color channels are highly correlated such that all edges spatially overlap in the same manner as the desired gradient. The constraint term in least squares optimization is proposed to align edges to match the desired gradient based on the transformation theory of gradient profile sharpness. The proposed constraint term adaptively uses the gradients of the channels with different weights to estimate sharp edges. We also design a new measurement to compute the energy of aligned edges in a color image. The proposed algorithm can be applied to images captured by various sensors in different environments. Experimental results show that the proposed algorithm performs effectively when estimating high-quality color images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. V. Aslantas, A depth estimation algorithm with a single image. Opt. Express 15(8), 5024–5029 (2007)

    Article  Google Scholar 

  2. B. Bayer, in Color Imaging Array. US Patent 3,971,065 (1976)

  3. T. Boult, G. Wolberg, Correcting chromatic aberrations using image warping. in Computer Vision and Pattern Recognition Proceedings CVPR ’92, 1992 IEEE Computer Society Conference on, pp. 684–687 (1992)

  4. J. Canny, A computational approach to edge detection. Pattern Anal. Mach. Intell. IEEE Trans. PAMI 8(6), 679–698 (1986)

    Article  Google Scholar 

  5. S.H. Chan, T.Q. Nguyen, Single-image, spatially variant, out-of-focus blur removal. in Proceedings of SPIE 8500, pp. 85,000F-15 (2012)

  6. J. Chang, H. Kang, M.G. Kang, Correction of axial and lateral chromatic aberration with false color filtering. Image Process. IEEE Trans. 22(3), 1186–1198 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  7. S.J. Chen, H.L. Shen, Multispectral image out-of-focus deblurring using interchannel correlation. Image Process. IEEE Trans. 24(11), 4433–4445 (2015)

    Article  MathSciNet  Google Scholar 

  8. S.W. Chung, B.K. Kim, W.J. Song, Removing chromatic aberration by digital image processing. Opt. Eng. 49(6), 067002–0670010 (2010)

    Article  Google Scholar 

  9. R. Fattal, Image upsampling via imposed edge statistics. ACM Trans. Gr. 26(3), 95 (2007)

    Article  Google Scholar 

  10. Y. He, K.H. Yap, L. Chen, L.P. Chau, A new color image regularization scheme for blind image deconvolution, in Acoustics, Speech and Signal Processing, ICASSP 2008. IEEE International Conference on, pp. 1253–1256 (2008)

  11. H. Kang, S.H. Lee, J. Chang, M.G. Kang, Partial differential equation based approach for removal of chromatic aberration with local characteristics. J. Electron. Imaging 19(3), 033016–033018 (2010)

    Article  Google Scholar 

  12. K. Kidono, Y. Ninomiya, Visibility estimation under night-time conditions using a multiband camera. in Intelligent Vehicles Symposium, IEEE, pp. 1013–1018 (2007)

  13. B.K. Kim, R.H. Park, Automatic detection and correction of purple fringing using the gradient information and desaturation. in Signal Processing Conference 16th European, pp. 1–5 (2008)

  14. S. Koyama, Y. Inaba, M. Kasano, T. Murata, A day and night vision mos imager with robust photonic-crystal-based rgb-and-ir. Electron Dev. IEEE Trans. 55(3), 754–759 (2008)

    Article  Google Scholar 

  15. J.Y. Kwon, M.G. Kang, Multispectral demosaicking considering out-of-focus problem for red-green–blue-near-infrared image sensors. J. Electron. Imaging 25(2), 023010 (2010)

    Article  Google Scholar 

  16. E.S. Lee, M.G. Kang, Regularized adaptive high-resolution image reconstruction considering inaccurate subpixel registration. Image Process. IEEE Trans. 12(7), 826–837 (2003)

    Article  Google Scholar 

  17. X. Li, Y. Hu, X. Gao, D. Tao, B. Ning, A multi-frame image super-resolution method. Signal Process. 90(2), 405–414 (2010)

    Article  MATH  Google Scholar 

  18. W. Lu, Y.P. Tan, Color filter array demosaicking: new method and performance measures. Image Process. IEEE Trans. 12(10), 1194–1210 (2003)

    Article  Google Scholar 

  19. D.G. Luenberger, Y. Ye, Linear and Nonlinear Programming (Addison-Wesley, Reading, 1984)

    MATH  Google Scholar 

  20. Y. Monno, M. Tanaka, M. Okutomi, Multispectral demosaicking using adaptive kernel upsampling. in Image Processing (ICIP), 2011 18th IEEE International Conference on, pp. 3157–3160 (2011)

  21. J.H. Park, M.G. Kang, Multispectral iris authentication system against counterfeit attack using gradient-based image fusion. Opt. Eng. 46(11), 117003–1170014 (2007)

    Article  Google Scholar 

  22. I. Pekkucuksen, Y. Altunbasak, Multiscale gradients-based color filter array interpolation. Image Process. IEEE Trans. 22(1), 157–165 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  23. M. Petrou, J. Kittler, Optimal edge detectors for ramp edges. IEEE Trans. Pattern Anal. Mach. Intell. 13(5), 483–491 (1991)

    Article  Google Scholar 

  24. Z. Sadeghipoor, Y.M. Lu, S. Süsstrunk, Gradient-based correction of chromatic aberration in the joint acquisition of color and near-infrared images. in Proceedings of SPIE 9404, pp. 94,040F–94,040F-11 (2015)

  25. L. Schaul, C. Fredembach, S. Süsstrunk, Color image dehazing using the near-infrared. in Image Processing (ICIP), 2009 16th IEEE International Conference on, pp. 1629–1632 (2009)

  26. C. Schuler, M. Hirsch, S. Harmeling, B. Scholkopf, Non-stationary correction of optical aberrations. in Computer Vision (ICCV), 2011 IEEE International Conference on, pp. 659–666 (2011)

  27. C.T. Shen, W.L. Hwang, S.C. Pei, Spatially-varying out-of-focus image deblurring with l1-2 optimization and a guided blur map. in Acoustics, Speech and Signal Processing (ICASSP), 2012 IEEE International Conference on, pp. 1069–1072 (2012)

  28. Sony, Specifications of imx222lqj (2013)

  29. F. Sroubek, P. Milanfar, Robust multichannel blind deconvolution via fast alternating minimization. Image Process. IEEE Trans. 21(4), 1687–1700 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  30. D. Sugimura, T. Mikami, H. Yamashita, T. Hamamoto, Enhancing color images of extremely low light scenes based on rgb/nir images acquisition with different exposure times. Image Process. IEEE Trans. 24(11), 3586–3597 (2015)

    Article  MathSciNet  Google Scholar 

  31. J. Sun, J. Sun, Z. Xu, H.Y. Shum, Gradient profile prior and its applications in image super-resolution and enhancement. Image Process. IEEE Trans. 20(6), 1529–1542 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  32. Y.W. Tai, S. Liu, M. Brown, S. Lin, Super resolution using edge prior and single image detail synthesis. in Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pp. 2400–2407 (2010)

  33. L. Wang, S. Xiang, G. Meng, H. Wu, C. Pan, Edge-directed single-image super-resolution via adaptive gradient magnitude self-interpolation. Circuits Syst. Video Technol. IEEE Trans. 23(8), 1289–1299 (2013)

    Article  Google Scholar 

  34. Q. Yan, Y. Xu, X. Yang, T. Nguyen, Single image superresolution based on gradient profile sharpness. Image Process. IEEE Trans. 24(10), 3187–3202 (2015)

    Article  MathSciNet  Google Scholar 

  35. D.S. Yoo, M.K. Park, M.G. Kang, Joint deblurring and demosaicing using edge information from bayer images. IEICE Trans. Inf. Syst. 97(7), 1872–1884 (2014)

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT and Future Planning (No. 2015R1A2A1A14000912).

Author information

Authors and Affiliations

  1. Department of Electrical and Electronic Engineering, Yonsei University, 50 Yonsei-Ro, Seodaemun-Gu, Seoul, South Korea

    Ji Yong Kwon & Moon Gi Kang

Authors
  1. Ji Yong Kwon
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Moon Gi Kang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Moon Gi Kang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kwon, J.Y., Kang, M.G. Restoration for Out-of-Focus Color Image Based on Gradient Profile Sharpness. Circuits Syst Signal Process 37, 178–202 (2018). https://doi.org/10.1007/s00034-017-0542-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00034-017-0542-5

Keywords

Search

Navigation