Skip to main content
Log in

Non-blind deblurring of structured images with geometric deformation

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

Non-blind deconvolution, which is to restore a sharp version of a given blurred image when the blur kernel is known, is a fundamental step in image deblurring. While the problem has been extensively studied, existing methods have conveniently ignored an important fact that deformation can significantly affect the statistical characteristics of an image and introduce additional blurring effect. In this paper, we show how to enhance non-blind deconvolution by recovering and undoing the deformation while deconvolving a given blurred image. We show that this is the case for almost all popular regularizers that have been proposed for image deblurring such as total variation and its variants. We conduct extensive simulations and experiments on real images and verify that the incorporation of geometric deformation in deconvolution can significantly improve the final deblurring results. Combined with existing blur kernel estimation techniques, our method can also be used to enhance blind image deblurring.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Notes

  1. Here, the same as [25, “rectified image” is in a sense that the image is of front viewpoint and regular patterns.

  2. Suppose the size of \(K\) is \(m\)-by-\(n\), the \((i,j)\)th element of \(K^*\) is given by \(K^*(i,j) = K(m-i,n-j)\).

  3. To ensure the fair of comparison, all baselines are also implemented by using gradient descent to solve (2).

References

  1. Cai, J.-F., Ji, H., Liu, C., Shen, Z.: Blind motion deblurring from a single image using sparse approximation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 104–111 (2009)

  2. Chan, T.F., Wong, C.-K.: Total variation blind deconvolution. IEEE Trans. Image Process. 7(3), 370–375 (1998)

    Article  Google Scholar 

  3. Cho, S., Lee, S.: Fast motion deblurring. ACM Trans. Graphics 28(5), 145-1–145-8 (2009)

    Google Scholar 

  4. Fergus, R., Singh, B., Hertzmann, A., Roweis, S.T., Freeman, W.: Removing camera shake from a single photograph. ACM Trans. Graphics 25, 787–794 (2006)

    Article  Google Scholar 

  5. Joshi, N., Zitnick, C.L, Szeliski, R., Kriegman, D. J.: Image deblurring and denoising using color priors. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1550–1557 (2009)

  6. Krishnan, D., Fergus, R.: Fast image deconvolution using hyper-Laplacian priors. In: Neural Information Processing Systems, pp. 1033–1041 (2009)

  7. Krishnan, D., Tay, T., Fergus, R.: Blind deconvolution using a normalized sparsity measure. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 233–240 (2011)

  8. Kundur, D., Hatzinakos, D.: Blind image deconvolution. IEEE Signal Process. Mag. 13(3), 43–64 (1996)

    Article  Google Scholar 

  9. Landi, G., Piccolomini, E.L.: An improved Newton projection method for nonnegative deblurring of Poisson-corrupted images with Tikhonov regularization. Numer. Alg. 60(1), 169–188 (2012)

    Article  MATH  Google Scholar 

  10. Levin, A.: Blind motion deblurring using image statistics. In: Neural Information Processing Systems, pp. 841–848 (2006)

  11. Levin, A., Fergus, R., Durand, F., Freeman, W.T.: Image and depth from a conventional camera with a coded aperture. ACM Trans. Graphics 26(3), 70 (2007)

    Article  Google Scholar 

  12. Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Understanding blind deconvolution algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 33(12), 2354–2367 (2011)

    Article  Google Scholar 

  13. Liu, G., Ma, Y.: Blind image deblurring by spectral properties of convolution operators. (2012), Arxiv, abs/1209.2082

  14. Mignotte, M.: A segmentation-based regularization term for image deconvolution. IEEE Trans. Image Process. 15(7), 1973–1984 (2006)

    Article  Google Scholar 

  15. Nagy, J.G., Palmer, K., Perrone, L.: Iterative methods for image deblurring: a Matlab object-oriented approach. Numer. Alg. 36(1), 73–93 (2004)

    Article  MATH  MathSciNet  Google Scholar 

  16. Richardson, H.W.: Bayesian-based iterative method of image restoration. J. Opt. Soc. Am. 62(1), 55–59 (1972)

    Article  Google Scholar 

  17. Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Phys. D 60(1–4), 259–268 (1992)

    Google Scholar 

  18. Shan, Q., Jia, J., Agarwala, A.: High-quality motion deblurring from a single image. ACM Trans. Graphics 27(3), 73-1–73-10 (2008)

    Google Scholar 

  19. Tai, Y.-W., Tan, P., Brown, M.S.: Richardson-Lucy deblurring for scenes under a projective motion path. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1603–1618 (2011)

    Article  Google Scholar 

  20. Tsumuraya, F.: Deconvolution based on the Wiener-Lucy chain algorithm: an approach to recover local information losses in the deconvolution procedure. J. Opt. Soc. Am. A 13(7), 1532–1536 (1996)

    Google Scholar 

  21. Weiss, Y., Freeman, W.T.: What makes a good model of natural images? In: IEEE Conference on Computer Vision and Pattern Recognition (2007)

  22. Wiener, N.: Extrapolation, interpolation, and smoothing of stationary time series. The MIT Press (1964)

  23. Xu, L., Jia, J.: Two-phase kernel estimation for robust motion deblurring. In: European Conference on Computer Vision, pp. 157–170 (2010)

  24. Yuan, L., Sun, J., Quan, L., Shum, H.-Y.: Progressive Inter-scale and intra-scale non-blind image deconvolution. ACM Trans. Graphics 27(3), 74-1–74-10 (2008)

    Google Scholar 

  25. Zhang, Z., Ganesh, A., Liang, X., Ma, Y.: TILT: transform invariant low-rank textures. Int. J. Computer Vis. 99(1), 1–24 (2012)

    Article  MATH  MathSciNet  Google Scholar 

Download references

Acknowledgments

X. Zhang and F. Sun are supported by the National Basic Research Program (973 Program) of China (No. 2013CB329403). Yi Ma is partially supported by the funding of ONR N00014-09-1-0230, NSF CCF 09-64215, NSF IIS 11-16012.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xin Zhang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhang, X., Sun, F., Liu, G. et al. Non-blind deblurring of structured images with geometric deformation . Vis Comput 31, 131–140 (2015). https://doi.org/10.1007/s00371-014-0920-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-014-0920-y

Keywords

Navigation