Abstract
Non-blind deconvolution, which is to restore a sharp version of a given blurred image when the blur kernel is known, is a fundamental step in image deblurring. While the problem has been extensively studied, existing methods have conveniently ignored an important fact that deformation can significantly affect the statistical characteristics of an image and introduce additional blurring effect. In this paper, we show how to enhance non-blind deconvolution by recovering and undoing the deformation while deconvolving a given blurred image. We show that this is the case for almost all popular regularizers that have been proposed for image deblurring such as total variation and its variants. We conduct extensive simulations and experiments on real images and verify that the incorporation of geometric deformation in deconvolution can significantly improve the final deblurring results. Combined with existing blur kernel estimation techniques, our method can also be used to enhance blind image deblurring.
Similar content being viewed by others
Notes
Here, the same as [25, “rectified image” is in a sense that the image is of front viewpoint and regular patterns.
Suppose the size of \(K\) is \(m\)-by-\(n\), the \((i,j)\)th element of \(K^*\) is given by \(K^*(i,j) = K(m-i,n-j)\).
To ensure the fair of comparison, all baselines are also implemented by using gradient descent to solve (2).
References
Cai, J.-F., Ji, H., Liu, C., Shen, Z.: Blind motion deblurring from a single image using sparse approximation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 104–111 (2009)
Chan, T.F., Wong, C.-K.: Total variation blind deconvolution. IEEE Trans. Image Process. 7(3), 370–375 (1998)
Cho, S., Lee, S.: Fast motion deblurring. ACM Trans. Graphics 28(5), 145-1–145-8 (2009)
Fergus, R., Singh, B., Hertzmann, A., Roweis, S.T., Freeman, W.: Removing camera shake from a single photograph. ACM Trans. Graphics 25, 787–794 (2006)
Joshi, N., Zitnick, C.L, Szeliski, R., Kriegman, D. J.: Image deblurring and denoising using color priors. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1550–1557 (2009)
Krishnan, D., Fergus, R.: Fast image deconvolution using hyper-Laplacian priors. In: Neural Information Processing Systems, pp. 1033–1041 (2009)
Krishnan, D., Tay, T., Fergus, R.: Blind deconvolution using a normalized sparsity measure. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 233–240 (2011)
Kundur, D., Hatzinakos, D.: Blind image deconvolution. IEEE Signal Process. Mag. 13(3), 43–64 (1996)
Landi, G., Piccolomini, E.L.: An improved Newton projection method for nonnegative deblurring of Poisson-corrupted images with Tikhonov regularization. Numer. Alg. 60(1), 169–188 (2012)
Levin, A.: Blind motion deblurring using image statistics. In: Neural Information Processing Systems, pp. 841–848 (2006)
Levin, A., Fergus, R., Durand, F., Freeman, W.T.: Image and depth from a conventional camera with a coded aperture. ACM Trans. Graphics 26(3), 70 (2007)
Levin, A., Weiss, Y., Durand, F., Freeman, W.T.: Understanding blind deconvolution algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 33(12), 2354–2367 (2011)
Liu, G., Ma, Y.: Blind image deblurring by spectral properties of convolution operators. (2012), Arxiv, abs/1209.2082
Mignotte, M.: A segmentation-based regularization term for image deconvolution. IEEE Trans. Image Process. 15(7), 1973–1984 (2006)
Nagy, J.G., Palmer, K., Perrone, L.: Iterative methods for image deblurring: a Matlab object-oriented approach. Numer. Alg. 36(1), 73–93 (2004)
Richardson, H.W.: Bayesian-based iterative method of image restoration. J. Opt. Soc. Am. 62(1), 55–59 (1972)
Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Phys. D 60(1–4), 259–268 (1992)
Shan, Q., Jia, J., Agarwala, A.: High-quality motion deblurring from a single image. ACM Trans. Graphics 27(3), 73-1–73-10 (2008)
Tai, Y.-W., Tan, P., Brown, M.S.: Richardson-Lucy deblurring for scenes under a projective motion path. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1603–1618 (2011)
Tsumuraya, F.: Deconvolution based on the Wiener-Lucy chain algorithm: an approach to recover local information losses in the deconvolution procedure. J. Opt. Soc. Am. A 13(7), 1532–1536 (1996)
Weiss, Y., Freeman, W.T.: What makes a good model of natural images? In: IEEE Conference on Computer Vision and Pattern Recognition (2007)
Wiener, N.: Extrapolation, interpolation, and smoothing of stationary time series. The MIT Press (1964)
Xu, L., Jia, J.: Two-phase kernel estimation for robust motion deblurring. In: European Conference on Computer Vision, pp. 157–170 (2010)
Yuan, L., Sun, J., Quan, L., Shum, H.-Y.: Progressive Inter-scale and intra-scale non-blind image deconvolution. ACM Trans. Graphics 27(3), 74-1–74-10 (2008)
Zhang, Z., Ganesh, A., Liang, X., Ma, Y.: TILT: transform invariant low-rank textures. Int. J. Computer Vis. 99(1), 1–24 (2012)
Acknowledgments
X. Zhang and F. Sun are supported by the National Basic Research Program (973 Program) of China (No. 2013CB329403). Yi Ma is partially supported by the funding of ONR N00014-09-1-0230, NSF CCF 09-64215, NSF IIS 11-16012.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhang, X., Sun, F., Liu, G. et al. Non-blind deblurring of structured images with geometric deformation . Vis Comput 31, 131–140 (2015). https://doi.org/10.1007/s00371-014-0920-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-014-0920-y