Signal, Image and Video Processing

, Volume 10, Issue 6, pp 1159–1167 | Cite as

Blind restoration and resolution enhancement of images based on complex filtering

Original Paper
First Online:
Received:
Revised:
Accepted:

Abstract

Recently, a blind resolution enhancement method that uses a two-dimensional and single-input multiple-output extension of the constant modulus algorithm has been developed for pure translational motion. The method works well in case of low bit depth unobserved true images, but its performance decreases for high bit depth true images. In this work, we propose a refined scheme in which complex representation of images and a set of complex deconvolution FIR filters are used. Simulations show that the refined method succeeds in reconstructing the low and high bit depth true images without the knowledge of blur parameters. Visual results for the restoration case (single image, no subsampling) are also given. No assumption is made about the blurs except that they have low-pass characteristics. Also, they do not have to be the same for the observed low-resolution images and they do not need to be shift invariant.

Keywords

Blind image restoration Blind image super-resolution  2D constant modulus algorithm  Adaptive filters 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgments

The authors would like to thank Prof. Peyman Milanfar for kindly providing the MDSP Resolution Enhancement Software. This work was supported by Scientific and Technological Research Council of Turkey (TUBITAK) under Project Number 107E193.

References

  1. 1.
    Tsai, R.Y., Huang, T.S.: Multiple frame image restoration and registration. In: Advances in Computer Vision and Image Processing, pp. 317–339. JAI Press Inc., Greenwich (1984)Google Scholar
  2. 2.
    Irani, M., Peleg, S.: Improving resolution by image registration. CVGIP Graph. Models Image Process. 53, 231–239 (1991)CrossRefGoogle Scholar
  3. 3.
    Stark, H., Oskoui, P.: High-resolution image recovery from image-plane arrays, using convex projections. J. Opt. Soc. Am. A 6, 1715–1726 (1989)CrossRefGoogle Scholar
  4. 4.
    Patti, A.J., Sezan, M.I., Tekalp, A.M.: Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time. IEEE Trans. Image Process. 6(8), 1064–1076 (1997)CrossRefGoogle Scholar
  5. 5.
    Schultz, R.R., Stevenson, R.L.: Extraction of high-resolution frames from video sequences. IEEE Trans. Image Process. 5(6), 996–1011 (1996)CrossRefGoogle Scholar
  6. 6.
    Tom, B.C., Katsaggelos, A.K.: Reconstruction of a high-resolution image by simultaneous registration, restoration, and interpolation of low-resolution images. In: Proceedings of 1995 IEEE International Conference Image Processing, vol. 2, pp. 539–542. Washington (1995)Google Scholar
  7. 7.
    Elad, M., Feuer, A.: Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images. IEEE Trans. Image Process. 6(12), 1646–1658 (1997)CrossRefGoogle Scholar
  8. 8.
    Farsiu, S., Robinson, D., Elad, M., Milanfar, P.: Fast and robust multi-frame super-resolution. IEEE Trans. Image Process. 13(10), 1327–1344 (2004)CrossRefGoogle Scholar
  9. 9.
    Kang, M., Lee, E.: Regularized adaptive high-resolution image reconstruction considering inaccurate subpixel registration. IEEE Trans. Image Process. 12(7), 826–837 (2003)MathSciNetCrossRefGoogle Scholar
  10. 10.
    He, H., Kondi, L.P.: An image super-resolution algorithm for different error levels per frame. IEEE Trans. Image Process. 15(3), 592–603 (2006)CrossRefGoogle Scholar
  11. 11.
    Woods, N.A., Galatsanos, N.P., Katsaggelos, A.K.: Stochastic methods for joint registration, restoration, and interpolation of multiple undersampled images. IEEE Trans. Image Process. 15(1), 201–213 (2006)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Segall, C., Katsaggelos, A.K., Molina, R., Mateos, J.: Bayesian resolution enhancement of compressed video. IEEE Trans. Image Process. 13(7), 898–911 (2004)CrossRefGoogle Scholar
  13. 13.
    Gunturk, B.K., Altunbasak, Y., Mersereau, R.M.: Super-resolution reconstruction of compressed video using transform-domain statistics. IEEE Trans. Image Process. 13(1), 33–43 (2004)CrossRefGoogle Scholar
  14. 14.
    Shechtman, E., Caspi, Y., Irani, M.: Space-time super-resolution. IEEE Trans. Pattern Anal. Mach. Intell. 27(4), 531–545 (2005)CrossRefMATHGoogle Scholar
  15. 15.
    Park, S.C., Park, M.K., Kang, M.G.: Super-resolution image reconstruction—a technical overview. IEEE Signal Process. Mag. 20(3), 21–36 (2003)CrossRefGoogle Scholar
  16. 16.
    Farsiu, S., Robinson, D., Elad, M., Milanfar, P.: Advances and challenges in super-resolution. Int. J. Imaging Syst. Technol. 14(2), 47–57 (2004)CrossRefGoogle Scholar
  17. 17.
    Bose, N.K., Chan, R.H., Ng, M.K.: Special issue on high resolution image reconstruction. Int. J. Imaging. Syst. Tech. 14(2), 35 (2004). doi: 10.1002/ima.20005
  18. 18.
    Ng, M., Chan, T., Kang, M.G., Milanfar, P.: Special issue on super-resolution imaging: analysis, algorithms, and applications. EURASIP J. Adv. Signal Process. 2006(1), 1–2 (2006). doi: 10.1155/ASP/2006/90531
  19. 19.
    Baker, S., Kanade, T.: Limits on super-resolution and how to break them. IEEE Trans. Pattern Anal. Mach. Intell. 24(9), 1167–1183 (2002)CrossRefGoogle Scholar
  20. 20.
    Capel, D., Zisserman, A.: Super-resolution from multiple views using learnt image models. In: Proceedings of IEEE Conference Computer Vision and Pattern Recognition, pp. 627–634 (2001)Google Scholar
  21. 21.
    Nguyen, N., Milanfar, P., Golub, G.: Efficient generalized cross-validation with applications to parametric image restoration and resolution enhancement. IEEE Trans. Image Process. 10(9), 1299–1308 (2001)MathSciNetCrossRefMATHGoogle Scholar
  22. 22.
    Woods, N., Galatsanos, N., Katsaggelos, A.K.: EM-based simultaneous registration, restoration, and interpolation of super-resolved images. In: Proceedings of IEEE International Conference Image Processing, pp. 303–306 (2003)Google Scholar
  23. 23.
    He, Y., Yap, K.H., Chen, L., Chau, L.P.: A soft MAP framework for blind super-resolution image reconstruction. Image Vis. Comput. 27, 364–373 (2009)CrossRefGoogle Scholar
  24. 24.
    El-Khamy, S.E., Hadhoud, M.M., Dessouky, M.I., Salam, B.M., Abd El-Samie, F.E.: Blind multichannel reconstruction of high-resolution images using wavelet fusion. Appl. Opt. 44, 7349–7356 (2005)CrossRefMATHGoogle Scholar
  25. 25.
    Wirawan, P.D., Maitre, H.: Multi-channel high resolution blind image estimation. In: Proceedings of IEEE ICASSP, pp. 3229–3232 (1999)Google Scholar
  26. 26.
    Yagle: Blind superresolution from undersampled blurred measurements. In: Proceedings of Advanced Signal Processing Algorithms, Architectures, Implementation XIII, pp. 299–309 (2003)Google Scholar
  27. 27.
    Sroubek, F., Cristobal, G., Flusser, J.: A unified approach to superresolution and multichannel blind deconvolution. IEEE Trans. Image Process. 16(9), 2322–2332 (2007)Google Scholar
  28. 28.
    Faramarzi, E., Rajan, D., Christensen, M.P.: Unified blind method for multi-image super-resolution and single/multi image blur deconvolution. IEEE Trans. Image Process. 22(6), 2101–2114 (2013)MathSciNetCrossRefGoogle Scholar
  29. 29.
    Kundur, D., Hatzinakos, D.: Blind image deconvolution. IEEE Signal Process. Mag. 13(3), 43–64 (1996)CrossRefGoogle Scholar
  30. 30.
    Jiang, M., Wang, G.: Development of blind image deconvolution and its applications. J. X-ray Sci. Technol. 11, 13–19 (2003)Google Scholar
  31. 31.
    Godard, D.: Self-recovering equalization and carrier tracking in two dimensional data communication systems. IEEE Trans. Commun. 28(11), 1867–1875 (1980)CrossRefGoogle Scholar
  32. 32.
    Treichler, J.R., Agee, B.G.: A new approach to multipath correction of constant modulus signals. IEEE Trans. Commun. 31(2), 459–473 (1983)Google Scholar
  33. 33.
    Vural, C., Sethares, W.A.: Blind image deconvolution via dispersion minimization. Digit. Signal Process. 16, 137–148 (2006)MathSciNetCrossRefMATHGoogle Scholar
  34. 34.
    Kara, F., Vural, C.: Blind image resolution enhancement based on a 2D constant modulus algorithm. Inverse Probl. (2008). doi: 10.1088/0266-5611/24/1/015010 MathSciNetMATHGoogle Scholar
  35. 35.
    Kara, F., Vural, C.: Blind image deconvolution based on complex mapping. In: IEEE 15th Signal Processing and Communications Applications Conference (SIU) (2007)Google Scholar
  36. 36.
    Kara, F., Vural, C.: Complex mapping-based blind image super-resolution. In: IEEE 16th Signal Processing and Communications Applications Conference (SIU) (2008)Google Scholar
  37. 37.
    Elad, M., Hel-Or, Y.: A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur. IEEE Trans. Image Process. 10(8), 1187–1193 (2001)CrossRefMATHGoogle Scholar
  38. 38.
    Gillette, J.C., Stadtmiller, T.M., Hardie, R.C.: Aliasing reduction in staring infrared images utilizing subpixel techniques. Opt. Eng. 34(11), 3130–3137 (1995)CrossRefGoogle Scholar
  39. 39.
    Vural, C., Sethares, W.A.: Recursive blind image deconvolution via dispersion minimization. Int. J. Adapt. Control Signal Process. 19(8), 601–622 (2005)MathSciNetCrossRefMATHGoogle Scholar
  40. 40.
    De Haan, G., Biezen, P.: Sub-pixel motion estimation with 3-D recursive search block-matching. Signal Process. Image Commun. 9, 229–239 (1994)CrossRefGoogle Scholar
  41. 41.
    Kilthau, S.L., Drew, M.S., Moller, T.: Full search content independent block matching based on the fast Fourier transform. In: IEEE International Conference on Image Processing, Rochester (2002)Google Scholar
  42. 42.
    Nakajima, N.: Blind deconvolution using the maximum likelihood estimation and the iterative algorithm. Opt. Commun. 100, 59–66 (1993)CrossRefGoogle Scholar
  43. 43.
    Richardson, W.H.: Bayesian-based iterative method of image restoration. J. Opt. Soc. Am. 62, 55–59 (1972)CrossRefGoogle Scholar
  44. 44.
    Banham, M.R., Katsaggelos, A.K.: Digital image restoration. IEEE Signal Process. Mag. 14(2), 24–41 (1997)CrossRefGoogle Scholar
  45. 45.
    Farsiu,S., Robinson, D., Elad, M., Milanfar, P.: Robust shift and add approach to super-resolution. In: Proceedings of the 2003 SPIE Conference on Applications of Digital Signal and Image Processing, pp. 121–130 (2003)Google Scholar
  46. 46.
    Tsumuraya, F., Miura, N., Baba, N.: Iterative blind deconvolution method using Lucy’s algorithm. Astron. Astrophys. 282, 699–708 (1994)Google Scholar

Copyright information

© Springer-Verlag London 2016

Authors and Affiliations

  1. 1.TUBITAK-BILGEMGebzeTurkey
  2. 2.Department of Electrical and Electronics EngineeringMarmara UniversityKadikoy, IstanbulTurkey

Personalised recommendations