Skip to main content
Log in

Video resolution enhancement by using discrete and stationary wavelet transforms with illumination compensation

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

This paper proposes a new video resolution enhancement technique, in which a state-of-the-art illumination compensation procedure is applied to the respective frames before the registration process. After illumination compensation process, the respective frames are registered by using Vandewalle technique. In parallel, the corresponding frame is decomposed into its frequency subbands by using discrete wavelet transform (DWT) and stationary wavelet transform (SWT). Furthermore, the high-frequency subbands (LH, HL, and HH) have been super resolved by using Vandewalle super resolution technique. Afterward, the super resolved high-frequency subbands are being enhanced by the ones obtained through SWT as the latter ones contain more information. The enhanced high-frequency subbands and the output of the registration technique, which is regarded as the low-frequency subband, have been combined by using inverse DWT (IDWT) in order to construct the high-resolution frame. The quantitative (PSNR) results show the superiority of the proposed technique over the conventional and state-of-the-art video resolution enhancement techniques, in which for Akiyo video sequence there are 5.45 dB improvements over the average PSNR compared to Vandewalle registration technique with structure adaptive normalized convolution.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Borman, S., Stevenson, R.L.: Super-resolution from image sequences: a review. In: Proceedings of the Midwest Symposium on Circuits and Systems, pp. 374–378, 1998

  2. Elad, M., Feuer, A.: Super-resolution reconstruction of image sequences. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 21(9), 817–834 (1999)

    Article  Google Scholar 

  3. Tsai, R.Y., Huang, T.S.: “Multiframe image restoration and registration”. In: Huang, T.S., (ed) Advances in Computer Vision and Image Processing. JAI Press, vol. 1, 1984, pp. 317–339

  4. Keren, D., Peleg, S., Brada, R.: Image sequence enhancement using subpixel displacements. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., pp. 742–746 June (1988)

  5. Demirel, H., Anbarjafari, G.: Image resolution enhancement by using discrete and stationary wavelet decomposition. IEEE Trans. Image Process. 20(5), 1458–1460 (2011)

    Article  MathSciNet  Google Scholar 

  6. Reddy, B.S., Chatterji, B.N.: An fft-based technique for translation, rotation and scale-invariant image registration. IEEE Trans. Image Process. 5(8), 1266–1271 (1996)

    Article  Google Scholar 

  7. Cortelazzo, L., Lucchese, G.M.: A noise-robust frequency domain technique for estimating planar roto translations. IEEE Trans. Signal Process. 48(6), 1769–1786 (2000)

    Article  Google Scholar 

  8. Irani, M., Peleg, S.: Improving resolution by image registration. CVGIP: Graph. Model. Image Process. 53(13), 231–239 (1991)

    Google Scholar 

  9. Demirel, H., Izadpanahi, S.: Motion-Based Localized Super Resolution Technique for Low Resolution Video Enhancement. 16th European Signal Processing Conference (EUSIPCO-2008), Lausanne, Switzerland (2008)

  10. Marcel, B., Briot, M., Murrieta, R.: Calcul de Translation et Rotation par la Transformation de Fourier. Traitement du Signal 14(2), 135–149 (1997)

    MATH  Google Scholar 

  11. Robinson, M.D., Toth, C.A., Lo, J.Y., Farsiu, S.: Efficient fourier-wavelet super-resolution. IEEE Trans. Image Process. 19(10), 2669–2681 (2010)

    Article  MathSciNet  Google Scholar 

  12. Nguyen, N., Milanfar, P.: A wavelet-based interpolation-restoration method for superresolution (wavelet superresolution). Circuits Syst. Signal Process 19(4), 321–338 (2000)

    Article  MATH  Google Scholar 

  13. Demirel, H., Anbarjafari, G., Izadpanahi, S.: Improved motion-based localized super resolution technique using discrete wavelet transform for low resolution video enhancement. \(\text{17} ^{th}\) European Signal Processing Conference (EUSIPCO-2009), Glasgow, Scotland, Aug. 2009, pp. 1097–1101

  14. Vandewalle, P., Süsstrunk, S., Vetterli, M.: A frequency domain approach to registration of aliased images with application to super-resolution. EURASIP J. Appl. Signal Process. (special issue on Super-resolution) vol. 2006, Article ID 71459

  15. Piao, Y., Shin, l., Park, H. W.: Image resolution enhancement using inter-subband correlation in wavelet domain. Int. Conf. Image Process. (ICIP 2007) vol. 1, pp. I- 445–448

  16. Demirel, H., Ozcinar, C., Anbarjafari, G.: Satellite image contrast enhancement using discrete wavelet transform and singular value decomposition. IEEE Geosci Remote Sens. Lett. 7(2), 334–338 (2010)

    Article  Google Scholar 

  17. Temizel, A., Vlachos, T.: Wavelet domain image resolution enhancement using cycle-spinning. Electron. Lett. 41(3), 119–121 (2005)

    Article  Google Scholar 

  18. Anbarjafari, G., Demirel, H.: Image super resolution based on interpolation of wavelet domain high frequency subbands and the spatial domain input image. ETRI J. 32(3), 390–394 (2010)

    Article  Google Scholar 

  19. Mallat, S.: A Wavelet Tour of Signal Processing. Published by Academic Press, 1999, 2nd edition ISBN 012466606X, 9780124666061

  20. Zomet, A., Rav-Acha, A., Peleg, S.: Robust super-resolution. In: Proceedings on International Conference on Computer Vision and Pattern Recognition (CVPR), 2001, pp. I-645 - I-650

  21. Pham, T.Q., van Vliet, L.J., Schutte, K: Robust fusion of irregularly sampled data using adaptive normalized convolution. EURASIP J. Appl. Signal Process. vol. 2006, Article ID 83268

  22. Ozcinar, C., Izadpanahi, S., Anbarjafari, G., Demirel, H.: Video Resolution Enhancement by Using Complex Wavelet Transform. International Conference on Image Processing, 2011

  23. Demirel, H., Anbarjafari, G.: Data fusion boosted face recognition based on probability distribution functions in different colour channels. EURASIP J. Adv. Signal Process. 2009, Accepted on May 2009

  24. Xiph.org Test Media, Retrieved on October 2010, from the World Wide Web on http://media.xiph.org/video/derf/

  25. Temizel, A.: Image resolution enhancement using wavelet domain hidden Markov tree and coefficient sign estimation. Int Conf. Image Process. (ICIP2007), vol. 5, pp. V-381-384

Download references

Acknowledgments

Authors would like to thank Prof. Dr. Ivan Selesnick from Polytechnic University for providing the DWT codes in MATLAB.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Gholamreza Anbarjafari.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Anbarjafari, G., Izadpanahi, S. & Demirel, H. Video resolution enhancement by using discrete and stationary wavelet transforms with illumination compensation. SIViP 9, 87–92 (2015). https://doi.org/10.1007/s11760-012-0422-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-012-0422-1

Keywords

Navigation