Skip to main content
SpringerLink
Log in

Wavelet domain dictionary learning-based single image superresolution

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Recently sparse representations over learned dictionaries have been proven to be a very successful representation method for many image processing applications. This paper proposes a new approach for increasing the resolution from a single low-resolution image. This approach is based on learned dictionaries in the wavelet domain. The proposed method combines many desired properties of wavelet-based representations such as compactness, directionality and analysis in many scales with the flexibility of redundant sparse representations. Such an approach serves for two main purposes. First, it sparsifies the training set, and second, it allows the design of structured dictionaries. Structured dictionaries better capture intrinsic image characteristics. Furthermore, the design of multiple structured dictionaries serves to reduce the number of dictionary atoms and consequently reduces the computational complexity. Three couples of wavelet subband dictionaries are designed using the K-SVD algorithm: three for the low-resolution and three for the high-resolution wavelet subband images. The image patch size and dictionary redundancy issues are empirically investigated in this work. Extensive tests indicate that a patch size of \(6\times 6\) and a dictionary width of 216 is a good compromise between computational complexity and representation quality. The proposed algorithm is shown to be superior to the leading spatial domain sparse representation techniques both visually and quantitatively with an average PSNR increase of 1.71 dB as tested over the Kodak data set. This result is also validated in terms of SSIM as a perceptual quality metric. It is shown that the proposed approach better restores the lost high-frequency details in the three wavelet detail subbands. Furthermore, the proposed algorithm is shown to significantly reduce the dictionary learning and sparse coding computational complexity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Mallat, S., Zhang, Z.: Matching pursuits with time frequency dictionaries. IEEE Trans. Signal Process. 41(12), 3397–3415 (1993)

    Article  MATH  Google Scholar 

  2. Pati, Y.C., Rezaiifar, R., Krishnaprasad, P.S.: Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition. In: Proceedings of the 27th Annual Asilomar Conference Signals, Systems, and Computers, Pacific Grove, CA, 1–3 Nov 1993 43(1), 40–44 (1993)

  3. Chen, S.S., Donoho, D.L., Saunders, M.A.: Atomic decomposition by basis pursuit. SIAM J. Sci. Comput. 20(1), 33–61 (1998)

    Article  MathSciNet  Google Scholar 

  4. Gorodnitsky, I.F., Rao, B.D.: Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm. IEEE Trans. Signal Process. 45(3), 600–616 (1997)

    Article  Google Scholar 

  5. Rubinstein, R., Bruckstein, A.M., Elad, M.: Dictionaries for sparse representation modeling. Proc. IEEE 98(6), 1045–1057 (2010)

    Article  Google Scholar 

  6. Zeyde, R., Elad, M., Protter, M.: On single image scale-up using sparse representations. Curv. Surf. Avignon France 6920, 711–730 (2010)

    MathSciNet  Google Scholar 

  7. Patel, V.M., Chellappa, R.: Sparse representations, compressive sensing and dictionaries for pattern recognition. In: Proceedings of the First Asian Conference on Pattern Recognition (ACPR), pp. 325–329. Beijing, China, 28 Nov 2011

  8. Chen, F., Yu, H., Hu, R.: Shape sparse representation for joint object classification and segmentation. IEEE Trans. Image Process. 22(3), 992–1004 (2012)

    Google Scholar 

  9. Chen, H.W., Kang, L.W., Lu, C.H.: Dictionary learning-based distributed compressive video sensing. In: Proceedings of the Picture Coding Symposium (PCS), vol. 99, pp. 210–213. Nagoya, Japan, 8–10 Dec 2012

  10. Ophir, B., Lustig, M., Elad, M.: Multi-scale dictionary learning using wavelets. IEEE J. Sel. Top. Signal Process. 5(5), 1014–1024 (2011)

    Article  Google Scholar 

  11. Yang, J., Wright, J., Huang, T., Ma, Y.: Image super-resolution as sparse representation of raw image patches. In: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition(CVPR), pp. 1–8. Anchorage, AK, 23–28 Jun 2008

  12. Yang, J., Wright, J., Huang, T., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010)

    Article  MathSciNet  Google Scholar 

  13. Aharon, M., Elad, M., Bruckstein, A.M.: The K-SVD: an algorithm for designing of overcomplete dictionaries for sparse representations. IEEE Trans. Signal Process. 54(11), 4311–4322 (2006)

    Article  Google Scholar 

  14. Elad, M., Aharon, M.: Image denoising via sparse and redundant representations over learned dictionaries. IEEE Trans. Image Process. 15(12), 3736–3745 (2006)

    Article  MathSciNet  Google Scholar 

  15. Mairal, J., Bach, F., Ponce, J., Sapiro, G.: Online dictionary learning for sparse coding. In: Proceedings of the 26th International Conference on Machine Learning, pp. 689–696. Montreal, Canada, 14–18 Jun 2009

  16. Mairal, J., Bach, F., Ponce, J., Sapiro, G., Zisserman, A.: Supervised dictionary learning. In: Proceedings of the 21st Neural and Information Processing Systems, pp. 8–10. Vancouver, BC, Dec 2008

  17. Bruckstein, A.M., Donoho, D.L., Elad, M.: From sparse solutions of systems of equations to sparse modeling of signals and images. SIAM Rev. 51(1), 34–81 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  18. Kodak Lossless True Color Image Suite. http://r0k.us/graphics/kodak/

  19. Elad, M., Yavneh, I.: A plurality of sparse representations is better than the sparsest one alone. IEEE Trans. Inf. Theory 55(10), 4701–4714 (2009)

    Article  MathSciNet  Google Scholar 

  20. Dong, W., Zhand, L., Shi, G., Wu, X.: Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization. IEEE Trans. Image Process. 20(7), 1838–1857 (2011)

    Article  MathSciNet  Google Scholar 

  21. Daubechies, I.: Ten Lectures on Wavelets, vol. 194, pp. 254–257. SIAM, Philadelphia, PA (1992)

    Book  MATH  Google Scholar 

  22. Muresan, D.D., Parks, T.W.: Prediction of image detail. In: Proceedings of IEEE International Conference on Image Processing ICIP, pp. 323–326. Vancouver, BC, Canada, 10–13 Sept 2000

  23. Mueller, N., Yue, L., Minh, N.D.: Image interpolation using multiscale geometric representations. In: Electronic Imaging 2007. International Society for Optics and Photonics (2007)

  24. Temizel, A.: Image resolution enhancement using wavelet domain hidden Markov tree and coefficient sign estimation. In: Proceedings of IEEE International Conference on Image Processing ICIP, vol. 5, pp. 381–384. San Antonio, TX, 16–19 Sept 2007

  25. Mailh, B., Gribonval, R., Vandergheynst, P., Bimbot, F.: Fast orthogonal sparse approximation algorithms over local dictionaries. Proc. Signal Process. (SIGPRO) 91(12), 2822–2835 (2011)

    Article  Google Scholar 

  26. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)

    Article  Google Scholar 

  27. Dong, W., Zhang, L., Lukac, R., Shi, G.: Sparse representation based image interpolation with nonlocal autoregressive modeling. IEEE Trans. Image Process. 22(4), 1382–1394 (2013)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Electrical and Electronic Engineering Department, Eastern Mediterranean University, TRNC, Via Mersin 10, Gazimağusa, Turkey

    M. Nazzal & H. Ozkaramanli

Authors
  1. M. Nazzal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. H. Ozkaramanli
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to M. Nazzal.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nazzal, M., Ozkaramanli, H. Wavelet domain dictionary learning-based single image superresolution. SIViP 9, 1491–1501 (2015). https://doi.org/10.1007/s11760-013-0602-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-013-0602-7

Keywords

Search

Navigation