Skip to main content
Log in

Extended wavelet sparse convolutional neural network (EWSCNN) for super resolution

  • Published:
Sādhanā Aims and scope Submit manuscript

Abstract

Multiresolution property of wavelet transform at first level decomposition is used for single image super-resolution (SISR) in this paper. Earlier, wavelet based SISR methods used generative approaches, but in this work, discriminative approach is used. With the help of deep CNN, we attempt to learn a complex end-to-end nonlinear mapping between low-resolution (LR) and high-resolution (HR) patches in order to estimate the LR patch's missing details. The input LR patch comprises of four sub-bands of LR image wavelet coefficients and the output HR patches are the residuals of four sub-bands of HR image wavelet coefficients. We reduce the low frequency information reconstruction problem by utilizing residues of wavelet sub bands. A key advantage of residual learning is speeding up the training and providing better reconstruction accuracy. We name the deep CNN proposed for super resolution in this work as Extended Sparse Wavelet Convolutional Neural Network for Super Resolution (EWSCNN-SR). The proposed EWSCNN-SR net provides better performance when compared to the other state-of-the-art SISR methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5

Similar content being viewed by others

References

  1. Pandey R K and Ramakrishnan A G 2018 Efficient document-image super-resolution using convolutional neural network. Sadhana Acad. Proc. Eng. Sci. 43(2): 1–6

    MathSciNet  MATH  Google Scholar 

  2. Park S C, Park M K and Kang M G 2003 Super-resolution image reconstruction: a technical overview. IEEE Signal Process. 20(3): 21–36

    Article  Google Scholar 

  3. Luo X, Xu Y and Yang J 2019 Multi-resolution dictionary learning for face recognition. Pattern Recognit. 93: 283–292. ISSN0031-3203

  4. Abiantun R, Juefei-Xu F, Prabhu U and Savvides M 2019 SSR2: Sparse signal recovery for single-image super-resolution on faces with extreme low resolutions. Pattern Recognit. 90:308–324. ISSN0031-3203

  5. Li K, Zhu Y, Yang J and Jiang J 2016 Video super-resolution using an adaptive superpixel-guided auto-regressive model. Pattern Recognit. 51: 59–71

    Article  Google Scholar 

  6. Mallat S and Yu G 2010 Super-resolution with sparse mixing estimators. IEEE Trans. Image Process. 19(11): 2889–2900

    Article  MathSciNet  MATH  Google Scholar 

  7. Dong C, Loy C C, He K and Tang X 2014 Learning a deep convolutional network for image super-resolution. In: Lecture Notes in Computer Science, vol. 8692

  8. Dong C, Loy C C, He K and Tang X 2016 Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38(2): 295–307

    Article  Google Scholar 

  9. Arun P V, Herrmann I, Budhiraj K M and Karnieli A 2019 Convolutional network architectures for super-resolution/sub-pixel mapping of drone-derived images. Pattern Recognit. 88: 431–446. ISSN 0031-3203

  10. Timofte R, De Smet V and Van Gool L 2014 A+: adjusted anchored neighborhood regression for fast super-resolution. ACCV

  11. Huang J, Singh A and Ahuja N 2015 Single image super-resolution from transformed self-exemplars. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, pp. 5197–5206

  12. Dong C, Loy C C and Tang X 2016 Accelerating the super-resolution convolutional neural network. In: Lecture Notes in Computer Science, vol. 9906

  13. Bevilacqua M, Roumy A, Guillemot C and Alberi-Morel M-L 2012 Low-complexity single-image super-resolution based on nonnegative neighbor embedding. BMVC

  14. Zeyde R, Elad M and Protter M 2012 On single image scale-up using sparse-representation. In: Proc. 7th Int. Conf. Curves Surf., pp. 711–730

  15. Martin D, Fowlkes C, Tal D and Malik J 2001 A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001, Vancouver, BC, Canada, vol. 2, pp. 416–423

  16. Zhu Z, Guo F, Yu H and Chen C 2014 Fast single image super-resolution via self-example learning and sparse representation. IEEE Trans. Multimed. 16(8): 2178–2190

    Article  Google Scholar 

  17. He K, Zhang X, Ren S and Sun J 2015 Delving deep into rectifiers: surpassing human-level performance on ImageNet classification. In: IEEE International Conference on Computer Vision (ICCV), Santiago, pp. 1026–1034

  18. Deng J, Dong W, Socher R, Li L, Li K and Fei-Fei L 2009 ImageNet: a large-scale hierarchical image database. In: IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, pp. 248–255

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to S Deivalakshmi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yeswanth, P.V., Deivalakshmi, S. Extended wavelet sparse convolutional neural network (EWSCNN) for super resolution. Sādhanā 48, 52 (2023). https://doi.org/10.1007/s12046-023-02108-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s12046-023-02108-0

Keywords

Navigation