Abstract
Multiresolution property of wavelet transform at first level decomposition is used for single image super-resolution (SISR) in this paper. Earlier, wavelet based SISR methods used generative approaches, but in this work, discriminative approach is used. With the help of deep CNN, we attempt to learn a complex end-to-end nonlinear mapping between low-resolution (LR) and high-resolution (HR) patches in order to estimate the LR patch's missing details. The input LR patch comprises of four sub-bands of LR image wavelet coefficients and the output HR patches are the residuals of four sub-bands of HR image wavelet coefficients. We reduce the low frequency information reconstruction problem by utilizing residues of wavelet sub bands. A key advantage of residual learning is speeding up the training and providing better reconstruction accuracy. We name the deep CNN proposed for super resolution in this work as Extended Sparse Wavelet Convolutional Neural Network for Super Resolution (EWSCNN-SR). The proposed EWSCNN-SR net provides better performance when compared to the other state-of-the-art SISR methods.
Similar content being viewed by others
References
Pandey R K and Ramakrishnan A G 2018 Efficient document-image super-resolution using convolutional neural network. Sadhana Acad. Proc. Eng. Sci. 43(2): 1–6
Park S C, Park M K and Kang M G 2003 Super-resolution image reconstruction: a technical overview. IEEE Signal Process. 20(3): 21–36
Luo X, Xu Y and Yang J 2019 Multi-resolution dictionary learning for face recognition. Pattern Recognit. 93: 283–292. ISSN0031-3203
Abiantun R, Juefei-Xu F, Prabhu U and Savvides M 2019 SSR2: Sparse signal recovery for single-image super-resolution on faces with extreme low resolutions. Pattern Recognit. 90:308–324. ISSN0031-3203
Li K, Zhu Y, Yang J and Jiang J 2016 Video super-resolution using an adaptive superpixel-guided auto-regressive model. Pattern Recognit. 51: 59–71
Mallat S and Yu G 2010 Super-resolution with sparse mixing estimators. IEEE Trans. Image Process. 19(11): 2889–2900
Dong C, Loy C C, He K and Tang X 2014 Learning a deep convolutional network for image super-resolution. In: Lecture Notes in Computer Science, vol. 8692
Dong C, Loy C C, He K and Tang X 2016 Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38(2): 295–307
Arun P V, Herrmann I, Budhiraj K M and Karnieli A 2019 Convolutional network architectures for super-resolution/sub-pixel mapping of drone-derived images. Pattern Recognit. 88: 431–446. ISSN 0031-3203
Timofte R, De Smet V and Van Gool L 2014 A+: adjusted anchored neighborhood regression for fast super-resolution. ACCV
Huang J, Singh A and Ahuja N 2015 Single image super-resolution from transformed self-exemplars. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, pp. 5197–5206
Dong C, Loy C C and Tang X 2016 Accelerating the super-resolution convolutional neural network. In: Lecture Notes in Computer Science, vol. 9906
Bevilacqua M, Roumy A, Guillemot C and Alberi-Morel M-L 2012 Low-complexity single-image super-resolution based on nonnegative neighbor embedding. BMVC
Zeyde R, Elad M and Protter M 2012 On single image scale-up using sparse-representation. In: Proc. 7th Int. Conf. Curves Surf., pp. 711–730
Martin D, Fowlkes C, Tal D and Malik J 2001 A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001, Vancouver, BC, Canada, vol. 2, pp. 416–423
Zhu Z, Guo F, Yu H and Chen C 2014 Fast single image super-resolution via self-example learning and sparse representation. IEEE Trans. Multimed. 16(8): 2178–2190
He K, Zhang X, Ren S and Sun J 2015 Delving deep into rectifiers: surpassing human-level performance on ImageNet classification. In: IEEE International Conference on Computer Vision (ICCV), Santiago, pp. 1026–1034
Deng J, Dong W, Socher R, Li L, Li K and Fei-Fei L 2009 ImageNet: a large-scale hierarchical image database. In: IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, pp. 248–255
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yeswanth, P.V., Deivalakshmi, S. Extended wavelet sparse convolutional neural network (EWSCNN) for super resolution. Sādhanā 48, 52 (2023). https://doi.org/10.1007/s12046-023-02108-0
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s12046-023-02108-0