Abstract
In recent year, researchers have gradually focused on single image super-resolution for large scale factors. Single image contains scarce high-frequency details, which is insufficient to reconstruct high-resolution image. To address this problem, we propose a multi-scale progressive image super-resolution reconstruction network (MSPN) based on the asymmetric Laplacian pyramid structure. Our proposed network allows us to separate the difficult problem into several subproblems for better performance. Specially, we propose an improved multi-scale feature extraction block (MSFB) to widen our proposed network and achieve deeper and more effective feature information exploitation. Moreover, weight normalization is applied into MSFB to tackle the gradient vanishing and gradient exploding problem, and to accelerate the convergence speed of training. In addition, we introduce pyramid pooling layer into the upsampling module to further enhance the image reconstruction performance by aggregating local and global context information. Extensive evaluations on benchmark datasets show that our proposed algorithm gains great performance against the state-of-the-art methods in terms of accuracy and visual effect.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Shi WZ, Caballero J, Ledig C, Zhuang XH, Bai WJ, Bhatia K, de Marvao AMSM, Dawes T, O’Regan D, Rueckert D (2013) Cardiac image super-resolution with global correspondence using multi-atlas patchmatch. Proceedings of MICCAI, pp 9–16
Gunturk BK, Altunbasak Y, Mersereau RM (2004) Super-resolution reconstruction of compressed video using transform-domain statistics. IEEE Trans Image Process 13:33–43
Zou WWW, Yuen PC (2012) Very low resolution face recognition problem. IEEE Trans Image Process 21:327–340
Yıldırım D, Güngör O (2012) A novel image fusion method using ikonos satellite images. J Geodesy Geoinform 427–429:1593–1596
Dong C, Loy CC, He K, Tang X (2014) Learning a deep convolutional network for image super-resolution. Eur Conf Comput Vis 8692:184–199
Kim J, Kwon Lee J, Mu Lee K (2016) Accurate image super-resolution using very deep convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1646–1654
Kim J, Kwon Lee J, Mu Lee K (2016) Deeply-recursive convolutional network for image super-resolution. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1637–1645
Tai Y, Yang J, Liu X (2017) Image super-resolution via deep recursive residual network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2790–2798
Tong T, Li G, Liu XJ, Gao QQ (2017) Image super-resolution using dense skip connections. In: Proceedings of the IEEE international conference on computer vision, IEEE computer society, pp 4809–4817
Lim B, Son S, Kim H, Nah S, Lee KM (2017) Enhanced deep residual networks for single image super-resolution. In: The IEEE conference on computer vision and pattern recognition workshops, vol 1, pp 1132–1140
Zhang YL, Tian YP, Kong Y, Zhong BN, Fu Y (2018) Residual dense network for image super-resolution. In: The IEEE/CVF conference on computer vision and pattern recognition, pp 2472–2481
Lai WS, Huang JB, Ahuja N, Yang MH (2017) Deep Laplacian pyramid networks for fast and accurate super-resolution. In: IEEE conference on computer vision and pattern recognition, pp 5835–5843
Lai WS, Huang JB, Ahuja N, Yang MH (2018) Fast and accurate image super-resolution with deep Laplacian pyramid networks. IEEE Trans Pattern Anal Mach Intell 99
Wang YF, Perazzi F, Mcwilliams B, et al (2018) A fully progressive approach to single-image super-resolution. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pp 977–986
Agustsson E, Timofte R (2017) Ntire 2017 challenge on single image super-resolution: dataset and study. In: The IEEE conference on computer vision and pattern recognition workshops, vol 3, p 2
Keys RG (1981) Cubic convolution interpolation for digital image processing. IEEE Trans Acoust Speech Signal Process 37:1153–1160
Shi W, Caballero J, Husz´ar F, Totz J, Aitken AP, Bishop R, Rueckert D, Wang Z (2016) Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1874–1883
Dong C, Loy CC, Tang X (2016) Accelerating the super-resolution convolutional neural network. In: European conference on computer vision. Springer, pp 391–407
Ledig C, Theis L, Husz´ar F, Caballero J, Cunningham A, Acosta A, Aitken A, Tejani A, Totz J, Wang Z, et al (2017) Photo-realistic single image super-resolution using a generative adversarial network. In: The IEEE conference on computer vision and pattern recognition, pp 105–114
Sergey I, Christian S (2015) Batch normalization: Accelerating deep network training by reducing internal covariate shift. In: International conference on machine learning, pp 448–456
Tim S, Diederik PK (2016) Weight normalization: A simple reparameterization to accelerate training of deep neural networks. Adv Neural Inform Process Syst 901–909
Yu JH, Fan YC, Yang JC et al (2018) Wide activation for efficient and accurate image super-resolution. In: IEEE conference on computer vision and pattern recognition
Zhao H, Shi J, Qi X, Wang X, Jia J (2017) Pyramid scene parsing network. In: The IEEE conference on computer vision and pattern recognition, pp 2881–2890
Park D, Kim K, Chun SY (2018) Efficient module based single image super resolution for multiple problems. Proceedings of CVPRW, pp 995–1003
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9
Li JC, Fang FM, Mei KF, Zhang GX (2018) Multi-scale residual network for image super-resolution. In: European conference on computer vision. Springer, pp 527–542
Huang G, Liu Z, Weinberger KQ, van der Maaten L (2017) Densely connected convolutional networks. Proceedings of CVPR, pp 2261–2269
Bevilacqua M, Roumy A, Guillemot C, Alberi-Morel ML (2012) Low-complexity single-image super-resolution based on nonnegative neighbor embedding. In: Proceedings of the 23rd British machine vision conference
Zeyde R, Elad M, Protter M (2010) On single image scale-up using sparse representations. In: International conference on curves and surfaces. Springer, pp 711–730
Arbelaez P, Maire M, Fowlkes C, Malik J (2011) Contour detection and hierarchical image segmentation. IEEE Trans Pattern Anal Mach Intell 33:898–916
Huang JB, Singh A, Ahuja N (2015) Single image super-resolution from transformed self-exemplars. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5197–5206
Matsui Y, Ito K, Aramaki Y, Fujimoto A, Ogawa T, Yamasaki T, Aizawa K (2017) Sketch-based manga retrieval using manga109 dataset. Multimedia Tools Appl 76:21811–21838
Timofte R, De Smet V, Van Gool L (2014) A+: adjusted anchored neighborhood regression for fast super-resolution. In: Asian conference on computer vision. Springer, pp 111–126
Ahn N, Kang B, Sohn KA (2018) Fast, accurate, and lightweight super-resolution with cascading residual network. In: European conference on computer vision. Springer, pp 256–272
Ahn N, Kang B, Sohn KA (2018) Image super-resolution via progressive cascading residual network. In: 2018 IEEE/CVF conference on computer vision and pattern recognition workshops, pp 904–912
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Ying, S., Fan, S., Wang, H. (2021). A Multi-scale Progressive Method of Image Super-Resolution. In: Lu, H. (eds) Artificial Intelligence and Robotics. ISAIR 2019. Studies in Computational Intelligence, vol 917. Springer, Cham. https://doi.org/10.1007/978-3-030-56178-9_14
Download citation
DOI: https://doi.org/10.1007/978-3-030-56178-9_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-56177-2
Online ISBN: 978-3-030-56178-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)