Skip to main content

A Multi-scale Progressive Method of Image Super-Resolution

  • Chapter
  • First Online:
Artificial Intelligence and Robotics (ISAIR 2019)

Part of the book series: Studies in Computational Intelligence ((SCI,volume 917))

Included in the following conference series:

  • 738 Accesses

Abstract

In recent year, researchers have gradually focused on single image super-resolution for large scale factors. Single image contains scarce high-frequency details, which is insufficient to reconstruct high-resolution image. To address this problem, we propose a multi-scale progressive image super-resolution reconstruction network (MSPN) based on the asymmetric Laplacian pyramid structure. Our proposed network allows us to separate the difficult problem into several subproblems for better performance. Specially, we propose an improved multi-scale feature extraction block (MSFB) to widen our proposed network and achieve deeper and more effective feature information exploitation. Moreover, weight normalization is applied into MSFB to tackle the gradient vanishing and gradient exploding problem, and to accelerate the convergence speed of training. In addition, we introduce pyramid pooling layer into the upsampling module to further enhance the image reconstruction performance by aggregating local and global context information. Extensive evaluations on benchmark datasets show that our proposed algorithm gains great performance against the state-of-the-art methods in terms of accuracy and visual effect.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Shi WZ, Caballero J, Ledig C, Zhuang XH, Bai WJ, Bhatia K, de Marvao AMSM, Dawes T, O’Regan D, Rueckert D (2013) Cardiac image super-resolution with global correspondence using multi-atlas patchmatch. Proceedings of MICCAI, pp 9–16

    Google Scholar 

  2. Gunturk BK, Altunbasak Y, Mersereau RM (2004) Super-resolution reconstruction of compressed video using transform-domain statistics. IEEE Trans Image Process 13:33–43

    Article  Google Scholar 

  3. Zou WWW, Yuen PC (2012) Very low resolution face recognition problem. IEEE Trans Image Process 21:327–340

    Article  MathSciNet  Google Scholar 

  4. Yıldırım D, Güngör O (2012) A novel image fusion method using ikonos satellite images. J Geodesy Geoinform 427–429:1593–1596

    Google Scholar 

  5. Dong C, Loy CC, He K, Tang X (2014) Learning a deep convolutional network for image super-resolution. Eur Conf Comput Vis 8692:184–199

    Google Scholar 

  6. Kim J, Kwon Lee J, Mu Lee K (2016) Accurate image super-resolution using very deep convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1646–1654

    Google Scholar 

  7. Kim J, Kwon Lee J, Mu Lee K (2016) Deeply-recursive convolutional network for image super-resolution. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1637–1645

    Google Scholar 

  8. Tai Y, Yang J, Liu X (2017) Image super-resolution via deep recursive residual network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2790–2798

    Google Scholar 

  9. Tong T, Li G, Liu XJ, Gao QQ (2017) Image super-resolution using dense skip connections. In: Proceedings of the IEEE international conference on computer vision, IEEE computer society, pp 4809–4817

    Google Scholar 

  10. Lim B, Son S, Kim H, Nah S, Lee KM (2017) Enhanced deep residual networks for single image super-resolution. In: The IEEE conference on computer vision and pattern recognition workshops, vol 1, pp 1132–1140

    Google Scholar 

  11. Zhang YL, Tian YP, Kong Y, Zhong BN, Fu Y (2018) Residual dense network for image super-resolution. In: The IEEE/CVF conference on computer vision and pattern recognition, pp 2472–2481

    Google Scholar 

  12. Lai WS, Huang JB, Ahuja N, Yang MH (2017) Deep Laplacian pyramid networks for fast and accurate super-resolution. In: IEEE conference on computer vision and pattern recognition, pp 5835–5843

    Google Scholar 

  13. Lai WS, Huang JB, Ahuja N, Yang MH (2018) Fast and accurate image super-resolution with deep Laplacian pyramid networks. IEEE Trans Pattern Anal Mach Intell 99

    Google Scholar 

  14. Wang YF, Perazzi F, Mcwilliams B, et al (2018) A fully progressive approach to single-image super-resolution. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pp 977–986

    Google Scholar 

  15. Agustsson E, Timofte R (2017) Ntire 2017 challenge on single image super-resolution: dataset and study. In: The IEEE conference on computer vision and pattern recognition workshops, vol 3, p 2

    Google Scholar 

  16. Keys RG (1981) Cubic convolution interpolation for digital image processing. IEEE Trans Acoust Speech Signal Process 37:1153–1160

    Article  MathSciNet  Google Scholar 

  17. Shi W, Caballero J, Husz´ar F, Totz J, Aitken AP, Bishop R, Rueckert D, Wang Z (2016) Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1874–1883

    Google Scholar 

  18. Dong C, Loy CC, Tang X (2016) Accelerating the super-resolution convolutional neural network. In: European conference on computer vision. Springer, pp 391–407

    Google Scholar 

  19. Ledig C, Theis L, Husz´ar F, Caballero J, Cunningham A, Acosta A, Aitken A, Tejani A, Totz J, Wang Z, et al (2017) Photo-realistic single image super-resolution using a generative adversarial network. In: The IEEE conference on computer vision and pattern recognition, pp 105–114

    Google Scholar 

  20. Sergey I, Christian S (2015) Batch normalization: Accelerating deep network training by reducing internal covariate shift. In: International conference on machine learning, pp 448–456

    Google Scholar 

  21. Tim S, Diederik PK (2016) Weight normalization: A simple reparameterization to accelerate training of deep neural networks. Adv Neural Inform Process Syst 901–909

    Google Scholar 

  22. Yu JH, Fan YC, Yang JC et al (2018) Wide activation for efficient and accurate image super-resolution. In: IEEE conference on computer vision and pattern recognition

    Google Scholar 

  23. Zhao H, Shi J, Qi X, Wang X, Jia J (2017) Pyramid scene parsing network. In: The IEEE conference on computer vision and pattern recognition, pp 2881–2890

    Google Scholar 

  24. Park D, Kim K, Chun SY (2018) Efficient module based single image super resolution for multiple problems. Proceedings of CVPRW, pp 995–1003

    Google Scholar 

  25. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9

    Google Scholar 

  26. Li JC, Fang FM, Mei KF, Zhang GX (2018) Multi-scale residual network for image super-resolution. In: European conference on computer vision. Springer, pp 527–542

    Google Scholar 

  27. Huang G, Liu Z, Weinberger KQ, van der Maaten L (2017) Densely connected convolutional networks. Proceedings of CVPR, pp 2261–2269

    Google Scholar 

  28. Bevilacqua M, Roumy A, Guillemot C, Alberi-Morel ML (2012) Low-complexity single-image super-resolution based on nonnegative neighbor embedding. In: Proceedings of the 23rd British machine vision conference

    Google Scholar 

  29. Zeyde R, Elad M, Protter M (2010) On single image scale-up using sparse representations. In: International conference on curves and surfaces. Springer, pp 711–730

    Google Scholar 

  30. Arbelaez P, Maire M, Fowlkes C, Malik J (2011) Contour detection and hierarchical image segmentation. IEEE Trans Pattern Anal Mach Intell 33:898–916

    Article  Google Scholar 

  31. Huang JB, Singh A, Ahuja N (2015) Single image super-resolution from transformed self-exemplars. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5197–5206

    Google Scholar 

  32. Matsui Y, Ito K, Aramaki Y, Fujimoto A, Ogawa T, Yamasaki T, Aizawa K (2017) Sketch-based manga retrieval using manga109 dataset. Multimedia Tools Appl 76:21811–21838

    Article  Google Scholar 

  33. Timofte R, De Smet V, Van Gool L (2014) A+: adjusted anchored neighborhood regression for fast super-resolution. In: Asian conference on computer vision. Springer, pp 111–126

    Google Scholar 

  34. Ahn N, Kang B, Sohn KA (2018) Fast, accurate, and lightweight super-resolution with cascading residual network. In: European conference on computer vision. Springer, pp 256–272

    Google Scholar 

  35. Ahn N, Kang B, Sohn KA (2018) Image super-resolution via progressive cascading residual network. In: 2018 IEEE/CVF conference on computer vision and pattern recognition workshops, pp 904–912

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Surong Ying .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Ying, S., Fan, S., Wang, H. (2021). A Multi-scale Progressive Method of Image Super-Resolution. In: Lu, H. (eds) Artificial Intelligence and Robotics. ISAIR 2019. Studies in Computational Intelligence, vol 917. Springer, Cham. https://doi.org/10.1007/978-3-030-56178-9_14

Download citation

Publish with us

Policies and ethics