Skip to main content
SpringerLink
Log in

Single image super-resolution: a comprehensive review and recent insight

  • Review Article
  • Published:
Frontiers of Computer Science Aims and scope Submit manuscript

Abstract

Super-resolution (SR) is a long-standing problem in image processing and computer vision and has attracted great attention from researchers over the decades. The main concept of SR is to reconstruct images from low-resolution (LR) to high-resolution (HR). It is an ongoing process in image technology, through up-sampling, de-blurring, and de-noising. Convolution neural network (CNN) has been widely used to enhance the resolution of images in recent years. Several alternative methods use deep learning to improve the progress of image super-resolution based on CNN. Here, we review the recent findings of single image super-resolution using deep learning with an emphasis on distillation knowledge used to enhance image super-resolution., it is also to highlight the potential applications of image super-resolution in security monitoring, medical diagnosis, microscopy image processing, satellite remote sensing, communication transmission, the digital multimedia industry and video enhancement. Finally, we present the challenges and assess future trends in super-resolution based on deep learning.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Freedman G, Fattal R. Image and video upscaling from local self-examples. ACM Transactions on Graphics, 2011, 30(2): 12

    Article  Google Scholar 

  2. Glasner D, Bagon S, Irani M. Super-resolution from a single image. In: Proceedings of the 12th IEEE International Conference on Computer Vision. 2009, 349–356

  3. Yang J, Lin Z, Cohen S. Fast image super-resolution based on in-place example regression. In: Proceedings of 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2013, 1059–1066

  4. Bevilacqua M, Roumy A, Guillemot C, Morel M L A. Low-complexity single-image super-resolution based on nonnegative neighbor embedding. In: Proceedings of British Machine Vision Conference (BMVC). 2012, 135.1–135.10

  5. Chang H, Yeung D-Y, Xiong Y. Super-resolution through neighbor embedding. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004.; vol. 1. 2004, I–I

  6. Freeman W T, Pasztor E C, Carmichael O T. Learning low-level vision. International Journal of Computer Vision, 2000, 40(1): 25–47

    Article  MATH  Google Scholar 

  7. Jia K, Wang X, Tang X. Image transformation based on learning dictionaries across image spaces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2013, 35(2): 367–380

    Article  Google Scholar 

  8. Timofte R, De Smet V, Van Gool L. Anchored neighborhood regression for fast example-based super-resolution. In: Proceedings of 2013 IEEE International Conference on Computer Vision. 2013, 1920–1927

  9. Yang J, Wang Z, Lin Z, Cohen S, Huang T. Coupled dictionary training for image super-resolution. IEEE Transactions on Image Processing, 2012, 21(8): 3467–3478

    Article  MathSciNet  MATH  Google Scholar 

  10. Yang J, Wright J, Huang T, Ma Y. Image super-resolution as sparse representation of raw image patches. In: Proceedings of 2008 IEEE Conference on Computer Vision and Pattern Recognition. 2008, 1–8

  11. Yang J, Wright J, Huang T S, Ma Y. Image super-resolution via sparse representation. IEEE Transactions on Image Processing, 2010, 19(11): 2861–2873

    Article  MathSciNet  MATH  Google Scholar 

  12. Zeyde R, Elad M, Protter M. On single image scale-up using sparse-representations. In: Proceedings of the 7th International Conference on Curves and Surfaces. 2010, 711–730

  13. Yang W, Zhang X, Tian Y, Wang W, Xue J H, Liao Q. Deep learning for single image super-resolution: a brief review. IEEE Transactions on Multimedia, 2019, 21(12): 3106–3121

    Article  Google Scholar 

  14. Zhou L, Feng S. A review of deep learning for single image superresolution. In: Proceedings of International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS). 2019, 139–142

  15. Ha V K, Ren J, Xu X, Zhao S, Xie G, Vargas V M. Deep learning based single image super-resolution: A survey. In: Proceedings of the 9th International Conference on Brain Inspired Cognitive Systems. 2018, 106–119

  16. Zhang H, Wang P, Zhang C, Jiang Z. A comparable study of CNN-based single image super-resolution for space-based imaging sensors. Sensors, 2019, 19(14): 3234

    Article  Google Scholar 

  17. Dong C, Loy C C, He K, Tang X. Image super-resolution using deep convolutional networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 38(2): 295–307

    Article  Google Scholar 

  18. Kim J, Lee J K, Lee K M. Accurate image super-resolution using very deep convolutional networks. In: Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. 2016, 1646–1654

  19. Dong C, Loy C C, Tang X. Accelerating the super-resolution convolutional neural network. In: Proceedings of the 14th European Conference on Computer Vision. 2016, 391–407

  20. Kim J, Lee J K, Lee K M. Deeply-recursive convolutional network for image super-resolution. In: Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. 2016, 1637–1645

  21. Li X, Wu Y, Zhang W, Wang R, Hou F. Deep learning methods in real-time image super-resolution: a survey. Journal of Real-Time Image Processing, 2020, 17(6): 1885–1909

    Article  Google Scholar 

  22. Wang Z, Chen J, Hoi S C H. Deep learning for image super-resolution: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021, 43(10): 3365–3387

    Article  Google Scholar 

  23. Bashir S M A, Wang Y, Khan M, Niu Y. A comprehensive review of deep learning-based single image super-resolution. PeerJ Computer Science, 2021, 7: e621

    Article  Google Scholar 

  24. Liu A, Liu Y, Gu J, Qiao Y, Dong C. Blind image super-resolution: A survey and beyond. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022: 1–9

  25. Zhu H, Xie C, Fei Y, Tao H. Attention mechanisms in CNN-based single image super-resolution: a brief review and a new perspective. Electronics, 2021, 10(10): 1187

    Article  Google Scholar 

  26. Tian J, Ma K K. A survey on super-resolution imaging. Signal, Image and Video Processing, 2011, 5(3): 329–342

    Article  Google Scholar 

  27. Shah A J, Gupta S B. Image super resolution-a survey. In: Proceedings of the 1st International Conference on Emerging Technology Trends in Electronics, Communication & Networking. 2012, 1–6

  28. Ghesu F C, Köhler T, Haase S, Hornegger J. Guided image superresolution: a new technique for photogeometric super-resolution in hybrid 3-D range imaging. In: Jiang X, Hornegger J, Koch R, eds. Pattern Recognition. Cham: Springer, 2014, 227–238

    Chapter  Google Scholar 

  29. Moitra S. Single-image super-resolution techniques: a review. International Journal for Science and Advance Research in Technology, 2017, 3(4): 271–283

    Google Scholar 

  30. Huang D, Liu H. A short survey of image super resolution algorithms. Journal of Computer Science Technology Updates, 2015, 2(2): 19–29

    Article  Google Scholar 

  31. Schultz R R, Stevenson R L. A Bayesian approach to image expansion for improved definition. IEEE Transactions on Image Processing, 1994, 3(3): 233–242

    Article  Google Scholar 

  32. Wang Y, Wan W, Wang R, Zhou X. An improved interpolation algorithm using nearest neighbor from VTK. In: Proceedings of 2010 International Conference on Audio, Language and Image Processing. 2010, 1062–1065

  33. Titus J, Geroge S. A comparison study on different interpolation methods based on satellite images. International Journal of Engineering Research & Technology, 2013, 2(6): 82–85

    Google Scholar 

  34. Parsania P, Virparia D. A review: Image interpolation techniques for image scaling. International Journal of Innovative Research in Computer and Communication Engineering, 2014, 2(12): 7409–7414

    Article  Google Scholar 

  35. Li X, Orchard M T. New edge-directed interpolation. IEEE Transactions on Image Processing, 2001, 10(10): 1521–1527

    Article  Google Scholar 

  36. Gavade A B, Sane P. Super resolution image reconstruction by using bicubic interpolation. In: Proceedings of National Conference on Advanced Technologies in Electrical and Electronic Systems. 2014, 1

  37. Irani M, Peleg S. Improving resolution by image registration. CVGIP: Graphical Models and Image Processing, 1991, 53(3): 231–239

    Google Scholar 

  38. Nayak R, Patra D. Enhanced iterative back-projection based superresolution reconstruction of digital images. Arabian Journal for Science and Engineering, 2018, 43(12): 7521–7547

    Article  Google Scholar 

  39. Stark H, Oskoui P. High-resolution image recovery from image-plane arrays, using convex projections. Journal of the Optical Society of America A, 1989, 6(11): 1715–1726

    Article  Google Scholar 

  40. Fan C, Wu C, Li G, Ma J. Projections onto convex sets superresolution reconstruction based on point spread function estimation of low-resolution remote sensing images. Sensors, 2017, 17(2): 362

    Article  Google Scholar 

  41. Schultz R R, Stevenson R L. Improved definition video frame enhancement. In: Proceedings of 1995 International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 1995, 2169–2172

  42. Schultz R R, Stevenson R L. Extraction of high-resolution frames from video sequences. IEEE Transactions on Image Processing, 1996, 5(6): 996–1011

    Article  Google Scholar 

  43. Besag J. On the statistical analysis of dirty pictures. Journal of the Royal Statistical Society: Series B: (Methodological), 1986, 48(3): 259–279

    Article  MathSciNet  MATH  Google Scholar 

  44. Homem M R P, Martins A L D, Mascarenhas N D A. Super-resolution image reconstruction using the discontinuity adaptive ICM. 1994. Poster, https://www.dca.fee.unicamp.br/~ting/misc/anais-poster-2007/posters/33629.pdf

  45. Timofte R, De Smet V, Van Gool L. A+: Adjusted anchored neighborhood regression for fast super-resolution. In: Proceedings of the 12th Asian Conference on Computer Vision. 2014, 111–126

  46. Wen Y, Sheng B, Li P, Lin W, Feng D D. Deep color guided coarse-to-fine convolutional network cascade for depth image super-resolution. IEEE Transactions on Image Processing, 2019, 28(2): 994–1006

    Article  MathSciNet  MATH  Google Scholar 

  47. Tai Y, Yang J, Liu X. Image super-resolution via deep recursive residual network. In: Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2017, 2790–2798

  48. Hui Z, Gao X, Yang Y, Wang X. Lightweight image super-resolution with information multi-distillation network. In: Proceedings of the 27th ACM International Conference on Multimedia. 2019, 2024–2032

  49. Ahn N, Kang B, Sohn K A. Fast, accurate, and lightweight super-resolution with cascading residual network. In: Proceedings of the 15th European Conference on Computer Vision. 2018, 256–272

  50. Zhu F, Zhao Q. Efficient single image super-resolution via hybrid residual feature learning with compact back-projection network. In: Proceedings of 2019 IEEE/CVF International Conference on Computer Vision Workshop. 2019, 2453–2460

  51. Li J, Fang F, Mei K, Zhang G. Multi-scale residual network for image super-resolution. In: Proceedings of the 15th European Conference on Computer Vision (ECCV). 2018, 517–532

  52. Liu J, Tang J, Wu G. Residual feature distillation network for lightweight image super-resolution. In: Proceedings of European Conference on Computer Vision. 2020, 41–55

  53. Li W, Li J, Li J, Huang Z, Zhou D. A lightweight multi-scale channel attention network for image super-resolution. Neurocomputing, 2021, 456: 327–337

    Article  Google Scholar 

  54. Zhang Y, Li K, Li K, Wang L, Zhong B, Fu Y. Image super-resolution using very deep residual channel attention networks. In: Proceedings of 15th European Conference on Computer Vision (ECCV). 2018, 294–310

  55. Hu J, Shen L, Sun G. Squeeze-and-excitation networks. In: Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018, 7132–7141

  56. Cheng X, Li X, Yang J, Tai Y. SESR: Single image super resolution with recursive squeeze and excitation networks. In: Proceedings of the 24th International Conference on Pattern Recognition (ICPR). 2018, 147–152

  57. Roy A G, Navab N, Wachinger C. Concurrent spatial and channel ‘squeeze & excitation’ in fully convolutional networks. In: Proceedings of 21st International Conference on Medical Image Computing and Computer-Assisted Intervention. 2018, 421–429

  58. Dai T, Cai J, Zhang Y, Xia S T, Zhang L. Second-order attention network for single image super-resolution. In: Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2019, 11057–11066

  59. Choi J S, Kim M. A deep convolutional neural network with selection units for super-resolution. In: Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). 2017, 1150–1156

  60. Anwar S, Barnes N. Densely residual Laplacian super-resolution. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 44(3): 1192–1204

    Article  Google Scholar 

  61. Zhang Y, Li K, Li K, Zhong B, Fu Y. Residual non-local attention networks for image restoration. 2019, arXiv preprint arXiv: 1903.10082

  62. Hu Y, Li J, Huang Y, Gao X. Channel-wise and spatial feature modulation network for single image super-resolution. IEEE Transactions on Circuits and Systems for Video Technology, 2020, 30(11): 3911–3927

    Article  Google Scholar 

  63. Kim J H, Choi J H, Cheon M, Lee J S. Ram: Residual attention module for single image super-resolution. 2018, arXiv preprint arXiv: 1811.12043v1

  64. Liu J, Zhang W, Tang Y, Tang J, Wu G. Residual feature aggregation network for image super-resolution. In: Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2020, 2356–2365

  65. Zheng Z, Jiao Y, Fang G. Upsampling attention network for single image super-resolution. In: Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications. 2021, 399–406

  66. Lim B, Son S, Kim H, Nah S, Lee K M. Enhanced deep residual networks for single image super-resolution. In: Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). 2017, 1132–1140

  67. Zhang K, Zuo W, Zhang L. Learning a single convolutional super-resolution network for multiple degradations. In: Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018, 3262–3271

  68. Zhang Y, Tian Y, Kong Y, Zhong B, Fu Y. Residual dense network for image super-resolution. In: Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018, 2472–2481

  69. Tong T, Li G, Liu X, Gao Q. Image super-resolution using dense skip connections. In: Proceedings of 2017 IEEE International Conference on Computer Vision (ICCV). 2017, 4809–4817

  70. Wang W, Li X, Yang J, Lu T. Mixed link networks. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence. 2018, 2819–2825

  71. Shi W, Caballero J, Huszár F, Totz J, Aitken A P, Bishop R, Rueckert D, Wang Z. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2016, 1874–1883

  72. Haris M, Shakhnarovich G, Ukita N. Deep back-projection networks for super-resolution. In: Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018, 1664–1673

  73. Dun Y, Da Z, Yang S, Xue Y, Qian X. Kernel-attended residual network for single image super-resolution. Knowledge-Based Systems, 2021, 213: 106663

    Article  Google Scholar 

  74. Ledig C, Theis L, Huszár F, Caballero J, Cunningham A, Acosta A, Aitken A, Tejani A, Totz J, Wang Z, Shi W. Photo-realistic single image super-resolution using a generative adversarial network. In: Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2017, 105–114

  75. Shocher A, Cohen N, Irani M. Zero-shot super-resolution using deep internal learning. In: Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2018, 3118–3126

  76. Wang X, Yu K, Wu S, Gu J, Liu Y, Dong C, Qiao Y, Loy CC. ESRGAN: Enhanced super-resolution generative adversarial networks. In: Proceedings of European Conference on Computer Vision. 2018, 63–79

  77. Jolicoeur-Martineau A. The relativistic discriminator: a key element missing from standard GAN. In: Proceedings of the 7th International Conference on Learning Representations. 2019

  78. Szegedy C, Ioffe S, Vanhoucke V, Alemi A A. Inception-v4, inception-resnet and the impact of residual connections on learning. In: Proceedings of the 31st AAAI Conference on Artificial Intelligence. 2017, 4278–4284

  79. Zhang W, Liu Y, Dong C, Qiao Y. RankSRGAN: Generative adversarial networks with ranker for image super-resolution. In: Proceedings of 2019 IEEE/CVF International Conference on Computer Vision. 2019, 3096–3105

  80. Maeda S. Unpaired image super-resolution using pseudo-supervision. In: Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2020, 288–297

  81. Bell-Kligler S, Shocher A, Irani M. Blind super-resolution kernel estimation using an internal-GAN. In: Proceedings of the 33rd International Conference on Neural Information Processing Systems. 2019, 26

  82. Gu J, Lu H, Zuo W, Dong C. Blind super-resolution with iterative kernel correction. In: Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2019, 1604–1613

  83. Michaeli T, Irani M. Nonparametric blind super-resolution. In: Proceedings of IEEE International Conference on Computer Vision. 2013, 945–952

  84. Ren D, Zhang K, Wang Q, Hu Q, Zuo W. Neural blind deconvolution using deep priors. In: Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2020, 3338–3347

  85. Zhang K, Gool L V, Timofte R. Deep unfolding network for image super-resolution. In: Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2020, 3214–3223

  86. Liang J, Zhang K, Gu S, Gool L V, Timofte R. Flow-based kernel prior with application to blind super-resolution. In: Proceedings of 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2021, 10596–10605

  87. Luo Z, Huang Y, Li S, Wang L, Tan T. Unfolding the alternating optimization for blind super resolution. In: Proceedings of the 34th International Conference on Neural Information Processing Systems. 2020

  88. Wang L, Wang Y, Dong X, Xu Q, Yang J, An W, Guo Y. Unsupervised degradation representation learning for blind superresolution. In: Proceedings of 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2021, 10576–10585

  89. Gandelsman Y, Shocher A, Irani M. “Double-DIP”: Unsupervised image decomposition via coupled deep-image-Priors. In: Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2019, 11018–11027

  90. Cornillère V, Djelouah A, Wang Y. Sorkine-Hornung O, Schroers C. Blind image super-resolution with spatially variant degradations. ACM Transactions on Graphics, 2019, 38(6): 166

    Article  Google Scholar 

  91. He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2016, 770–778

  92. Gou J, Yu B, Maybank S J, Tao D. Knowledge distillation: a survey. International Journal of Computer Vision, 2021, 129(6): 1789–1819

    Article  Google Scholar 

  93. Gao Q, Zhao Y, Li G, Tong T. Image super-resolution using knowledge distillation. In: Proceedings of the 14th Asian Conference on Computer Vision (ACCV). 2018, 527–541

  94. He Z, Dai T, Lu J, Jiang Y, Xia S T. Fakd: feature-affinity based knowledge distillation for efficient image super-resolution. In: Proceedings of 2020 IEEE International Conference on Image Processing (ICIP). 2020, 518–522

  95. Lee W, Lee J, Kim D, Ham B. Learning with privileged information for efficient image super-resolution. In: Proceedings of the 16th European Conference on Computer Vision. 2020, 465–482

  96. Zhang L, Wang P, Shen C, Liu L, Wei W, Zhang Y, Van Den Hengel A. Adaptive importance learning for improving lightweight image super-resolution network. International Journal of Computer Vision, 2020, 128(2): 479–499

    Article  MathSciNet  Google Scholar 

  97. Hui Z, Wang X, Gao X. Fast and accurate single image superresolution via information distillation network. In: Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018, 723–731

  98. Zhang Y, Chen H, Chen X, Deng Y, Xu C, Wang Y. Data-free knowledge distillation for image super-resolution. In: Proceedings of 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2021, 7848–7857

  99. Jiang K, Wang Z, Yi P, Jiang J, Xiao J, Yao Y. Deep distillation recursive network for remote sensing imagery super-resolution. Remote Sensing, 2018, 10(11): 1700

    Article  Google Scholar 

  100. Lu T, Yang W, Wan Y. Super-resolution for surveillance video via adaptive block-matching registration. In: Proceedings of 2015 International Conference on Artificial Intelligence and Industrial Engineering. 2015, 1–3

  101. Shao J, Chao F, Luo M, Lin J. A super-resolution reconstruction algorithm for surveillance video. Journal of Forensic Science and Medicine, 2017, 3(1): 26

    Article  Google Scholar 

  102. Ghazali N N A N, Zamani N A, Abdullah S N H S, Jameson J. Super resolution combination methods for CCTV forensic interpretation. In: Proceedings of the 12th International Conference on Intelligent Systems Design and Applications (ISDA). 2012, 853–858

  103. Yu H, Liu D, Shi H, Yu H, Wang Z, Wang X, Cross B, Bramler M, Huang T S. Computed tomography super-resolution using convolutional neural networks. In: Proceedings of 2017 IEEE International Conference on Image Processing (ICIP). 2017, 3944–3948

  104. Greenspan H, Oz G, Kiryati N, Peled S. MRI inter-slice reconstruction using super-resolution. Magnetic Resonance Imaging, 2002, 20(5): 437–446

    Article  MATH  Google Scholar 

  105. Yu J, Lavery L, Kim K. Super-resolution ultrasound imaging method for microvasculature in vivo with a high temporal accuracy. Scientific Reports, 2018, 8(1): 13918

    Article  Google Scholar 

  106. Isaac J S, Kulkarni R. Super resolution techniques for medical image processing. In: Proceedings of 2015 International Conference on Technologies for Sustainable Development (ICTSD). 2015, 1–6

  107. Park S C, Park M K, Kang M G. Super-resolution image reconstruction: a technical overview. IEEE Signal Processing Magazine, 2003, 20(3): 21–36

    Article  Google Scholar 

  108. Kouame D, Ploquin M. Super-resolution in medical imaging: An illustrative approach through ultrasound. In: Proceedings of 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro. 2009, 249–252

  109. He S, Tian Y, Feng S, Wu Y, Shen X, Chen K, He Y, Sun Q, Li X, Xu J, Wen Z L, Qu J Y. In vivo single-cell lineage tracing in zebrafish using high-resolution infrared laser-mediated gene induction microscopy. eLife, 2020, 9: e52024

    Article  Google Scholar 

  110. Jones M G, Khodaverdian A, Quinn J J, Chan M M, Hussmann J A, Wang R, Xu C, Weissman J S, Yosef N. Inference of single-cell phylogenies from lineage tracing data using Cassiopeia. Genome Biology, 2020, 21: 92

    Article  Google Scholar 

  111. Andresen V, Pollok K, Rinnenthal J L, Oehme L, Günther R, Spiecker H, Radbruch H, Gerhard J, Sporbert A, Cseresnyes Z, Hauser A E, Niesner R. High-resolution intravital microscopy. PLoS One, 2012, 7(12): e50915

    Article  Google Scholar 

  112. Small A, Stahlheber S. Fluorophore localization algorithms for super-resolution microscopy. Nature Methods, 2014, 11(3): 267–279

    Article  Google Scholar 

  113. Orrit M. Celebrating optical nanoscopy. Nature Photonics, 2014, 8(12): 887

    Article  Google Scholar 

  114. Singh A, Sidhu J S. Super resolution applications in modern digital image processing. International Journal of Computer Applications, 2016, 150(2): 6–8

    Article  Google Scholar 

  115. UI Hoque M R, Burks R, Kwan C, Li J. Deep learning for remote sensing image super-resolution. In: Proceedings of the 10th IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON). 2019, 286–292

  116. Zhu H, Tang X, Xie J, Song W, Mo F, Gao X. Spatio-temporal superresolution reconstruction of remote-sensing images based on adaptive multi-scale detail enhancement. Sensors, 2018, 18(2): 498

    Article  Google Scholar 

  117. Guo J, Gong X, Wang W, Que X, Liu J. SASRT: semantic-aware super-resolution transmission for adaptive video streaming over wireless multimedia sensor networks. Sensors, 2019, 19(14): 3121

    Article  Google Scholar 

  118. Mithra K, Vishvaksenan K S. Security and resolution enhanced transmission of medical image through IDMA aided coded STTD system. In: Proceedings of 2017 International Conference on Communication and Signal Processing (ICCSP). 2017, 2061–2065

  119. Hayat K. Multimedia super-resolution via deep learning: a survey. Digital Signal Processing, 2018, 81: 198–217

    Article  Google Scholar 

  120. Bishop C M, Blake A, Marthi B. Super-resolution enhancement of video. In: Proceedings of the 9th International Workshop on Artificial Intelligence and Statistics. 2003, 25–32

  121. Del Gallego N P, Ilao J. Multiple-image super-resolution on mobile devices: an image warping approach. EURASIP Journal on Image and Video Processing, 2017, 2017(1): 8

    Article  Google Scholar 

  122. Hassaballah M, Hosny K M. Recent Advances in Computer Vision: Theories and Applications. Cham: Springer, 2018

    Google Scholar 

  123. Liu D, Soran B, Petrie G, Shapiro L. A review of computer vision segmentation algorithms. 2012Lecture notes 53, 2012.

  124. Liu F, Wang J, Zhu S, Gleicher M, Gong Y. Visual-quality optimizing super resolution. Computer Graphics Forum, 2009, 28(1): 127–140

    Article  Google Scholar 

  125. Hirst D, Rilliard A, Aubergé V. Comparison of subjective evaluation and an objective evaluation metric for prosody in text-to-speech synthesis. In: Proceedings of the 3rd ESCA/COCOSDA Workshop on Speech Synthesis. 1998, 1–4

  126. A. R. Reibman and T. Schaper, “Subjective performance evaluation for super-resolution image enhancement,” in Second Int. Wkshp on Video Proc. and Qual. Metrics (VPQM’06), 2006 https://ece.uwaterloo.ca/~z70wang/publications/ICIP12b.pdf

  127. Opozda S, Sochan A. The survey of subjective and objective method for quality assessment of 2D and 3D images. Theoretical and Applied Informatics, 2014, 26(1–2): 39–67

    Google Scholar 

  128. Th. Alpert and J.-P. Evain, “Subjective quality evaluation - the SSCQE and DSCQE methodologies,” EBU technical review, Spring, See tech.ebu.ch/docs/techreview/trev_271-evain.pdf website, 1997, 12–20

  129. Int. Telecommun. Union, Methodology for the Subjective Assessment of the Quality of Television Pictures ITU-R Recommendation BT.500-9, Tech. Rep., See itu.int/rec/R-REC-BT.500-11-200206-S/en website, 2002

  130. Wang Z, Bovik A C, Sheikh H R, Simoncelli E P. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 2004, 13(4): 600–612

    Article  Google Scholar 

  131. Yan B, Bare B, Ma C, Li K, Tan W. Deep objective quality assessment driven single image super-resolution. IEEE Transactions on Multimedia, 2019, 21(11): 2957–2971

    Article  Google Scholar 

  132. Sheikh H R, Bovik A C, De Veciana G. An information fidelity criterion for image quality assessment using natural scene statistics. IEEE Transactions on Image Processing, 2005, 14(12): 2117–2128

    Article  Google Scholar 

  133. Sheikh H R, Bovik A C. A visual information fidelity approach to video quality assessment. In: The first international workshop on video processing and quality metrics for consumer electronics; vol. 7. 2005, 2117–2128

    Google Scholar 

  134. Yeganeh H, Rostami M, Wang Z. Objective quality assessment for image super-resolution: a natural scene statistics approach. In: Proceedings of the 19th IEEE International Conference on Image Processing. 2012, 1481–1484

  135. Wang X, Jiang G, Yu M. Reduced reference image quality assessment based on Contourlet domain and natural image statistics. In: Proceedings of the 5th International Conference on Image and Graphics. 2009, 45–50

  136. Al Madeed N, Awan Z, Al Madeed S. Image quality assessment-a survey of recent approaches. In: Proceedings of the 8th International Conference on Computer Science, Engineering and Applications. 2018, 143–156

  137. Keshk H M, Abdel-Aziem M M, Ali A S, Assal M A. Performance evaluation of quality measurement for super-resolution satellite images. In: Proceedings of 2014 Science and Information Conference. 2014, 364–371

  138. Zhu X, Cheng Y, Peng J, Wang R, Le M, Liu X. Super-resolved image perceptual quality improvement via multifeature discriminators. Journal of Electronic Imaging, 2020, 29(1): 013017

    Article  Google Scholar 

  139. Blau Y, Michaeli T. The perception-distortion tradeoff. In: Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018, 6228–6237

  140. Mittal A, Soundararajan R, Bovik A C. Making a “completely blind” image quality analyzer. IEEE Signal Processing Letters, 2012, 20(3): 209–212

    Article  Google Scholar 

  141. Ma C, Yang C Y, Yang X, Yang M H. Learning a no-reference quality metric for single-image super-resolution. Computer Vision and Image Understanding, 2017, 158: 1–16

    Article  Google Scholar 

  142. Blau Y, Mechrez R, Timofte R, Michaeli T, Zelnik-Manor L. The 2018 PIRM challenge on perceptual image super-resolution. In: Proceedings of European Conference on Computer Vision. 2018, 334–355

Download references

Acknowledgements

This work was supported in part by the National Natural Science Foundation of China (Grant No. 62072328).

Author information

Authors and Affiliations

  1. College of Intelligence and Computing, Tianjin University, Tianjin, 300350, China

    Hanadi Al-Mekhlafi & Shiguang Liu

Authors
  1. Hanadi Al-Mekhlafi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shiguang Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shiguang Liu.

Additional information

Hanadi AL-Mekhlafi received the Master degree from School of Software Engineering, South China University of Technology, China. She is currently studying for PhD degree in the College of Intelligence and Computing, Tianjin University, China. Her research interests include image/video processing, computer graphics, deep learning.

Shiguang Liu (Senior Member, IEEE) received the PhD degree from the State Key Laboratory of CAD and CG, Zhejiang University, China. He is currently a Professor with the College of Intelligence and Computing, Tianjin University, China. His research interests include image/video processing, computer graphics, visualization, and virtual reality.

Electronic Supplementary Material

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Al-Mekhlafi, H., Liu, S. Single image super-resolution: a comprehensive review and recent insight. Front. Comput. Sci. 18, 181702 (2024). https://doi.org/10.1007/s11704-023-2588-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11704-023-2588-9

Keywords

Search

Navigation