Skip to main content
SpringerLink
Log in

Deep artifact-free residual network for single-image super-resolution

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Recently, convolutional neural networks have shown promising performance for single-image super-resolution. In this paper, we propose deep artifact-free residual (DAFR) network which uses the merits of both residual learning and usage of ground-truth image as target. Our framework uses a deep model to extract the high-frequency information which is necessary for high-quality image reconstruction. We use a skip connection to feed the low-resolution image to network before the image reconstruction. In this way, we are able to use the ground-truth images as target and avoid misleading the network due to artifacts in difference image. In order to extract clean high-frequency information, we train network in two steps. First step is a traditional residual learning which uses the difference image as target. Then, the trained parameters of this step are transferred to the main training in second step. Our experimental results show that the proposed method achieves better quantitative and qualitative image quality compared to the existing methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Duchon, C.E.: Lanczos filtering in one and two dimensions. J. Appl. Meteorol. 18, 1016–1022 (1979)

    Article  Google Scholar 

  2. Sun, J., Xu, Z., Shum, H.-Y.: Image super-resolution using gradient profile prior. In: 2008 IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2008, pp. 1–8 (2008)

  3. Kim, K.I., Kwon, Y.: Single-image super-resolution using sparse regression and natural image prior. IEEE Trans. Pattern Anal. Mach. Intell. 32, 1127–1133 (2010)

    Article  Google Scholar 

  4. Timofte, R., De Smet, V., Van Gool, L.: A+: adjusted anchored neighborhood regression for fast super-resolution. In: Asian Conference on Computer Vision, pp. 111–126 (2014)

  5. Yang, C.-Y., Yang, M.-H.: Fast direct super-resolution by simple functions. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 561–568 (2013)

  6. Yang, J., Wright, J., Huang, T.S., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19, 2861–2873 (2010)

    Article  MathSciNet  Google Scholar 

  7. Schulter, S., Leistner, C., Bischof, H.: Fast and accurate image upscaling with super-resolution forests. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3791–3799 (2015)

  8. Dong, C., Loy, C.C., He, K., Tang, X.: Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38, 295–307 (2016)

    Article  Google Scholar 

  9. Dong, C., Loy, C.C., Tang, X.: Accelerating the super-resolution convolutional neural network. In: European Conference on Computer Vision, pp. 391–407 (2016)

  10. Kim, J., Kwon Lee, J., Mu Lee, K.: Accurate image super-resolution using very deep convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1646–1654 (2016)

  11. Kim, J., Kwon Lee, J., Mu Lee, K.: Deeply-recursive convolutional network for image super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1637–1645 (2016)

  12. Shah, A., Kadam, E., Shah, H., Shinde, S., Shingade, S.: Deep residual networks with exponential linear unit. In: Proceedings of the Third International Symposium on Computer Vision and the Internet, pp. 59–65 (2016)

  13. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

  14. Sidike, P., Krieger, E., Alom, M.Z., Asari, V.K., Taha, T.: A fast single-image super-resolution via directional edge-guided regularized extreme learning regression. Signal Image Video Process. 11, 961–968 (2017)

    Article  Google Scholar 

  15. Yang, C.-Y., Ma, C., Yang, M.-H.: Single-image super-resolution: a benchmark. In: European Conference on Computer Vision, pp. 372–386 (2014)

  16. Glasner, D., Bagon, S., Irani, M.: Super-resolution from a single image. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 349–356 (2009)

  17. Huang, J.-B., Singh, A., Ahuja, N.: Single image super-resolution from transformed self-exemplars. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5197–5206 (2015)

  18. Chaudhry, A.M., Riaz, M.M., Ghafoor, A.: Super-resolution based on self-example learning and guided filtering. Signal Image Video Process. 13, 237–244 (2019)

    Article  Google Scholar 

  19. Bevilacqua, M., Roumy, A., Guillemot, C., Alberi-Morel, M.L.: Low-complexity single-image super-resolution based on nonnegative neighbor embedding. In: Proceedings of the 23rd British Machine Vision Conference (BMVC), pp. 135.1–135.10. BMVA Press (2012) (ISBN 1-901725-46-4)

  20. Freeman, W.T., Jones, T.R., Pasztor, E.C.: Example-based super-resolution. IEEE Comput. Graph. Appl. 22, 56–65 (2002)

    Article  Google Scholar 

  21. Jianchao, Y., Wright, J., Huang, T., Ma, Y.: Image super-resolution as sparse representation of raw image patches. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)

  22. Dong, W., Zhang, L., Lukac, R., Shi, G.: Sparse representation based image interpolation with nonlocal autoregressive modeling. IEEE Trans. Image Process. 22, 1382–1394 (2013)

    Article  MathSciNet  Google Scholar 

  23. He, K., Zhang, X., Ren, S., Sun, J.: Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans. Pattern Anal. Mach. Intell. 37, 1904–1916 (2015)

    Article  Google Scholar 

  24. Nejati, H., Ghazijahani, H.A., Abdollahzadeh, M., Malekzadeh, T., Cheung, N.-M., Lee, K.H., et al.: Fine-grained wound tissue analysis using deep neural network. arXiv preprint arXiv:1802.10426 (2018)

  25. Song, S., Cheung, N.-M., Chandrasekhar, V., Mandal, B.: Deep Adaptive Temporal Pooling for Activity Recognition. arXiv preprint arXiv:1808.07272 (2018)

  26. Malekzadeh, T., Abdollahzadeh, M., Nejati, H., Cheung, N.-M.: Aircraft Fuselage Defect Detection Using Deep Neural Networks. arXiv preprint arXiv:1712.09213 (2017)

  27. Hoang, T., Do, T.-T., Le Tan, D.-K., Cheung, N.-M.: Selective deep convolutional features for image retrieval. In: Proceedings of the 2017 ACM on Multimedia Conference, pp. 1600–1608 (2017)

  28. Abdollahzadeh, M., Malekzadeh, T., Seyedarabi, H.: Multi-focus image fusion for visual sensor networks. In: 2016 24th Iranian Conference on Electrical Engineering (ICEE), pp. 1673–1677 (2016)

  29. Zhang, Y., Tian, Y., Kong, Y., Zhong, B., Fu, Y.: Residual dense network for image super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2472–2481 (2018)

  30. Wang, Y., Wang, L., Wang, H., Li, P.: End-to-end image super-resolution via deep and shallow convolutional networks. IEEE Access 7, 31959–31970 (2019)

    Article  Google Scholar 

  31. Wen, Y., Sheng, B., Li, P., Lin, W., Feng, D.D.: Deep color guided coarse-to-fine convolutional network cascade for depth image super-resolution. IEEE Trans. Image Process. 28, 994–1006 (2019)

    Article  MathSciNet  Google Scholar 

  32. Xie, C., Liu, Y., Zeng, W., Lu, X.: An improved method for single image super-resolution based on deep learning. Signal Image Video Process. 13, 1–9 (2018)

    Google Scholar 

  33. He, K., Zhang, X., Ren, S., Sun, J.: Delving deep into rectifiers: surpassing human-level performance on imagenet classification. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1026–1034 (2015)

  34. Zeiler, M.D., Fergus, R.: Visualizing and understanding convolutional networks. In: European Conference on Computer Vision, pp. 818–833 (2014)

  35. Bishop, C.M.: Neural Networks for Pattern Recognition. Oxford University Press, Oxford (1995)

    MATH  Google Scholar 

  36. Chatfield, K., Simonyan, K., Vedaldi, A., Zisserman, A.: Return of the devil in the details: delving deep into convolutional nets. arXiv preprint arXiv:1405.3531 (2014)

  37. Pascanu, R., Mikolov, T., Bengio, Y.: On the difficulty of training recurrent neural networks. In: International Conference on Machine Learning, pp. 1310–1318 (2013)

  38. Dong, C., Loy, C.C., He, K., Tang, X.: Learning a deep convolutional network for image super-resolution. In: European Conference on Computer Vision, pp. 184–199 (2014)

  39. Zeyde, R., Elad, M., Protter, M.: On single image scale-up using sparse-representations. In: International Conference on Curves and Surfaces, pp. 711–730 (2010)

  40. Martin, D., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Eighth IEEE International Conference on Computer Vision. ICCV 2001. Proceedings, pp. 416–423 (2001)

  41. Xiang, X., Zhai, M., Zhang, R., Qiao, Y., El Saddik, A.: Deep optical flow supervised learning with prior assumptions. IEEE Access 6, 43222–43232 (2018)

    Article  Google Scholar 

  42. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86, 2278–2324 (1998)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Islamic Azad University, Science and Research Branch, Tehran, Iran

    Hamdollah Nasrollahi, Kamran Farajzadeh & Vahid Hosseini

  2. Amirkabir University of Technology, Tehran, Iran

    Esmaeil Zarezadeh

  3. Faculty of Electrical and Computer Engineering, University of Tabriz, Tabriz, Iran

    Milad Abdollahzadeh

  4. Singapore University of Technology and Design (SUTD), Singapore, Singapore

    Milad Abdollahzadeh

Authors
  1. Hamdollah Nasrollahi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kamran Farajzadeh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Vahid Hosseini
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Esmaeil Zarezadeh
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Milad Abdollahzadeh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Milad Abdollahzadeh.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nasrollahi, H., Farajzadeh, K., Hosseini, V. et al. Deep artifact-free residual network for single-image super-resolution. SIViP 14, 407–415 (2020). https://doi.org/10.1007/s11760-019-01569-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-019-01569-3

Keywords

Search

Navigation