Skip to main content
SpringerLink
Log in

Chest X-ray images super-resolution reconstruction via recursive neural network

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

To address the problems of insufficient detail extraction and long training time in the super-resolution reconstruction of chest X-ray images, a method of chest X-ray images super-resolution reconstruction using recursive neural network is proposed in this paper. Firstly, this paper designs a lightweight recursive network as the main branch, which solves the problem of training difficulty and time-consuming. Then, to overcome the lack of detail extraction in chest X-ray image, a detail complementary model is designed as another branch of the network to solve the problem of shallow information loss. Finally, the optimized activation function is used to reduce the loss of texture details and make the reconstructed image more complete and richer. When the scale factor is 2, the experimental results show that compared with other methods based on deep learning, such as the deep recursive neural network (DRCN), the details of chest X-ray images reconstructed by our method are more abundant. Specifically, the average value of PSNR and SSIM were improved by 0.17 dB and 0.0013 respectively. Moreover, the reconstruction speed of the images was increased by about 16% compared with DRCN.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. M Batz, A Eichenseer, J Selier, M Jonscher, A Kaup (2015). Hybrid super-resolution combining example-based single-image and interpolation-based multi-image reconstruction approaches, IEEE International Conference on Image Processing (ICIP) 58–62

  2. Bengio Y, Simard P, Frasconi P (1994) Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Netw 5(2):157–166

    Article  Google Scholar 

  3. Chen Y, Shi F, Christodoulou AG, Xie Y, Zhou Z, Li D (2018) Efficient and accurate MRI super-resolution using a generative adversarial network and 3D multi-level densely connected network. In: International conference on medical image computing and computer-assisted intervention. Springer, Cham, pp 91–99

    Google Scholar 

  4. Dong C, Loy CC, He KM et al (2019) Image super-resolution using deep convolutional networks. IEEE Trans Pattern Anal Mach Intell 38(2):295–307

    Article  Google Scholar 

  5. C Dong, CC Loy, and X Tang (2016). Accelerating the super-resolution convolutional neural network, In European conference on computer vision, 391–407

  6. K He, X Zhang, S Ren, and J Sun (2016). Deep residual learning for image recognition,” In Proceedings of the IEEE conference on computer vision and pattern recognition, 770–778

  7. Hinton G, Deng L, Yu D, Dahl G, Mohamed AR, Jaitly N, Senior A, Vanhoucke V, Nguyen P, Sainath T, Kingsbury B (2012) Deep neural networks for acoustic modeling in speech recognition. IEEE Signal Process Mag 29(6):82–97

    Article  Google Scholar 

  8. M Irani, and S Peleg, (1990). Super resolution from image sequences, in [1990] proceedings. 10th international conference on pattern recognition, 115-120

  9. Irani M, Peleg S (1991) Improving resolution by image registration. CVGIP: Graphical models and image processing 53(3):231–239

    Google Scholar 

  10. Keys R (1981) Cubic convolution interpolation for digital image processing. IEEE Trans Acoust Speech Signal Process 29(6):1153–1160

    Article  MathSciNet  MATH  Google Scholar 

  11. Kim KI, Kwon Y (2010) Single-image super-resolution using sparse regression and natural image prior. IEEE Trans Pattern Anal Mach Intell 32(6):1127–1133

    Article  Google Scholar 

  12. J Kim, JK Lee, and KM Lee (2016). Deeply-recursive convolutional network for image super-resolution,” In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 1637–1645

  13. Li Y, Liang W, Zhang YL, An HB, Tan JD (2016) Automatic lumbar vertebrae detection based on feature fusion deep learning for partial occluded C-arm X-ray images. In: Proceedings of the 38th annual international conference of the engineering in medicine and biology society (EMBC). Orlando, FL, USA, IEEE, pp 647–650

    Google Scholar 

  14. B Lim, S Son, H Kim, et al (2017). Enhanced deep residual networks for single image super-resolution,“In Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 136–144

  15. Lin Z, Shum HY (2004) Fundamental limits of reconstruction-based superresolution algorithms under local translation. IEEE Trans Pattern Anal Mach Intell 26(1):83–97

    Article  Google Scholar 

  16. Meng X, Chen YM, Deng ZS (2012) Automatic panoramic imaging studies of clinical x-ray based on edge feature point. Chinese Journal of Medical Physics 29(3):3371–3374

    Google Scholar 

  17. Park SC, Park MK, Kang MG (2003) Super-resolution image reconstruction: a technical overview. IEEE Signal Process Mag 20(3):21–36

    Article  Google Scholar 

  18. K Ratakonda, N Ahuja (1998). POCS based adaptive image magnification, In Proceedings 1998 International Conference on Image Processing IEEE, ICIP98 (Cat. No. 98CB36269) 203–207

  19. Schultz RR, Stevenson RL (1996) Extraction of high-resolution frames from video sequences. IEEE Trans Image Process 5(6):996–1011

    Article  Google Scholar 

  20. Shi J, Li Z, Ying S, Wang C, Liu Q, Zhang Q, Yan P (2018) MR image super-resolution via wide residual networks with fixed skip connection. IEEE journal of biomedical and health informatics 23(3):1129–1140

    Article  Google Scholar 

  21. Spampinato C, Palazzo S, Giordano D, Aldinucci M, Leonardi R (2016) Deep learning for automated skeletal bone age assessment in X-ray images. Med Image Anal 36:41–51

    Article  Google Scholar 

  22. Stark H, Oskoui P (1989) High-resolution image recovery from image-plane arrays, using convex projections. J Opt Soc Am A Opt Image Sci 6(11):1715–1726

    Article  Google Scholar 

  23. Y Tai, J Yang, X Liu (2017). Image super-resolution via deep recursive residual network, Proceedings of the IEEE conference on computer vision and pattern recognition, 3147–3155

  24. Tesche CD, Clarke J (1977) DC SQUID: noise and optimization. J Low Temp Phys 29(3–4):301–331

    Article  Google Scholar 

  25. Tian Y, Jia RS, Xu SH, Hua R, Deng MD (2019) Super-resolution reconstruction of remote sensing images based on convolutional neural network. J Appl Remote Sens 13(4):1–12. https://doi.org/10.1117/1.JRS.13.4.046502

    Article  Google Scholar 

  26. R Timofte, V De Smet, and L Van Gool (2014). A+: Adjusted anchored neighborhood regression for fast super-resolution, In Asian conference on computer vision, 111–126

  27. Tong YB, Zhang QS, QI YP (2006) Image quality assessing by combining PSNR with SSIM. Journal of Image and Graphics 11(12):1758–1763

    Google Scholar 

  28. Umehara K, Ota J, Ishimaru N, Ohno S, Okamoto K, Suzuki T, Ishida T (2017) Performance evaluation of super-resolution methods using deep-learning and sparse-coding for improving the image quality of magnified images in chest radiographs. Open Journal of Medical Imaging 7(03):100–111

    Article  Google Scholar 

  29. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  30. Xiao J, Liu E, Zhu L (2017) Improved image super-resolution algorithm based on convolutional neural network. Acta Opt Sin 37(3)

  31. Xu L, Zeng X, Huang Z, Li W, Zhang H (2020) Low-dose chest X-ray image super-resolution using generative adversarial nets with spectral normalization. Biomedical Signal Processing and Control 55:101600

    Article  Google Scholar 

  32. C You, G Li, Y Zhang, X Zhang, H Shan, M Li, ... and MW Vannier (2019). CT super-resolution GAN constrained by the identical, residual, and cycle learning ensemble (GAN-CIRCLE), IEEE Trans Med Imaging

  33. Y Zhang, Y Tian, Y Kong, B Zhong, and Y Fu (2018). Residual dense network for image super-resolution.,” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2472–2481

  34. Zhou RG, Liu XG, Luo J (2017) Quantum circuit realization of the bilinear interpolation method for GQIR. Int J Theor Phys 56(9):2966–2980

    Article  MathSciNet  MATH  Google Scholar 

  35. Zhou JH, Zhou C, Zhu JJ et al (2015) A method of super-resolution reconstruction for remote sensing image based on non-subsampled contourlet transform. Acta Opt Sin 35(1):106–114

    Google Scholar 

Download references

Acknowledgements

The authors are grateful for collaborative funding support from the Natural Science Foundation of Shandong Province, China (ZR2018MEE008), the Key Research and Development Program of Shandong Province, China (2017GSF20115).

Author information

Authors and Affiliations

  1. College of Computer Science and Engineering, Shandong University of Science and Technology, Qingdao, 266590, China

    Chao-Yue Zhao, Rui-Sheng Jia, Qing-Ming Liu, Xiao-Ying Liu, Hong-Mei Sun & Xing-Li Zhang

  2. Shandong Province Key Laboratory of Wisdom Mine Information Technology, Shandong University of Science and Technology, Qingdao, 266590, China

    Rui-Sheng Jia, Hong-Mei Sun & Xing-Li Zhang

Authors
  1. Chao-Yue Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rui-Sheng Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Qing-Ming Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiao-Ying Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hong-Mei Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Xing-Li Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Rui-Sheng Jia or Hong-Mei Sun.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhao, CY., Jia, RS., Liu, QM. et al. Chest X-ray images super-resolution reconstruction via recursive neural network. Multimed Tools Appl 80, 263–277 (2021). https://doi.org/10.1007/s11042-020-09773-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09773-x

Keywords

Search

Navigation