Skip to main content

Deep Learning Networks with p-norm Loss Layers for Spatial Resolution Enhancement of 3D Medical Images

  • Conference paper
  • First Online:
From Bioinspired Systems and Biomedical Applications to Machine Learning (IWINAC 2019)

Abstract

Nowadays, obtaining high-quality magnetic resonance (MR) images is a complex problem due to several acquisition factors, but is crucial in order to perform good diagnostics. The enhancement of the resolution is a typical procedure applied after the image generation. State-of-the-art works gather a large variety of methods for super-resolution (SR), among which deep learning has become very popular during the last years. Most of the SR deep-learning methods are based on the minimization of the residuals by the use of Euclidean loss layers. In this paper, we propose an SR model based on the use of a p-norm loss layer to improve the learning process and obtain a better high-resolution (HR) image. This method was implemented using a three-dimensional convolutional neural network (CNN), and tested for several norms in order to determine the most robust fit. The proposed methodology was trained and tested with sets of MR structural T1-weighted images and showed better outcomes quantitatively, in terms of Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index (SSIM), and the restored and the calculated residual images showed better CNN outputs.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://fguma.es/unidad-imagen-molecular/.

References

  1. Abramovich, F., Benjamini, Y., Donoho, D.L., Johnstone, I.M.: Adapting to unknown sparsity by controlling the false discovery rate. Ann. Stat. 34(2), 584–653 (2006)

    Article  MathSciNet  Google Scholar 

  2. Blueschke, D., Savin, I.: No such thing as a perfect hammer: comparing different objective function specifications for optimal control. Cent. Eur. J. Oper. Res. 25(2), 377–392 (2017)

    Article  MathSciNet  Google Scholar 

  3. Chen, X., Xu, F., Ye, Y.: Lower bound theory of nonzero entries in solutions of \(l_{2}\)-\(l_{p}\) minimization. SIAM J. Sci. Comput. 32(5), 2832–2852 (2010)

    Article  MathSciNet  Google Scholar 

  4. Gentile, C.: The robustness of the p-norm algorithms. Mach. Learn. 53(3), 265–299 (2003)

    Article  Google Scholar 

  5. Grove, A.J., Littlestone, N., Schuurmans, D.: General convergence results for linear discriminant updates. Mach. Learn. 43(3), 173–210 (2001)

    Article  Google Scholar 

  6. Jia, Y., et al.: Caffe: convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408.5093 (2014)

  7. Landman, B.A., et al.: Multi-parametric neuroimaging reproducibility: a 3-T resource study. Neuroimage 54(4), 2854–2866 (2011)

    Article  Google Scholar 

  8. Li, Z., Tang, J., He, X.: Robust structured nonnegative matrix factorization for image representation. IEEE Trans. Neural Netw. Learn. Syst. 29(5), 1947–1960 (2018)

    Article  MathSciNet  Google Scholar 

  9. Marcus, D.S., Wang, T.H., Parker, J., Csernansky, J.G., Morris, J.C., Buckner, R.L.: Open access series of imaging studies (OASIS): cross-sectional MRI data in young, middle aged, nondemented, and demented older adults. J. Cogn. Neurosci. 19(9), 1498–1507 (2007). https://doi.org/10.1162/jocn.2007.19.9.1498

    Article  Google Scholar 

  10. Pham, C.H., Ducournau, A., Fablet, R., Rousseau, F.: Brain MRI super-resolution using deep 3D convolutional networks. In: 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), pp. 197–200, April 2017. https://doi.org/10.1109/ISBI.2017.7950500

  11. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)

    Article  Google Scholar 

  12. Worth, A.J.: MGH CMA internet brain segmentation repository (IBSR) (2010). http://www.cma.mgh.harvard.edu/ibsr/

  13. Ye, Y.F., Shao, Y.H., Deng, N.Y., Li, C.N., Hua, X.Y.: Robust Lp-norm least squares support vector regression with feature selection. Appl. Math. Comput. 305, 32–52 (2017)

    MathSciNet  MATH  Google Scholar 

  14. Zhang, C., Li, D., Tan, J.: The support vector regression with adaptive norms. Procedia Comput. Sci. 18, 1730–1736 (2013)

    Article  Google Scholar 

Download references

Acknowledgements

This work is partially supported by the Ministry of Economy and Competitiveness of Spain under grant TIN2014-53465-R, project name Video surveillance by active search of anomalous events. It is also partially supported by the Autonomous Government of Andalusia (Spain) under project P12-TIC-657, project name Self-organizing systems and robust estimators for video surveillance. Both of them include funds from the European Regional Development Fund (ERDF). The authors thankfully the grant of the University of Málaga and acknowledge the computer resources, technical expertise and assistance provided by the SCBI (Supercomputing and Bioinformatics) center of the University of Málaga. They also gratefully acknowledge the support of NVIDIA Corporation with the donation of two Titan X GPUs. Karl Thurnhofer-Hemsi (FPU15/06512) is funded by a PhD scholarship from the Spanish Ministry of Education, Culture and Sport under the FPU program. The authors acknowledge the funding from the following grants, which was used to develop the OASIS database by its creators: P50 AG05681, P01 AG03991, R01 AG021910, P50 MH071616, U24 RR021382, R01 MH56584.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Karl Thurnhofer-Hemsi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Thurnhofer-Hemsi, K., López-Rubio, E., Roé-Vellvé, N., Molina-Cabello, M.A. (2019). Deep Learning Networks with p-norm Loss Layers for Spatial Resolution Enhancement of 3D Medical Images. In: Ferrández Vicente, J., Álvarez-Sánchez, J., de la Paz López, F., Toledo Moreo, J., Adeli, H. (eds) From Bioinspired Systems and Biomedical Applications to Machine Learning. IWINAC 2019. Lecture Notes in Computer Science(), vol 11487. Springer, Cham. https://doi.org/10.1007/978-3-030-19651-6_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-19651-6_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-19650-9

  • Online ISBN: 978-3-030-19651-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics