Abstract
In clinical practice, magnetic resonance (MR) imaging is often scanned with large slice thickness due to many limiting factors such as scanning time. The acquired images are thus anisotropic, with much lower inter-slice resolution than the intra-slice resolution. For better coverage of the organs of interest, multiple anisotropic scans, each of which focus to a certain scan direction, are usually acquired per patient. In this work, we propose a 3D deep learning based super-resolution (SR) framework to reconstruct the isotropic high-resolution MR images from multiple anisotropic scans. In particular, we employ the spatially sparse fidelity loss to the locations acquired in anisotropic inputs, such that their intensities keep the same before and after the reconstruction. Meanwhile, the adversarial regularization is adopted to make sure that the entire reconstructed image owns consistent appearance perceptually. Different from other SR methods, our approach fuses inputs of multiple anisotropic images, instead of a single one. Moreover, our reconstruction is attained without using any supervision from the isotropic high-resolution images, making it unique among early works and highly applicable to many real clinical scenarios.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Dong, C., Loy, C.C., He, K., Tang, X.: Image super-resolution using deep convolutional networks. arXiv:1501.00092 (2014)
Essen, V., et al.: The human connectome project: a data acquisition perspective. NeuroImage 62(4), 2222–2231 (2012)
Huang, J.B., Singh, A., Ahuja, N.: Single image super-resolution from transformed self-exemplars. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5197–5206 (2015)
Jia, Y., Gholipour, A., He, Z., Warfield, S.K.: A new sparse representation framework for reconstruction of an isotropic high spatial resolution MR volume from orthogonal anisotropic resolution scans. IEEE Trans. Med. Imaging 36(5), 1182–1193 (2017)
Kim, J., Lee, J.K., Lee, K.M.: Accurate image super-resolution using very deep convolutional networks. arXiv:1511.04587 (2015)
Shi, F., Cheng, J., Wang, L., Yap, P., Shen, D.: LRTV: MR image super-resolution with low-rank and total variation regularizations. IEEE Trans. Med. Imaging 34(12), 2459–2466 (2015)
Wang, Z., Simoncelli, E.P., Bovik, A.C.: Multiscale structural similarity for image quality assessment. In: The Thrity-Seventh Asilomar Conference on Signals, Systems Computers, November 2003, vol. 2, pp. 1398–1402 (2003)
Yang, J., Wright, J., Huang, T.S., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010)
Zhang, J., et al.: Brain atlas fusion from high-thickness diagnostic magnetic resonance images by learning-based super-resolution. Pattern Recognit. 63, 531–541 (2017)
Zhao, C., Carass, A., Dewey, B.E., Prince, J.L.: Self super-resolution for magnetic resonance images using deep networks. In: 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), April 2018, pp. 365–368 (2018)
Acknowledgement
This work was partially supported by the National Key Research and Development Program of China (2018YFC0116400) and STCSM grants (19QC1400600, 17411953300).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Xuan, K. et al. (2019). Reconstruction of Isotropic High-Resolution MR Image from Multiple Anisotropic Scans Using Sparse Fidelity Loss and Adversarial Regularization. In: Shen, D., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11766. Springer, Cham. https://doi.org/10.1007/978-3-030-32248-9_8
Download citation
DOI: https://doi.org/10.1007/978-3-030-32248-9_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32247-2
Online ISBN: 978-3-030-32248-9
eBook Packages: Computer ScienceComputer Science (R0)