Abstract
Compressed Sensing Magnetic Resonance Imaging (CS-MRI) could be considered a challenged task since it could be designed as an efficient technique for fast MRI acquisition which could be highly beneficial for several clinical routines. In fact, it could grant better scan quality by reducing motion artifacts amount as well as the contrast washout effect. It offers also the possibility to reduce the exploration cost and the patient’s anxiety. Recently, Deep Learning Neuronal Network (DL) has been suggested in order to reconstruct MRI scans with conserving the structural details and improving parallel imaging-based fast MRI. In this paper, we propose Deep Convolutional Encoder-Decoder architecture for CS-MRI reconstruction. Such architecture bridges the gap between the non-learning techniques, using data from only one image, and approaches using large training data. The proposed approach is based on autoencoder architecture divided into two parts: an encoder and a decoder. The encoder as well as the decoder has essentially three convolutional blocks. The proposed architecture has been evaluated through two databases: Hammersmith dataset (for the normal scans) and MICCAI 2018 (for pathological MRI). Moreover, we extend our model to cope with noisy pathological MRI scans. The normalized mean square error (NMSE), the peak-to-noise ratio (PSNR), and the structural similarity index (SSIM) have been adopted as evaluation metrics in order to evaluate the proposed architecture performance and to make a comparative study with the state-of-the-art reconstruction algorithms. The higher PSNR and SSIM values as well as the lowest NMSE values could attest that the proposed architecture offers better reconstruction and preserves textural image details. Furthermore, the running time is about 0.8 s, which is suitable for real-time processing. Such results could encourage the neurologist to adopt it in their clinical routines.
Similar content being viewed by others
Data availability
The data used to support the findings of this study are included within the article
References
Seo JK, Woo EJ, Katcher U, Wang Y (2013) Electro-magnetic tissue properties MRI. Imperial College Press, London
Hollingsworth KG (2015) Reducing acquisition time in clinical MRI by data undersampling and compressed sensing reconstruction. Phys Med Biol 60(21):R297–R322
Lustig M, Donoho DL, Santos JM, Pauly JM (2008) Compressed sensing MRI. IEEE Signal Process Mag 25(2):72–82
Nyquist H (1928) Certain topics in telegraph transmission theory. Trans Am Inst Electr Eng 47(2):617–644
Griswold MA, Blaimer M, Breuer F et al (2005) Parallel magnetic resonance imaging using the GRAPPA operator formalism. Magn Reson Med 54(6):1553–1556
Pruessmann KP, Weiger M, Scheidegger MB, Boesiger P (1999) SENSE: sensitivity encoding for fast MRI. Magn Reson Med 42(5):952–962
Yazdanpanah AP, Regentova EE (2017) Compressed sensing magnetic resonance imaging based on shearlet sparsity and nonlocal total variation. J Med Imaging 4(2)
Yazdanpanah AP, Regentova EE (2017) Compressed sensing mri using curvelet sparsity and nonlocal total variation: Cs-nltv. Electron Imaging 13:5–9
Chandarana H, Feng L, Block TK, Rosenkrantz AB, Lim RP, Babb JS, Sodickson DK, Otazo R (2013) Free-breathing contrast-enhanced multiphase MRI of the liver using a combination of compressed sensing, parallel imaging, and golden-angle radial sampling. Investig Radiol 48(1):10–16
Fair MJ, Gatehouse PD, DiBella EVR, Firmin DN (2015) A review of 3D first-pass, whole-heart, myocardial perfusion cardiovascular magnetic resonance. J Cardiovasc Magn Reson 17(1):68
Lustig M, Donoho D, Pauly JM (2007) Sparse MRI: the application of compressed sensing for rapid MR imaging. Magn Reson Med 58(6):1182–1195
Baraniuk R (2007) Compressive sensing. IEEE Signal Process Mag 24(4):118–121
Yang J, Zhang Y, Yin W (2010) A fast alternating direction method for TVL1-L2 signal reconstruction from partial Fourier data. IEEE J Sel Topics Signal Process 4(2):288–297
Qu X, Guo D, Ning B, Hou Y, Lin Y, Cai S, Chen Z (2012) Undersampled MRI reconstruction with patch-based directional wavelets. Magn Reson Imaging 30(7):964–977
Qu X, Hou Y, Lam F, Guo D, Zhong J, Chen Z (2014) Magnetic resonance image reconstruction from undersampled measurements using a patch-based nonlocal operator. Med Image Anal 18(6):843–856
Zhan Z, Cai J-F, Liu Y, Chen Z, Qu X (2015) Fast multiclass dictionaries learning with geometrical directions in MRI reconstruction. IEEE Trans Biomed Eng 63:1850–1861. https://doi.org/10.1109/TBME.2015.2503756
Zhuang P, Zhu X, Ding X (2019) MRI reconstruction with an edge-preserving filtering prior. Signal Process 155:346–357
Zhu Y, Shen W, Cheng F, Jin C, Cao G (2020) Removal of high density Gaussian noise in compressed sensing MRI reconstruction through modified total variation image denoising method. Heliyon 6(3)
Shen D, Wu G, Suk H-I (2017) Deep learning in medical image analysis. Annu Rev Biomed Eng 19:221–248
Knoll F, Hammernik K, Zhang C, Möller S, Pock T, Sodickson DK, and Akçakaya M (2019) “Deep learning methods for parallel magnetic resonance image reconstruction” CoRR, abs/1904.01112
Liang D, Cheng J, Ke Z, and Ying L (2019) “Deep mri reconstruction: unrolled optimization algorithms meet neural networks”. arXiv preprint arXiv:1907.11711
Dong C, Loy CC, He K, Tang X (2015) Image super-resolution using deep convolutional networks. IEEE Trans Pattern Anal Mach Intell 38(2):295–307
Tamada D, Kromrey ML, Ichikawa S, Onishi H, Motosugi U (2020) Motion artefact reduction using a convolutional neural network for dynamic contrast enhanced MR imaging of the liver. Magn Reson Med Sci 19(1):64
Sun J, Li H, Xu Z et al (2016) “Deep ADMM-net for compressive sensing MRI” in Proceeding of NIPS, pp. 10–18
Schlemper J, Caballero J, Hajnal JV, Price AN, Rueckert D (2018) A deep cascade of convolutional neural networks for dynamic MR image reconstruction. IEEE Trans Med Imaging 37(2):491–503
Chen F, Taviani V, Malkiel I, Cheng JY, Tamir JI, Shaikh J et al (2018) Variable-density single-shot fast spin-echo MRI with deep learning reconstruction by using variational networks. Radiology
Caballero J, Price AN, Rueckert D, Hajnal JV (2014) Dictionary learning and time sparsity for dynamic MR data reconstruction. IEEE Trans Med Imaging 33(4):979–994
Ravishankar S, Bresler Y (2011) MR image reconstruction from highly undersampled k-space data by dictionary learning. IEEE Trans Med Imaging 30(5):1028–1041
Caballero J, Rueckert D, and Hajnal JV (2012) “Dictionary learning and time sparsity in dynamic MRI” in Proceeding of MICCAI, pp. 256–263
Quan TM and Jeong W-K (2016) “Compressed sensing reconstruction of dynamic contrast enhanced MRI using GPU-accelerated convolutional sparse coding,” in Proceeding of IEEE ISBI, pp. 518–521
Quan TM and Jeong W-K (2016) “Compressed sensing dynamic MRI reconstruction using GPU-accelerated 3D convolutional sparse coding.” in Proceeding of MICCAI, pp. 484–492
Luo G, Zhao N, Jiang W, Hui ES, Cao P (2020) MRI reconstruction using deep Bayesian estimation. Magn Reson Med 84:2246–2261
Ramzi Z, Ciuciu P, Starck JL (2020) Benchmarking MRI Reconstruction neural networks on large public datasets. Appl Sci 10:1816–1831
Gedeon TD, Harris D (1992) “Progressive image compression”. In: 1992. International Joint Conference on Neural Networks (IJCNN)
Myronenko A (2018) “3D MRI Brain tumor segmentation using autoencoder regularization.” BrainLes @MICCAI
Mardani M, Gong E, Cheng JY, Vasanawala S, Zaharchuk G, Alley M, Thakur N, Han S, Dally W, Pauly JM et al (2017) “Deep generative adversarial networks for compressed sensing automates MRI” arXiv preprint arXiv:1706.00051
Yu S, Dong H, Yang G, Slabaugh G, Dragotti PL, Ye X, Liu F, Arridge S, Keegan J, Firmin D et al (2017) “Deep de-aliasing for fast compressive sensing MRI” arXiv preprint arXiv:1705.07137
Quan TM, Thanh N-D, Jeong W-K (2018) Compressed sensing MRI reconstruction using a generative adversarial network with a cyclic loss. IEEE Trans Med Imaging 37(6):1488–1497 Crossref Web
Guang Y, Simiao Y, Dong H, Slabaugh G, Dragotti P, Ye X, Liu F, Arridge S, Keegan J, Guo Y, Firmin D (2017) DAGAN: deep de-aliasing generative adversarial networks for fast compressed sensing MRI reconstruction. IEEE Trans Med Imaging 36:19–25
Cho K, van Merrienboer B, Bahdanau D, Bengio Y (2014) On the properties of neural machine translation: encoder-decoder approaches. CoRR abs/1409.1259
Sutskever Ilya, Vinyals Oriol, and Le Quoc (2014) “Sequence to sequence learning with neural networks”. In Advances in Neural Information Processing Systems (NIPS)
Kalchbrenner Nal and Blunsom Phil (2013) Two recurrent continuous translation models. In Proceedings of the ACL Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1700–1709
Bahdanau D, Cho K, and Bengio Y (2014) “Neural machine translation by jointly learning to align and translate” arXiv preprint arXiv:1409.0473
Schuster M, Paliwal KK (1997) Bidirectional recurrent neural networks. Signal Process IEEE Trans 45(11):2673–2681
Sutskever I, Vinyals O, and Le QV (2014) “Sequence to sequence learning with neural networks,” in Advances in Neural Information Processing Systems, pp. 3104–3112
Cho K, van Merrienboer B, Gulcehre C, Bougares F, Schwenk H, and Bengio Y (2014) “Learning phrase representations using RNN encoder-decoder for statistical machine translation” Pro. EMNLP
Lu Liang et al (2015) “A study of the recurrent neural network encoder-decoder for large vocabulary speech recognition.” INTERSPEECH
Zhang Y (2017) “A better autoencoder for image: convolutional autoencoder”, In 2017. International Conference on Neural Information Processing (ICONIP17)
Scherer D, Muller A, and Behnke S (2010) “Evaluation of pooling operations in convolutional architectures for object recognition”. Intenational Conference on Artificial Neural Networks, ICANN, pages: 1-10
Zeiler MD, Krishnan D, Taylor GW, Fergus R (2010) Deconvolutional networks
Alex K, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Proces Syst
Tieleman T, and Hinton G (2012) Lecture 6.5 - RMSProp, COURSERA: Neural Networks for Machine Learning. Technical report
Salkind NJ (2010) Encyclopedia of research design (Vols. 1-0). SAGE Publications, Inc, Thousand Oaks. https://doi.org/10.4135/9781412961288
Hammernik K, Klatzer T, Kobler E, Recht MP, Sodickson DK, Pock T, and Knoll F (2017) “Learning a variational network for reconstruction of accelerated MRI data” arXiv preprint arXiv:1704.00447
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflicts of interest.
Ethical approval
This is an observational study. The Research Ethics Committee has confirmed that no ethical approval is required.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Njeh, I., Mzoughi, H., Ben Slima, M. et al. Deep Convolutional Encoder-Decoder algorithm for MRI brain reconstruction. Med Biol Eng Comput 59, 85–106 (2021). https://doi.org/10.1007/s11517-020-02285-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11517-020-02285-8