Abstract
Purpose
Acute ischemic stroke is one of the primary causes of death worldwide. Recent studies have shown that the assessment of collateral status could aid in improving the treatment for patients with acute ischemic stroke. We present a 3D deep regression neural network to automatically generate the collateral images from dynamic susceptibility contrast-enhanced magnetic resonance perfusion (DSC-MRP) in acute ischemic stroke.
Methods
This retrospective study includes 144 subjects with acute ischemic stroke (stroke cases) and 201 subjects without acute ischemic stroke (controls). DSC-MRP images of these subjects were manually inspected for collateral assessment in arterial, capillary, early and late venous, and delay phases. The proposed network was trained on 205 subjects, and the optimal model was chosen using the validation set of 64 subjects. The predictive power of the network was assessed on the test set of 76 subjects using the squared correlation coefficient (R-squared), mean absolute error (MAE), Tanimoto measure (TM), and structural similarity index (SSIM).
Results
The proposed network was able to predict the five phase maps with high accuracy. On average, 0.897 R-squared, 0.581 × 10−1 MAE, 0.946 TM, and 0.846 SSIM were achieved for the five phase maps. No statistically significant difference was, in general, found between controls and stroke cases. The performance of the proposed network was lower in the arterial and venous phases than the other three phases.
Conclusion
The results suggested that the proposed network performs equally well for both control and acute ischemic stroke groups. The proposed network could help automate the assessment of collateral status in an efficient and effective manner and improve the quality and yield of diagnosis of acute ischemic stroke. The follow-up study will entail the clinical evaluation of the collateral images that are generated by the proposed network.
Similar content being viewed by others
References
Liebeskind DS, Tomsick TA, Foster LD, Yeatts SD, Carrozzella J, Demchuk AM, Jovin TG, Khatri P, von Kummer R, Sugg RM (2014) Collaterals at angiography and outcomes in the Interventional Management of Stroke (IMS) III trial. Stroke 45(3):759–764
Goyal M, Demchuk AM, Menon BK, Eesa M, Rempel JL, Thornton J, Roy D, Jovin TG, Willinsky RA, Sapkota BL (2015) Randomized assessment of rapid endovascular treatment of ischemic stroke. N Engl J Med 372(11):1019–1030
Bang OY, Saver JL, Buck BH, Alger JR, Starkman S, Ovbiagele B, Kim D, Jahan R, Duckwiler GR, Yoon SR (2008) Impact of collateral flow on tissue fate in acute ischaemic stroke. J Neurol Neurosurg Psychiatry 79(6):625–629
Menon BK, d’Esterre CD, Qazi EM, Almekhlafi M, Hahn L, Demchuk AM, Goyal M (2015) Multiphase CT angiography: a new tool for the imaging triage of patients with acute ischemic stroke. Radiology 275(2):510–520
Garcia-Tornel A, Carvalho V, Boned S, Flores A, Rodriguez-Luna D, Pagola J, Muchada M, Sanjuan E, Coscojuela P, Juega J, Rodriguez-Villatoro N, Menon B, Goyal M, Ribo M, Tomasello A, Molina CA, Rubiera M (2016) Improving the evaluation of collateral circulation by multiphase computed tomography angiography in acute stroke patients treated with endovascular reperfusion therapies. Interv Neurol 5(3–4):209–217. https://doi.org/10.1159/000448525
Kim SJ, Son JP, Ryoo S, Lee MJ, Cha J, Kim KH, Kim GM, Chung CS, Lee KH, Jeon P (2014) A novel magnetic resonance imaging approach to collateral flow imaging in ischemic stroke. Ann Neurol 76(3):356–369
Robson PM, Dai W, Shankaranarayanan A, Rofsky NM, Alsop DC (2010) Time-resolved vessel-selective digital subtraction MR angiography of the cerebral vasculature with arterial spin labeling. Radiology 257(2):507–515
Menon BK, Smith EE, Modi J, Patel SK, Bhatia R, Watson TWJ, Hill MD, Demchuk AM, Goyal M (2011) Regional leptomeningeal score on CT angiography predicts clinical and imaging outcomes in patients with acute anterior circulation occlusions. Am J Neuroradiol 32(9):1640. https://doi.org/10.3174/ajnr.A2564
Roh HG, Kim EY, Kim IS, Lee HJ, Park JJ, Lee SB, Choi JW, Jeon YS, Park M, Kim SU, Kim HJ (2019) A novel collateral imaging method derived from time-resolved dynamic contrast-enhanced MR angiography in acute ischemic stroke: a pilot study. Am J Neuroradiol. https://doi.org/10.3174/ajnr.A6068
LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436
Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, Van Der Laak JA, Van Ginneken B, Sánchez CI (2017) A survey on deep learning in medical image analysis. Med Image Anal 42:60–88
Lundervold AS, Lundervold A (2018) An overview of deep learning in medical imaging focusing on MRI. arXiv preprint arXiv:181110052
McBee MP, Awan OA, Colucci AT, Ghobadi CW, Kadom N, Kansagra AP, Tridandapani S, Auffermann WF (2018) Deep learning in radiology. Acad Radiol 25:1472–1480
Sun C, Guo S, Zhang H, Li J, Chen M, Ma S, Jin L, Liu X, Li X, Qian X (2017) Automatic segmentation of liver tumors from multiphase contrast-enhanced CT images based on FCNs. Artif Intell Med 83:58–66
Havaei M, Davy A, Warde-Farley D, Biard A, Courville A, Bengio Y, Pal C, Jodoin P-M, Larochelle H (2017) Brain tumor segmentation with deep neural networks. Med Image Anal 35:18–31
Vu QD, Kwak JT (2019) A dense multi-path decoder for tissue segmentation in histopathology images. Comput Methods Programs Biomed 173:119–129
Dong C, Loy CC, Tang X (2016) Accelerating the super-resolution convolutional neural network. In: European conference on computer vision, 2016. Springer, pp 391–407
Ravì D, Szczotka AB, Shakir DI, Pereira SP, Vercauteren T (2018) Effective deep learning training for single-image super-resolution in endomicroscopy exploiting video-registration-based reconstruction. Int J Comput Assist Radiol Surg 13:1–8
Garg R, BG VK, Carneiro G, Reid I (2016) Unsupervised cnn for single view depth estimation: geometry to the rescue. In: European conference on computer vision, 2016. Springer, pp 740–756
Mahmood F, Durr NJ (2018) Deep learning and conditional random fields-based depth estimation and topographical reconstruction from conventional endoscopy. Med Image Anal 48:230–243
Frid-Adar M, Diamant I, Klang E, Amitai M, Goldberger J, Greenspan H (2018) GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification. Neurocomputing 321:321–331
Wolterink JM, Dinkla AM, Savenije MH, Seevinck PR, van den Berg CA, Išgum I (2017) Deep MR to CT synthesis using unpaired data. In: International workshop on simulation and synthesis in medical imaging, 2017. Springer, pp 14–23
Hiasa Y, Otake Y, Takao M, Matsuoka T, Takashima K, Carass A, Prince JL, Sugano N, Sato Y (2018) Cross-modality image synthesis from unpaired data using CycleGAN. In: International workshop on simulation and synthesis in medical imaging, 2018. Springer, pp 31–41
Lucas C, Kemmling A, Bouteldja N, Aulmann LF, Mamlouk AM, Heinrich MP (2018) Learning to predict ischemic stroke growth on acute CT perfusion data by interpolating low-dimensional shape representations. Front Neurol 9:989
Chen L, Bentley P, Rueckert D (2017) Fully automatic acute ischemic lesion segmentation in DWI using convolutional neural networks. NeuroImage Clin 15:633–643. https://doi.org/10.1016/j.nicl.2017.06.016
Stier N, Vincent N, Liebeskind D, Scalzo F (2015) Deep learning of tissue fate features in acute ischemic stroke. In: 2015 IEEE international conference on bioinformatics and biomedicine (BIBM), 2015. IEEE, pp 1316–1321
Pinto JAADS, Mckinley R, Alves V, Wiest R, Silva CA, Reyes M (2018) Stroke lesion outcome prediction based on MRI imaging combined with clinical information. Front Neurol 9:1060
Nielsen A, Hansen Mikkel B, Tietze A, Mouridsen K (2018) Prediction of tissue outcome and assessment of treatment effect in acute ischemic stroke using deep learning. Stroke 49(6):1394–1401. https://doi.org/10.1161/STROKEAHA.117.019740
Robben D, Suetens P (2018) Perfusion parameter estimation using neural networks and data augmentation. In: International MICCAI brainlesion workshop, 2018. Springer, pp 439–446
Hess A, Meier R, Kaesmacher J, Jung S, Scalzo F, Liebeskind D, Wiest R, McKinley R (2018) Synthetic perfusion maps: imaging perfusion deficits in DSC-MRI with deep learning. In: International MICCAI brainlesion workshop, 2018. Springer, pp 447–455
Xiao Y, Alamer A, Fonov V, Lo BW, Tampieri D, Collins DL, Rivaz H, Kersten-Oertel M (2017) Towards automatic collateral circulation score evaluation in ischemic stroke using image decompositions and support vector machines. In: Jorge Cardoso M et al (eds) Molecular imaging, reconstruction and analysis of moving body organs, and stroke imaging and treatment. Springer, pp 158–167
Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: International conference on learning representations
Srivastava RK, Greff K, Schmidhuber J (2015) Training very deep networks. In: Cortes C et al (eds) Advances in neural information processing systems, pp 2377–2385
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp 770–778
Huang G, Liu Z, Weinberger KQ, van der Maaten L (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, vol 2, p 3
Jégou S, Drozdzal M, Vazquez D, Romero A, Bengio Y (2017) The one hundred layers tiramisu: fully convolutional densenets for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 2017, pp 11–19
Zhang Y, Tian Y, Kong Y, Zhong B, Fu Y (2018) Residual dense network for image super-resolution. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp 2472–2481
Li X, Chen H, Qi X, Dou Q, Fu C-W, Heng P-A (2018) H-DenseUNet: hybrid densely connected UNet for liver and tumor segmentation from CT volumes. IEEE Trans Med Imaging 37(12):2663–2674
Roy AG, Navab N, Wachinger C (2018) Concurrent spatial and channel ‘squeeze & excitation’ in fully convolutional networks. In: Medical image computing and computer assisted intervention—MICCAI 2018. Springer, Cham, pp 421–429
Wang S, Tang C, Sun J, Zhang Y (2019) Cerebral Micro-bleeding detection based on densely connected neural network. Front Neurosci 13:422. https://doi.org/10.3389/fnins.2019.00422
Fu Y, Mazur TR, Wu X, Liu S, Chang X, Lu Y, Li HH, Kim H, Roach MC, Henke L (2018) A novel MRI segmentation method using CNN-based correction network for MRI-guided adaptive radiotherapy. Med Phys 45(11):5129–5137
Yu L, Yang X, Chen H, Qin J, Heng P-A (2017) Volumetric convnets with mixed residual connections for automated prostate segmentation from 3D MR images. In: AAAI, 2017, pp 66–72
Milletari F, Navab N, Ahmadi S-A (2016) V-net: fully convolutional neural networks for volumetric medical image segmentation. In: 2016 fourth international conference on 3D vision (3DV). IEEE, pp 565–571
Kamnitsas K, Ledig C, Newcombe VF, Simpson JP, Kane AD, Menon DK, Rueckert D, Glocker B (2017) Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Med Image Anal 36:61–78
Wachinger C, Reuter M, Klein T (2018) DeepNAT: deep convolutional neural network for segmenting neuroanatomy. NeuroImage 170:434–445
Kleesiek J, Urban G, Hubert A, Schwarz D, Maier-Hein K, Bendszus M, Biller A (2016) Deep MRI brain extraction: a 3D convolutional neural network for skull stripping. NeuroImage 129:460–469
Swinscow TDV, Campbell MJ (2002) Statistics at square one. BMJ, London
Willmott CJ, Matsuura K (2005) Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance. Clim Res 30(1):79–82
Tanimoto TT (1958) Elementary mathematical theory of classification and prediction. IBM Corp., New York
Theodoridis S, Koutroumbas K (2008) Pattern recognition, 4th edn. Academic Press, Inc, Cambridge
Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612
Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention, 2015. Springer, pp 234–241
Xie S, Girshick R, Dollár P, Tu Z, He K (2017) Aggregated residual transformations for deep neural networks. In: 2017 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 5987–5995
Kinga D, Adam JB (2015) A method for stochastic optimization. In: International conference on learning representations (ICLR)
Wu Y, He K (2018) Group normalization. In: Proceedings of the European conference on computer vision (ECCV), 2018, pp 3–19
Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Paper presented at the proceedings of the 32nd international conference on international conference on machine learning—vol 37, Lille, France
Acknowledgements
This was supported by the National Research Foundation of Korea through the Korea Government (MSIP) under Grants 2016R1C1B2012433 and 2017R1A2B1008020.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
To, M.N.N., Kim, H.J., Roh, H.G. et al. Deep regression neural networks for collateral imaging from dynamic susceptibility contrast-enhanced magnetic resonance perfusion in acute ischemic stroke. Int J CARS 15, 151–162 (2020). https://doi.org/10.1007/s11548-019-02060-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11548-019-02060-7