To compare two established software applications in terms of apparent diffusion coefficient (ADC) lesion volumes, volume of critically hypoperfused brain tissue, and calculated volumes of perfusion-diffusion mismatch in brain MRI of patients with acute ischemic stroke.
Brain MRI examinations of 81 patients with acute stroke due to large vessel occlusion of the anterior circulation were analyzed. The volume of hypoperfused brain tissue, ADC volume, and the volume of perfusion-diffusion mismatch were calculated automatically with two different software packages. The calculated parameters were compared quantitatively using formal statistics.
Significant difference was found for the volume of hypoperfused tissue (median 91.0 ml vs. 102.2 ml; p < 0.05) and the ADC volume (median 30.0 ml vs. 23.9 ml; p < 0.05) between different software packages. The volume of the perfusion-diffusion mismatch differed significantly (median 47.0 ml vs. 67.2 ml; p < 0.05). Evaluation of the results on a single-subject basis revealed a mean absolute difference of 20.5 ml for hypoperfused tissue, 10.8 ml for ADC volumes, and 27.6 ml for mismatch volumes, respectively. Application of the DEFUSE 3 threshold of 70 ml infarction core would have resulted in dissenting treatment decisions in 6/81 (7.4%) patients.
Volume segmentation in different software products may lead to significantly different results in the individual patient and may thus seriously influence the decision for or against mechanical thrombectomy.
• Automated calculation of MRI perfusion-diffusion mismatch helps clinicians to apply inclusion and exclusion criteria derived from randomized trials.
• Infarct volume segmentation plays a crucial role and lead to significantly different result for different computer programs.
• Perfusion-diffusion mismatch estimation from different computer programs may influence the decision for or against mechanical thrombectomy.
Mechanical thrombectomy (MT) performed within 6 h from symptom onset is regarded as gold standard therapy in patients with acute ischemic stroke caused by large vessel occlusion (LVO) in the anterior circulation [1,2,3,4,5,6,7,8,9]. Recently, two prospectively randomized trials demonstrated the value of MT in selected patients with a prolonged time interval from symptom onset or the time last seen well and MT, i.e., 6 to 16 h in DEFUSE3  and 6 to 24 h in DAWN . Therefore, following the current guidelines from the American Heart Association/American Stroke Association (AHA/ASA) for acute stroke treatment, MR- or CT-based perfusion and MR diffusion imaging is advised in an extended time window up to 24 h . In the light of these findings, more refined knowledge of the performance of user-independent quantification of the infarct volume and/or the volume of potentially salvageable tissue is becoming increasingly important in a real-life setting.
The evaluation of the presumable infarct core volume by means of MR diffusion-weighted imaging (DWI) and the volume of putatively critically hypoperfused brain tissue by means of MR perfusion imaging (PWI) could provide crucial information about potentially salvageable ischemic brain tissue that could be functionally recovered, if perfusion is restored sufficiently. The difference between both volumes (i.e., the assumed penumbra) usually referred to as perfusion-diffusion mismatch represents an approximate measure of the tissue at risk and has been investigated in detail over the last two decades [13, 14]. Besides computed tomography perfusion (CTP), the most commonly used method to access perfusion parameters is by means of dynamic susceptibility contrast MR imaging (DSC-MRI), a method utilizing the signal drop caused by paramagnetic contrast media in T2- or T2*-weighted images. The evaluation of contrast media dynamics involves complex mathematical operations to estimate the volume size of hypoperfused tissue . In DWI-MRI, the infarct core can be delineated by regions of hypointense signal in ADC images due to the cytotoxic edema. The apparent diffusion coefficient (ADC) is usually used to estimate the size of the infarct core. A large ADC core of > 70 ml has been demonstrated to relate to worse clinical outcome . Hence, quantification of the infarct core (with or without perfusion-diffusion mismatch) has been regarded as mandatory by AHA/ASO recommendations in the process of decision-making for MT to select those patients that will most likely benefit from such treatment [12, 17].
Given that many of the steps involved in the evaluation of the perfusion-diffusion mismatch are user dependent and the consistency of the quantitative evaluation highly correlates with user experience, an automatic software support with minimal user interaction is appreciated in clinical routine. Specifically, the volumetric quantification of both hypoperfused tissue and ADC is crucial, as these parameters define the perfusion-diffusion mismatch and, thus, may influence therapeutic decisions. Volumetric quantification can be done manually, which is time consuming and user dependent, or requires additional image processing methods. Because of this need, several software applications for quantitative analysis in acute ischemic stroke have been developed, offering a fully automated perfusion-diffusion mismatch calculation without user interaction to support treatment decisions (e.g., whether a patient receives MT and/or thrombolysis, respectively, or best medical care).
The aim of this study was to compare the performance of two software applications, RAPID® (iSchemaView) and Olea Sphere® (Olea Medical). Perfusion-diffusion mismatch volumes and their dependence from hypoperfused tissue and ADC volumes were explored in this retrospective study. We investigated if suggested limits for therapeutic treatment decisions, recommended by seminal studies, have general validity or should be considered individually for different software systems.
We analyzed brain MRI examinations of consecutive patients with clinical symptoms of acute stroke and LVO of the anterior circulation between 2012 and 2018 jointly managed or treated by the Department of Neurology and the Division of Neuroradiology, Vascular and Interventional Radiology at the Medical University of Graz. Patients were retrospectively identified using the internal picture archiving and communication system (PACS). We excluded patients not receiving MR perfusion imaging as well as patients without LVO, stroke of the vertebrobasilar circulation, and stroke mimics without detected DWI lesion or vessel occlusion. Eighty-seven patients met those criteria. In six patients, automatic evaluation of perfusion-diffusion mismatch failed either in one or both software applications. A failed calculation was considered when either perfusion data or diffusion data were not provided in one or both of the two software packages due to severe motion artifacts. Finally, a total of 81 patients (38 females, mean age 68.8 ± 12.7 years, range 27–88 years, median NIHSS 11) were included in our analysis. Of these, 53 had occlusions of the middle cerebral artery (M1 or M2 segment), 21 of the internal carotid artery, five of the terminal internal carotid artery, and two patients had tandem occlusions of the internal carotid artery and the middle cerebral artery, respectively.
This study was approved by the local ethics committee in accordance with the declaration of Helsinki.
Magnetic resonance imaging data acquisition
MRI was performed on a single 1.5-Tesla clinical scanner (SIEMENS MAGNETOM Espree, Siemens Healthineers) according to the standard protocol used at our hospital for the workup of patients with acute stroke. This protocol includes the following sequences: axial diffusion-weighted single-shot echo planar imaging (TR/TE 4000/88 ms; isotropic diffusion weighting; b values 0 and 1000 s/mm2, matrix 128 × 128, FOV 240 × 240 mm2), axial perfusion imaging (TR/TE 1800 ms, 40 ms, slice thickness 5 mm, matrix 128 × 128, FOV 240 × 240 mm2, flip angle 60), axial fluid-attenuated inversion recovery (TR/TE 8000 ms/99 ms, slice thickness 5 mm) or optional axial fluid-attenuated inversion recovery blade (TR/TE 8500 ms/98 ms, slice thickness 5 mm), axial T2-weighted (TR/TE 49 ms, 40 ms, slice thickness 2.5 mm), before 2015 axial T2*-weighted GE (TR/TE 936 ms, 26 ms, slice thickness 5 mm), axial 3D TOF angiography (TR/TE 26 ms, 7.00 ms, slice thickness 0.8 mm), axial T1-weighted post contrast media (TR/TE 690 ms, 17 ms, slice thickness 5 mm), and optional angiography of the extra cranial vessels using fast low angle shot magnetic resonance imaging. Contrast media Gadovist (Bayer Vital GmbH), ProHance (Bracco Imaging), and Dotarem (Guerbet) were administered intravenously via a power injector (Spectris; Medrad Inc.) with a dose of 0.1 mmol/kg body weight at 4 ml/s flow followed by 20 ml of NaCl 0.9% at the same flow. ProHance is the standard contrast medium that is substituted by Gadovist or Dotarem in the rare cases of known intolerance. The total acquisition time took 14 min and 18 min, respectively, with the additional extra cranial angiography.
Automated perfusion-diffusion mismatch calculation
The RAPID® software was installed in our hospital 2012 as prerequisite for participation in the SWIFT PRIME stroke trial . The Olea Sphere® DSC plug-in for automated calculation of diffusion-perfusion mismatch was installed 2018 as part of the Olea Sphere® post processing package (including volumetric tumor assessment tractography etc.). Both commercially available software packages are used in the daily clinical routine and there is no personal or financial relationship to the vendors. Quantitative automated perfusion-diffusion mismatch calculation performed by RAPID® was recalculated with Olea Sphere® software for all patients in this study. RAPID® and Olea Sphere® are two fully automated post processing software applications used for quantitative stroke analysis. Both applications provide perfusion and diffusion maps such as relative cerebral blood flow, relative blood volume, and relative mean transit time. Furthermore, both software applications quantify the volume of hypoperfused tissue and ADC lesion and automatically calculate the volume of perfusion-diffusion mismatch. Decreased perfusion is quantified on Tmax maps, an estimate of delayed blood supply whereby a delay of 6 s (Tmax > 6 s) [18, 19] of the time to the maximum of the residue function was chosen as a threshold for hypoperfused tissue for both software applications (see Fig. 1). Threshold for ADC (620 × 10−6 mm2/s) volume estimation was also identical for both software applications . Perfusion-diffusion mismatch, the penumbra, is defined as the difference in the volume of segmented hypoperfused tissue volume and the segmented volume of the ADC lesion. All volumes are given in milliliter (ml).
All MRI source images along with perfusion-diffusion mismatch calculation summaries from RAPID® and Olea Sphere® were independently reviewed and checked for validity by two experienced neuroradiologists (N.H. and U.W.). The neuroradiologists were not blinded to the software. However, the reports were evaluated in terms of correct placement of the arterial input function, and misregistration of regions outside the territory of the occluded artery, respectively. Moreover, studies with distinctive motion artifacts that rendered the results of the automated segmentation useless had been excluded. The morphological MRIs were assessed for T2-FLAIR lesions, hemorrhage, and vessel occlusions.
Statistical analyses were performed using the software SPSS 24 (IBM) and OriginPro 2018 (OriginLab Corporation). For the comparison of parameters evaluated by the two software applications RAPID® and Olea Sphere®, scatterplots were used to investigate the correlation between both methods. Bland-Altman plots were used to detect systematic biases in one of the two methods. For all volume differences in the Bland-Altman plots, we calculated mean ADC volume differences (VolumeRAPID®–VolumeOlea Sphere®). Descriptive statistics was used to quantify the volume differences between both software packages for hypoperfused tissue, ADC, and perfusion-diffusion mismatch (mean values for normal distributed values and median values for non-normal distribution). The Shapiro-Wilk test was used to test for normal distribution of data. Not surprisingly, the estimated volumes were not normal distributed since occlusions of different vascular sections lead to a hypoperfusion of certain cerebral areas. A test for significant differences was therefore performed with the Wilcoxon signed-rank test. Results were reported with z-score (z) and Pearson’s correlation coefficient (r) to report effect size.
Scatter plots of hypoperfused tissue and ADC tissue volumes showed a good agreement between RAPID® and Olea Sphere® calculations (Fig. 2). However, the perfusion-diffusion mismatch determined by the two computer programs were significantly different (Fig. 3). The median volume of the perfusion-diffusion mismatch was 47.0 ml for RAPID® and 67.2 ml for Olea Sphere®, respectively (p < 0.05, z = − 6.32, r = 0.70). The median of volume of hypoperfused tissue was 91.0 ml for RAPID® and 102.2 ml for Olea Sphere®, respectively (p < 0.05, z = − 6.03, r = 0.67). ADC volume differences were determined as 30.0 ml for RAPID® and 23.9 ml for Olea Sphere® (p < 0.05, z = 3.77, r = 0.42), respectively (Fig. 3).
Bland-Altman analyses revealed that the hypoperfused tissue volume was largely estimated with Olea Sphere® compared with RAPID® (hypoperfused tissue mean = − 13.8 ml). ADC lesion volume was slightly largely estimated by RAPID® (ADC mean = 8.2 ml). Perfusion-diffusion mismatch volume was found to be larger when using Olea Sphere® (perfusion-diffusion mismatch mean = − 22.1 ml) (see Fig. 4). These results suggest the presence of a systematic bias when comparing both methods. However, no method over- or underestimated the evaluated mean volumes to a large extent.
For the support of a therapeutic decision, the absolute difference between both methods on a single-subject basis is of utmost interest. The mean absolute difference for hypoperfused tissue volume was 20.5 ml between software packages. A smaller difference between Olea Sphere® and RAPID® was found for ADC volumes (10.8 ml) and the largest difference was found for perfusion-diffusion mismatch volume (27.6 ml) (Fig. 5). Differences between software packages were as large as 63.1 ml for hypoperfused tissue, 65.0 ml for ADC, and 92.4 ml for perfusion-diffusion mismatch volumes, respectively.
Examples for different hypoperfused tissue volumes and ADC volumes, determined by RAPID® (blue regions) and Olea Sphere® (yellow regions), in two exemplary patients are presented in Fig. 6. In patient A, the diffusion volumes are in good agreement (72.0 ml RAPID® vs. 61.1 ml Olea Sphere®) while there is a larger difference in the outlined hypoperfused tissue volumes (91.0 ml RAPID® vs. 128.3 ml Olea Sphere®). Patient B shows a larger difference in ADC volume (96.0 ml RAPID® vs. 58.2 ml Olea Sphere®) and a better agreement in hypoperfused tissue volumes (108.0 ml RAPID® vs. 135.1 ml Olea Sphere®).
After applying a threshold of < 70 ml for the ADC volume of the infarct core that was derived from the inclusion criteria of the randomized multicenter DEFUSE 3 trial , 47/81 (58%) patients (Olea Sphere®) and 41/81 (50.6%) patients (RAPID®) would have been deemed eligible for mechanical thrombectomy. Application of the DEFUSE 3 threshold of 70 ml infarction core would have resulted in dissenting treatment decisions in 6/81(7.4%) patients.
Determination of the infarct core volume and the amount of potentially salvageable brain tissue (penumbra) after LVO are important predictive factors for the functional outcome of patients treated with MT . A recent meta-analysis indicated that selection of acute ischemic stroke patients, using advanced neuroimaging methods, is associated with improved clinical outcomes . Therefore, advanced imaging techniques, such as MR-PWI and MR-DWI, that allow for quantifying the volume of the infarct core and penumbra play an increasingly important role in the management of acute stroke [23, 24]. For estimation of hypoperfused tissue volume, ADC lesion volume, and perfusion-diffusion mismatch volume, various software packages have been developed in the last decade. To meet the requirements for a clinically applicable therapy decision support, all manufacturers aim for automated volume estimation with minimal user interaction to ensure operator independence. Recently published thrombectomy trials used RAPID® to determine the volume size of the infarct core and the size of the penumbra [8, 10, 11]. In these trials, patients with an infarct core > 70 ml or an infarct core volume above a specified threshold were deemed unsuitable for MT.
In our study, we compared two established software products (RAPID® and Olea Sphere®) with regard to volume estimation of hypoperfused tissue, ADC, and perfusion-diffusion mismatch. There is a general consistency between both software programs specifically when comparing the mean values of hypoperfused tissue, ADC, and perfusion-diffusion mismatch. A small systematic difference was observed in the sense that RAPID® outlines smaller volumes of hypoperfused tissue but slightly larger ADC volumes. This fact becomes more important when looking at the absolute difference between both methods. An absolute difference between RAPID® and Olea Sphere® of nearly 30 ml perfusion-diffusion mismatch volume suggests that a strict limit of perfusion-diffusion mismatch > 70 ml for the decision whether MT is an appropriate therapy might not be transferable to other software products. Potential reasons for the perfusion-diffusion mismatch volume discrepancies may be the different segmentation algorithm for the hypoperfused tissue and ADC volumes. Although the identified regions for hypoperfused tissue and ADC are congruent, small differences of the outlined regions in single slices can sum up to considerable differences in 3D volumes. However, differences of hypoperfused tissue and ADC volumes estimated with RAPID® and Olea Sphere® seemed to be independent from volume size. This suggests that a constant correction factor might be applied to perfusion-diffusion mismatch volume limits for each software package to ensure comparable results with respect to therapy decision. Our results are in line with the work of Yunyun Xiong et al  in that the authors also observed differences in the volume of the infarct core for both software packages. They showed that RAPID® core volumes were larger than Olea Sphere® core volumes if a threshold of rCBF < 30% is applied. However, results are not directly comparable with our results as CT perfusion is based on relative cerebral blood flow (rCBF) to delineate the infarct core.
In our study, 6/81 patients would not have met the inclusion criteria for the DEFUSE 3 trial when the results of RAPID® were taken into account. Assuming the absence of other conflicting factors, strict application of the 70 ml volume limit would have led to the exclusion of these patients from mechanical thrombectomy. However, in this study, only two software packages were investigated. Further studies will be necessary comparing more software packages for automated perfusion-diffusion mismatch evaluation to validate suggested limits for therapy decision on a broader basis.
Several possible limitations must be considered when interpreting the results of our study. Firstly, identification of MRI studies and automated volume calculation was performed retrospectively. However, as all consecutive studies during the time of the investigation were included, the RAPID® and Olea Sphere® processing were performed on the same MRI source images, and no manual correction was performed during the segmentation process; the typical drawbacks of retrospective data acquisition were minimized for our study. Secondly, the compared software packages are applying different segmentation algorithms for calculation of the volume of hypoperfused tissue and ADC. The exact underlying algorithm is not known. As the use of such software in the clinical routine is considered to be without user interaction, the missing in-depth knowledge about the underlying algorithms does not influence the results of our study. Thirdly, we did not attempt to correlate the results with the clinical outcome of the patients or the final stroke volume in the follow-up imaging. However, as the primary goal of the study was to evaluate the technical differences of the two software packages in stroke diagnostics, correlation to the clinical outcome would have meant a research question on its own. Furthermore, additional calculation of the spatial overlap between lesions was not performed. In the automated perfusion-diffusion mismatch evaluation, the user has no access to the outlined regions. Therefore, a post processing of the outlined regions in terms of quantifying the overlap, for example with estimating the Dice coefficient, was not possible. However, two experienced neuroradiologists have examined all 81 patients and confirmed the congruence of hypoperfused tissue and ADC for the two evaluations on a visual basis.
The benefits of using automated imaging software to support clinical decisions in acute ischemic stroke are undoubted. However, this study revealed that volume segmentation in different software products may lead to significantly different result in the individual patient and may thus seriously influence the decision for or against mechanical thrombectomy. Thresholds used for therapeutic decisions and based on absolute numbers might not be transferable between different software platforms.
Large vessel occlusion
Broderick JP, Palesch YY, Demchuk AM et al (2013) Endovascular therapy after intravenous t-PA versus t-PA alone for stroke. N Engl J Med 368:893–903
Ciccone A, Valvassori L, Nichelatti M et al (2013) Endovascular treatment for acute ischemic stroke. N Engl J Med 368:904–913
Kidwell CS, Jahan R, Gornbein J et al (2013) A trial of imaging selection and endovascular treatment for ischemic stroke. N Engl J Med 368:914–923
Berkhemer OA, Fransen PS, Beumer D et al (2015) A randomized trial of intraarterial treatment for acute ischemic stroke. N Engl J Med 372:11–20
Goyal M, Demchuk AM, Menon BK et al (2015) Randomized assessment of rapid endovascular treatment of ischemic stroke. N Engl J Med 372:1019–1030
Bracard S, Ducrocq X, Mas JL et al (2016) Mechanical thrombectomy after intravenous alteplase versus alteplase alone after stroke (THRACE): a randomised controlled trial. Lancet Neurol 15:1138–1147
Campbell BC, Mitchell PJ, Kleinig TJ et al (2015) Endovascular therapy for ischemic stroke with perfusion-imaging selection. N Engl J Med 372:1009–1018
Jovin TG, Chamorro A, Cobo E et al (2015) Thrombectomy within 8 hours after symptom onset in ischemic stroke. N Engl J Med 372:2296–2306
Saver JL, Goyal M, Bonafe A et al (2015) Stent-retriever thrombectomy after intravenous t-PA vs. t-PA alone in stroke. N Engl J Med 372:2285–2295
Albers GW, Marks MP, Kemp S et al (2018) Thrombectomy for stroke at 6 to 16 hours with selection by perfusion imaging. N Engl J Med 378:708–718
Nogueira RG, Jadhav AP, Haussen DC et al (2018) Thrombectomy 6 to 24 hours after stroke with a mismatch between deficit and infarct. N Engl J Med 378:11–21
Powers WJ, Rabinstein AA, Ackerson T et al (2018) 2018 guidelines for the early management of patients with acute ischemic stroke: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 49:e46–e110
Beaulieu C, de Crespigny A, Tong DC, Moseley ME, Albers GW, Marks MP (1999) Longitudinal magnetic resonance imaging study of perfusion and diffusion in stroke: evolution of lesion volume and correlation with clinical outcome. Ann Neurol 46:568–578
Campbell BC, Christensen S, Levi CR et al (2012) Comparison of computed tomography perfusion and magnetic resonance imaging perfusion-diffusion mismatch in ischemic stroke. Stroke 43:2648–2653
Quarles CC, Bell LC, Stokes AM (2019) Imaging vascular and hemodynamic features of the brain using dynamic susceptibility contrast and dynamic contrast enhanced MRI. Neuroimage 187:32–55
Vora NA, Shook SJ, Schumacher HC et al (2011) A 5-item scale to predict stroke outcome after cortical middle cerebral artery territory infarction: validation from results of the Diffusion and Perfusion Imaging Evaluation for Understanding Stroke Evolution (DEFUSE) Study. Stroke 42:645–649
Thomalla G, Simonsen CZ, Boutitie F et al (2018) MRI-guided thrombolysis for stroke with unknown time of onset. N Engl J Med 379:611–622
Christensen S, Mouridsen K, Wu O et al (2009) Comparison of 10 perfusion MRI parameters in 97 sub-6-hour stroke patients using voxel-based receiver operating characteristics analysis. Stroke 40:2055–2061
Wouters A, Christensen S, Straka M et al (2017) A comparison of relative time to peak and Tmax for mismatch-based patient selection. Front Neurol 8:539
Purushotham A, Campbell BC, Straka M et al (2015) Apparent diffusion coefficient threshold for delineation of ischemic core. Int J Stroke 10:348–353
Campbell BCV, Majoie CBLM, Albers GW (2019) Penumbral imaging and functional outcome in patients with anterior circulation ischaemic stroke treated with endovascular thrombectomy versus medical therapy: a meta-analysis of individual patient-level data. Lancet Neurol 18:46–55
Tsivgoulis G, Katsanos AH, Schellinger PD et al (2018) Advanced neuroimaging in stroke patient selection for mechanical thrombectomy. Stroke 49:3067–3070
Guenego A, Mosimann PJ, Pereira VM et al (2019) Proposed achievable levels of dose and impact of dose-reduction systems for thrombectomy in acute ischemic stroke: an international, multicentric, retrospective study in 1096 patients. Eur Radiol 29:3506–3515
Lansberg MG, Lee J, Christensen S et al (2011) RAPID automated patient selection for reperfusion therapy: a pooled analysis of the Echoplanar Imaging Thrombolytic Evaluation Trial (EPITHET) and the Diffusion and Perfusion Imaging Evaluation for Understanding Stroke Evolution (DEFUSE) Study. Stroke 42:1608–1614
Xiong Y, Huang CC, Fisher M, Hackney DB, Bhadelia RA, Selim MH (2019) Comparison of automated CT perfusion softwares in evaluation of acute ischemic stroke. J Stroke Cerebrovasc Dis 28:104392
We are extremely grateful to Prof. Franz Fazekas for his valuable contribution to the conception of this study. To our regret, further work on this manuscript on his part was thwarted, due to a severe medical incident.
Open access funding provided by Medical University of Graz.
The scientific guarantor of this publication is Dr. Gernot Reishofer.
Conflict of interest
The authors of this manuscript declare no relationships with any companies whose products or services may be related to the subject matter of the article.
Statistics and biometry
One of the authors has significant statistical expertise.
Written informed consent was obtained from all subjects (patients) in this study.
Institutional Review Board approval was obtained.
• performed at one institution
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Deutschmann, H., Hinteregger, N., Wießpeiner, U. et al. Automated MRI perfusion-diffusion mismatch estimation may be significantly different in individual patients when using different software packages. Eur Radiol 31, 658–665 (2021). https://doi.org/10.1007/s00330-020-07150-8