Skip to main content

Diagnostic test accuracy of pretreatment collateral score in predicting stroke outcomes after intra-arterial endovascular thrombectomy: a meta-analysis in DSA and CTA

European Radiology volume 32, pages 6097–6107 (2022)Cite this article

Abstract

Objectives

This study compared the diagnostic accuracy of pretreatment circulation collateral scoring (CS) system using digital subtraction angiography (DSA) and computed tomography angiography (CTA) in predicting favorable functional outcome (FFO) after intra-arterial endovascular thrombectomy (IA-EVT). Subgroup analysis characterizing scoring systems within each category was additionally conducted.

Materials and methods

We performed a diagnostic meta-analysis to assess the sensitivity and specificity of each CS system by using DSA and CTA, respectively. The hierarchical summary receiver operating characteristic curve (HSROC) models were used to estimate the diagnostic odds ratio (DOR) and area under the curve (AUC). The Bayes theorem was employed to determine posttest probability (PTP).

Results

In total, 14 and 21 studies were assessed with DSA and CTA, respectively. In DSA, the pooled sensitivity and specificity were 0.72 (95% CI, 0.63–0.79) and 0.61 (0.53–0.68), respectively, and in the HSROC model, the DOR was 3.94 (2.71–5.73), and the AUC was 0.71 (90.67–0.75). CTA revealed a pooled sensitivity and specificity of 0.74 (0.64–0.82) and 0.53 (0.44–0.62), respectively, and in the HSROC model, the DOR was 3.17 (2.34–4.50), and the AUC was 0.67 (0.63–0.71). With a pretest probability of 26.3%, the CS in DSA and CTA exhibited limited increase of PTPs of 39% and 36%, respectively, in detecting the FFO on day 90.

Conclusion

DSA and CTA have comparable accuracy and are limited in predicting the functional outcome. The collateral score systems assessed with DSA and CTA were more suitable for screening than diagnosis for patients before IA-EVT.

Key Points

• Our study revealed the differences of various scoring systems for assessing collateral status.

• DSA and CTA have comparable accuracy, but both imaging modalities played relatively limited roles in predicting functional outcome on day 90.

• The collateral score systems assessed with DSA and CTA were more suitable for screening than diagnosis for patients before IA-EVT.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Abbreviations

ASITN/SIR:

American Society of Intervention and Therapeutic Neuroradiology/Society of Interventional Radiology

AUC:

Area under the curve

CS:

Collateral scoring

CTA:

Computed tomography angiography

DOR:

Diagnostic odds ratio

DSA:

Digital subtraction angiography

FFO:

Favorable functional outcome

HSROC:

Hierarchical summary receiver operating characteristic curve

IA-EVT:

Intra-arterial endovascular thrombectomy

mRS:

Modified Rankin Scale

PTP:

Posttest probability

rLMC:

Regional leptomeningeal collateral

References

  1. Berkhemer OA, Fransen PS, Beumer D et al (2015) A randomized trial of intraarterial treatment for acute ischemic stroke. N Engl J Med 372:11–20

  2. Goyal M, Demchuk AM, Menon BK et al (2015) Randomized assessment of rapid endovascular treatment of ischemic stroke. N Engl J Med 372:1019–1030

  3. Saver JL, Goyal M, Bonafe A et al (2015) Stent-retriever thrombectomy after intravenous t-PA vs. t-PA alone in stroke. N Engl J Med 372:2285–2295

  4. Campbell BC, Mitchell PJ, Kleinig TJ et al (2015) Endovascular therapy for ischemic stroke with perfusion-imaging selection. N Engl J Med 372:1009–1018

  5. Jovin TG, Chamorro A, Cobo E et al (2015) Thrombectomy within 8 hours after symptom onset in ischemic stroke. N Engl J Med 372:2296–2306

  6. Albers GW, Marks MP, Kemp S et al (2018) Thrombectomy for Stroke at 6 to 16 hours with selection by perfusion imaging. N Engl J Med 378:708–718

  7. Nogueira RG, Jadhav AP, Haussen DC et al (2018) Thrombectomy 6 to 24 hours after stroke with a mismatch between deficit and infarct. N Engl J Med 378:11–21

  8. Vagal A, Aviv R, Sucharew H et al (2018) Collateral clock is more important than time clock for tissue fate. Stroke 49:2102–2107

  9. Rusanen H, Saarinen JT, Sillanpaa N (2015) Collateral Circulation predicts the size of the infarct core and the proportion of salvageable penumbra in hyperacute ischemic stroke patients treated with intravenous thrombolysis. Cerebrovasc Dis 40:182–190

    Article  CAS  Google Scholar 

  10. Qian J, Fan L, Zhang W, Wang J, Qiu J, Wang Y (2020) A meta-analysis of collateral status and outcomes of mechanical thrombectomy. Acta Neurol Scand 142:191–199

    Article  Google Scholar 

  11. Yeo LL, Paliwal P, Teoh HL et al (2015) Assessment of intracranial collaterals on CT angiography in anterior circulation acute ischemic stroke. AJNR Am J Neuroradiol 36:289–294

  12. Sung SM, Lee TH, Cho HJ et al (2015) Functional outcome after recanalization for acute pure M1 occlusion of the middle cerebral artery as assessed by collateral CTA flow. Clin Neurol Neurosurg 131:72–76

  13. Liu L, Ding J, Leng X et al (2018) Guidelines for evaluation and management of cerebral collateral circulation in ischaemic stroke 2017. Stroke Vasc Neurol 3:117–130

  14. Liberati A, Altman DG, Tetzlaff J et al (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ 339:b2700

  15. Whiting PF, Rutjes AW, Westwood ME et al (2011) QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med 155:529–536

  16. Higgins JP, Thompson SG, Deeks JJ, Altman DG (2003) Measuring inconsistency in meta-analyses. BMJ 327:557–560

    Article  Google Scholar 

  17. Hartzes AM, Morgan CJ (2019) Meta-analysis for diagnostic tests. J Nucl Cardiol 26:68–71

    Article  Google Scholar 

  18. Leeflang MM (2014) Systematic reviews and meta-analyses of diagnostic test accuracy. Clin Microbiol Infect 20:105–113

    Article  CAS  Google Scholar 

  19. Deeks JJ, Macaskill P, Irwig L (2005) The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol 58:882–893

    Article  Google Scholar 

  20. Higashida RT, Furlan AJ, Roberts H et al (2003) Trial design and reporting standards for intra-arterial cerebral thrombolysis for acute ischemic stroke. Stroke 34:e109–e137

  21. Christoforidis GA, Mohammad Y, Kehagias D, Avutu B, Slivka AP (2005) Angiographic assessment of pial collaterals as a prognostic indicator following intra-arterial thrombolysis for acute ischemic stroke. AJNR Am J Neuroradiol 26:1789–1797

    PubMed  PubMed Central  Google Scholar 

  22. Mangiafico S, Consoli A, Renieri L et al (2013) Semi-quantitative and qualitative evaluation of pial leptomeningeal collateral circulation in acute ischemic stroke of the anterior circulation: the Careggi Collateral Score. Ital J Anat Embryol 118:277–287

  23. Al-Ali F, Jefferson A, Barrow T et al (2013) The capillary index score: rethinking the acute ischemic stroke treatment algorithm. Results from the Borgess Medical Center Acute Ischemic Stroke Registry. J Neurointerv Surg 5:139–143

  24. Tan IY, Demchuk AM, Hopyan J et al (2009) CT angiography clot burden score and collateral score: correlation with clinical and radiologic outcomes in acute middle cerebral artery infarct. AJNR Am J Neuroradiol 30:525–531

  25. Souza LC, Yoo AJ, Chaudhry ZA et al (2012) Malignant CTA collateral profile is highly specific for large admission DWI infarct core and poor outcome in acute stroke. AJNR Am J Neuroradiol 33:1331–1336

  26. Menon BK, Smith EE, Modi J et al (2011) Regional leptomeningeal score on CT angiography predicts clinical and imaging outcomes in patients with acute anterior circulation occlusions. AJNR Am J Neuroradiol 32:1640–1645

  27. Miteff F, Levi CR, Bateman GA, Spratt N, McElduff P, Parsons MW (2009) The independent predictive utility of computed tomography angiographic collateral status in acute ischaemic stroke. Brain 132:2231–2238

    Article  Google Scholar 

  28. Maas MB, Lev MH, Ay H et al (2009) Collateral vessels on CT angiography predict outcome in acute ischemic stroke. Stroke 40:3001–3005

  29. Kim JT, Liebeskind DS, Jahan R et al (2018) Impact of hyperglycemia according to the collateral status on outcomes in mechanical thrombectomy. Stroke 49:2706–2714

  30. Singer OC, Berkefeld J, Nolte CH et al (2015) Collateral vessels in proximal middle cerebral artery occlusion: the ENDOSTROKE study. Radiology 274:851–858

  31. Hwang YH, Kang DH, Kim YW, Kim YS, Park SP, Liebeskind DS (2015) Impact of time-to-reperfusion on outcome in patients with poor collaterals. AJNR Am J Neuroradiol 36:495–500

    Article  Google Scholar 

  32. Sheth SA, Sanossian N, Hao Q et al (2016) Collateral flow as causative of good outcomes in endovascular stroke therapy. J Neurointerv Surg 8:2–7

  33. Liebeskind DS, Tomsick TA, Foster LD et al (2014) Collaterals at angiography and outcomes in the Interventional Management of Stroke (IMS) III trial. Stroke 45:759–764

  34. Liebeskind DS, Jahan R, Nogueira RG, Zaidat OO, Saver JL, Investigators S (2014) Impact of collaterals on successful revascularization in Solitaire FR with the intention for thrombectomy. Stroke 45:2036–2040

    Article  Google Scholar 

  35. Marks MP, Lansberg MG, Mlynash M et al (2014) Effect of collateral blood flow on patients undergoing endovascular therapy for acute ischemic stroke. Stroke 45:1035–1039

  36. Sallustio F, Motta C, Pizzuto S et al (2017) CT angiography-based collateral flow and time to reperfusion are strong predictors of outcome in endovascular treatment of patients with stroke. J Neurointerv Surg 9:940–943

  37. Ribo M, Flores A, Rubiera M et al (2011) Extending the time window for endovascular procedures according to collateral pial circulation. Stroke 42:3465–3469

  38. Mangiafico S, Saia V, Nencini P et al (2014) Effect of the interaction between recanalization and collateral circulation on functional outcome in acute ischaemic stroke. Interv Neuroradiol 20:704–714

  39. Duan Z, Huang X, Gao J et al (2020) Application of capillary index score in predicting three-month functional outcome after endovascular treatment for acute ischemic stroke in China. Interv Neuroradiol 26:309–315

  40. Al-Ali F, Berkhemer OA, Yousman WP et al (2016) The capillary index score as a marker of viable cerebral tissue: proof of concept-the capillary index score in the MR CLEAN (Multicenter Randomized Clinical Trial of Endovascular Treatment for Acute Ischemic Stroke in the Netherlands) trial. Stroke 47:2286–2291

  41. Labeyrie PE, Redjem H, Blanc R et al (2016) The Capillary Index Score before thrombectomy: an angiographic correlate of favorable outcome. J Neurointerv Surg 8:1119–1122

  42. Rai AT, Jhadhav Y, Domico J, Hobbs GR (2012) Procedural predictors of outcome in patients undergoing endovascular therapy for acute ischemic stroke. Cardiovasc Intervent Radiol 35:1332–1339

    Article  Google Scholar 

  43. Hassler E, Kneihsl M, Deutschmann H et al (2020) Relationship between stroke etiology and collateral status in anterior circulation large vessel occlusion. J Neurol 267:3362–3370

  44. Jansen IG, Mulder MJ, Goldhoorn RB et al (2019) Impact of single phase CT angiography collateral status on functional outcome over time: results from the MR CLEAN Registry. J Neurointerv Surg 11:866–873

  45. Cao R, Qi P, Liu Y, Ma X, Shen Z, Chen J (2019) Improving prognostic evaluation by 4D CTA for Endovascular treatment in acute ischemic stroke patients: a preliminary study. J Stroke Cerebrovasc Dis 28:1971–1978

    Article  Google Scholar 

  46. Yeo LL, Andersson T, Holmberg A et al (2019) Posterior communicating and anterior communicating arteries on pre-thrombectomy computed tomography scans are associated with good outcomes irrespective of leptomeningeal collateral status. Interv Neuroradiol 25:364–370

  47. de Havenon A, Mlynash M, Kim-Tenser MA et al (2019) Results From DEFUSE 3: good collaterals are associated with reduced ischemic core growth but not neurologic outcome. Stroke 50:632–638

  48. Nordmeyer H, Webering N, Chapot R et al (2017) The association between collateral status, recanalization and long term outcome in stroke patients treated with stent retrievers - are there indications not to perform thrombectomy based on CT angiography? J Neuroradiol 44:217–222

  49. Schonenberger S, Pfaff J, Uhlmann L et al (2017) The impact of conscious sedation versus general anesthesia for stroke thrombectomy on the predictive value of collateral status: a post hoc analysis of the SIESTA trial. AJNR Am J Neuroradiol 38:1580–1585

  50. Berkhemer OA, Jansen IG, Beumer D et al (2016) Collateral Status on baseline computed tomographic angiography and intra-arterial treatment effect in patients with proximal anterior circulation stroke. Stroke 47:768–776

  51. Gerber JC, Petrova M, Krukowski P et al (2016) Collateral state and the effect of endovascular reperfusion therapy on clinical outcome in ischemic stroke patients. Brain Behav 6:e00513

  52. Garcia-Tornel A, Carvalho V, Boned S et al (2016) Improving the evaluation of collateral circulation by multiphase computed tomography angiography in acute stroke patients treated with endovascular reperfusion therapies. Interv Neurol 5:209–217

  53. Ko CC, Liu HM, Chen TY et al (2020) Prediction of mTICI 3 recanalization and clinical outcomes in endovascular thrombectomy for acute ischemic stroke: a retrospective study in the Taiwan registry. Neurol Sci. https://doi.org/10.1007/s10072-020-04800-z

  54. Broocks G, Kemmling A, Meyer L et al (2019) Computed tomography angiography collateral profile is directly linked to early edema progression rate in acute ischemic stroke. Stroke 50:3424–3430

  55. Park JS, Kwak HS, Chung GH, Hwang S (2018) The prognostic value of CT-angiographic parameters after reperfusion therapy in acute ischemic stroke patients with internal carotid artery terminus occlusion: leptomeningeal collateral status and clot burden score. J Stroke Cerebrovasc Dis 27:2797–2803

    Article  Google Scholar 

  56. Gersing AS, Schwaiger BJ, Kleine JF et al (2017) Clinical outcome predicted by collaterals depends on technical success of mechanical thrombectomy in middle cerebral artery occlusion. J Stroke Cerebrovasc Dis 26:801–808

  57. Nambiar V, Sohn SI, Almekhlafi MA et al (2014) CTA collateral status and response to recanalization in patients with acute ischemic stroke. AJNR Am J Neuroradiol 35:884–890

  58. van Horn N, Kniep H, Leischner H et al (2021) Predictors of poor clinical outcome despite complete reperfusion in acute ischemic stroke patients. J Neurointerv Surg 13:14–18

  59. Kim BJ, Chung JW, Park HK et al (2017) CT angiography of collateral vessels and outcomes in endovascular-treated acute ischemic stroke patients. J Clin Neurol 13:121–128

  60. Chang JY, Jeon SB, Jung C, Gwak DS, Han MK (2019) Postreperfusion blood pressure variability after endovascular thrombectomy affects outcomes in acute ischemic stroke patients with poor collateral circulation. Front Neurol 10:346

    Article  Google Scholar 

  61. Gavriliuc P, Kharouba R, Cohen JE, Gomori JM, Yaghmour N, Leker RR (2018) Clot length does not impact outcome following thrombectomy. J Neurol Sci 395:91–94

    Article  CAS  Google Scholar 

  62. Seeta Ramaiah S, Churilov L, Mitchell P, Dowling R, Yan B (2014) The impact of arterial collateralization on outcome after intra-arterial therapy for acute ischemic stroke. AJNR Am J Neuroradiol 35:667–672

    Article  CAS  Google Scholar 

  63. Kim BM, Baek JH, Heo JH et al (2018) Collateral status affects the onset-to-reperfusion time window for good outcome. J Neurol Neurosurg Psychiatry 89:903–909

  64. van den Wijngaard IR, Holswilder G, Wermer MJ et al (2016) Assessment of collateral status by dynamic CT angiography in acute MCA stroke: timing of acquisition and relationship with final infarct volume. AJNR Am J Neuroradiol 37:1231–1236

  65. Kaschka IN, Kloska SP, Struffert T et al (2016) Clot burden and collaterals in anterior circulation stroke: differences between single-phase CTA and multi-phase 4D-CTA. Clin Neuroradiol 26:309–315

  66. Beyer SE, Thierfelder KM, von Baumgarten L et al (2015) Strategies of collateral blood flow assessment in ischemic stroke: prediction of the follow-up infarct volume in conventional and dynamic CTA. AJNR Am J Neuroradiol 36:488–494

  67. Menon BK, d'Esterre CD, Qazi EM et al (2015) Multiphase CT angiography: a new tool for the imaging triage of patients with acute ischemic stroke. Radiology 275:510–520

  68. Smit EJ, Vonken EJ, van Seeters T et al (2013) Timing-invariant imaging of collateral vessels in acute ischemic stroke. Stroke 44:2194–2199

  69. Smit EJ, Vonken EJ, van der Schaaf IC et al (2012) Timing-invariant reconstruction for deriving high-quality CT angiographic data from cerebral CT perfusion data. Radiology 263:216–225

  70. Ben Hassen W, Malley C, Boulouis G et al (2019) Inter- and intraobserver reliability for angiographic leptomeningeal collateral flow assessment by the American Society of Interventional and Therapeutic Neuroradiology/Society of Interventional Radiology (ASITN/SIR) scale. J Neurointerv Surg 11:338–341

  71. Kamalian S, Kemmling A, Borgie RC et al (2013) Admission insular infarction >25% is the strongest predictor of large mismatch loss in proximal middle cerebral artery stroke. Stroke 44:3084–3089

  72. Kaesmacher J, Chaloulos-Iakovidis P, Panos L et al (2019) Mechanical thrombectomy in ischemic stroke patients with Alberta Stroke Program early computed tomography score 0-5. Stroke 50:880–888

  73. Cagnazzo F, Derraz I, Dargazanli C et al (2020) Mechanical thrombectomy in patients with acute ischemic stroke and ASPECTS </=6: a meta-analysis. J Neurointerv Surg 12:350–355

  74. Diestro JDB, Dmytriw AA, Broocks G et al (2020) Endovascular thrombectomy for low ASPECTS large vessel occlusion ischemic stroke: a systematic review and meta-analysis. Can J Neurol Sci 47:612–619

  75. Broocks G (December 1, 2021-) Improving low Alberta Stroke Program early ct score stroke thrombectomy. Available via https://clinicaltrials.gov/ct2/show/record/NCT04862507

Download references

Acknowledgements

Data curation and investigation were performed by Wei-Zhen Lu, Hui-An Lin, Chyi-Huey Bai, Sen-Kuang Hou, and Sheng-Feng Lin. Wei-Zhen Lu (first author) and Hui-An Lin (co-first author) contributed equally. Formal analysis and software were conducted by Sheng-Feng Lin. Original draft was wrote by Wei-Zhen Lu, Hui-An Lin, and Sheng-Feng Lin. Final review and editing of the draft were performed by Wei-Zhen Lu and Sheng-Feng Lin.

Funding

The authors state that this work has not received any funding.

Author information

Authors and Affiliations

  1. Department of Emergency Medicine, Taipei Medical University-Shuang Ho Hospital, New Taipei, Taiwan

    Wei-Zhen Lu

  2. Department of Emergency Medicine, Taipei Medical University Hospital, Taipei, Taiwan

    Hui-An Lin, Sen-Kuang Hou & Sheng-Feng Lin

  3. Department of Emergency Medicine, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan

    Sen-Kuang Hou

  4. School of Public Health, College of Public Health, Taipei Medical University, Taipei, Taiwan

    Chyi-Huey Bai & Sheng-Feng Lin

  5. Department of Public Health, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan

    Chyi-Huey Bai & Sheng-Feng Lin

  6. Nutrition Research Center, Taipei Medical University Hospital, Taipei, Taiwan

    Chyi-Huey Bai

  7. Department of Critical Care Medicine, Taipei Medical University Hospital, Taipei, Taiwan

    Sheng-Feng Lin

Authors
  1. Wei-Zhen Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hui-An Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sen-Kuang Hou
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Chyi-Huey Bai
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Sheng-Feng Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sheng-Feng Lin.

Ethics declarations

Guarantor

The scientific guarantor of this publication is Sheng-Feng Lin.

Conflict of interest

The authors of this manuscript declare no relationships with any companies whose products or services may be related to the subject matter of the article.

Statistics and biometry

One of the authors, Sheng-Feng Lin, has significant statistical expertise.

Informed consent

This study was a systemic review and meta-analysis. No informed consent and ethical committee review were required. This study was registered on PROSPERO (reference number: CRD42021237879).

Ethical approval

This study was registered on PROSPERO (reference number: CRD42021237879). This study was a systemic review and meta-analysis. No informed consent and ethical committee review were required.

Methodology

  • Retrospective

  • Diagnostic or prognostic study

  • Multicentre study

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Wei-Zhen Lu is the first author, and Hui-An Lin is the co-first author.

Supplementary Information

ESM 1

(DOCX 11730 kb)

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Lu, WZ., Lin, HA., Hou, SK. et al. Diagnostic test accuracy of pretreatment collateral score in predicting stroke outcomes after intra-arterial endovascular thrombectomy: a meta-analysis in DSA and CTA . Eur Radiol 32, 6097–6107 (2022). https://doi.org/10.1007/s00330-022-08706-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00330-022-08706-6

Keywords

  • Acute ischemic stroke
  • Collateral circulation
  • Computed tomography angiography
  • Digital subtraction angiography
  • Thrombectomy