External validation of cerebral aneurysm rupture probability model with data from two patient cohorts
- 360 Downloads
For a treatment decision of unruptured cerebral aneurysms, physicians and patients need to weigh the risk of treatment against the risk of hemorrhagic stroke caused by aneurysm rupture. The aim of this study was to externally evaluate a recently developed statistical aneurysm rupture probability model, which could potentially support such treatment decisions.
Segmented image data and patient information obtained from two patient cohorts including 203 patients with 249 aneurysms were used for patient-specific computational fluid dynamics simulations and subsequent evaluation of the statistical model in terms of accuracy, discrimination, and goodness of fit. The model’s performance was further compared to a similarity-based approach for rupture assessment by identifying aneurysms in the training cohort that were similar in terms of hemodynamics and shape compared to a given aneurysm from the external cohorts.
When applied to the external data, the model achieved a good discrimination and goodness of fit (area under the receiver operating characteristic curve AUC = 0.82), which was only slightly reduced compared to the optimism-corrected AUC in the training population (AUC = 0.84). The accuracy metrics indicated a small decrease in accuracy compared to the training data (misclassification error of 0.24 vs. 0.21). The model’s prediction accuracy was improved when combined with the similarity approach (misclassification error of 0.14).
The model’s performance measures indicated a good generalizability for data acquired at different clinical institutions. Combining the model-based and similarity-based approach could further improve the assessment and interpretation of new cases, demonstrating its potential use for clinical risk assessment.
KeywordsCerebral aneurysm Risk factors Hemodynamics Shape Rupture Prediction
The authors would like to thank Rafik Ouared and Olivier Brina for helping with the image segmentation of the AneuX data.
This study was funded by the National Institutes of Health/National Institute of Neurological Disorders and Stroke (NIH-NINDS, grant no. R21NS094780). NJ, SH, VMP, and PB were supported by SystemsX.ch project AneuX evaluated by the Swiss National Science Foundation.
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. For this type of study, formal consent is not required.
- 6.Cebral J, Ollikainen E, Chung BJ, Mut F, Sippola V, Jahromi BR, Tulamo R, Hernesniemi J, Niemela M, Robertson AM, Frösen J (2017) Flow conditions in the intracranial aneurysm lumen are associated with inflammation and degenerative changes of the aneurysm wall. AJNR Am J Neuroradiol 38:119–126CrossRefGoogle Scholar
- 10.Detmer FJ, Chung BJ, Mut F, Slawski M, Hamzei-Sichani F, Putman C, Jiménez C, Cebral JR (2018) Development and internal validation of an aneurysm rupture probability model based on patient characteristics and aneurysm location, morphology, and hemodynamics. Int J Comput Assist Radiol Surg. https://doi.org/10.1007/s11548-018-1837-0 CrossRefGoogle Scholar
- 12.Gillani RL, Podraza KM, Luthra N, Origitano TC, Schneck MJ (2016) Factors influencing the management of unruptured intracranial aneurysms. Cureus. https://doi.org/10.7759/cureus.601
- 13.Greving JP, Wermer MJ, Brown RD, Morita A, Juvela S, Yonekura M, Ishibashi T, Torner JC, Nakayama T, Rinkel GJ, Algra A (2014) Development of the PHASES score for prediction of risk of rupture of intracranial aneurysms: a pooled analysis of six prospective cohort studies. Lancet Neurol 13:59–66CrossRefGoogle Scholar
- 16.Jabbarli R, Dinger TF, Darkwah Oppong M, Pierscianek D, Dammann P, Wrede KH, Kaier K, Köhrmann M, Forsting M, Kleinschnitz C, Sure U (2018) Risk factors for and clinical consequences of multiple intracranial aneurysms: a systematic review and meta-analysis. Stroke 49(4):848–855CrossRefGoogle Scholar
- 19.Kleinloog R, de Mul N, Verweij BH, Post JA, Rinkel GJE, Ruigrok YM (2017) Risk factors for intracranial aneurysm rupture: a systematic review. Neurosurgery. https://doi.org/10.1093/neuros/nyx238
- 24.Piccinelli M, Bacigaluppi S, Boccardi E, Ene-Iordache B, Remuzzi A, Veneziani A, Antiga L (2011) Geometry of the internal carotid artery and recurrent patterns in location, orientation, and rupture status of lateral aneurysms: an image-based computational study. Neurosurgery 68(5):1270–1285CrossRefGoogle Scholar
- 30.Thompson BG, Brown RD, Amin-Hanjani S, Broderick JP, Cockroft KM, Connolly ES, Duckwiler GR, Harris CC, Howard VJ, Johnston SC, Meyers PM, Molyneux A, Ogilvy CS, Ringer AJ, Torner J (2015) Guidelines for the management of patients with unruptured intracranial aneurysms: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 46(8):2368–2400CrossRefGoogle Scholar
- 36.Wiebers DO, Whisnant JP, Huston J, Meissner I, Brown RD, Piepgras DG, Forbes GS, Thielen K, Nichols D, O’Fallon WM, Peacock J, Jaeger L, Kassell NF, Kongable-Beckman GL, Torner JC (2003) Unruptured intracranial aneurysms: natural history, clinical outcome, and risks of surgical and endovascular treatment. Lancet 362:103–110CrossRefGoogle Scholar
- 37.Xiang J, Varble N, Davies JM, Rai AT, Kono K, Sugiyama S, Binning MJ, Tawk RG, Choi H, Ringer AJ, Snyder KV, Levy EI, Hopkins LN, Siddiqui AH, Meng H (2017) Initial clinical experience with AView—a clinical computational platform for intracranial aneurysm morphology, hemodynamics, and treatment management. World Neurosurg 108:534–542CrossRefGoogle Scholar