Abstract
Purpose
In this study, we wished to compare statistically the novel SORG algorithm in predicting survival in spine metastatic disease versus currently used methods.
Methods
We recruited 40 patients with spinal metastatic disease who were operated at Geneva University Hospitals by the Neurosurgery or Orthopedic teams between the years of 2015 and 2020. We did an ROC analysis in order to determine the accuracy of the SORG ML algorithm and nomogram versus the Tokuhashi original and revised scores.
Results
The analysis of data of our independent cohort shows a clear advantage in terms of predictive ability of the SORG ML algorithm and nomogram in comparison with the Tokuhashi scores. The SORG ML had an AUC of 0.87 for 90 days and 0.85 for 1 year. The SORG nomogram showed a predictive ability at 90 days and 1 year with AUCs of 0.87 and 0.76 respectively. These results showed excellent discriminative ability as compared with the Tokuhashi original score which achieved AUCs of 0.70 and 0.69 and the Tokuhashi revised score which had AUCs of 0.65 and 0.71 for 3 months and 1 year respectively.
Conclusion
The predictive ability of the SORG ML algorithm and nomogram was superior to currently used preoperative survival estimation scores for spinal metastatic disease.
Similar content being viewed by others
References
Ahmed AK, Goodwin CR, Heravi A, Kim R, Abu-Bonsrah N, Sankey E, Kerekes D, De la Garza RR, Schwab J, Sciubba DM (2018) Predicting survival for metastatic spine disease: a comparison of nine scoring systems. Spine J 18(10):1804–1814. https://doi.org/10.1016/j.spinee.2018.03.011
Bollen L, van der Linden YM, Pondaag W, Fiocco M, Pattynama BP, Marijnen CA, Nelissen RG, Peul WC, Dijkstra PD (2014) Prognostic factors associated with survival in patients with symptomatic spinal bone metastases: a retrospective cohort study of 1,043 patients. Neuro Oncol 16(7):991–998. https://doi.org/10.1093/neuonc/not318
Bongers MER, Karhade AV, Villavieja J, Groot OQ, Bilsky MH, Laufer I, Schwab JH (2020) Does the SORG algorithm generalize to a contemporary cohort of patients with spinal metastases on external validation? Spine J. https://doi.org/10.1016/j.spinee.2020.05.003
Bouthors C, Prost S, Court C, Blondel B, Charles YP, Fuentes S, Mousselard HP, Mazel C, Flouzat-Lachaniette CH, Bonnevialle P, Saihlan F, the S (2020) Outcomes of surgical treatments of spinal metastases: a prospective study. Support Care Cancer 28(5):2127–2135. https://doi.org/10.1007/s00520-019-05015-5
Charlson ME, Pompei P, Ales KL, MacKenzie CR (1987) A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis 40(5):373–383. https://doi.org/10.1016/0021-9681(87)90171-8
Cole JS, Patchell RA (2008) Metastatic epidural spinal cord compression. Lancet Neurol 7(5):459–466. https://doi.org/10.1016/s1474-4422(08)70089-9
Collins GS, Reitsma JB, Altman DG, Moons KG (2015) Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): the TRIPOD statement. Br J Surg 102(3):148–158. https://doi.org/10.1002/bjs.9736
Dea N, Versteeg AL, Sahgal A, Verlaan J-J, Charest-Morin R, Rhines LD, Sciubba DM, Schuster JM, Weber MH, Lazary A, Fehlings MG, Clarke MJ, Arnold PM, Boriani S, Bettegowda C, Laufer I, Gokaslan ZL, Fisher CG, Tumor obot AKF (2019) Metastatic spine disease: should patients with short life expectancy be denied surgical care? Int Retrospective Cohort Study Neurosurg 87(2):303–311. https://doi.org/10.1093/neuros/nyz472
Forsberg JA, Wedin R, Bauer HC, Hansen BH, Laitinen M, Trovik CS, Keller JO, Boland PJ, Healey JH (2012) External validation of the Bayesian Estimated Tools for Survival (BETS) models in patients with surgically treated skeletal metastases. BMC Cancer 12:493. https://doi.org/10.1186/1471-2407-12-493
Gregory Zegarek, Enrico Tessitore, Aria Nouri, Karl Schaller, Renato Gondar. Sorg algorithm to predict 3- and 12-month survival in metastatic spinal disease: a cross-sectional population-based retrospective study. Brain and Spine. Volume 1, Supplement 1. 2021. 100122. ISSN 2772–5294. https://doi.org/10.1016/j.bas.2021.100122.
Karhade AV, Thio Q, Ogink PT, Bono CM, Ferrone ML, Oh KS, Saylor PJ, Schoenfeld AJ, Shin JH, Harris MB, Schwab JH (2019) Predicting 90-day and 1-year mortality in spinal metastatic disease: development and internal validation. Neurosurgery 85(4):E671-e681. https://doi.org/10.1093/neuros/nyz070
Karhade AV, Ahmed AK, Pennington Z, Chara A, Schilling A, Thio Q, Ogink PT, Sciubba DM, Schwab JH (2020) External validation of the SORG 90-day and 1-year machine learning algorithms for survival in spinal metastatic disease. Spine J 20(1):14–21. https://doi.org/10.1016/j.spinee.2019.09.003
Katagiri H, Okada R, Takagi T, Takahashi M, Murata H, Harada H, Nishimura T, Asakura H, Ogawa H (2014) New prognostic factors and scoring system for patients with skeletal metastasis. Cancer Med 3(5):1359–1367
Kirshblum S, Waring W 3rd (2014) Updates for the international standards for neurological classification of spinal cord injury. Phys Med Rehabil Clin N Am 25(3):505-517 vii. https://doi.org/10.1016/j.pmr.2014.04.001
Laufer I, Rubin DG, Lis E, Cox BW, Stubblefield MD, Yamada Y, Bilsky MH (2013) The NOMS framework: approach to the treatment of spinal metastatic tumors. Oncologist 18(6):744–751. https://doi.org/10.1634/theoncologist.2012-0293
L’esperance S, Vincent F, Gaudreault M, Ouellet J, Li M, Tosikyan A, Goulet S, oncologieCdlédpe (2012) Treatment of metastatic spinal cord compression: CEPO review and clinical recommendations. Curr Oncol 19(6):e478
Nater A, Tetreault LA, Kopjar B, Arnold PM, Dekutoski MB, Finkelstein JA, Fisher CG, France JC, Gokaslan ZL, Rhines LD, Rose PS, Sahgal A, Schuster JM, Vaccaro AR, Fehlings MG (2018) Predictive factors of survival in a surgical series of metastatic epidural spinal cord compression and complete external validation of 8 multivariate models of survival in a prospective North American multicenter study. Cancer 124(17):3536–3550. https://doi.org/10.1002/cncr.31585
Oken MM, Creech RH, Tormey DC, Horton J, Davis TE, McFadden ET, Carbone PP (1982) Toxicity and response criteria of the Eastern Cooperative Oncology Group. Am J Clin Oncol 5(6):649–655
Paulino Pereira NR, Janssen SJ, van Dijk E, Harris MB, Hornicek FJ, Ferrone ML, Schwab JH (2016) Development of a prognostic survival algorithm for patients with metastatic spine disease. J Bone Joint Surg Am 98(21):1767–1776. https://doi.org/10.2106/jbjs.15.00975
Paulino Pereira NR, Janssen SJ, van Dijk E, Harris MB, Hornicek FJ, Ferrone ML, Schwab JH (2016) SORG nomogram application. https://sorg-apps.shinyapps.io/spinemetssurvival/. Accessed 26.09.2020 2020
Paulino Pereira NR, McLaughlin L, Janssen SJ, van Dijk CN, Bramer JAM, Laufer I, Bilsky MH, Schwab JH (2017) The SORG nomogram accurately predicts 3- and 12-months survival for operable spine metastatic disease: external validation. J Surg Oncol 115(8):1019–1027. https://doi.org/10.1002/jso.24620
Sciubba DM, Petteys RJ, Dekutoski MB, Fisher CG, Fehlings MG, Ondra SL, Rhines LD, Gokaslan ZL (2010) Diagnosis and management of metastatic spine disease. A review J Neurosurg Spine 13(1):94–108. https://doi.org/10.3171/2010.3.Spine09202
Sciubba DM, Goodwin CR, Yurter A, Ju D, Gokaslan ZL, Fisher C, Rhines LD, Fehlings MG, Fourney DR, Mendel E, Laufer I, Bettegowda C, Patel SR, Rampersaud YR, Sahgal A, Reynolds J, Chou D, Weber MH, Clarke MJ (2016) A systematic review of clinical outcomes and prognostic factors for patients undergoing surgery for spinal metastases secondary to breast cancer. Global Spine J 6(5):482–496. https://doi.org/10.1055/s-0035-1564807
Taylor JW, Schiff D (2010) Metastatic epidural spinal cord compression. Semin Neurol 30(3):245–253. https://doi.org/10.1055/s-0030-1255221
Tokuhashi Y, Matsuzaki H, Toriyama S, Kawano H, Ohsaka S (1990) Scoring system for the preoperative evaluation of metastatic spine tumor prognosis. Spine (Phila Pa 1976) 15(11):1110–1113. https://doi.org/10.1097/00007632-199011010-00005
Tokuhashi Y, Matsuzaki H, Oda H, Oshima M, Ryu J (2005) A revised scoring system for preoperative evaluation of metastatic spine tumor prognosis. Spine (Phila Pa 1976) 30(19):2186–2191. https://doi.org/10.1097/01.brs.0000180401.06919.a5
Tokuhashi Y, Uei H, Oshima M, Ajiro Y (2014) Scoring system for prediction of metastatic spine tumor prognosis. World J Orthop 5(3):262–271. https://doi.org/10.5312/wjo.v5.i3.262
Tomita K, Kawahara N, Kobayashi T, Yoshida A, Murakami H, Akamaru T (2001) Surgical strategy for spinal metastases. Spine (Phila Pa 1976) 26(3):298–306. https://doi.org/10.1097/00007632-200102010-00016
Van Calster B, McLernon DJ, van Smeden M, Wynants L, Steyerberg EW, Topic Group “Evaluating diagnostic t, prediction models” of the Si (2019) Calibration: the Achilles heel of predictive analytics. BMC Med 17(1):230. https://doi.org/10.1186/s12916-019-1466-7
van der Linden YM, Dijkstra SP, Vonk EJ, Marijnen CA, Leer JW (2005) Prediction of survival in patients with metastases in the spinal column: results based on a randomized trial of radiotherapy. Cancer 103(2):320–328. https://doi.org/10.1002/cncr.20756
Yang JJ, Chen CW, Fourman MS, Bongers MER, Karhade AV, Groot OQ, Lin WH, Yen HK, Huang PH, Yang SH, Schwab JH, Hu MH (2021) International external validation of the SORG machine learning algorithms for predicting 90-day and 1-year survival of patients with spine metastases using a Taiwanese cohort. Spine J S1529–9430(21):00060–7. https://doi.org/10.1016/j.spinee.2021.01.027
Yoshihara H, Yoneoka D (2014) Trends in the surgical treatment for spinal metastasis and the in-hospital patient outcomes in the United States from 2000 to 2009. Spine J 14(9):1844–1849
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Institutional review board statement
EMR review was given ethical approval by the Geneva University Hospitals institutional review board for retrospective chart analysis on patients who underwent surgery for spinal metastatic disease at our University tertiary care center.
Consent to participate
Informed consent for clinical research is systematically obtained from each patient after diagnosis and prior to surgery.
Conflict of interest
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article is part of the Topical Collection on Spine—Other.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Zegarek, G., Tessitore, E., Chaboudez, E. et al. SORG algorithm to predict 3- and 12-month survival in metastatic spinal disease: a cross-sectional population-based retrospective study. Acta Neurochir 164, 2627–2635 (2022). https://doi.org/10.1007/s00701-022-05322-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00701-022-05322-7