Abstract
Purpose
Surgeons need tools to provide individualised estimates of surgical outcomes and the uncertainty surrounding these, to convey realistic expectations to the patient. This study developed and validated prognostic models for patients undergoing surgical treatment of lumbar disc herniation, to predict outcomes 1 year after surgery, and implemented these models in an online prediction tool.
Methods
Using the data of 1244 patients from a large spine unit, LASSO and linear regression models were fitted with 90% upper prediction limits, to predict scores on the Core Outcome Measures Index, and back and leg pain. Candidate predictors included sociodemographic factors, baseline symptoms, medical history, and surgeon characteristics. Temporal validation was conducted on 364 more recent patients at the same unit, by examining the proportion of observed outcomes exceeding the threshold of the 90% upper prediction limit (UPL), and by calculating mean bias and other calibration measures.
Results
Poorer outcome was predicted by obesity, previous spine surgery, and having basic obligatory (rather than private) insurance. In the validation data, fewer than 12% of outcomes were above the 90% UPL. Calibration plots for the model validation showed values for mean bias < 0.5 score points and regression slopes close to 1.
Conclusion
While the model accuracy was good overall, the prediction intervals indicated considerable predictive uncertainty on the individual level. Implementation studies will assess the clinical usefulness of the online tool. Updating the models with additional predictors may improve the accuracy and precision of outcome predictions.
Graphic abstract
These slides can be retrieved under Electronic Supplementary Material.
Similar content being viewed by others
References
Archer K, Bird ML, Haug C, Coronado R, Wegener S, Devin CJ, Schlundt D (2015) Patients’ Experience and Expectations of Lumbar Spine Surgery for Degenerative Conditions: a Qualitative Study. The Spine Journal 15(10 Supplement):S99–S100. https://doi.org/10.1016/j.spinee.2015.07.046
Ronnberg K, Lind B, Zoega B, Halldin K, Gellerstedt M, Brisby H (2007) Patients’ satisfaction with provided care/information and expectations on clinical outcome after lumbar disc herniation surgery. Spine 32(2):256–261. https://doi.org/10.1097/01.brs.0000251876.98496.52
Koerner JD, Glaser J, Radcliff K (2015) Which Variables Are Associated With Patient-reported Outcomes After Discectomy? Review of SPORT Disc Herniation Studies. Clin Orthop Relat Res 473(6):2000–2006. https://doi.org/10.1007/s11999-014-3671-1
Wilson CA, Roffey DM, Chow D, Alkherayf F, Wai EK (2016) A systematic review of preoperative predictors for postoperative clinical outcomes following lumbar discectomy. Spine J 16(11):1413–1422. https://doi.org/10.1016/j.spinee.2016.08.003
Moons KGM, Royston P, Vergouwe Y, Grobbee DE, Altman DG (2009) Prognosis and prognostic research: what, why, and how? BMJ 338:b375. https://doi.org/10.1136/bmj.b375
Royston P, Moons KG, Altman DG, Vergouwe Y (2009) Prognosis and prognostic research: developing a prognostic model. BMJ 338:b604. https://doi.org/10.1136/bmj.b604
Altman DG, Vergouwe Y, Royston P, Moons KG (2009) Prognosis and prognostic research: validating a prognostic model. BMJ 338:b605. https://doi.org/10.1136/bmj.b605
Moons KG, Altman DG, Vergouwe Y, Royston P (2009) Prognosis and prognostic research: application and impact of prognostic models in clinical practice. BMJ 338:b606. https://doi.org/10.1136/bmj.b606
Haskins R, Osmotherly PG, Rivett DA (2015) Validation and impact analysis of prognostic clinical prediction rules for low back pain is needed: a systematic review. J Clin Epidemiol 68(7):821–832. https://doi.org/10.1016/j.jclinepi.2015.02.003
Vroomen PC, de Krom MC, Knottnerus JA (2000) When does the patient with a disc herniation undergo lumbosacral discectomy? J Neurol Neurosurg Psychiatry 68(1):75–79. https://doi.org/10.1136/jnnp.68.1.75
Lubelski D, Alentado V, Nowacki AS, Shriver M, Abdullah KG, Steinmetz MP, Benzel EC, Mroz TE (2018) Preoperative Nomograms Predict Patient-Specific Cervical Spine Surgery Clinical and Quality of Life Outcomes. Neurosurgery 83(1):104–113. https://doi.org/10.1093/neuros/nyx343
Khor S, Lavallee D, Cizik AM, Bellabarba C, Chapman JR, Howe CR, Lu D, Mohit AA, Oskouian RJ, Roh JR, Shonnard N, Dagal A, Flum DR (2018) Development and Validation of a Prediction Model for Pain and Functional Outcomes After Lumbar Spine Surgery. JAMA Surg 153(7):634–642. https://doi.org/10.1001/jamasurg.2018.0072
Collins GS, Reitsma JB, Altman DG, Moons KG (2015) Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): the TRIPOD statement. Ann Intern Med 162(1):55–63. https://doi.org/10.7326/M14-0697
Ferrer M, Pellise F, Escudero O, Alvarez L, Pont A, Alonso J, Deyo R (2006) Validation of a minimum outcome core set in the evaluation of patients with back pain. Spine 31(12):1372–1379. https://doi.org/10.1097/01.brs.0000218477.53318.bc(discussion 1380)
Mannion AF, Porchet F, Kleinstuck FS, Lattig F, Jeszenszky D, Bartanusz V, Dvorak J, Grob D (2009) The quality of spine surgery from the patient’s perspective Part 1: the Core Outcome Measures Index in clinical practice. Eur Spine J 18(Suppl 3):367–373. https://doi.org/10.1007/s00586-009-0942-8
Mannion AF, Elfering A, Staerkle R, Junge A, Grob D, Semmer NK, Jacobshagen N, Dvorak J, Boos N (2005) Outcome assessment in low back pain: how low can you go? Eur Spine J 14(10):1014–1026. https://doi.org/10.1007/s00586-005-0911-9
Roder C, Chavanne A, Mannion AF, Grob D, Aebi M (2005) SSE Spine Tango–content, workflow, set-up. Tango. Eur Spine J 14(10):920–924. https://doi.org/10.1007/s00586-005-1023-2
Tibshirani R (1996) Regression shrinkage and selection via the Lasso. J Roy Stat Soc B Met 58(1):267–288
Willmott CJ (1981) On the Validation of Models. Phys Geogr 2(2):184–194. https://doi.org/10.1080/02723646.1981.10642213
Hamilton DF, Ghert M, Simpson AH (2015) Interpreting regression models in clinical outcome studies. Bone Joint Res 4(9):152–153. https://doi.org/10.1302/2046-3758.49.2000571
Mannion AF, Elfering A (2006) Predictors of surgical outcome and their assessment. Eur Spine J 15(Suppl 1):S93–108. https://doi.org/10.1007/s00586-005-1045-9
Mannion AF, Mariaux F, Fekete TF, Haschtmann D, Loibl M, Becker H-J, Kleinstuck FS, Porchet F, Jeszenszky D, Elfering A (2018) Time for one more question? A simple “yellow flag” tool to assess psychological factors in patients undergoing spine surgery. Eur Spine J 27(Suppl 5):670
Kohlboeck G, Greimel KV, Piotrowski WP, Leibetseder M, Krombholz-Reindl M, Neuhofer R, Schmid A, Klinger R (2004) Prognosis of multifactorial outcome in lumbar discectomy: a prospective longitudinal study investigating patients with disc prolapse. Clin J Pain 20(6):455–461
Carragee EJ, Han MY, Suen PW, Kim D (2003) Clinical outcomes after lumbar discectomy for sciatica: the effects of fragment type and anular competence. J Bone Joint Surg Am 85(1):102–108
Mannion AF, Junge A, Elfering A, Dvorak J, Porchet F, Grob D (2009) Great expectations: really the novel predictor of outcome after spinal surgery? Spine 34(15):1590–1599. https://doi.org/10.1097/BRS.0b013e31819fcd52
Acknowledgements
This research was supported by a research grant from the Mäxi Foundation, Switzerland. We thank all the patients of the Schulthess Klinik who have contributed data to the registry. We thank all present and past surgeons working at the Schulthess Klinik Spine Center for their compliance with the surgical forms of the Spine Tango Registry. We thank Dave O’Riordan, Gordana Balaban, Julian Amacker, Kirsten Clift, Sara Preziosa, Stéphanie Dosch, Riccardo Curatolo, and Selina Nauer for the administration of the surgical forms and patient-rated outcome measures in our registry and for the preparation of the data files for analysis. We thank Jana Neumann for her work on the statistical analysis plan. We thank Oliver Zumbrunnen for the programming of the online tool.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
There are no conflicts to be declared.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Staub, L.P., Aghayev, E., Skrivankova, V. et al. Development and temporal validation of a prognostic model for 1-year clinical outcome after decompression surgery for lumbar disc herniation. Eur Spine J 29, 1742–1751 (2020). https://doi.org/10.1007/s00586-020-06351-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00586-020-06351-5