Abstract
Purpose
Predictive models in spine surgery are of use in shared decision-making. This study sought to develop multivariable models to predict the probability of general and surgical perioperative complications of spinal surgery for lumbar degenerative diseases.
Methods
Data came from EUROSPINE's Spine Tango Registry (1.2012–12.2017). Separate prediction models were built for surgical and general complications. Potential predictors included age, gender, previous spine surgery, additional pathology, BMI, smoking status, morbidity, prophylaxis, technology used, and the modified Mirza invasiveness index score. Complete case multiple logistic regression was used. Discrimination was assessed using area under the receiver operating characteristic curve (AUC) with 95% confidence intervals (CI). Plots were used to assess the calibration of the models.
Results
Overall, 23′714/68′111 patients (54.6%) were available for complete case analysis: 763 (3.2%) had a general complication, with ASA score being strongly predictive (ASA-2 OR 1.6, 95% CI 1.20–2.12; ASA-3 OR 2.98, 95% CI 2.19–4.07; ASA-4 OR 5.62, 95% CI 3.04–10.41), while 2534 (10.7%) had a surgical complication, with previous surgery at the same level being an important predictor (OR 1.9, 95%CI 1.71–2.12). Respectively, model AUCs were 0.74 (95% CI, 0.72–0.76) and 0.64 (95% CI, 0.62–0.65), and calibration was good up to predicted probabilities of 0.30 and 0.25, respectively.
Conclusion
We developed two models to predict complications associated with spinal surgery. Surgical complications were predicted with less discriminative ability than general complications. Reoperation at the same level was strongly predictive of surgical complications and a higher ASA score, of general complications. A web-based prediction tool was developed at https://sst.webauthor.com/go/fx/run.cfm?fx=SSTCalculator.
Introduction
Patients today are, correctly, much more involved in decision-making regarding their treatment than they used to be [1]. Physicians and surgeons treating spinal disorders should be able to make evidence-based predictions regarding the outcome of their treatments, based on reliable prognostic information. In the last few years, a number of statistical prediction models have been developed to predict the outcome of spine surgery [2,3,4,5,6,7,8], mainly focusing on the benefits of the intervention regarding pain relief, quality of life improvement and/or return to work.
In view of recent developments in shared decision-making, not only the benefits but also the risks associated with different treatment modalities must be clearly communicated to the patient. For this reason, risk calculators have also been developed to predict complication rates [4, 9,10,11,12,13].
Lee et al. were the first to create a predictive model assessing the risk of medical complications following spine surgery and to develop an online tool for its clinical use [10]. Their study was based on a population of 1476 patients, split into two subsets for internal and cross-validation. Although successful, they acknowledged that the accuracy of such predictive models would be improved with greater power. Also, their model only evaluated the risk for general medical complications and lacked a surgical complication counterpart. Later on, they developed a model for surgical site infection—one of many possible surgical complications—on the same patient population [9]. The model showed reasonable success as far as its discriminative capacity was concerned, but no information was provided regarding how well the predictions were aligned with the observed outcomes (i.e. "calibration").
Kasparek et al. [14] sought to validate the general-medical complication model of Lee et al. [10]. In total, 44 patients developed a medical complication in a population of 273 patients undergoing spinal surgery. The model demonstrated adequate prediction of the medical complication risk group (low, medium, high), but the authors conceded that, with only 273 patients, the analysis may have been underpowered. Janssen et al. [15] investigated the validity of the surgical site infection model of Lee et al. [9] in a population of 898 patients undergoing thoracolumbar spine surgery. They demonstrated a Nagelkerke’s R2 of 0.01, indicating poor external predictive strength.
Kim et al. [16, 17] used artificial neural networks in addition to classic logistic regression methods to identify risk factors for various types of complication in two subsets of spine patients: those undergoing elective adult spinal deformity surgery [16] and those undergoing posterior lumbar spine fusion [17]. They trained their multivariable models using data from the American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) database, and model performance was compared with that of a model containing just the American Society for Anesthesiology (ASA) score as predictor. The areas under the receiver operating characteristic curves (AUC) were better for the multivariable models (0.54–0.84, depending on the complication in question) than for ASA alone (0.37–0.52). This hence showed promising results in the advancing field of artificial neural network models. However, no online tool was developed for its further use or the assessment of its validity in the clinical setting. Indeed, neural networks are notoriously more challenging to use for the development of decision-support systems, since the most important input variables are more difficult to identify than they are in regression models.
The aforementioned studies focused on medical complications based on small databases, were conducted as single-centre studies, had poor external validity, or used novel statistical/machine-learning approaches to produce models that do not easily lend themselves to further validation by others.
In the present study our aim was to combine previously identified individual predictors of outcome, e.g. number of previous spine surgeries [18, 19], age [20], ASA score [21], complexity of the surgery [22], BMI [23], and smoking status [24, 25] in a multivariable model to predict complications, using a large multicentre dataset from the EUROSPINE “Spine Tango” registry [26]. We sought to develop two models and a web-based tool for predicting the likelihood of incurring a perioperative complication in connection with spine surgery: one focusing on general medical complications and the other, on surgical complications.
Methods
Source of data
This was a retrospective multicentre registry data-based study of prospectively collected data within the EUROSPINE “Spine Tango” Registry [26]. The analysis of these routinely collected, anonymised data was approved by the Swiss Ethics Committees for research involving humans [27].
The registry currently includes over 120 ‘000 surgical patient cases from several spine centres from more than 20 countries. Medical history and surgical details are documented by the surgeon using the Spine Tango surgery form, as are surgical and general medical complications arising between admission and discharge.
Participants
Inclusion and exclusion criteria
Patients included in the present study were operated on between January 2012 and December 2017. All included patients had spine surgery for degenerative disorders of the lumbar spine in one of the participating EUROSPINE Spine Tango centres. Patients aged between 18 and 95 were identified on the basis of a "main pathology" documented as "degenerative disease", and "level of intervention" as “thoracolumbar”, “thoraco-lumbo-sacral”, ‘‘lumbar’’, “lumbo-sacral” or ‘‘sacral” on the Spine Tango 2011 Surgery form. All patient cases with missing values for the variables indicated below were excluded from the analysis (see later).
Outcome
We defined two independent binary (presence/absence) outcome variables describing perioperative complications. First, the occurrence of a surgical complication arising either intraoperatively (nerve root damage, spinal cord damage, dura lesion, vascular injury, fractures of vertebral structures) and/or postoperatively before discharge (epidural or other hematoma, radiculopathy, CSF leak/pseudomeningocele, motor/sensory dysfunction, bowel/bladder dysfunction, wound infection, implant malposition, implant failure, wrong level). Second, the occurrence of a general complication arising either intraoperatively (anaesthesiological, cardiovascular, pulmonary, thromboembolism, death) and/or postoperatively before discharge (cardiovascular, pulmonary, cerebral, kidney/urinary, liver/gastrointestinal, thromboembolism, death).
Predictors
The selection of predictors was based on evidence of their predictive capacity in the current literature [18,19,20,21,22,23,24,25, 28]. All the predictor variables are collected systematically in the registry and are typically known or decided upon preoperatively, on the "admission" section of the Spine Tango Form. They included: age; sex (male, female); whether patients had had previous spine surgery (if so, whether at the same or on a different spinal level); body mass index (BMI, < 20, 20–25, 26–30, 31–35, > 35 kg/m2); smoking status (no, yes); morbidity state [using the American Society of Anaesthesiologists Physical Status Score (ASA; scored 1–5)]; the modified Mirza Invasiveness Index (representing the invasiveness of the planned surgical procedure) [29, 30]; the presence of an additional pathology (other than degenerative disease, such as fracture/trauma, non-degenerative deformity, infection, tumour, etc.); planned preoperative prophylaxis (infection, thromboembolism, ossification); and planned intraoperative technology (conventional or minimally invasive spine surgery (MISS)/less invasive spine surgery(LISS)).
Sample size
Sample size considerations for prediction models need to take into account whether the outcome number of events is large enough for fitting multiple predictor models, taking all relevant predictors into account simultaneously. The generally accepted rule is to have at least ten events per variable [30,31,32]. Given that, in the planned study, 10 independent predictor variables were to be evaluated simultaneously, this implied at least 100 events (occurrence of a complication) observed for each of the outcomes, a condition that was met for the generation of separate models to predict general medical complications and surgical complications (see later).
Missing data
A complete case analysis was used for the development of the prediction models. As such, cases with any missing data regarding the previously noted predictors or outcomes were excluded from the analysis. The results were reanalysed at a later stage in a sensitivity analysis based on imputed data.
Statistical analysis methods
Descriptive statistics included median and interquartile ranges or mean and standard deviations (SD) for continuous variables and counts and percentages of total for categorical variables. The two binary outcome variables, general medical perioperative complications and surgical perioperative complications, were addressed with multiple logistic regression models fitted to each outcome.
Predictor models with many prognostic indicators tend to fit the data used in the study optimally, but predictions for new subjects perform less well. This problem is known as overfitting. To address overfitting in our models, we used shrinkage, a technique in which the regression coefficients of the prediction models are multiplied by a global shrinkage factor (a real number < 1), leading to a reduction in their values ("shrinkage") towards zero. We used the dfbeta method [33] to derive a separate global shrinkage factor for each of the two models. This method is equivalent to leave-one-out cross-validation (LOOCV), which is a common but less efficient approach that is difficult to apply to large datasets [33] such as the present one. Original and shrunken regression coefficients were presented as odds ratios (OR) with 95% confidence intervals (CI).
Model performance
To assess model performance, we evaluated how well the predicted probability of a complication corresponded to the actual observed complication rate, by assessing the model's discriminative ability and calibration. Discrimination was examined using the area under the receiver operating characteristic curve (AUROC, or c-statistic) with 95% CI. In the ROC curve, sensitivity is plotted against 1-specificity. In general, an AUC of 0.5 suggests no better discrimination than tossing a coin, 0.6–0.7 is considered possibly helpful, 0.7–0.8 is considered acceptable, 0.8–0.9 is considered excellent, and more than 0.9 is considered outstanding [34].
Calibration of a prediction model measures the agreement between observed outcomes and predictions. In the present study, internal calibration of the two models was assessed using calibration plots. Internal calibration refers to agreement between observed and predicted probabilities in the sample in which the model was developed, showing how well the model represents the observed reality and whether it tends to over- or underestimate the probability of an event [35,36,37].
Sensitivity analysis
A sensitivity analysis was performed to assess the potential bias in the results as a consequence of using complete case analysis. For this reason, a single dataset was imputed based on the assumption that data were missing at random (MAR). The imputed dataset was obtained from doing a single imputation, in which missing values for our predictors (e.g. missing smoking status, BMI or ASA score) were filled using multivariate imputation based on chained equations [38, 39]. After single imputation the coefficients of the two models, corresponding AUC’s and their calibration plots were re-estimated, using the aforementioned methods.
All analyses were conducted using R for Windows [40], using the packages openxlsx, tableone, pROC, tidyverse, shrink [33], boot, biostatUZH, mice [39] and gbm. The work was carried out following the concept of reproducible research, and the R-code is available upon request [41]. The results of the study were reported according to the TRIPOD guidelines [42].
Results
Participants
Figure 1 shows the flowchart for patient inclusion in the study. In total, 68′111 cases were registered in the database at the time of data export. Of these, 54′452 were degenerative cases, of which 43′557 included the lumbar spine (according to the definition above). Selecting patients between age 18 and 95 years resulted in 43′461 cases. Using a complete case approach to the analysis, the final sample size was N = 23′714, with the total number of cases excluded being 19′747 (45.4%). The variables with the most missing data were smoking status (39.4%), morbidity status (18.2%) and BMI (15.4%). The baseline characteristics of the final study group are shown in Table 1. The mean age was 58.9 (15.7 SD) years, and 11,450 (48.3%) were males. In total, 16,921 (71.4%) patients had had no previous surgery. Patients were most frequently (9176; 38.7%) in the BMI category 26–30 kg/m2. Most participants, 18,799 (79.3%), did not smoke. The most common morbidity state was ASA-2 (12,941 (54.6%) patients). The median Mirza score was 2 (interquartile range 1 to 7). Most participants had infection prophylaxis (22,832; 96.3%), and the majority had thromboembolism prophylaxis (17,754; 74.9%). There were more conventional technologies used (9437; 39.8%) than MISS/LISS (2502; 13.7%); the most commonly used technology was microscope (14,268; 60.2%).
Details regarding the incidence of the different types of complication are shown in Table 2 for general medical complications and Table 3 for surgical complications. Overall, 763/23,714 (3.2%) patients had a general medical complication and 2534/23,714 (10.7%), a surgical complication, indicating that sufficient events were observed to be able to fit the multiple prediction models. The most common intraoperative general complication was of a cardiovascular nature (25; 0.11%) and the most common postoperative general complication, postoperative kidney/urinary problems, being reported in 200 (0.84%) cases. The most common intraoperative surgical complication was dural tear, being reported in 1638 (6.91%) cases, with motor dysfunction being the most common postoperative surgical complication 168 (0.71%).
Model development
Model predicting general medical complications
The calculated shrinkage factor for the general medical complication model was 0.98, indicating that not much overfitting was present. The odds ratios, their 95% confidence intervals (CI) and the p values for the shrunken prediction model for general medical complications are shown in Table 4. Higher age (OR 1.03, 95% CI 1.03–1.04 per year) was associated with greater odds of having a complication. An ASA score of 2 or more was also associated with greater odds of having a complication, with the effect being more marked the higher the ASA score (ASA 2, OR 1.6, 95% CI 1.2–2.12; ASA 3, OR 2.98, 95% CI 2.19–4.07; ASA 4, OR 5.62, 95% CI 3.04–10.41), as were more complex procedures according to the modified Mirza score (OR 1.03, 95% CI 1.02–1.04 per point increase) and conventional surgical technology having been used (OR 1.32, 95% CI 1.12–1.54). Using infection prophylaxis (OR 0.59, 95% CI 0.37–0.92) was associated with reduced odds of a general medical complication.
Model predicting surgical complications
The calculated shrinkage factor for the surgical complication model was 0.97. The odds ratios, their confidence intervals (95% CI) and the p values for the shrunken prediction model for surgical complications are shown in Table 5. Higher age (OR 1.02, 95% CI 1.01–1.02), previous spine surgery at the same level (OR 1.9, 95% CI 1.71–2.12), BMI over 35 (OR 1.29, 95% CI 1.00–1.67), an ASA score of 3 (OR 1.23, 95% CI 1.06–1.43), a higher modified Mirza score (OR 1.01, 95% CI 1.00–1.01), any additional spine pathology (OR 1.3, 95% CI 1.14–1.49), ossification prophylaxis (OR 2.18, 95% CI 1.38–3.46) and conventional surgical technology having been used (OR 1.12, 95% CI 1.02–1.22) were each associated with an increased odds of having a surgical complication. Male gender (OR 0.81, 95% CI 0.75–0.89) was associated with decreased odds of incurring a surgical complication, as was using thromboembolism prophylaxis (OR 0.85, 95% CI 0.77–0.94).
Model performance
The ROC’s for the models can be seen in Fig. 2 (general medical complications) and Fig. 3 (surgical complications). The AUC for the model for general complications was 0.74 (95% CI: 0.72–0.76), while that for surgical complications was 0.64 (95% CI: 0.62–0.65) after shrinkage. The calibration plots for the two models are shown in Fig. 4 (general complications) and Fig. 5 (surgical complications). In the calibration curve for the general complications model, the observed values agreed well with the predicted values up to a predicted probability of 0.3. However, beyond this point, higher predicted probability values corresponded to much lower observed values, and the confidence intervals increased markedly. The same pattern was seen for the surgical complications model, but there the inflection point was reached at a predicted probability of about 0.25.
Calibration plot for general complication model. The y-axis describes the observed average probability of complications; x-axis describes the models corresponding to predicted values.The red line indicates optimal calibration; the black line represents the models' calibration with confidence limits given by the yellow area
Calibration plot surgical complication model. The y-axis describes the observed average probability of complications; x-axis describes the models corresponding to predicted values. The red line indicates optimal calibration; the black line represents the models ‘calibration with confidence limits as yellow area
Sensitivity analysis
The estimated coefficients for the predictors in the dataset with single imputation are shown in "Appendix" (Tables 8 and 9). Shrinkage factors calculated for the single imputation method were 0.985 for general medical complications and 0.980 for surgical complications. Recalculating the AUC for the single imputation dataset resulted in an AUC of 0.75 (95% CI: 0.74–0.76) for general medical complications and an AUC of 0.64 (95% CI: 0.63–0.65) for surgical complications. These results were then compared to the complete case dataset. The ROC curves and calibration plots for the sensitivity analysis can also be found in "Appendix" (Figs. 6, 7, 8, 9).
Discussion
Summary and Interpretation
We developed two models to predict general medical and surgical complications during spine surgery, based on the data collected within the EUROSPINE Spine Tango registry over a period of 6 years. The issue of overfitting was addressed by using shrinkage.
The ASA grade had the largest odds ratio for the probability of incurring a general complication, with a higher grade increasing the odds. The effect of the ASA grade on the incidence of general and surgical complications in spine surgery has been shown in numerous previous studies [21, 44,45,46,47].
Previous spine surgery at the same vertebral level had the largest per point odds ratio for an increased probability of a surgical complication. Nonetheless, very high values in continuous variables such as age or the modified Mirza score, which also increased the odds of a complication, could potentially exceed the per point odds ratio of previous spine surgery. The effect of previous spine surgery is already known and has been quantified before in data from the same registry [18, 19], and higher age and/or more invasive procedures have also been shown in previous studies to be associated with a greater likelihood of incurring a surgical complication [22, 43]. Our model also showed an increase in odds for surgical complications when additional non-degenerative spine pathologies are present. A possible explanation for this could be that the additional pathology makes the intervention more difficult and non-standard methods have to be used.
The models developed in the present study can be used when discussing a possible surgical intervention in a shared decision-making situation, along with models predicting the possible benefits or expected average outcomes, where models/baseline variables to predict individual outcome are not available. By using the regression coefficients from the model, one can estimate the risk of having either a surgical or medical complication in an individual patient. For example, a male patient, age 40 y, body mass index between 20 and 25 kg.m−2, non-smoker, without previous spinal surgery, ASA score of 1, undergoing L5–S1 posterior discectomy without posterior fusion (Mirza Score = 1), no additional pathologies, using prophylaxis for infection and thromboembolism have a calculated risk of 5.11% for having a surgical complication. The same patient has a calculated risk of 0.87% of suffering a medical complication.
In comparison, a female patient age 59 y, body mass index between 26 and 30 kg.m−2, smoker, previous surgery at the same level, ASA score of 2, undergoing L4–S1 posterolateral fusion with pedicle screws and no decompression (Mirza score = 6), no additional pathologies, using infection and thromboembolism prophylaxis have a calculated risk of 16.8% of experiencing a surgical complication and a calculated risk of 2.76% of developing a medical complication. This preoperative knowledge might help patients and surgeons alike to decide upon their next treatment steps that could be taken pre- or perioperatively to minimise the risk of a complication, e.g. smoking cessation, weight loss, less invasive surgery. Based on the predictor models, a freely available, web-based prediction tool has been developed https://sst.webauthor.com/go/fx/run.cfm?fx=SSTCalculator.
To assess the performance of our models in terms of discrimination, we calculated ROC curves and their AUC’s. The model predicting medical complications showed an AUC of 0.74, which can be considered as acceptable, and which was similar to the AUC of 0.76 reported for the model of Lee et al. [10]. The discriminative ability of the model predicting surgical complications was less good, with an AUC of just 0.64, but might still be considered possibly helpful. A possible explanation for the lower AUC for the surgical complications model might be that surgical complications in general could be less predictable and might be more dependent on the surgeon skill and experience rather than the patient's baseline characteristics that have been included in our model, although previous studies have shown that the chosen variables do have a predictive value for complications in degenerative spine surgery. In comparison, general complications could depend more on the physical status of the patient and hence be better able to be predicted.
Internal calibration was assessed using calibration plots. In the calibration plot for the general complications model we saw that the observed probabilities agreed well with the estimated probabilities for low predicted probabilities, and thus, the model shows a relatively satisfactory goodness-of-fit in that region. Beyond a predicted probability of approximately 0.3, however, the predicted values showed a clear overestimation of the reality and thus led to an overprediction of complication risks. The same applied to the model for surgical complications, which tended towards overestimation from a probability of about 0.25 onwards. One possible explanation for this could be that the complication rates in our dataset were low and therefore the risk of, and accuracy in predicting, an unfavourable event was also very low. In other words, in reality there were no cases with high risk and thus high-risk cases could not be used to train the model. Either way, this phenomenon should be considered, if a comparatively high probability above 0.25–0.30 is given during the risk assessment, when using these models.
The aforementioned findings were confirmed in sensitivity analyses using single imputation for missing data. In these we found similar tendencies regarding the influence of the different predictor variables, the calculated AUCs for the ROC analyses and the calibration curves.
Tendencies for overfitting of our models appeared to be very small, as our shrinkage factors were close to 1. This suggests that the models may be applicable to populations outside of the given study group, although this should be verified by external validation.
Reported complication rates in spine surgery for degenerative disease range from 3.7 to 16%, depending on the definition of complication used and the technique being focused on [48,49,50]. In our population we found 3.2% medical complications and 10.7% surgical complications. A problem in the current literature is the reliability of complication reporting since there are no generally acknowledged reporting standards [51]. Overall, we found no notable discrepancy with the previously reported complication rates in our population group. When the number of cases in the registry has increased sufficiently to include a variable reflecting, for example, the type or geographical region of the contributing centres, it may be possible to calibrate/customise the model to accommodate differences in the thresholds for reporting.
Strengths and limitations
We view the use of a large multicentre database for model development as a relative advantage regarding the prediction of complications in lumbar spine surgery, when compared with other models previously developed. The model developed by McGirt et al. [4] used a single-centre database. The ACS-NSQIP [13] was developed using a heterogeneous patient population, and by only accepting one Current Procedural Terminology (CPT) code for each risk calculation, it may have underestimated the complexity of the surgery [52, 53], since many spine surgery cases comprise multiple procedures in one operation. In our model, complex spine surgery is taken into account using the modified Mirza index [29, 54]. Ratliff et al. [12] used the large MarketScan dataset, which included mostly younger patients. As the authors themselves conceded, this can be seen as a major limitation, since an increasing number of spine patients are elderly, due to the effects of degenerative disease on the aging spine [55]. A drawback of Lee et al.’s predictive model [9, 10] is that it was developed using only 1476 patients, which may not be a large enough sample. In addition to the above, our prediction of surgical complications included a range of different types, both intraoperatively and prior to discharge, rather than only surgical site infection [9], although our model was not able to specifically predict the likelihood of incurring any particular surgical complication or its severity. Including the modified Mirza index as a measure of surgical invasiveness obviated the need to sub-divide the data to produce separate predictor models for different spine surgical procedures of varying complexity and hence improved the overall power of the results.
A limitation of our study was that the prediction models were not validated using an external dataset. Although we tried to avoid overfitting of our models by using shrinkage, this is not a substitute for an actual external validation.
Another limitation of the study was the complete case analysis approach (i.e. we only included patients for whom there were no missing data), which could have introduced selection bias. The missing data are the result of the incomplete filling out of the Spine Tango surgery forms by the participating surgeons. We tried to address this limitation by performing a sensitivity analysis using single imputation and found our results to be robust. In the present study there was no analysis of complications occurring after hospital discharge, since the collected data were focused on complications during the hospital stay, as recorded on the Tango Surgery form. Finally, surgeons and patients using these models should keep in mind that the developed models tend to overestimate risks when assessing higher risk situations, as discussed in detail above.
We also emphasise that not only the risks, but also the benefits of surgery should be communicated adequately to the patient, such that both can be taken into account when making decisions about surgery. As such, any risk calculations using our model should ideally go hand in hand with estimates of pain and functional improvement when planning surgery.
Implications for future research
To ensure their broader applicability, our models should be externally validated. Also, separate prediction models could be developed for different spine pathologies, which would further increase their applicability. Analogous models could also be built looking at the risk of complications after discharge using the data from the Spine Tango Follow-Up form, which documents complications arising after hospitalisation up to many years' follow-up. Similarly, models predicting the likelihood of clinically relevant improvements in patient-oriented outcomes should be developed.
Conclusion
We were able to build two predictor models that can be used to predict the probability of incurring a complication during or shortly after spine surgery (before discharge). Of the two models, general complications were able to be predicted with greater discriminative ability than surgical complications. Reoperations at the same level were a predominant predictive factor for surgical complications, and a higher ASA score showed the highest odds for general complications. Complication rates were in the expected range, as reported in the literature. A freely available, web-based prediction tool has been developed for the purposes of further testing and validation https://sst.webauthor.com/go/fx/run.cfm?fx=SSTCalculator
The findings of this study are relevant for patient counselling and informed and shared decision making.
References
Boss EF, Mehta N, Nagarajan N et al (2016) Shared decision making and choice for elective surgical care: a systematic review. Otolaryngol-Head Neck Surg Off J Am Acad Otolaryngol-Head Neck Surg 154:405–420. https://doi.org/10.1177/0194599815620558
Khor S, Lavallee D, Cizik AM et al (2018) Development and validation of a prediction model for pain and functional outcomes after lumbar spine surgery. JAMA Surg 153:634–642. https://doi.org/10.1001/jamasurg.2018.0072
Tetreault LA, Kopjar B, Vaccaro A et al (2013) A clinical prediction model to determine outcomes in patients with cervical spondylotic myelopathy undergoing surgical treatment: data from the prospective, multi-center AOSpine North America study. J Bone Joint Surg Am 95:1659–1666. https://doi.org/10.2106/JBJS.L.01323
McGirt MJ, Sivaganesan A, Asher AL, Devin CJ (2015) Prediction model for outcome after low-back surgery: individualized likelihood of complication, hospital readmission, return to work, and 12-month improvement in functional disability. Neurosurg Focus 39:E13. https://doi.org/10.3171/2015.8.FOCUS15338
Lee BH, Yang J-H, Lee H-M et al (2016) Surgical outcome predictor in degenerative lumbar spinal disease based on health related quality of life using euro-quality 5 dimensions analysis. Yonsei Med J 57:1214–1221. https://doi.org/10.3349/ymj.2016.57.5.1214
Held U, Burgstaller JM, Wertli MM et al (2018) Prognostic function to estimate the probability of meaningful clinical improvement after surgery - Results of a prospective multicenter observational cohort study on patients with lumbar spinal stenosis. PLoS ONE. https://doi.org/10.1371/journal.pone.0207126
Chen H-N, Tsai Y-F (2013) A predictive model for disability in patients with lumbar disc herniation. J Orthop Sci Off J Jpn Orthop Assoc 18:220–229. https://doi.org/10.1007/s00776-012-0354-1
Spratt KF, Keller TS, Szpalski M et al (2004) A predictive model for outcome after conservative decompression surgery for lumbar spinal stenosis. Eur Spine J 13:14–21. https://doi.org/10.1007/s00586-003-0583-2
Lee MJ, Cizik AM, Hamilton D, Chapman JR (2014) Predicting surgical site infection after spine surgery: a validated model using a prospective surgical registry. Spine J 14:2112–2117. https://doi.org/10.1016/j.spinee.2013.12.026
Lee MJ, Cizik AM, Hamilton D, Chapman JR (2014) Predicting medical complications after spine surgery: a validated model using a prospective surgical registry. Spine J 14:291–299. https://doi.org/10.1016/j.spinee.2013.10.043
Bekelis K, Desai A, Bakhoum SF, Missios S (2014) A predictive model of complications after spine surgery: the national surgical quality improvement program (NSQIP) 2005–2010. Spine J Off J North Am Spine Soc 14:1247–1255. https://doi.org/10.1016/j.spinee.2013.08.009
Ratliff JK, Balise R, Veeravagu A et al (2016) Predicting occurrence of spine surgery complications using “Big Data” modeling of an administrative claims database. JBJS 98:824–834. https://doi.org/10.2106/JBJS.15.00301
Bilimoria KY, Liu Y, Paruch JL et al (2013) Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. J Am Coll Surg 217:833-842.e3. https://doi.org/10.1016/j.jamcollsurg.2013.07.385
Kasparek MF, Boettner F, Rienmueller A et al (2018) Predicting medical complications in spine surgery: evaluation of a novel online risk calculator. Eur Spine J Off Publ Eur Spine Soc Eur Spinal Deform Soc Eur Sect Cerv Spine Res Soc 27:2449–2456. https://doi.org/10.1007/s00586-018-5707-9
Janssen DMC, van Kuijk SMJ, d’Aumerie BB, Willems PC (2018) External validation of a prediction model for surgical site infection after thoracolumbar spine surgery in a Western European cohort. J Orthop Surg 13:114. https://doi.org/10.1186/s13018-018-0821-2
Kim JS, Arvind V, Oermann EK et al (2018) Predicting surgical complications in patients undergoing elective adult spinal deformity procedures using machine learning. Spine Deform 6:762–770. https://doi.org/10.1016/j.jspd.2018.03.003
Kim JS, Merrill RK, Arvind V et al (2018) Examining the ability of artificial neural networks machine learning models to accurately predict complications following posterior lumbar spine fusion. Spine 43:853–860. https://doi.org/10.1097/BRS.0000000000002442
Zehnder P, Aghayev E, Fekete TF et al (2016) Influence of previous surgery on patient-rated outcome after surgery for degenerative disorders of the lumbar spine. Eur Spine J Off Publ Eur Spine Soc Eur Spinal Deform Soc Eur Sect Cerv Spine Res Soc 25:2553–2562. https://doi.org/10.1007/s00586-016-4383-x
Zehnder P, Fekete T, Aghayev E et al (2017) Quantification of the increased risk of complications during surgery for degenerative spinal disorders in patients with prior spine surgery. Orthop Proc. https://doi.org/10.1302/1358-992X.99BSUPP_10.SBPR2016-028
Sobottke R, Aghayev E, Röder C et al (2012) Predictors of surgical, general and follow-up complications in lumbar spinal stenosis relative to patient age as emerged from the Spine Tango Registry. Eur Spine J 21:411–417. https://doi.org/10.1007/s00586-011-2016-y
Fu K-M, Smith J, Polly D et al (2011) Correlation of higher preoperative American society of anesthesiology grade and increased morbidity and mortality rates in patients undergoing spine surgery: clinical article. J Neurosurg Spine 14:470–474. https://doi.org/10.3171/2010.12.SPINE10486
Cizik AM, Lee MJ, Martin BI et al (2012) Using the Spine Surgical Invasiveness Index to Identify Risk of Surgical Site Infection. J Bone Joint Surg Am 94:335–342. https://doi.org/10.2106/JBJS.J.01084
Bono OJ, Poorman GW, Foster N et al (2018) Body mass index predicts risk of complications in lumbar spine surgery based on surgical invasiveness. Spine J Off J North Am Spine Soc 18:1204–1210. https://doi.org/10.1016/j.spinee.2017.11.015
Phan K, Fadhil M, Chang N et al (2018) Effect of smoking status on successful arthrodesis, clinical outcome, and complications after anterior lumbar interbody fusion (ALIF). World Neurosurg 110:e998–e1003. https://doi.org/10.1016/j.wneu.2017.11.157
Martin C, Gao Y, Duchman K, Pugely A (2016) The Impact of current smoking and smoking cessation on short-term morbidity risk after lumbar spine surgery. Spine 41:577–584. https://doi.org/10.1097/BRS.0000000000001281
EUROSPINE - Overview. https://www.eurospine.org/spine-tango.htm. Accessed 20 Jun 2020
Swiss association of research ethics committees. In: swissethics. https://swissethics.ch/en/. Accessed 20 Jun 2020
Pochon L, Kleinstück F, Porchet F, Mannion A (2015) Influence of gender on patient-oriented outcomes in spine surgery. Eur Spine J. https://doi.org/10.1007/s00586-015-4062-3
Mirza SK, Deyo RA, Heagerty PJ, et al (2008) Development of an index to characterize the “invasiveness” of spine surgery: validation by comparison to blood loss and operative time. Spine 33:2651–2661; discussion 2662. https://doi.org/https://doi.org/10.1097/BRS.0b013e31818dad07
Holzer EM, Aghayev E, O’Riordan D et al (2020) Validation of a surgical invasiveness index in patients with lumbar spinal disorders registered in the Spine Tango registry. Eur Spine J. https://doi.org/10.1007/s00586-020-06651-w
Concato J, Peduzzi P, Holford TR, Feinstein AR (1995) Importance of events per independent variable in proportional hazards analysis. I. Background, goals, and general strategy. J Clin Epidemiol 48:1495–1501. https://doi.org/10.1016/0895-4356(95)00510-2
Peduzzi P, Concato J, Feinstein AR, Holford TR (1995) Importance of events per independent variable in proportional hazards regression analysis. II. Accuracy and precision of regression estimates. J Clin Epidemiol 48:1503–1510. https://doi.org/10.1016/0895-4356(95)00048-8
Peduzzi P, Concato J, Kemper E et al (1996) A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol 49:1373–1379. https://doi.org/10.1016/s0895-4356(96)00236-3
Dunkler D, Sauerbrei W, Heinze G (2016) Global, Parameterwise and Joint Shrinkage Factor Estimation. J Stat Softw 69:1–19. https://doi.org/https://doi.org/10.18637/jss.v069.i08
Mandrekar JN (2010) Receiver operating characteristic curve in diagnostic test assessment. J Thorac Oncol Off Publ Int Assoc Study Lung Cancer 5:1315–1316. https://doi.org/10.1097/JTO.0b013e3181ec173d
Austin PC, Steyerberg EW (2014) Graphical assessment of internal and external calibration of logistic regression models by using loess smoothers. Stat Med 33:517–535. https://doi.org/10.1002/sim.5941
Steyerberg EW, Vickers AJ, Cook NR et al (2010) Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiol Camb Mass 21:128–138. https://doi.org/10.1097/EDE.0b013e3181c30fb2
Hosmer DW, Lemesbow S (1980) Goodness of fit tests for the multiple logistic regression model. Commun Stat - Theory Methods 9:1043–1069. https://doi.org/10.1080/03610928008827941
Azur MJ, Stuart EA, Frangakis C, Leaf PJ (2011) Multiple imputation by chained equations: what is it and how does it work? Int J Methods Psychiatr Res 20:40–49. https://doi.org/10.1002/mpr.329
van Buuren S, Groothuis-Oudshoorn K (2011) Mice: multivariate imputation by chained equations in R. J Stat Softw 45:1–67
R: The R project for statistical computing. https://www.r-project.org/. Accessed 20 Jun 2020
Localio AR, Goodman SN, Meibohm A et al (2018) Statistical code to support the scientific story. Ann Intern Med 168:828–829. https://doi.org/10.7326/M17-3431
Collins GS, Reitsma JB, Altman DG, Moons KGM (2015) Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD). Circulation 131:211–219. https://doi.org/10.1161/CIRCULATIONAHA.114.014508
Li Z, Liu P, Zhang C et al (2019) Incidence, prevalence, and analysis of risk factors for surgical site infection after lumbar fusion surgery: ≥2-year follow-up retrospective study. World Neurosurg 131:e460–e467. https://doi.org/10.1016/j.wneu.2019.07.207
Whitmore RG, Stephen JH, Vernick C et al (2014) ASA grade and Charlson Comorbidity Index of spinal surgery patients: correlation with complications and societal costs. Spine J 14:31–38. https://doi.org/10.1016/j.spinee.2013.03.011
Mannion AF, Fekete TF, Porchet F et al (2014) The influence of comorbidity on the risks and benefits of spine surgery for degenerative lumbar disorders. Eur Spine J 23:66–71. https://doi.org/10.1007/s00586-014-3189-y
Somani S, Capua JD, Kim JS et al (2017) ASA classification as a risk stratification tool in adult spinal deformity surgery: a study of 5805 patients. Glob Spine J 7:719–726. https://doi.org/10.1177/2192568217700106
Kobayashi K, Imagama S, Ando K et al (2017) Complications associated with spine surgery in patients aged 80 years or older: Japan association of spine surgeons with ambition (JASA) multicenter study. Glob Spine J 7:636–641. https://doi.org/10.1177/2192568217716144
Saleh A, Thirukumaran C, Mesfin A, Molinari RW (2017) Complications and readmission after lumbar spine surgery in elderly patients: an analysis of 2,320 patients. Spine J 17:1106–1112. https://doi.org/10.1016/j.spinee.2017.03.019
Flexman AM, Charest-Morin R, Stobart L et al (2016) Frailty and postoperative outcomes in patients undergoing surgery for degenerative spine disease. Spine J 16:1315–1323. https://doi.org/10.1016/j.spinee.2016.06.017
Altshuler M, Mueller K, MacConnell A et al (2020) Does minimally invasive spine surgery reduce the rate of perioperative medical complications? A retrospective single-center experience of 1435 degenerative lumbar spine surgeries. Eur Spine J Off Publ Eur Spine Soc Eur Spinal Deform Soc Eur Sect Cerv Spine Res Soc. https://doi.org/10.1007/s00586-020-06536-y
Nasser R, Yadla S, Maltenfort MG et al (2010) Complications in spine surgery: a review. J Neurosurg Spine 13:144–157. https://doi.org/10.3171/2010.3.SPINE09369
Sebastian A, Goyal A, Alvi MA et al (2019) Assessing the performance of national surgical quality improvement program surgical risk calculator in elective spine surgery: insights from patients undergoing single-level posterior lumbar fusion. World Neurosurg 126:e323–e329. https://doi.org/10.1016/j.wneu.2019.02.049
Merrill RK, Ibrahim JM, Machi AS, Raphael JS (2020) Analysis and review of automated risk calculators used to predict postoperative complications after orthopedic surgery. Curr Rev Musculoskelet Med 13:298–308. https://doi.org/10.1007/s12178-020-09632-0
Deyo RA, Mirza SK, Martin BI et al (2010) Trends, major medical complications, and charges associated with surgery for lumbar spinal stenosis in older adults. JAMA 303:1259–1265. https://doi.org/10.1001/jama.2010.338
Acknowledgements
We would like to thank Professor Oliver Distler, Head of Department of Rheumatology, at the University Hospital Zurich, Switzerland, for his support, advice and assistance in planning and conducting the study. Also, we would like to thank Mario Rodrigues from Webauthor.com for programming the online tool. We are grateful to all clinics participating in the Spine Tango registry and contributing data to it. Data from the following clinics were used in this study (ordered alphabetically by country): St Andrew’s Hospital, Adelaide, Australia; Royal Adelaide Hospital, Spinal Surgery, Adelaide, Australia; Universitatsklinik fur Orthopadie der Medizinischen Universitat Wien, Austria; Grand Hopital de Charleroi, Orthopedie, Charleroi, Belgium; Cliniques Universitaires Saint-Luc, Orthopedie, Bruxelles, Belgium; Clinique Saint-Pierre, Orthopedie, Ottignies, Belgium; Clinique Edith Cavell, Orthopedie, Bruxelles, Belgium; Hospital das Clinicas de Ribeirao Preto, Ribeirao Preto, Biomecanica Medicina e Reabilitacao do Aparelho Locomotor, Ribeirao Preto, Brazil; Universitatsklinik Koln, Klinik fur Orthopadie und Unfallchirurgie, Koln, Germany; Universitatsklinik Koln, Neurochirurgie, Koln, Germany; Krankenhaus der Barmherzigen Bruder, Wirbelsaulenzentrum, Trier, Germany; Klinikum Uckermark, Orthopadische Klinik, Schwedt, Germany; Klinikum Offenbach GmbH, Neurozentrum Neurochirurgische Klinik, Offenbach, Germany; Gemeinschaftspraxis fur Orthopadie und Neurochirurgie, Hof, Germany; P. D. Hinduja National Hospital, Spine unit department of orthopaedics, Mumbai, India; Jadria Private Hospital, Spine, Baghdad, Iraq; Sant’Andrea Hospital Sapienza University of Rome, Neurochirurgia, Rome, Italy3; Istituto Ortopedico Villa Salus, Neurochirurgia, Melilli, Italy; IRCCS Galeazzi Orthopedic Institut, Milano, Italy; Clinica Cellini, Chirurgia Vertebrale, Torino, Italy; Spitalul Clinic de Traumatologie si Ortopedie, Spine surgery department, Chisinau, Moldova; Wojewodzki Szpital Specjalistyczny nr 2, Neuorchirurgia, Jastrzębie-Zdroj, Poland; Uniwersytecki Szpital Kliniczny, Klinika Ortopedii i Traumatologii, Wroclaw, Poland; SCM Polanica, Neurosurgery, Polanica-Zdroj, Poland; Medical University of Silesia, Department of Neurosurgery and Neurotraumatology, Katowice, Poland; General Hospital Torun, Department of Neurosurgery, Torun, Poland; Hospital Sao Joao, Neurosurgery, Porto, Portugal; University Clinic Orthopedics, Orthopedic clinic, Ljubljana, Slovenia; Orthopaedic Hospital Valdoltra, Spine surgery and paediatric orthopaedics, Ankaran, Slovenia; Hospital Universitario Virgen de la Arrixaca, Departamento de Cirugia Ortopedica y Traumatologia, Murcia, Spain; Hospital Sant Pau, Cirugia Ortopedica y Traumatologia, Barcelona, Spain; Spital Sonnenhof, Orthopädie, Bern, Switzerland; Spital Schwyz, Orthopadische Klinik, Schwyz, Switzerland; Schulthess Klinik, Wirbelsaulenzentrum, Zurich, Switzerland; Salem Spital, Neurochirurgie, Bern, Switzerland; Kantonsspital St. Gallen, Klinik fur orthopadische Chirurgie und Traumatologie, St. Gallen, Switzerland; Inselspital, Neurosurgery, Bern, Switzerland; Hopital Cantonal Fribourg, Orthopedie, Fribourg, Switzerland; Hirslanden Klinik Birshof, Zentrum fur Wirbelsaulenmedizin, Munchenstein, Switzerland; Das Rückenzentrum, Wirbelsäulenmedizin, Thun, Switzerland; Clinique Generale de Fribourg, Neurochirurgie, Fribourg, Switzerland; CHUV, Colonne vertebrale, Lausanne, Switzerland; Bethesda Spital, Neurochirurgie, Basel, Switzerland; Gazi University Faculty of Medicine, Department of Neurosurgery, Ankara, Turkey; Salford Royal NHS Trust, Spinal Department, Salford, UK; Salford Royal NHS Foundation Trust, Department of Neurosurgery, Manchester, UK; Royal Derby Hospital, spinal unit, Derby, UK; Nuffield Orthopaedic center, spinal unit, Oxford, UK; The Walton Centre NHS Foundation Trust, Department of Neurosurgery, Liverpool, UK; Christiana Care Hospital, Department of Spine Surgery, Newark, Delaware, USA.
Funding
Open Access funding provided by Universität Zürich. This study received no external funding.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest
The authors declare that they have no conflict of interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix
Appendix
Unshrunken baseline models
See Tables
6,
7.
Sensitivity analysis
See Tables
8,
9 and Figs.
6,
7,
8,
9.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Zehnder, P., Held, U., Pigott, T. et al. Development of a model to predict the probability of incurring a complication during spine surgery. Eur Spine J 30, 1337–1354 (2021). https://doi.org/10.1007/s00586-021-06777-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00586-021-06777-5
Keywords
- Spine surgery
- Patient outcome
- Complications
- Prediction model
- Degenerative spine