Introduction

Obesity is a growing global issue [1]. In patients with severe obesity, metabolic surgery has been proven the most effective long-term solution for weight reduction and improving comorbidities such as type 2 diabetes, hypertension, dyslipidemia, and the sleep apnea [2,3,4,5]. Despite many advantages of metabolic surgery, the procedure has also potential risk. In order to improve the patient’s outcome, the enhanced recovery after bariatric surgery (ERABS) protocol was developed. This protocol enables patients to be discharged at day one postoperatively [6, 7]. Some studies even suggest that same-day discharge after Roux-en-Y gastric bypass (RYGB) is safe [8]. This small window presents a challenge to observe major complications, especially in patients with severe obesity who are more at risk for complications such as hemorrhage, anastomotic leaks, stenosis, and thrombosis [9, 10].

Checklists are increasingly utilized to identify early complications following surgical treatments, and can be effective when properly deployed in preventing or reducing complications such as prolonged hospital stay, readmission, reoperation, and even mortality [11,12,13,14]. In 2017, van Mil et al. published a standardized postoperative checklist for metabolic surgery [15]. The patient’s willingness to be discharged home and a decrease in hemoglobin level were found to be significant predictors for complications in this study. Several studies evaluated hemoglobin level, heart rate, postoperative C-reactive protein (CRP), and leukocyte count as postoperative predictive parameters for complications after metabolic surgery, but there is no consensus on their predictive value [16,17,18,19,20]. In current practice, metabolic surgery is increasingly performed in daycare surgery and ward rounds are performed by young residents in many hospitals, to discharge patients home as safely as possible, a checklist can be a useful tool [21].

A useful checklist needs accurate cut-off points and unnecessary parameters should be omitted. The aim of this study was to evaluate the predictive value of the outcome of the checklist and its individual parameters. In addition, new cut-off values for linear variables from the checklist were determined.

Methods

Design and Data Collection

This single center retrospective cohort study includes all patients that underwent a laparoscopic sleeve gastrectomy (SG), RYGB, or one-anastomosis gastric bypass (OAGB) between June 2018 and January 2021. The choice of procedure was made by the surgeon and patient based on patient characteristics and preference. Patients were selected for metabolic surgery in accordance to IFSO criteria and excluded in case the checklist was not available [22]. Preoperatively at inclusion, a blood sample was obtained. Postoperatively, all patients were treated according to the ERABS protocol. The first day after surgery, the checklist was filled in by the surgical resident or physician assistant. Data was collected on baseline characteristics, checklist content, length of hospital stay, type of procedure, minor and major complications, hospital readmissions, and unplanned revisits to the emergency ward or the outpatient clinic and mortality.

Postoperative Checklist

The postoperative checklist for metabolic surgery from the study published in 2017 by van Mil et al. was used. Calf pain was added to the checklist with the hypothesis of predicting venous embolisms. The study hospital is a high-volume center with approximately 900 metabolic procedures annually. Surgery was performed by four experienced metabolic surgeons. A visual analogue scale (VAS) was used for scoring pain. Only if tissue was prone to tearing or bleeding during surgery, a silicone wound drain Ch 30 + RO (Dispo Medical©) was placed to monitor potential bleeding or leakage. Table 1 shows the parameters and cut-off points. The postoperative checklist advised whether a patient could be safely discharged or should stay in the hospital for further observation or examinations. The final decision was made by the attending bariatric surgeon.

Table 1 Parameters of the postoperative checklist for metabolic surgery

Outcomes

The occurrence of a major complication within 30 days of surgery was used as a primary outcome measure. Secondary outcomes were minor complications, readmission, and unplanned visits to the hospital within 30 days postoperatively. Complications were scored using the Clavien-Dindo (CD) classification [23].

Statistical Analysis

Analyses were performed using SPSS (PASW) 28 software (SPSS Inc., Chicago, Illinois, USA). Patient outcomes were described as absolute number with percentage or median with interquartile range (IQR). The differences between patients with and without major complications, minor complications, readmission, and unplanned revisits were analyzed using the chi-squared test, Fisher exact, or Mann-Whitney U test when appropriate. Multinomial logistic regression analysis was used to estimate the relationship between the occurrence of major complications and the checklist outcomes, adjusting for baseline characteristics. Receiver operating characteristics (ROC) curves were constructed for linear checklist values (Table 1) on major complications. For all values with an area under the curve (AUC) greater than 0.70, the optimal cut-off value for predicting postoperative complications was determined. Results were evaluated at a significant threshold of P < 0.05 (two-sided).

Results

Baseline Characteristics

A total of 1593 patients were included between June 2018 and January 2021. Four patients were excluded because they underwent fundoplication surgery. Patient characteristics are shown in Table 2.

Table 2 Baseline characteristics in absolute numbers or median value, with its percentage or IQR

Procedure Characteristics

The SG was most frequently performed 871/1589 (54.8%), followed by RYGB 551/1589 (34.7%) and the OAGB 167/1589 (10.5%). The median procedure time, recorded from first incision by the surgeon until the last suture, was 39 min (32–47), using the ERABS protocol [24].

Complications

Major complications (hemorrhage, anastomotic leakage, perforation, and stenosis) occurred in 62/1589 (3.9%) patients. Baseline characteristics of patients were significantly different for age (P = 0.004), BMI (P = 0.038), hypertension (P = 0.011), dyslipidemia (P = 0.003), cardiovascular disease (P = 0.013), anticoagulant use (P = 0.006), and procedure time (P = 0.028) (Table 3). The most frequent major complication observed was hemorrhage (CD ≥ 3), occurring in 38/62 (61%) of the patients experiencing complications and 38/1589 (2.4%) overall. Hemorrhage was diagnosed based on a significant decrease in hemoglobin levels and clinical symptoms in 24/38 (63.2), or by a CT scan 14/38 (36.8%). Reoperation was performed in 31/38 (81.6%) patients, gastroscopy in 4/38 (10.5%) patients, and 3/38 (7.9%) patients received packed red blood cells without requiring further intervention.

Table 3 Baseline characteristics between patients with no and major complications in absolute numbers or median value with its percentage or IQR

Checklist Outcome

Patients with major complications were significantly more likely to get a negative discharge advice following the checklist, requiring consultation with the metabolic surgeon when compared to patients without major complications (90.3% versus 48.1%, P < 0.001, respectively). Of all parameters included in the checklist, oral intake, mobilization, calf pain, willingness for discharge, heart rate, drain > 30 ml/24 h, hemoglobin postoperative, hemoglobin decrease, and leukocytes were significantly different between groups. After correcting for confounders, all significant parameters remained significant (Table 4). In 38 (2.4%) patients with a hemorrhage (CD ≥ 3), 37 (97.4%) patients received a negative advice. One patient was initially discharged with a positive advise (showing no signs), but later readmitted. After correction for covariables, significant differences were observed in nausea, oral intake, mobilization, willingness for discharge, heart rate, hemoglobin postoperative, hemoglobin decrease, and leukocytes. In 39 (2.5%) patients with minor hemorrhage (CD ≤ 2), 36 (92.3%) received a negative advise. Supplementary file 1 displays the difference between no hemorrhage, minor, and major hemorrhage. Leakage within 30 days was seen in nine (0.6%) patients, and after correcting for confounders, only CRP was significantly different in these patients (median 78 versus 19, P = 0.003, respectively).

Table 4 Checklist outcome between patients with no and major complications in absolute numbers or median value with its percentage or IQR

Positive and Negative Predictive Values

For the development of a major complication, the postoperative checklist for metabolic surgery had a positive predictive value of 7.1% and a negative predictive value of 99.2%. Patients with a negative advise for the checklist had a significant higher chance of a complication with an odd ratio of 10.1 ([95% CI 4.3 to 23.5], P < 0.001). Of the total population (no or major complications) with a positive checklist (advice against discharge), the true positive rate was 91.9% and the true negative rate was 48.1%.

ROC Analysis

ROC analyses were conducted for significant different outcomes between the group with and without major complications. The AUC according to the ROC analysis for the total checklist was 0.80 (P < 0.001). With a cut-off value of ≥3 positive points, the sensitivity is 65% and the specificity is 82%. The AUC according to the ROC analysis for heart rate was 0.75 (P < 0.001). The cut-off point of 80.5 bpm for heart rate had the highest combination of sensitivity of 74% and a specificity of 61%. Both ROC curves are shown in Fig. 1A–B. The AUC for hemoglobin, hemoglobin decrease, and leukocyte count were significant for major complications; however, these results did not meet the criteria of an AUC of 0.7.

Fig. 1
figure 1

A ROC curves of postoperative heart rate and B of total score checklist as markers for major complications in patients after metabolic surgery: Analysis demonstrated an area under the curve of 0.74 (P < 0.001) and 0.79 (P < 0.001) for total checklist score. Abbreviation: ROC curve, receiver operating characteristics curve

Minor Complications

Minor complications occurred in 133 (8.4%) patients. Patients with minor complications were significantly more likely to have a negative discharge advice from the checklist, requiring consultation of a metabolic surgeon when compared to patients without complications (60.9% versus 48.8%, P = 0.008, respectively). The nausea scale (P = 0.032), oral intake (P < 0.001), willingness for discharge (P < 0.001), VAS score (P < 0.001), hemoglobin postoperative (P < 0.001), hemoglobin decrease (P = 0.027), and postoperative CRP (P = 0.002) were significantly different between the groups. Of minor complications (no or minor complications) with a positive checklist (advice against discharge), the true positive rate was 60.8% and the true negative rate was 51.2%.

Readmissions and Unplanned Revisits

In patients with a negative advise to go home, 33/791 (4.2%) patients were readmitted in comparison to 38/798 (4.8%) patients with a positive advise P = 0.569. In patients with a negative advise to go home, 100/791 (12.6%) patients had unplanned revisits in comparison to 77/798 (9.6%) patients with a positive advise P = 0.058. Seventy-one (4.5%) patients were readmitted to the hospital with a significant decrease in hemoglobin (P = 0.030) and increase of CRP (P = 0.008). Major complications occurred in 30% of the readmitted patients and minor complications in 63%. One hundred seventy-seven (11.1%) patients had unplanned visits to the outpatient clinic or emergency room, and were found to have significant differences in willingness to be discharged (P < 0.001), VAS score for pain (P < 0.001), postoperative hemoglobin (P = 0.024), and CRP level (P = 0.006) (Table 5). For the readmission category and a positive checklist (advice against discharge), the true positive rate was 47.9% and the true negative rate was 50.0%. Regarding unplanned revisits with a positive checklist (advice against discharge), the true positive rate was 57.0% and the true negative rate was 51.1%.

Table 5 Checklist outcome in patients with minor complications, readmission, and unplanned revisit in absolute numbers with percentage or median value with its IQR

Discussion

The narrow time frame and frequency of major complications for patients with extreme obesity following weight loss surgery highlights the importance of implementing a checklist to facilitate safe discharge. The aim of this study was to re-evaluate and validate the predictive value of a postoperative checklist and to evaluate individual parameters for major complications after metabolic surgery. This study showed that our postoperative checklist was significantly more likely to give a negative advice in patients developing a major complication, with heart rate being the most predictive individual parameter.

In 90.3% of patients with major complication, the checklist gave a negative discharge advice. However, the positive predicted value of the checklist was 7.1%, meaning large numbers of reevaluations could be avoided. Nonetheless, the negative predicted value was 99.2%, meaning most patients discharged home on the first postoperative day did not develop a major complication. The possible overtreatment outweighs the safeness of discharge [15].

In contradiction to the pilot study, not only the willingness to be discharged on day one postoperatively but also oral intake, ability to mobilize, and calf pain were significantly different between groups. When patients are unable to mobilize or eat, even after guidance of nurses according to the ERABS protocol, this may indicate a complication [6]. Calf pain was added to the checklist, as a potential predictor of venous thrombotic event (VTE) of the lower leg and could prevent the development of pulmonary embolism with high mortality [25]. Although this parameter was significantly higher, only 2 patients developed VTE, making the utility of this parameter questionable.

The most common major complication was hemorrhage 38/62 (61%) and 38/1589 (2.4%) of the total included patients. After metabolic surgery increase in heart rate is one of the first symptoms in patients with hemorrhage [16, 26, 27]. In 38 patients with hemorrhage from this study, the same trend was observed (97 bpm versus 78 bpm, P < 0.001; delta 19 bpm versus −0.2 bpm, P < 0.001, respectively). A heart rate of 87 bpm was found to have the best combination of sensitivity and specificity. A heart rate of 87 bpm is clinically relatively normal. As a result, more patients receive a negative advise, even if there are no complications which is not preferable. In our study, we observed also a significant difference in postoperative hemoglobin and delta-hemoglobin between patients with and without hemorrhage, which is consistent with earlier research on postoperative hemorrhage after metabolic surgery [16, 28]. Fecso et al. suggested a 2 mmol/L drop in hemoglobin as an indicator of intervention [16]. In our study, the identified cut-off value for delta-hemoglobin was 1.1 mmol/L, with a sensitivity of 87% and a specificity of 87%, and an AUC of 0.923 (P < 0.001), respectively. However, these results should be interpreted with caution due to the small sample size, and no definitive recommendations can be made.

Fever and peritonitis are not specific symptoms for hemorrhage; one would rather expect this for anastomotic leakage [29]. However, the group of patients with leakage was too small 9/1589 (0.6%) to achieve significance in temperature and abdominal distension. In addition, high CRP levels may be useful in identifying patients with anastomotic leakage [17, 18, 20]. Median CRP level in the group was 78 mg/L, almost identical to the recommended cut-off value of >79 mg/L. However, the results of this subanalyses should be interpreted with caution, no recommendation could be given.

Drainage might reflect the surgeon’s intraoperative evaluation and anticipation of complications [30]. In the current study, >30 cc/24 h drain output was significantly higher in major complications. However, among 24 patients with a drain, 5 had complications. The uncertain utility of drain output in predicting complications has led to a decrease in drain usage percentages, which is also observed in our center [30, 31].

In the minor complication group, most patients had problems with toleration of oral intake, which explained that nausea, oral intake, and willingness of discharge had a significantly more negative outcome in the minor complication group. For readmission and unplanned revisits, the checklist was not predictive. After assessment by the attending surgeon, some patients were allowed to go home regardless of the negative advice of the checklist. For patients with no willingness for discharge, a high VAS score, or a high CRP without any other findings suggestive of complications, more guidance in the postoperative process is imperative in future practice to prevent unnecessary readmissions or revisits.

Although this study had sufficiently large numbers, the COVID-19 pandemic resulted in fewer metabolic procedures than expected. Second, a fluctuation was observed in the time frame when vital signs were collected during the nurses’ round, ranging from early to late in the morning. This may have affected the outcome. Better communication is necessary between physicians and nurses for measurement of vital parameters and time of ward rounds. Thirdly, most AUCs were too small to calculate new cut-off values. Parameters were assessed individually, while some parameters may be related. It is worth noting that four patients had revision surgery, none had a major complication, and only one had a minor complication. Including these cases reflected real-clinical practice, as the checklist is used for all bariatric patients. A larger sample size in this subgroup would have provided more insights into the risk of complications in revision surgery [32]. For a future study, a prediction model may be even more specific for predicting complications. The neutrophil-to-lymphocyte ratio (NLR) and increase in heart rate were not included in this study, but have shown to be of great value [33, 34]. To examine the new checklist with cut-off values and other additional parameters, we advise it should be externally validated.

In conclusion, the checklist may be a useful tool to identify the patients that can be safely discharged home. Heart rate seems the most predictive parameter for major complications. We recommend that a predictive model of the modified checklist with additional parameters, such as increase in heart rate and NLR to identify patients at risks for major complications, be externally validated.