Introduction

Acute variceal bleeding (AVB) is one of the most common and serious complications of cirrhosis. Despite recent improvement in therapy (medication, endoscopy), up to 10–15% of patients still have persistent bleeding or early rebleeding and the overall mortality with each episode of AVB is still approximately 15% to 25% at six weeks [1,2,3]. Early identification of these high-risk patients and implementation of alternative more effective treatments, such as preemptive transjugular intrahepatic portosystemic shunt (p-TIPS), were recommended by multiple international consensus to improve the prognosis of this entity [4,5,6]. So far, factors found to be associated with the poor prognosis of cirrhotic patients with AVB include shock on admission, hepatic venous pressure gradient (HVPG) > 20 mmHg, concurrence of hepatic encephalopathy (HE) or hepatocellular carcinoma (HCC), renal failure and bacterial infection, etc. [7, 8]. Some scoring systems, such as Child-Turcotte-Pugh (CTP) [9], Model for End-stage Liver Disease (MELD) [10] and MELD-Na [11] have been proposed for predicting the prognosis of these patients. However, as these scores mainly reflect the severity of liver disease, their prediction accuracy may decrease when they encounter extrahepatic organ failures which have a vital impact on the prognosis of these patients [12, 13].

Acute-on-chronic liver failure (ACLF) was first defined by European Association for the Study of Liver-Chronic Liver Failure Consortium (EASL-CLIF) in the CANONIC study [14] as a syndrome characterized by acute decompensation (ie, ascites, hepatic encephalopathy, AVB and bacterial infection) of cirrhosis, multiple organ failure and high short-term mortality. In CANONIC study, the 28-day mortality in cirrhotic patients with ACLF is significantly higher than that in those without ACLF (33.9% vs. 4.7%, P < 0.001). Nowadays, with the progress of hemostasis technology, the proportion of AVB patients dying of hemorrhagic shock is gradually decreasing. Instead, most patients died of liver failure or multiple organ failures [14]. Although AVB is a well recognized precipitant leading to the occurrence and development of ACLF [15,16,17], the role of ACLF in the prognosis of cirrhotic patients with AVB has not yet been fully investigated.

In this study, we aimed at addressing the following 3 clinically relevant issues: (1) Whether the presence and grade of ACLF at admission was independently associated with the poor prognosis of cirrhotic patients hospitalized for AVB. (2) To analyse the difference of demographic characteristics, clinical features and laboratory parameters between AVB patients with and without ACLF (mere acute decompensation, AD). (3) To identify the accurate and robust prognostic scores in patients with ACLF and AD, respectively.

Patients and methods

Patients

Medical data of patients in this retrospective cohort study was obtained from Medical Information Mart for Intensive Care (MIMIC)-IV (version 2.0) [18, 19], which is a large and freely-available database comprising anonymous medical data of patients admitted to the intensive care units of Beth Israel Deaconess Medical Center between 2008 and 2019. Inclusion criteria: cirrhotic patients hospitalized for AVB. Exclusion criteria: (1) Less than 18 years old. (2) Pregnancy. (3) Without ICU stays. (4) Incomplete records. (5) HCC or malignant tumor in other organs. (6) Human immunodeficiency virus (HIV) infection or ongoing immunosuppressive therapy. (7) Serious extrahepatic diseases. Access to MIMIC-IV database was approved by the Institutional Review Board of the Beth Israel Deaconess Medical Center and Massachusetts Institute of Technology after the completion of online course and examination. Given the public availability of MIMIC-IV in which all patients' private information is anonymous, the approval by local ethics committee was waived.

Data collection

Medical data of cirrhotic patients hospitalized for AVB in MIMIC-IV 2.0 database was extracted through Postgres Structured Query Language (PostgreSQL) programming in Navicat Premium (version 15.0.12), including age, gender, race, first day vital signs, mean arterial pressure, percutaneous oxygen saturation, consciousness score, first day laboratory parameters, vasopressors therapy, mechanical ventilation therapy, renal replacement treatment (RRT) therapy, severity scores and survival information, etc. For those admitted multiple times to ICU, data from their first admission was used. For laboratory indicators measured more than one time, we selected the maximum or minimum of them according to their clinical implications, such as the maximum of bilirubin or minimum of albumin.

Calculation of prognostic scores

For all included patients, we calculated the traditional prognostic scores (CTP, MELD and MELD-Na). CTP score [9] was calculated as described previously. MELD score was directly obtained from MIMIC-IV. MELD-Na score was calculated using formula of: MELD-Na = MELD + 1.59 (135-Na), with maximum and minimum Na of 135 and 120 mEq/L, respectively [11]. In addition, we calculated the CLIF-C ACLF and CLIF-C AD score for patients with ACLF and AD, respectively, considering their corresponding specificity for the two distinct entities. CLIF-C ACLF score was calculated using formula of: CLIF-C ACLF = 10 × [0.33 × CLIF-OF score + 0.04 × Age (years) + 0.63 × Ln(WBC{109cells/L}) − 2] [20]. CLIF-C AD score was calculated using formula of: CLIF-C AD = 10 × [0.03 × Age(years) + 0.66 × Ln(Creatinine{mg/dL}) + 1.71 × Ln(INR) + 0.88 × Ln(WBC{109cells/L}) − 0.05 × Sodium(mmol/L) + 8] [21]. CLIF-OF score [20] was calculated as described previously.

Diagnostic criteria

Ascites, hepatic encephalopathy and bacterial infection were defined and graded according to International Ascites Club [22], West Haven Criteria [23] and international guidelines [24, 25], respectively. ACLF was defined by EASL-CLIF and diagnosed/graded according to CLIF-OF score. Specifically, liver failure was defined by total bilirubin ≥ 12 mg/dl; coagulation failure was defined by INR ≥ 2.5; kidney failure was defined by creatinine > 2 mg/dL or requirement of RRT; circulatory failure was defined by requirement of vasopressor therapy to maintain blood pressure; respiratory failure was defined by PaO2/FiO2 ≤ 200 or SpO2/FiO2 ≤ 214 or requirement of mechanical ventilation for reasons other than airway protection and in the absence of HE grade III or IV; brain failure was defined by HE grade III or IV (West Haven). Grade 1 ACLF was defined as: (1) single kidney failure; (2) single failure of the liver, coagulation, circulation or respiration along with a serum creatinine level ranging from 1.5 to 1.9 mg/dL and/or mild to moderate HE; (3) single cerebral failure along with a serum creatinine level ranging from 1.5 and 1.9 mg/dL. Grade 2 and 3 ACLF were defined as having 2 and ≥ 3 organ failures, respectively.

Study outcomes

The outcome of this study was 6-week all-cause mortality according to the Baveno VI Consensus Workshop [3]. Follow-up began on the date of patient’s admission and ended at 6 weeks later or the date of patient’s death.

Statistical analysis

Variables with normal or skewed distribution based on the result in Kolmogorov–Smirnov test (P > 0.05 for normal distribution) were described as means (± standard deviation) and medians (interquartile range), respectively. Comparisons of normal and skewed distribution variables between groups were performed with independent sample t-test and Mann–Whitney test, respectively. Categorical variables were described as numbers (percentage) and compared with Chi-square test. Univariate and multivariate Cox-proportional hazards regression analysis were performed to identify the risk factors for 6-week morality in AVB patients. Variables with P value < 0.05 in univariate analysis were considered for multivariate analysis with backward stepwise method. To evaluate the performance of prognostic scores in predicting 6-week mortality, discrimination, calibration and overall performance of each score were evaluated. Discrimination refers to the ability of a prediction score in stratifying patients according to their risk of developing the outcome. Calibration refers to the ability of predicting absolute risks (how closely the predicted probabilities agree with the actual outcomes). Discrimination was evaluated by plotting receiver operating characteristics (ROC) curve and calculating the area under curve (AUC) and compared by DeLong test. Calibration was evaluated by performing Hosmer–Lemeshow goodness-of-fit test and plotting the calibration curve to visually observe the consistency between predicted and actual mortality. Overall performance was assessed by calculating the Brier score and R2 value, a lower Brier score or higher R2 value indicating a better overall performance. Cumulative survival curves were plotted with Kaplan–Meier method and compared with log-rank test. Statistical analysis and figure plotting were performed using MedCalc 19.0.4, STATA 15.0 and R 4.2.0. A two-tailed P value < 0 0.05 was considered to be statistically significant.

Results

Baseline characteristics

A total of 603 consecutive patients with AVB were screened, and 268 patients were excluded for the following reasons: without cirrhosis (n = 46), without ICU stays (n = 129), incomplete records (n = 11), malignant tumor including HCC (n = 62), HIV infection (n = 13) and serious extrahepatic diseases (n = 7). Finally, 335 patients with cirrhosis and AVB who met the inclusion and exclusion criteria were included in this study. Their baseline characteristics were shown in Table 1. Patients were predominantly male (68.4%) and white (63.6%), with a median age of 55 years. The main etiology of cirrhosis was alcohol (60.0%). A total of 200 (59.7%), 201 (60.0%), 98 (29.2%) and 35 (10.4%) patients had ascites, hepatic encephalopathy, bacterial infection and portal vein thrombosis at admission, respectively. 181 (54.0%) patients had ACLF at admission (18.2%, 33.7% and 48.1% for grade 1, grade 2 and grade 3, respectively). The baseline characteristics of patients with and without ACLF were similar in terms of race, age, gender and etiology of cirrhosis. As expected, ACLF patients more frequently presented with bacterial infections and had significantly higher inflammatory markers such as peripheral white blood cell (WBC) count than AD patients. In addition, ACLF patients had higher level of total bilirubin, alanine aminotransferase, aspartate aminotransferase, international normalized ratio, prothrombin time, creatinine, blood urea nitrogen, potassium and lower level of hemoglobin, albumin and serum sodium at baseline. The clinical conditions of ACLF patients seems much more severe than that of AD patients, such as the more instability of vital signs (faster heart rate, lower mean arterial pressure and ratio of percutaneous oxygen saturation to fraction of inspired oxygen), higher proportion of ascites/hepatic encephalopathy and worse prognostic scores (CTP, MELD, MELD-Na) than AD patients. Besides, length of ICU stay and hospital stay in ACLF patients were significantly higher than that in AD patients. A total of 5 (1.5%) patients [AD = 1 (0.6%), ACLF = 4 (2.2%), P = 0.24] received liver transplantation.

Table 1 Baseline characteristics of all patients and patients with or without ACLF (N = 335)

Cumulative survival rates of cirrhotic patients hospitalized for AVB

Among the 335 included patients, 92 (27.5%) patients (ACLF = 79, AD = 13) died during a 42-day follow-up period. The cumulative 42-day survival rate in patients with ACLF was significantly lower than in those with AD (56.4% vs. 91.6%, P < 0.001) (Fig. 1A) and decreased gradually as the grade of ACLF increased (P < 0.001) (Fig. 1B). 22.5%, 34.2% and 63.8% of patients with ACLF grade 1, 2 and 3 died during the follow-up period, respectively (Fig. 1B).

Fig. 1
figure 1

Cumulative survival rates of cirrhotic patients hospitalized for AVB. A The 42-day cumulative survival rate of ACLF patients was significantly lower than that of AD patients (56.4% vs. 91.6%, P < 0.001). B The 42-day cumulative survival rate of patients with ACLF gradually decreases with the increase of ACLF grade (P < 0.001)

ACLF as an independent risk factor of 6-week mortality in cirrhotic patients with AVB

To further identify the role of ACLF in the prognosis of cirrhotic patients hospitalized for AVB, we performed Cox-proportional hazards regression analysis based on presence or absence of ACLF at admission and some well recognized risk factors for the prognosis of cirrhotic patients with AVB. In univariable analysis, variables with statistical differences included race, mean arterial pressure, SPO2 (percutaneous oxygen saturation)/FIO2 (fraction of inspired oxygen), presence of ACLF at admission, ascites, white blood cell, hemoglobin, albumin, total bilirubin, INR, ALT, serum sodium, serum potassium and serum creatinine (Table 2). Multivariable analysis showed that only ACLF (HR, 2.12, 95% CI: 1.07–4.20, P = 0.03), mean arterial pressure (HR, 0.97, 95% CI: 0.95–0.98, P < 0.001), white blood cell (HR, 1.02, 95% CI: 1.00–1.04, P = 0.03), total bilirubin (HR, 1.02, 95% CI: 1.00–1.04, P = 0.03), INR (HR, 1.58, 95% CI: 1.31–1.90, P < 0.001) and serum potassium (HR, 1.31, 95% CI: 1.05–1.63, P = 0.02) remained in the final regression model (Fig. 2).

Table 2 Risk factors for 6-week mortality in cirrhotic patients hospitalized for AVB
Fig. 2
figure 2

Forest plot showing the risk factors for 6-week mortality in cirrhotic patients with AVB. MAP, mean arterial pressure; SPO2, percutaneous oxygen saturation; FIO2, fraction of inspired oxygen

Performances of prognostic scores

Discrimination

In ACLF patients, the AUC regarding CTP, MELD, MELD-Na and CLIF-C ACLF were 0.645 (95% CI, 0.566–0.724), 0.706 (95% CI, 0.631–0.782), 0.704 (95% CI, 0.628–0.780) and 0.711 (95% CI, 0.636–0.786), respectively (Fig. 3A). No statistical differences between the AUC was found in DeLong test (P > 0.05 for all). The Youden index, cutoff value, sensitivity and specificity for above mentioned prognosis scores were 0.24/11/73.4/51.0, 0.34/25/77.2/56.9, 0.37/29/76.0/60.8 and 0.38/61/67.1/70.6, respectively (Table 3). In AD patients, the AUC regarding CTP, MELD, MELD-Na and CLIF-C AD were 0.677 (95% CI, 0.517–0.837), 0.683 (95% CI, 0.499–0.867), 0.661 (95% CI, 0.474–0.847) and 0.762 (95% CI, 0.615–0.909), respectively (Fig. 3B). In DeLong test, except MELD and MELD Na (P = 0.02), there was no statistical difference between the AUC (P > 0.05). The cutoff value, sensitivity and specificity for above mentioned prognosis scores were 10/61.5/76.6, 14/72.7/55.4, 23/40.9/88.1 and 55/77.3/68.4, respectively (Table 3).

Fig. 3
figure 3

Discrimination performance of prognostic scores in ACLF A and AD patients B

Table 3 Predictive values of prognostic scores

Calibration

In ACLF patients, the P value in Hosmer–Lemeshow goodness-of-fit test for CTP, MELD, MELD-Na and CLIF-C ACLF were 0.024, 0.650, 0.004 and 0.491, respectively (Table 3); the concordance between observed and predicted 6-week mortality shown by CLIF-C ACLF was excellent and was superior to that shown by the other three prognostic scores (Fig. 4A).

Fig. 4
figure 4

Calibration performance of prognostic scores in ACLF A and AD patients B

In AD patients, the P value in Hosmer–Lemeshow goodness-of-fit test for CTP, MELD, MELD-Na and CLIF-C AD were 0.677, 0.683, 0.661 and 0.762, respectively (Table 3); the concordance between observed and predicted 6-week mortality shown by CLIF-C AD was excellent and comparable to that shown by MELD but superior to that shown by CTP and MELD-Na (Fig. 4B).

Overall performance

In ACLF patients, the Brier score and R2 value for CTP, MELD, MELD-Na and CLIF-C ACLF were 0.229/0.104, 0.210/0.203, 0.213/0.187 and 0.209/0.219, respectively. In AD patients, the Brier score and R2 value for CTP, MELD, MELD-Na and CLIF-C AD were 0.094/0.077, 0.094/0.068, 0.093/0.073 and 0.087/0.173, respectively (Table 3).

Discussion

Acute variceal bleeding (AVB) is a life-threatening complication of cirrhosis. Acute-on-chronic liver failure (ACLF) is a syndrome characterized by acute decompensation of cirrhosis, multiple organ failures and high short-term mortality. In this single center retrospective cohort study, we investigated the role of ACLF in the prognosis of cirrhotic patients with AVB and found that the cumulative 6-week survival rate in patients with ACLF was significantly lower than that in those without ACLF and as the ACLF grades increased, the 6-week survival rate significantly decreased. In addition, the presence of ACLF at admission remained as a risk factor for 6-week mortality in cirrhotic patients with AVB after adjusting for confounding factors. Compared with the traditional prognostic scores, CLIF-C ACLF and CLIF-C AD performed best in patients with and without ACLF, respectively. To the best of our knowledge, this was the first study to validate the prediction performance of prognostic scores in AVB patients with and without ACLF, respectively.

In the last decade, different definitions of ACLF have been developed by multiple international consortia [14, 26,27,28]. Among them, we choose the EASL-CLIF definition because it was developed entirely in cirrhotic patients with various acute decompensations and therefore most suitable for the design of our study. In this study, patients with ACLF more frequently presented with bacterial infections and had significantly higher peripheral blood WBC count, which is consistent with the current mainstream view that ACLF is closely associated with an intense systemic inflammation which may induce immune-mediated tissue damage and mitochondrial dysfunction contributing to the development of organ failures [29,30,31,32]. ACLF patients also more frequently presented with ascites, which is an independent predictive factor of kidney failure, the most common organ failure in ACLF [33, 34]. In addition, ACLF patients had significantly higher serum potassium and lower serum sodium; serum potassium was identified as one of the independent risk factors for 6-week mortality in AVB patients (HR, 1.31, P = 0.02). Hyperkalemia might present a more severe condition involving intensive systemic inflammation, renal failure, liver failure and sarcopenia [35]. Hyponatremia has been well described in associations with hepatorenal syndrome, ascites and liver-related mortality [11]. Briefly speaking, our study conducted in AVB patients supports the view that ACLF is a more severe entity than AD [36], and it is very important to identify patients with ACLF at the early stage because it can increase their chances of receiving organ support treatment and/or intensive care, and correspondingly reduce their mortality.

Although it is well recognized that cirrhotic patients with ACLF carry a high short-term mortality, there are limited literature on the role of ACLF in the prognosis of cirrhotic patients with AVB, exclusively [37,38,39]. In this study, the 6-week mortality in AVB patients with ACLF was significantly higher than those without ACLF (43.6% vs. 8.4%, P < 0.0001) and increased significantly as the grade of ACLF increased (grade 1: 22.5%, grade 2: 34.2% and grade 3: 63.8%, P < 0.0001). The overall severity of ACLF is consistent with the result in CANONIC study (28-day mortality for AD, ACLF, ACLF grade 1, grade 2 and grade 3: 4.7%, 33.9%, 22.1%, 32.0% and 76.7%) and some recent studies on AVB by Shin et al. (28-day mortality AD:3.4%, ACLF:41.0%, grade 1: 7.1%, grade 2: 28.6% and grade 3: 80.8%) [37], Trebicka et al. (42-day mortality AD:10.0%, ACLF:47.1%, grade 1: 30.0%, grade 2: 50.0% and grade 3: 70.0%) [38] and Kumar et al. (42-day mortality AD:9.1%, ACLF:47.9%, grade 1: 24.0%, grade 2: 44.0% and grade 3: 77.0%) [39]. The different mortality in AVB patients with ACLF between our study and previous studies might be due to the different baseline characteristics of included patients. For example, Shin’s study included patients hospitalized either in ICU or general ward, Trebicka’s study included patients with HCC and Kumar’s study only included patients with refractory AVB, probably resulting in a relatively lower or higher mortality than our study. In addition, presence of ACLF at admission increased a 1.12 fold risk of death within 6-week after adjusting for confounding factors (HR = 2.12, P = 0.03), which was consistent with the result in study by Trebicka et al. (HR = 2.72, P < 0.001). In short, the 6-week mortality in AVB patients with ACLF was significantly higher than those with mere AD; ACLF is an independent risk factor for the 6-week mortality in cirrhotic patients complicated with AVB.

So far, few studies exclusively validated the performance of prognostic scores in AVB patients with or without ACLF. In this study, the AUC value of CLIF-C ACLF for 6-week mortality in AVB patients with ACLF is higher than the traditional scores, such as CTP, MELD and MELD-Na (although without statistic difference); the calibration ability of CLIF-C ACLF is excellent and superior to the traditional scores. In AD patients, CLIF-C AD was the only prognostic score with AUC > 0.7; the calibration ability of CLIF-C AD is also excellent and comparable to that of MELD but superior to that of CTP and MELD-Na. This is consistent with the result in our previous study in which CLIF-C AD outperformed the traditional prognostic scores in the prediction of 6-week mortality of AVB patients hospitalized in the general ward [40]. The superior performance of CLIF-C ACLF and CLIF-C AD to traditional prognostic scores might be due to the distinct background where these prognostic scores were developed. CTP and MELD were developed in cirrhotic patients who received surgery and TIPS therapy due to recurrent esophagogastric variceal bleeding and various complications of portal hypertension, respectively. MELD-Na was developed in cirrhotic patients listed for liver transplantation. All these three prognostic scores were developed regardless of the presence of ACLF. On the other hand, CLIF-C ACLF and CLIF-C AD were developed in cirrhotic patients included in the CANONIC study with and without ACLF, respectively. Thus, a superior performance of these two prognostic scores could be expected. According to the cutoff values of CLIF-C ACLF and CLIF-C AD, ACLF patients with CLIF-C ACLF score > 61 and AD patients with CLIF-C AD score > 55 may need to be stratified as high risk, respectively. These high risk patients may need to be provided with organ support therapy in intensive care unit [21] or salvage treatment such as pre-emptive TIPS [38] or Rescue TIPS [39], which were recently found to be very effective to reduce the 6-week and 1 year mortality in AVB patients with ACLF.

Our study has some limitations. First, as this was a single center and observational study, selection, information and confounding biases were inevitable. Second, although the medical record information in MIMIC database was prospectively and timely collected, the diagnosis of covert hepatic encephalopathy (minimal hepatic encephalopathy and grade I) might be partly effected by the subjective factors of observers. Besides, the diagnosis of respiratory failure or brain failure became difficult when the mechanical ventilation was provided because it was hard to determine the exact reason for the mechanical ventilation therapy (respiratory failure, airway protection in brain failure or both), which might to some extent lead to a bias in the diagnosis of respiratory failure or brain failure. Nonetheless, since the mortality in our cohort was consistent with that described in recent prospective studies on ACLF [37,38,39], we believe that our results are highly credible. Finally, as MIMIC database only comprises medical data of patients hospitalized in ICU, we did not validate the performance of prognostic scores in AVB patients hospitalized in the general ward.

In conclusion, ACLF at admission is an independent predictor for the 6-week mortality in cirrhotic patients with AVB. To improve the prognosis of this entity, it is essential to make treatment plans according to the presence or absence of ACLF at admission. CLIF-C ACLF and CLIF-C AD outperformed other prognostic scores in the prediction of 6-week mortality of patients with and without ACLF, respectively, and can be used for the risk stratification of these two distinct entities.