Introduction

Chronic Obstructive Pulmonary Disease (COPD) is a common chronic respiratory disease featured by persistent respiratory symptoms and airflow limitation [1]. COPD is an important public health challenge and associated with high mortality worldwide. According to the WHO, it is estimated that global COPD will rise to the third leading cause of death in 2030, with the corresponding economic burden ranking the fifth [2]. Acute exacerbation of COPD (AECOPD) is defined as an acute worsening of respiratory symptoms in COPD which require additional therapy [1]. AECOPD contributes significantly to mortality among patients with COPD [3], especially for those who require intensive care unit (ICU) admission with a high mortality rate of 16.9% to 48.8% [4, 5]. The severity of exacerbations reflected by clinical results is strongly correlated with patient prognosis. Whereas accurate decision-making and prompt treatment would predict a better prognosis, it is important to identify the factors that is able to predict outcomes in AECOPD patients. Although several studies have investigated independent factors to predict mortality due to AECOPD [6,7,8,9], few study especially focused on patients with AECOPD in ICU.

Medical Information Mart for Intensive Care III (MIMIC III) database can provide a wealth of clinical data to be routinely analyzed. The purpose of our study was to determine independent factors affecting mortality for patients with AECOPD in MIMIC III database by nomogram. Nomograms, user-friendly instrument with visualized prediction outcomes, are popular prognostic tools with the ability to predict clinical events by integrating potential risk factors [10]. Nomogram could be easily applied in clinical practice to identify high-risk patients and guide decision-making. Hence, we intend to develop and internally validate a nomogram to predict 30-day mortality after admission to ICU among AECOPD patients.

Material and methods

Data source

We extracted the data of this retrospective study from MIMIC-III version 1.4 (MIMIC-III v1.4) database. MIMIC-III is a large, open, and public database, containing more than 50,000 patients admitted to the ICU at Beth Israel Deaconess Medical Center from 2001 to 2012 [11]. We accessed the MIMIC-III after completion of the Protecting Human Research Participants exam. The establishment and employment of this database were approved by the Institutional Review Boards of the Massachusetts Institute of Technology and Beth Israel Deaconess Medical Center. No informed consent was required since all the data were de-identified.

Study population, data extraction and outcome

Adult patients (≥ 18 years old) with the diagnosis of AECOPD were selected from the database. The definition of AECOPD was based on the International Classification of Diseases, 9th edition (ICD-9) code 491.21. For patients with multiple hospitalizations, only the first hospitalization was enrolled. Other exclusion criteria included length of ICU stay < 48 h and missing data > 10%.

Data were extracted from MIMIC-III database through Structured Query Language [12]. The data upon admission to ICU were recorded, including age, gender, full blood count (white blood cell (WBC) count, neutrophil count, lymphocyte count, platelet count, hemoglobin), laboratory values (serum albumin, alanine transaminase (ALT), aspartate transaminase (AST), serum creatinine (sCr), serum blood urea nitrogen (BUN), serum sodium, serum potassium, serum calcium), arterial blood gas (pH, partial pressure of oxygen (pO2), partial pressure of carbon dioxide (pCO2), bicarbonate), vital signs (temperature, mean atrial pressure (MAP), heart rate, respiratory rate), comorbidities (hypertension, diabetes mellitus (DM), coronary heart disease (CHD), chronic renal disease (CKD), maligancy), treatment therapy (invasive mechanical ventilation (IMV) and vasopressor) and clinical severity scales (Sequential Organ Failure Assessment (SOFA) score and Simplified Acute Physiology Score II (SAPS II)). The neutrophil-to-lymphocyte ratio (NLR) was defined as the absolute count of neutrophils divided by the absolute count of lymphocytes. The platelet-to-lymphocyte ratio (PLR) was defined as the absolute count of platelets divided by the absolute count of lymphocytes. The prognostic nutritional index (PNI) value was calculated as the following equation: 10 × serum albumin (g/dL) + 0.005 × total lymphocyte count (mm3). For missing variables, predictive mean matching was used to impute numeric features. The primary outcome was 30-day all-cause mortality after admission to ICU.

Statistical analysis

Continuous variables are presented as the mean ± standard deviation (SD) for normal distribution and as the median and interquartile range (IQR) for skewed distribution. Normal distributions were confirmed by Agostino tests. Continuous variables were compared by unpaired Student's test or Mann–Whitney U-test. Categorical variables were compared using the χ2-test or Fisher exact test as appropriate. The median difference (MD) were analyzed by Hodges-Lehmann estimate along with 95% confidence interval (CI).

Univariate Cox proportional hazard analysis was performed to explore the potential confounders associated with 30-day mortality. Subsequently, variables with P values < 0.1 in univariate were used to establish multivariate Cox regression by the backward step-down process based on the Akaike information criterion (AIC) to estimate the hazard ratio (HR) and 95% CI. The final model minimized the score of AIC in order to have fewest variables. The variance inflation factor (VIF) was calculated to detect the potential collinearity between continuous variables. When VIF > 10, collinearity was considered to exist and it will be solved by regularization. Nomogram was constructed based on the multivariate Cox regression results to visualize the model [13]. The Harrell’s concordance index (C-index) and receiver operating characteristic (ROC) curve were used to evaluate the discrimination ability of the nomogram. The nomogram was then calibrated graphically by visual examination of the calibration plot with the Hosmer–Lemeshow (HL) goodness-of-fit test. Internal validation of the final multivariate model was performed using a bootstrap resampling approach with 1000 replications. Decision curve analysis (DCA) was performed to assess the clinical usefulness of the nomogram by quantifying the standardized net benefits at different threshold probabilities [14]. Finally, according to the median of risk score, all patients were divided into the high-risk and low-risk groups, and the survival curve with a log-rank test was used to verify the prognostic value of nomogram.

All analyses were conducted using R software (version 3.6.3) and two-sided p values less than 0.05 were considered statistically significant in each statistical analysis.

Results

Baseline characteristics of the included patients

995 patients with AECOPD in the MIMIC-III database were primary screened. 501 patients were excluded due to length of ICU stay < 48 h, missing data > 10% or age < 18 (Fig. 1). Finally, a total of 494 patients with AECOPD were included in our study, with a mean age of 70.8 years old and 50.2% male. The baseline characteristics of the study population were shown in Table 1. 417 (84.4%) patients were in the survivor group and 77 (15.6%) patients were in the non-survivor group. Non-survivors tended to be elder compared with the survivors (75.3 ± 8.6 years old vs. 69.9 ± 10.5 years old, P < 0.001). Deceased patients had significantly higher levels of neutrophil count (MD = 1600/μL, 95%CI, 300 to 2900/μL), BUN (MD = 4.0 mmol/L, 95%CI, 1.0 to 8.0 mmol/L), NLR (MD = 3.8, 95%CI, 1.5 to 7.1) and PLR (MD = 63.4, 95%CI, 9.3 to 119.9). While, the levels of lymphocyte count (MD = − 2600/μL, 95%CI, − 4000 to − 1000/μL), serum albumin (MD = − 0.3 g/dL, 95%CI, − 0.5 to − 0.1 g/dL), partial pressure of oxygen (MD = -16 mmHg, 95%CI, − 30 to − 2 mmHg) and PNI (MD = − 3.2, 95%CI, − 4.9 to − 1.6) were significantly lower in non-survivors. Clinical severities, such as SAPS II (MD = 6, 95%CI, 3 to 9) and SOFA (MD = 1, 95%CI, 0 to 2), tended to be more severe in the non-survivor group when compared with the survivor group. Non-survivors were more likely to be treated with IMV (61% vs. 46.3%, P = 0.002) and vasopressor (54.5% vs. 32.4%, P < 0.001). In terms of vital signs, there were no significant differences between the two groups.

Fig. 1
figure 1

The flow chart of the included population

Table 1 Baseline and clinical characteristics of the study population

Univariate and multivariate prognostic analyses

Univariate Cox regression analysis showed that age (HR = 1.057, 95% CI, 1.030 to 1.085; P < 0.001), neutrophil count (HR = 1.034, 95% CI, 1.004 to 1.065; P = 0.026), serum albumin (HR = 0.547, 95% CI, 0.379 to 0.787; P = 0.001), NLR (HR = 1.009, 95% CI, 1.003 to 1.016; P = 0.006), PNI (HR = 0.941, 95% CI, 0.908 to 0.975; P < 0.001), SAPSII (HR = 1.037, 95% CI, 1.004 to 1.065; P = 0.026), SOFA (HR = 1.099, 95% CI, 1.020 to 1.184; P = 0.013), IMV (HR = 2.602, 95% CI, 1.339 to 5.057; P = 0.005) and vasopressor use (HR = 2.206, 95% CI, 1.408 to 3.455; P < 0.001) were significantly associated with 30-day mortality. After considering collinearity, multivariate Cox regression analysis based on AIC identified that age (HR = 1.066, 95% CI, 1.037 to 1.095; P < 0.001), pO2 (HR = 0.997, 95% CI, 0.995 to 0.999; P = 0.009), NLR (HR = 1.006, 95% CI, 1.001 to 1.013; P = 0.048), PNI (HR = 0.958, 95% CI, 0.923 to 0.994; P = 0.024), IMV (HR = 2.516, 95% CI, 1.265 to 5.005; P = 0.008) and vasopressor use (HR = 2.042, 95% CI, 1.267 to 3.292; P = 0.003) were independent risk factors for 30-day mortality (Table 2).

Table 2 Univariate and multivariate analysis of Cox-proportional hazards model for the risk of 30-day mortality

Construction and internal validation of the prognostic nomogram

The nomogram for predicting the probability of 30-day survival among AECOPD patients was constructed based on the multivariate Cox regression model (Fig. 2). Every specific value of these factors was allocated a score on the points scale. By adding up these scores, the total score was calculated. The discrimination power of the nomogram was evaluated by the C-index values and ROC curves. As the relatively same sample size of our study, we adopted 1000 bootstrap for internal validation. After 1000 samples, the adjusted C-index was 0.745 (95% CI, 0.712 to 0.778) with sensitivity 78.7% and specificity 67.4% (Fig. 3A). The calibration curve showed that the prediction results of the nomogram model were in good agreement with the actual observations (HL test, P = 0.147) (Fig. 3B). In addition, the Kaplan–Meier survival curves revealed a significantly lower survival probability in the high-risk group than that in the low-risk group (P < 0.001), which indicated the substantial discriminatory power of the nomogram to stratify the risk (Fig. 4).

Fig. 2
figure 2

Nomogram to calculate risk score and predict 30-day survival probability in AECOPD patients. Scores were assigned for age, PO2, NLR level, PNI level, treatment of IMV and vasopressor by drawing a line upward from the corresponding values to the ‘score’ line. The sum of all these scores, plotted on the ‘Total score’ line, corresponds to predictions of 30-day survival probability. IMV invasive mechanical ventilation, NLR, neutrophil-to-lymphocyte ratio; PNI prognostic nutritional index; PO2 partial pressure of oxygen

Fig. 3
figure 3

The ROC curve (A) and calibration curve (B) of the nomogram in predicting 30-day mortality among AECOPD patients in ICU after 1000 bootstrap

Fig. 4
figure 4

The Kaplan–Meier survival curves classified by low-risk group and high-risk group

Clinical usefulness of the prognostic nomogram

The DCA curve was plotted to perform a clinical application of this nomogram. Using data from the whole cohort, the DCA showed that if the threshold probability of a patient or doctor is 10%-60%, the prognostic model had a better positive net gain by risk stratification than NLR, PLR and PNI, indicating that it has good potential as a clinical application (Fig. 5).

Fig. 5
figure 5

Decision curve analysis for 30-day survival. The x-axis showed the threshold probability. The y-axis represented net benefit. Black line meant that all patients were dead and gray line represented that none patients were dead. The red line displayed the benefit of the nomogram. The green line displayed the benefit of NLR. The blue line displayed the benefit of PLR. The lake blue line displayed the benefit of PNI. NLR neutrophil-to-lymphocyte ratio; PLR platelet-to-lymphocyte ratio; PNI prognostic nutritional index

Discussion

The prognosis of patients with COPD exacerbations requiring ICU admission is generally poor. In this study, the 30-day mortality was 15.6%, which is consistent with findings of previous studies [4, 5]. Our main purpose was to use clinical data obtained from MIMIC III database to evaluate risk factors associated with 30-day mortality of patients with COPD exacerbation admitted to ICU. Then, we constructed a prognostic nomogram for AECOPD patients using individual patients’ status on admission to ICU. Six risk factors, namely, age, pO2, NLR, PNI, IMV and vasopressors use were included to establish a prognostic nomogram. This nomogram demonstrated good discrimination assessed by the C-index and calibration evaluated by HL goodness of fit test. Thus, this nomogram could be efficiently and effectively applied in clinical practice.

The impact of age as a prognostic factor for AECOPD patients is well known. Previous studies have demonstrated the role of age as a determinant of prognosis [4, 15, 16]. Issues related to increasing age, such as frailty, sarcopenia and co-morbidity, might affect prognosis [17]. Besides, elder patients usually present with atypical symptoms, such as muscle weakness, vertigo, confusion and leg edema during severe exacerbations [18]. What’s more, their respiratory system and immune function are impaired and more susceptible to pulmonary infection [6]. Hypoxemia is another frequently recognized prognostic factor. Several studies have reported its impact on poor prognosis in AECOPD patients [19,20,21]. Additionally, 48.6% of patients treated with IMV in our study and hypoxemia treated with IMV further increase the risk of mortality according to the nomogram. In a study by Brown et al. [22], 38.7% of patients required IMV and multivariate analysis demonstrated that the requirement for IMV was significantly correlated with in-hospital mortality. Cao et al. also found that requirement for IMV was a significant predictor of in-hospital mortality of AECOPD [23]. Vasopressor is the first-line to elevate blood pressure and hypotension occurs more frequently in those non-survivors [24].

The measurement of NLR and PNI are cost-effective and easily performed in clinical laboratories. The neutrophil–lymphocyte ratio, calculated by both neutrophil and lymphocyte counts, is a biomarker to predict systemic inflammation [25]. Several studies have utilized NLR as a marker of inflammation and severity for AECOPD patients. LEE et al. prospectively evaluated the value of NLR in patients with AECOPD, stable disease, and healthy controls. Compared to stable disease and healthy controls, NLR was significantly correlated with AECOPD [26]. Other studies also confirmed that NLR was elevated in AECOPD patients when compared with COPD and healthy controls [27,28,29]. NLR is also a prognostic biomarker in COPD. Yao et al. enrolled 303 patients with AECOPD. NLR values were significantly higher in non-survivors than those who survived in hospital [28]. Prognostic nutritional index is reflected by serum albumin concentration and peripheral total lymphocyte count. Serum albumin is a hallmark of nutritional status. Hypoalbuminemia could also reflect poor clinical status and persistent inflammation. Several studies have suggested that hypoalbuminemia is associated with increased mortality among AECOPD patients [17, 30, 31]. Lymphocyte count, another biomarker of immune status and inflammation, could predict risk of mortality in AECOPD patients. Lymphocytopenia has been proved to be correlated with increased mortality in COPD patients with acute exacerbation [23, 32]. Then, Peng et al. investigated the role of PNI in predicting mortality among AECOPD patients and they observed that the risk of 30-day mortality significantly increased with the downgraded of PNI [33].

This study still had some limitations. First, the database has large missing data on height and weight, so we could not evaluate the impact of body mass index on mortality. Second, the data for the nomogram were obtained from a single center and selection bias could not be avoided. Third, the generalization of our nomogram should be interpreted with caution due to the absence of external validation. So, we would require multicenter prospective studies to further investigate the clinical practice of our nomogram.

Conclusion

The nomogram developed in our study could help clinicians to predict risk of 30-day mortality in ICU and assist them to stratify patients and provide appropriate care in clinical setting.