Abstract
Objectives
This study aimed to develop machine learning models for risk prediction of continuous renal replacement therapy (CRRT) following coronary artery bypass grafting (CABG) surgery in intensive care unit (ICU) patients.
Methods
We extracted CABG patients from the electronic medical record system of the hospital. The endpoint of this study was the requirement for CRRT after CABG surgery. The Boruta method was used for feature selection. Seven machine learning algorithms were developed to train models and validated using 10 fold cross-validation (CV). Model discrimination and calibration were estimated using the area under the receiver operating characteristic curve (AUC) and calibration plot, respectively. We used the SHapley Additive exPlanations (SHAP) method to illustrate the effects of the features attributed to the model and analyze the effects of individual features on the output of the mode.
Results
In this study, 72 (37.89%) patients underwent CRRT, with a higher mortality compared to those patients without CRRT. The Gaussian Naïve Bayes (GNB) model with the highest AUC were considered as the final predictive model and performed best in predicting postoperative CRRT. The analysis of importance revealed that cardiac troponin T, creatine kinase isoenzyme, albumin, low-density lipoprotein cholesterol, NYHA, serum creatinine, and age were the top seven features of the GNB model. The SHAP force analysis illustrated how created model visualized individualized prediction of CRRT.
Conclusions
Machine learning models were developed to predict CRRT. This contributes to the identification of risk variables for CRRT following CABG surgery in ICU patients and enables the optimization of perioperative managements for patients.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Coronary artery bypass grafting (CABG) as an effective way of myocardial revascularization is a remarkably successful operation and is commonly employed for patients with high-grade or complex coronary artery stenosis. However, the high incidence of postoperative complications may significantly impact both the overall quality of surgical healthcare and patient’s prognosis, as well as mortality [1]. The reported incidence of acute kidney injury (AKI) after CABG surgery ranges from approximate 30–50% [2, 3], while mild to moderate AKI frequently occurs. 2–4% of serious AKI patients are required for continuous renal replacement therapy (CRRT) after CABG surgery in intensive care unit (ICU) [4, 5]. Despite the advancements in intensive care quality and renal replacement therapy technique, short-term mortality of patients receiving CRRT remains high level, ranging from 40% to over 70% [6,7,8]. Therefore, identifying risk factors of postoperative CRRT in CABG patients is critical for reducing death risk.
The application of machine learning model based on artificial intelligence (AI) algorithms has gradually gained momentum in clinical practices owing to its demonstrated superior predictive performance compared to traditional analytical models [9]. This study was conducted to develop machine learning models for predicting risk factors of CRRT after CABG surgery in ICU patients, with an aim to safeguarding postoperative renal function and improving clinical outcomes.
Methods
Data source and patient population
A retrospective review was conducted on 190 adult patients with coronary heart disease who underwent isolated CABG surgery under the support of cardiopulmonary bypass at department of cardiovascular surgery of The First Affiliated Hospital of Nanjing Medical University from January 2013 to June 2020. The exclusion criteria were as follows: (1) patients age < 18 years; (2) patients who received CRRT prior to CABG surgery in the ICU; and (3) patients with missing information exceeding 30%. The endpoint of this study was the requirement for CRRT after CABG surgery. Patients’ data were partitioned randomly into a training set (90%) for model development and a validation set (10%) for model validation. This study complies with the Declaration of Helsinki (revised in 2013) and was approved and supervised by the Ethics Review Committee of The First Affiliated Hospital of Nanjing Medical University (2019-SR-313.A1). The informed consent of patients was waived by the Ethics Review Committee of the hospital.
Criteria of CRRT
The criteria for initiation of CRRT were as follows: (1) more than 6 h of continuous anuria; (2) urine volume less than 200 mL for over 10 h; (3) serum potassium concentration > 6.5 mmol/L (hyperkalemia); (4) severe metabolic acidosis (pH < 7.20 despite normal or low partial pressure of carbon dioxide in arterial blood); (5) serum creatinine (sCr) ≥ 300 µmol/L; (6) volume overload (especially pulmonary edema unresponsive to diuretics); (7) clinical complications of uremia (e.g., encephalopathy, pericarditis, and neuropathy).
Study variables and data collection
Baseline characteristics and co-morbidities of patients, such as age, gender, body mass index (BMI), smoking history, drinking history, acute myocardial infarction (AMI) history, hypertension, diabetes, chronic renal disease, atrioventricular block, atrial fibrillation (AF), and New York Heart Association (NYHA) classification, were documented. The electrocardiogram and echocardiogram records were gathered. Laboratory examinations, such as serum lipids, blood urea nitrogen (BUN), serum creatinine (sCr), myocardial injury biomarkers, albumin (ALB), and blood glucose levels, were tested upon admission. The timing of intra-aortic balloon pump (IABP) implantation, surgical duration, cardiopulmonary bypass time, length of hospital stay (LOS), length of ICU stay, statins use, and in-hospital mortality were recorded. We applied one standard transformation to collected variables: handling missing values by method of filling.
Statistical analysis and development of machine learning models
Statistical analyses were conducted using SPSS software (version 23.0). Continuous variables are presented as mean ± standard deviation or as median (interquartile spacing), while categorical variables are presented as number (proportions). Then, Student’s t-test or the Mann–Whitney test was employed to compare the difference in continuous variables between two groups, and the Chi-square test was used to compare the difference in categorical variables between two groups. All p values were two-sided, with less than 0.05 indicating statistical significance.
The Boruta method was used to select critical features, and machine learning algorithms were then employed to construct training models using 10 fold cross-validation (CV), which effectively avoided overfitting and facilitated determination of optimal hyperparameters. This study included seven machine learning models: AdaBoost, LightGBM, Gaussian Naïve Bayes (GNB), Complement Naïve Bayes (CNB), multi-layer perceptron neural network (MLP), k-nearest neighbors (KNN), and support vector machine (SVM). Performance of the models was evaluated based on relevant indicators, including the area under the receiver operating characteristic curve (AUC), accuracy (ACC), sensitivity, and specificity. In general, the model with the highest AUC exhibited the best predictive capacity and was selected as the final prediction model. A calibration plot was generated to evaluate the correlation between predicted and actual clinical outcomes.
Furthermore, the SHapley Additive exPlanations (SHAP) method was applied to enhance the interpretability of the final model. The SHAP summary plot was used to illustrate the influence of model features. Then, the SHAP dependence plot was used to analyze the importance of individual features affecting model output. The SHAP force plot was utilized to visually represent the impact of key features on the final model in individual patients. Figure 1 illustrates the flowchart for the study.
Results
Baseline characteristics of patients
The baseline characteristics of the patients are shown in Table 1. This study population had 153 (80.526%) males, with their median age of 66.0 (60.0, 72.0) years old. A total of 72 patients were included in the CRRT group for this study, with a higher median age (69.0 vs 64.0 years old, p = 0.002), a higher mortality (37.500% vs 7.627%, p < 0.001), and a longer length of ICU (14.0 vs 11.0 d, p < 0.001) compared to the non-CRRT group. The comparison of gender, BMI, hypertension, chronic renal disease, AF, NYHA classification, ALB, blood glucose, cardiac troponin T (cTnT), sCr, BUN, creatine kinase isoenzyme (CK-MB), and hospital costs detected statistical differences between the two groups (p ≤ 0.05). Furthermore, there were no differences between the two groups regarding surgical duration (238 in non-CRRT group vs. 230 min in CRRT group, p = 0.737) and cardiopulmonary bypass time (89 in non-CRRT group vs. 94 min in CRRT group, p = 0.881). The detail content is shown in Table 1.
Developed machine learning models and their prediction performance
The Boruta method was employed to identify the key variables associated with CRRT in CABG patients. Ultimately, 17 out of 39 clinical parameters remained significantly associated with CRRT, and these results are presented in Fig. 2. When assessing machine learning models for predicting CRRT, the GNB model showed the highest AUC values in both the training set (0.856, 95% CI: 0.805–0.954, Fig. 3a) and validation set (0.817, 95% CI: 0.630–0.958, Fig. 3b). Furthermore, the GNB model exhibited the highest ACC and specificity in the two data sets (Fig. 4a, b). The calibration plot was generated to evaluate the difference between predicted outcomes and actual clinical outcomes. When predicting CRRT risk, the GNB model displayed excellent calibration performance (Fig. 5). Therefore, the GNB model was recognized as the final predictive model.
Model explanation and application
We next calculated the feature importance using the SHAP value for the GNB model, which had the greatest discriminatory capacity in the validation cohort. Figure 6a exhibits 17 clinical features according to the average absolute SHAP value. Figure 6b provides an overview of the impact (the positive or negative aspects) of factors on the GNB model. To further explore the contribution of the features on a certain individual patient and clinical application for the GNB model, we randomly selected one patient from the validation cohort to exhibit a visual interpretation (Fig. 7). The developed model predicted the probability of CRRT in this patient to be 86.2%. The result shows that fast blood glucose of 20.76 mmol/L, sCr of 125.6 μmol/L, atrial fibrillation, age of 79 years old, and NYHA of III classification were the top five contributors to this prediction.
Discussion
Critically ill patients undergoing cardiac surgery frequently present with a complex clinical scenario, posing challenges for clinicians in predicting outcomes. Machine learning algorithms have proven to be valuable tools in overcoming this difficulty and are often employed to develop models for clinical studies [10]. Machine learning has emerged as a powerful tool for distinguishing and predicting prognoses in patients undergoing CABG surgery. However, these studies primarily focused on identifying risk factors associated with postoperative complications, mortality, and prolonged LOS [11,12,13]. Given significant impact of postoperative CRRT on hospital mortality, it was imperative to develop machine learning-based risk prediction model specifically for CRRT after cardiac surgery. Consequently, conducting an effective predictive model using preoperative clinical data is important for clinicians to provide valuable guidelines regarding appropriate interventions and rational allocation of medical resources.
This study involved the development and validation of seven machine learning models based on 17 clinical variables collected in the first 24 h of hospital admission. Among these models, the GNB model demonstrated superior predictive ability for CRRT, primarily due to its highest AUC and better calibration in this study. To achieve the best predictive performance and interpretability, the SHAP was employed in the GNB model. Feature importance analysis revealed that cTnT, CK-MB, ALB, low-density lipoprotein cholesterol (LDL-C), NYHA, sCr, and age were the top 7 features of the GNB model, with significant impact on predicting postoperative CRRT. In addition, the SHAP force analysis enables clinicians to comprehend why specific recommendations are made by the model for high-risk decisions. Collectively, these findings enhance our understanding of decision-making process underlying predictive models for users.
In this study, we have identified crucial features of postoperative CRRT. The biomarkers cTnT and CK-MB, indicating myocardial injury, could to a certain extent reflect cardiac deterioration. Preoperative elevations in cardiac biomarkers may increase the risk of postoperative complications, such as AKI [14, 15]. This could be attributed to the close relationship between cardiac and renal function, referred to as cardio-renal syndrome [15]. In our study, cTnT and CK-MB accounted for the highest weight in the GNB predictive model, which suggested that they were the most critical predictors for postoperative CRRT following CABG surgery. NYHA classification is another heart-related indicator for assessing impaired cardiac function. Several studies have explored the role of NYHA classification in predicting postoperative AKI or need for renal replacement therapy, with NYHA III/VI being an independent risk factor [16,17,18]. Consistently, our study showed that patients requiring CRRT had a significantly higher proportion of NYHA III/VI compared to those without CRRT (69.445% vs. 39.830%). NYHA was identified as an important risk factor of CRRT.
The crucial role of serum ALB in maintaining intravascular volume, partially by facilitating vascular integrity [19], is widely acknowledged. Consequently, reduced levels of serum ALB may result in tissue edema and decrease the circulating volume by extravasation. Previous study has demonstrated an association between preoperative low ALB and short-term or long-term prognosis in patients with cardiac surgery [20]. This suggests that reduced ALB levels can serve as prognostic indicators following cardiac surgery. In our study, we observed significantly lower ALB levels in the CRRT group compared to the non-CRRT group, albeit with a slight difference. It is worth considering that even a mild reduction in ALB levels may affect postoperative CRRT at below-normal levels. The studies have explored the relationship between preoperative renal function and postoperative CRRT, with increased sCr levels identified as the risk factor for CRRT [21,22,23]. Our study corroborates this finding, suggesting that patients with impaired renal function have worse tolerant ability to surgery, which increases their need for CRRT. Age is a force majeure risk factor, with older patients being less tolerant to trauma, stress, and cardiac surgery. Some clinical studies have demonstrated age as CRRT-associated risk factor after surgery in patients [21, 22]. Consistent with these findings, our study confirmed age as a predictor for postoperative CRRT after CABG surgery. Furthermore, our study also found a strong association between LDL-C and postoperative CRRT, although there was little difference in LDL-C levels between two group patients. Given that all patients had coronary artery disease, part of them may have been treated with lipid-lowering medications, such as statins. Indeed, our results showed that the rate of statin use among the two groups had no difference (69.444% vs. 77.966%). Accordingly, we hypothesis that serum LDL-C levels may be affected by different doses of statins and individual responsiveness. Despite no great difference in LDL-C levels, this indicator ought to be highly noticed in CABG patients.
Some previous researches have incorporated preoperative, intraoperative, and postoperative indicators of patients undergoing CABG to develop predictive models for clinical outcomes. It is important to acknowledge that including all variables in the model can enhance risk identification. However, it should be clarified that modeling using patients’ preoperative parameters (within 24 h after admission) offers a priori advantages in early risk variable identification and clinical guidance. Although the machine learning models demonstrated favorable predictive performance in this study, it was important to acknowledge limitations of this study. First, the retrospective nature of the study could have introduced some bias into the results. Second, external data were not used for model validation, potentially impacting the generalizability of the models. Additionally, the usage of angiotensin receptor blockers (ARBs) is reported as an important risk factor for the development of AKI. However, the data on ARBs were lacking in our study, which may affect the development of models and risk identification to some extent. We aim to address and improve these issues in future studies.
Conclusion
Machine learning algorithm was utilized to develop a predictive model for CRRT after CABG surgery in the ICU patients, and the GNB model exhibited an excellent predictive performance and identified risk variables associated with CRRT. This study provides theoretical guidance for surgical physicians and enables the optimization of perioperative managements for patients.
Abbreviations
- ALB:
-
Albumin
- AKI:
-
Acute kidney injury
- AMI:
-
Acute myocardial infarction
- AUC:
-
Area under the receiver operating characteristic curve
- BNP:
-
B-type natriuretic peptide
- BUN:
-
Blood urea nitrogen
- CABG:
-
Coronary artery bypass grafting
- CK-MB:
-
Creatine kinase isoenzyme
- CNB:
-
Complement Naïve Bayes
- CV:
-
Cross-validation
- CRRT:
-
Continuous renal replacement therapy
- cTnT:
-
Cardiac troponin T
- GNB:
-
Gaussian Naïve Bayes
- HDL-C:
-
High-density lipoprotein cholesterol
- HR:
-
Heart rate
- IABP:
-
Intra-aortic balloon pump
- ICU:
-
Intensive care unit
- KNN:
-
K-nearest neighbors
- LDL-C:
-
Low-density lipoprotein cholesterol
- LOS:
-
Length of hospital stay
- LVEF:
-
Left ventricular ejection fraction
- LVFS:
-
Left ventricular fraction shortening
- MLP:
-
Multi-layer perceptron neural network
- SVM:
-
Support vector machine
- sCr:
-
Serum creatinine
- SHAP:
-
SHapley Additive exPlanations
- TG:
-
Triglyceride
- TC:
-
Total cholesterol
References
Khan FM, Hameed I, Milojevic M, Wingo M, Krieger K, Girardi LN, et al. Quality metrics in coronary artery bypass grafting. Int J Surg (Lond, Engl). 2019;65:7–12.
Kertai MD, Zhou S, Karhausen JA, Cooter M, Jooste E, Li YJ, et al. Platelet counts, acute kidney injury, and mortality after coronary artery bypass grafting surgery. Anesthesiology. 2016;124:339–52.
Benedetto U, Luciani R, Goracci M, Capuano F, Refice S, Angeloni E, et al. Miniaturized cardiopulmonary bypass and acute kidney injury in coronary artery bypass graft surgery. Ann Thorac Surg. 2009;88:529–35.
Bucerius J, Gummert JF, Walther T, Schmitt DV, Doll N, Falk V, et al. On-pump versus off-pump coronary artery bypass grafting: impact on postoperative renal failure requiring renal replacement therapy. Ann Thorac Surg. 2004;77:1250–6.
Oh TK, Song IA. Postoperative acute kidney injury requiring continuous renal replacement therapy and outcomes after coronary artery bypass grafting: a nationwide cohort study. J Cardiothorac Surg. 2021;16:315.
Bastin AJ, Ostermann M, Slack AJ, Diller GP, Finney SJ, Evans TW. Acute kidney injury after cardiac surgery according to risk/injury/failure/loss/end-stage, acute kidney injury network, and kidney disease: improving global outcomes classifications. J Crit Care. 2013;28:389–96.
Kowalik MM, Lango R, Klajbor K, Musiał-Światkiewicz V, Kołaczkowska M, Pawlaczyk R, et al. Incidence- and mortality-related risk factors of acute kidney injury requiring hemofiltration treatment in patients undergoing cardiac surgery: a single-center 6-year experience. J Cardiothorac Vasc Anesth. 2011;25:619–24.
Lugones F, Chiotti G, Carrier M, Parent D, Thibodeau J, Ducharme B, et al. Continuous renal replacement therapy after cardiac surgery. Review of 85 cases. Blood Purif. 2004;22:249–55.
Itchhaporia D. Artificial intelligence in cardiology. Trends Cardiovasc Med. 2022;32:34–41.
Kang MW, Kim S, Kim YC, Kim DK, Oh KH, Joo KW, et al. Machine learning model to predict hypotension after starting continuous renal replacement therapy. Sci Rep. 2021;11:17169.
Zea-Vera R, Ryan CT, Havelka J, Corr SJ, Nguyen TC, Chatterjee S, et al. Machine learning to predict outcomes and cost by phase of care after coronary artery bypass grafting. Ann Thorac Surg. 2022;114:711–9.
Parise O, Parise G, Vaidyanathan A, Occhipinti M, Gharaviri A, Tetta C, et al. Machine learning to identify patients at risk of developing new-onset atrial fibrillation after coronary artery bypass. J Cardiovasc Dev Dis. 2023;10:82.
Triana AJ, Vyas R, Shah AS, Tiwari V. Predicting length of stay of coronary artery bypass grafting patients using machine learning. J Surg Res. 2021;264:68–75.
Siniscalchi A, Gamberini L, Mordenti A, Bernardi E, Cimatti M, Riganello I, et al. Postoperative troponin T elevation as a predictor of early acute kidney injury after orthotopic liver transplantation: a preliminary retrospective study. Transpl Proc. 2012;44:1999–2001.
Bucholz EM, Whitlock RP, Zappitelli M, Devarajan P, Eikelboom J, Garg AX, et al. Cardiac biomarkers and acute kidney injury after cardiac surgery. Pediatrics. 2015;135:e945–56.
Huang X, Lu X, Guo C, Lin S, Zhang Y, Zhang X, et al. Effect of preoperative risk on the association between intraoperative hypotension and postoperative acute kidney injury in cardiac surgery. Anaesth Crit Care Pain Med. 2023;42: 101233.
Mehta RH, Grab JD, O'Brien SM, Bridges CR, Gammie JS, Haan CK, et al. Bedside tool for predicting the risk of postoperative dialysis in patients undergoing cardiac surgery. Circulation. 2006;114:2208–16;quiz 08.
Gummert JF, Bucerius J, Walther T, Doll N, Falk V, Schmitt DV, et al. Requirement for renal replacement therapy in patients undergoing cardiac surgery. Thoracic Cardiovasc Surg. 2004;52:70–6.
Dagenais GR, Pogue J, Fox K, Simoons ML, Yusuf S. Angiotensin-converting-enzyme inhibitors in stable vascular disease without left ventricular systolic dysfunction or heart failure: a combined analysis of three trials. Lancet (London, England). 2006;368:581–8.
Shang L, Ao Y, Lv L, Lv L, Zhang Y, Hou J, et al. Preoperative liver function test abnormalities were associated with short-term and long-term prognosis in cardiac surgery patients without liver disease. Front Cardiovasc Med. 2021;8: 772430.
Martucci G, Rossetti M, Li Petri S, Alduino R, Volpes R, Panarello G, et al. Continuous renal replacement therapy after liver transplantation: peri-operative associated factors and impact on survival. J Clin Med. 2022;11:3803.
Wu HB, Ma WG, Zhao HL, Zheng J, Li JR, Liu O, et al. Risk factors for continuous renal replacement therapy after surgical repair of type A aortic dissection. J Thorac Dis. 2017;9:1126–32.
Geirsson A, Szeto WY, Pochettino A, McGarvey ML, Keane MG, Woo YJ, et al. Significance of malperfusion syndromes prior to contemporary surgical repair for acute type A dissection: outcomes and need for additional revascularizations. Eur J Cardiothorac Surg. 2007;32:255–62.
Acknowledgements
We are grateful for Yongqian Zhu (Department of Information, The First Affiliated Hospital of Nanjing Medical University) for the assistance in data collection in this study.
Funding
No funding were received in support of this work.
Author information
Authors and Affiliations
Contributions
Qian Zhang and Peng Zheng participated the design of this study, collected the data, analyzed the data, and drafted the draft manuscript. Zhou Hong analyzed and managed the data. Luo Li collected the data. Nannan Liu, Zhiping Bian, and Xiangjian Chen managed and supervised the data. Hengfang Wu and Sheng Zhao were responsible for the study, designed the study, and reviewed the manuscript.
Corresponding authors
Ethics declarations
Conflict of interest
The authors declare no conflicts of interest.
Research involving Human Participants
This retrospective study was approved and supervised by the Ethics Review Committee of The First Affiliated Hospital of Nanjing Medical University (2019-SR-313.A1). The informed consent of patients was waived by the Ethics Review Committee of the hospital.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
This article is published under an open access license. Please check the 'Copyright Information' section either on this page or in the PDF for details of this license and what re-use is permitted. If your intended use exceeds what is permitted by the license or if you are unable to locate the licence and re-use information, please contact the Rights and Permissions team.
About this article
Cite this article
Zhang, Q., Zheng, P., Hong, Z. et al. Machine learning in risk prediction of continuous renal replacement therapy after coronary artery bypass grafting surgery in patients. Clin Exp Nephrol 28, 811–821 (2024). https://doi.org/10.1007/s10157-024-02472-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10157-024-02472-z