Abstract
Septic patients in the intensive care unit (ICU) often develop sepsis-associated delirium (SAD), which is strongly associated with poor prognosis. The aim of this study is to develop a machine learning-based model for the early prediction of SAD. Patient data were extracted from the Medical Information Mart for Intensive Care IV (MIMIC-IV) database and the eICU Collaborative Research Database (eICU-CRD). The MIMIC-IV data were divided into a training set and an internal validation set, while the eICU-CRD data served as an external validation set. Feature variables were selected using least absolute shrinkage and selection operator regression, and prediction models were built using logistic regression, support vector machines, decision trees, random forests, extreme gradient boosting (XGBoost), k-nearest neighbors and naive Bayes methods. The performance of the models was evaluated in the validation set. The model was also applied to a group of patients who were not assessed or could not be assessed for delirium. The MIMIC-IV and eICU-CRD databases included 14,620 and 1723 patients, respectively, with a median time to diagnosis of SAD of 24 and 30 h. Compared with Non-SAD patients, SAD patients had higher 28-days ICU mortality rates and longer ICU stays. Among the models compared, the XGBoost model had the best performance and was selected as the final model (internal validation area under the receiver operating characteristic curves (AUROC) = 0.793, external validation AUROC = 0.701). The XGBoost model outperformed other models in predicting SAD. The establishment of this predictive model allows for earlier prediction of SAD compared to traditional delirium assessments and is applicable to patients who are difficult to assess with traditional methods.
Similar content being viewed by others
Introduction
Sepsis is a severe organ dysfunction caused by a dysregulated host response to infection, with high incidence and mortality, and is a common critical illness1. Approximately 48 million people worldwide suffer from sepsis each year and approximately 11 million people die from it2. Delirium is the most common manifestation of brain dysfunction in critically ill patients, characterized by symptoms such as altered consciousness, impaired attention, disorientation, hallucinations and delusions3. Delirium is a common neurological complication in septic patients in the intensive care unit (ICU), with reported incidence rates ranging from 17.7 to 48%, and its severity is closely associated with patient prognosis4,5. Furthermore, sepsis-induced delirium is also associated with long-term cognitive dysfunction after discharge, causing physical discomfort and pain to patients and a burden to families and the economy6,7.
Sepsis-associated delirium (SAD) is a complex clinical syndrome, the mechanism of which is not fully understood. It may be related to several factors, including neuroinflammation, cerebral perfusion abnormalities, blood–brain barrier damage, and neurotransmitter imbalances8. Currently, there is no definitive diagnostic criterion for SAD, and the Confusion Assessment Method for the ICU (CAM-ICU) score is the most effective tool for diagnosing and assessing delirium in adult ICU patients according to the 2013 Society of Critical Care Medicine guidelines for pain, agitation, and delirium9. There is still no specific treatment for SAD, and early detection and prevention of SAD in septic patients are critical to its occurrence and prognosis10. Several studies have analyzed the risk factors for SAD in septic patients4,5,11, but there is still no early prediction tool for SAD in septic patients.
The aim of this study is to develop an early prediction model for SAD using machine learning methods based on sepsis-related data from large public databases and to evaluate the clinical applicability of this model. Our ultimate goal is to provide clinicians with a tool to identify high-risk patients more quickly and comprehensively, allowing for earlier implementation of preventive measures and ultimately reducing the incidence and mortality of SAD.
Materials and methods
Data source
This is a retrospective cohort study based on the Medical Information Mart for Intensive Care-IV (MIMIC-IV, version 2.2) and the eICU Collaborative Research Database (eICU-CRD, version 2.0)12,13. The MIMIC-IV database contains information on all patients admitted to Beth Israel Deaconess Medical Center between 2008 and 2019, while the eICU-CRD is a multicenter telemedicine database containing data from more than 200,000 patients admitted to 335 ICUs in 208 hospitals across the United States between 2014 and 2015. The database includes comprehensive information such as length of stay, laboratory tests, medication management, vital signs, etc. for each patient. To protect patient privacy, all personal information was de-identified and random codes were used instead of patient identifiers. Therefore, this study did not require patient consent or ethics approval. The researcher (Zhang) has completed the training program provided by the collaborating institution (Certificate No. 53496787) and is qualified to use the database and extract data.
Study population
The diagnosis of sepsis was based on the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3), which defines sepsis as a sequential organ failure assessment (SOFA) score ≥ 2 associated with infection or suspected infection. Suspected infection was defined as antibiotics given within 3 days or 24 h of culture collection1. The following patients were excluded: (1) those aged < 18 years; (2) patients with multiple ICU admissions; (3) patients with an ICU stay of less than 24 h.
The presence of delirium was assessed using the CAM-ICU score, which consists of four features: (1) an acute onset of mental status changes or a fluctuating course; (2) inattention; (3) disorganized thinking; and (4) an altered level of consciousness. A patient is diagnosed as delirious (i.e., CAM-ICU positive) if they exhibit features 1 and 2, along with either feature 3 or 414.
We excluded septic patients without documented delirium assessment and septic patients who could not be assessed (documented inability to assess any of the 4 characteristics of the CAM-ICU scale). In addition, patients with a positive delirium assessment before the onset of sepsis and outside the ICU were excluded.
Data extraction and processing
The following data were extracted from the MIMIC-IV and eICU-CRD databases: (1) demographic information; (2) type of initial ICU admission; (3) initial vital signs and laboratory test results within 24 h of ICU admission; (4) SOFA and Glasgow Coma Scale (GCS) scores within 24 h of ICU admission; (5) comorbidities (hypertension, diabetes, acute myocardial infarction, chronic obstructive pulmonary disease, stroke, chronic kidney disease, acute kidney injury); (6) use of mechanical ventilation (MV), continuous renal replacement therapy (CRRT), vasopressors, and sedatives within 24 h of ICU admission; (7) ICU length of stay, 28-days ICU mortality, diagnosis time for delirium and sepsis. For continuous variables, outliers and obviously conflicting values were considered as missing values (for example, numerical values for vital signs were eliminated using certain rules (i.e., heart rate values should be between 0 and 300). Variables with more than 20% missing values were excluded from the analysis. Multiple imputation for missing values was performed using the “MICE” package15. For unordered multicategorical variables, one-hot coding was used to represent them.
Statistical analysis
Continuous variables were expressed as median and interquartile range. The Mann–Whitney U test was used for statistical comparisons between two groups. Categorical variables were described as counts and percentages, and the Chi-squared test or Fisher's exact test was used for group comparisons. Kaplan–Meier survival curves were constructed and compared using the log-rank test.
MIMIC-IV data were randomly divided into training and internal validation sets in a 7:3 ratio, with eICU-CRD data serving as the external validation set. Least absolute shrinkage and selection operator (LASSO) regression was used for dimensionality reduction and feature selection16. After data reduction, predictive models were built using the following methods: (1) logistic regression (LR); (2) support vector machine (SVM); (3) decision tree (DT); (4) random forest (RF); (5) extreme gradient boosting (XGBoost); (6) k-nearest neighbors (KNN); and (7) naive bayes (NB).
Model performance was evaluated using area under the receiver operating characteristic curve (AUROC), specificity, sensitivity, positive predictive value (PPV), negative predictive value (NPV), accuracy, and kappa coefficient, with AUROC serving as the primary performance metric. We also evaluated the change in PPV and NPV of the model at different prevalence rates. The model with optimal predictive performance was selected as the primary model for this study. Calibration curves were used to assess the degree of agreement between observed and predicted outcomes, and decision curve analysis (DCA) was used to assess net clinical benefit.
The Shapley Additive Explanations (SHAP) method was used to explore the interpretability of the final predictive model. Higher SHAP values indicated an increased likelihood of SAD17. Partial dependence plots (PDPs) could be used to calculate SHAP values for each feature, allowing clinicians to make more accurate predictions. PDPs can show the marginal effects of each feature on the predictions of the machine learning model.
To evaluate the application of the model, we applied the final model to another group of patients in the MIMIC-IV database who were not assessed or could not be assessed for delirium and predicted the occurrence of SAD in these individuals.
All statistical analyses were performed using R 4.2.3 (Vienna, Austria) and STATA 15.1 (College Station, Texas), with P < 0.05 considered statistically significant. The machine learning code and the raw patient data are available on Github (https://github.com/bbycat927/SAD).
Ethics approval and consent to participate
The MIMIC-IV database was approved by the Institutional Review Boards of Beth Israel Deaconess Medical Center and the Massachusetts Institute of Technology. Access to the eICU-CRD database was approved by the Institutional Review Board of the Massachusetts Institute of Technology. All protected health information in the database was de-identified, eliminating the need for individual patient consent. All methods were performed in accordance with relevant guidelines and regulations.
Results
Participants and baseline characteristics
After applying the exclusion criteria, a total of 14,620 patients from the MIMIC-IV database and 1723 patients from the eICU-CRD database were included (Fig. 1). Baseline characteristics of all patients are shown in Table 1. In the MIMIC-IV database, there were 5,390 cases of SAD (36.9%). Figure 2A shows the Kaplan–Meier curves for the two groups, showing a higher 28-days ICU mortality rate for the SAD group compared to the Non-SAD group (P < 0.01, Log-rank test). Similarly, ICU length of stay was significantly longer in the SAD group compared to the Non-SAD group (Fig. 2B P < 0.01, Mann–Whitney U test).
Supplementary Table S1 shows that the median time to diagnosis of sepsis in the MIMIC-IV and eICU-CRD databases was 3 and 0 h, the median time to diagnosis of SAD was 24 and 30 h, and the mean time to diagnosis of SAD was 44.9 and 58.7 h.
Feature selection and model development
Initially, 42 feature variables were identified (Table 1), and after one-hot coding of unordered multi-categorical variables, a total of 53 feature variables were obtained. LASSO regression was then performed. Figure 3A illustrates the cross-validation error for the penalty term. Using the lambda.1se criterion, we identified 43 variables with significant predictive ability. Figure 3B shows the coefficient profiles for these 53 features in LASSO regression, indicating the optimal point for retaining variables with non-zero coefficients. These 43 selected variables, along with their non-zero coefficient values, are presented in Supplementary Table S2. Based on the selected features, we built a traditional logistic regression model and six machine learning models: SVM, XGBoost, RF, KNN, DT, and NB.
Model performance
Table 2 describes the predictive performance of these models on the internal validation set, while Table 3 describes their performance on the external validation set. In terms of the AUROC, the XGBoost model outperformed the other models, with an AUROC of 0.793 on the internal validation set and 0.701 on the external validation set. The performance of the other models is also visualized in these figures, highlighting the superior performance of the XGBoost model (Fig. 4A and Fig. 4B).
To examine the calibration of the models, calibration curves for the three best performing models (XGBoost, RF, SVM) were generated and compared (Fig. 4C). Among them, XGBoost showed the best fit between observed and predicted probabilities, indicating its superior calibration. Decision curve analysis (DCA) was performed on these three models and the results are shown in Fig. 4D. The analysis showed that using the XGBoost prediction model provided the highest net benefit for predicting SAD, outperforming both RF and SVM.
For further analysis, we evaluated the PPV and NPV of the models at different thresholds (prevalence rates). In the internal validation set, RF showed the highest PPV at a threshold of 0.3, while XGBoost and SVM maintained stable PPV with increasing thresholds. For the external validation set, RF and XGBoost showed superior PPV. However, XGBoost showed consistent PPV across all thresholds. While all models showed an increase in NPV with increasing thresholds, the NPV was generally lower compared to the internal validation set (Supplementary Tables S3 and S4). Overall, these results confirm the robustness of XGBoost, particularly its stability across different prevalence rates.
Model interpretations
To identify the most influential features in the model, we plotted the feature importance ranking for the XGBoost model (top 15 features, Fig. 5A). These features included mechanical ventilation, cardiovascular ICU (CVICU), GCS score, sedation, acute kidney injury (AKI), temperature, anion gap, blood sodium, vasopressors, respiratory rate, age, stroke, bicarbonate, platelets, and white blood cells. The SHAP Summary plot (Fig. 5B) complements this ranking by illustrating the impact of each feature on the model's output. Each dot on the plot corresponds to a SHAP value for a feature in a given case. The y-axis represents a feature, and the x-axis location indicates the SHAP value or the magnitude of the feature's effect on the prediction. The color of the dots represents the actual value of the feature, with purple indicating low values and yellow indicating high values (e.g., for MV, yellow dots on the right side of the zero line indicate higher MV values contributing to a higher risk of SAD).
Partial Dependence Plots (PDPs) provide a graphical depiction of the marginal effect of a feature on the predicted outcome of a machine learning model (Fig. 6). In these plots, the x-axis represents the actual values of the clinical parameters, while the y-axis represents the corresponding SHAP values. This provides a way to quantify the relationship between the feature and the risk. A key advantage of PDPs is their ability to highlight non-linear relationships between features and the outcome. If the plotted line is not straight, or changes direction, this suggests that the relationship between the feature and the outcome is not linear. Thus, PDPs provide a more nuanced understanding of the model's decision rules beyond what is captured by linear models. For binary features, such as sedation, AKI, and stroke, the two distinct states of the variable are represented along the x-axis. The y-axis shows the average predicted outcome for the instances at each state. For example, a higher average prediction at one state over the other indicates that this state has a higher likelihood of leading to the predicted outcome. It's also worth noting that curve fitting for binary variables in PDPs does not indicate a trend or gradient as it does for continuous variables, but simply connects the average predictions at the two states.
Application of the model
In the MIMIC-IV database, there were a total of 6625 patients who were either not assessed or unable to be assessed for delirium, with 330 patients falling into the latter category (Fig. 1). The baseline characteristics of these patients compared with those with sepsis included in the MIMIC-IV model are detailed in Supplementary Table S5. These patients had higher ICU 28-days mortality and in-hospital mortality compared with those in the model (P < 0.01). Using XGBoost model, we predicted the occurrence of SAD in these patients. In the total group, 1833 patients (27.7%) were predicted to develop SAD. Furthermore, when comparing patients who were unassessed and those who could not be assessed, we found a higher predicted SAD incidence rate in the latter group, at 44.5% compared to 26.8% in the former group (P < 0.01). Mortality rate and ICU length of stay were also higher in the group of patients who could not be assessed than in those who were unassessed (P < 0.01) (Supplementary Table S5).
Discussion
In this investigation, we found that approximately 36.9% of sepsis patients in the ICU experienced delirium, with SAD patients having higher 28-days mortality rates and longer ICU stays compared to Non-SAD patients. We then developed an XGBoost-based machine learning predictive model that demonstrated commendable predictive performance in both internal and external validation, enabling early prediction of SAD on ICU admission. To our knowledge, this is the first study to establish a predictive model for SAD, as previous research has primarily focused on constructing predictive models for delirium18,19,20 or sepsis-associated encephalopathy21,22,23,24,25. Existing research on SAD has predominantly examined risk factors and typically included a limited number of study patients4,5.
Currently, the CAM-ICU score is the most commonly used method for diagnosing delirium, but it requires multiple assessments of the patient before a positive result is possible9,14. In contrast, our machine learning prediction model, based on data from the first 24 h of the patient's ICU admission, is able to predict SAD much earlier, as confirmed by our study results. It is worth noting that the completion of the delirium assessment by ICU staff (mainly nurses) varies widely, from only 38% in usual care to 84–95% after rigorous intervention26. Failure to complete has been attributed in part to patient-related factors such as age, language, sedation, and intubation, as well as staff-related issues such as inadequate training, difficulty using assessment tools, and heavy workload27,28. Even when an assessment is completed, a proportion of CAM-ICU scores are recorded as “unable to assess” (UTA) due to sedation, neurological deficits, underlying dementia or speech/hearing impairment. Such unassessable cases have been reported to account for 19–30% of all score records26,29. All of these factors can lead to underestimation of delirium in the ICU, and in our study we also found that many patients had no delirium assessment or were marked as UTA. Our predictive model revealed a SAD incidence of 27.7% in the cohort of unassessed patients, which was lower than the model's predicted incidence of 36.9%, while the SAD incidence in patients marked as UTA increased to a substantial 44.5%. Thus, by applying our machine learning prediction model to clinical data, clinicians may be able to identify potential SAD patients more comprehensively. However, it should be noted that further independent validation with different datasets with confirmed SAD diagnoses is needed to assess the generalizability and accuracy of this machine learning model in different clinical settings.
Our study identified mechanical ventilation as the strongest risk factor for SAD, with 50.6% of 6597 mechanically ventilated patients experiencing delirium, a finding consistent with many delirium-related studies18,19. In a study of mechanically ventilated sepsis patients, the incidence of SAD reached 48%5. In some partial dependence plots, we observed that sedation within 24 h of ICU admission was a favorable factor for SAD, which differs from some research findings18. Our sedatives included midazolam, dexmedetomidine, and propofol. Relevant studies have shown that the use of benzodiazepines and propofol may increase the risk of delirium30,31, whereas dexmedetomidine may decrease it32. However, the role of sedatives in SAD remains controversial; research by Yu Kawazoe et al.33 found no significant differences in mortality, delirium-free days, and ventilator-free days between the dexmedetomidine group and other sedative groups (propofol, midazolam, fentanyl) in mechanically ventilated sepsis patients. A large randomized controlled trial showed similar results34. We speculate that these results may be related to early sedation, as early sedation may reduce the duration of mechanical ventilation, which is the strongest risk factor for SAD, and its reduction would be conducive to reducing the incidence of SAD. Research by Stephens et al.35 found that the use of light sedation within the first 48 h of mechanical ventilation could reduce mortality, mechanical ventilation duration, and ICU length of stay. Shehabi et al.36 introduced the concept of early goal-directed sedation, implementing goal-directed sedation as soon as possible (12 h) after the initiation of mechanical ventilation, resulting in less benzodiazepine use, more delirium-free days, and less physical restraint in the early goal-directed therapy group. Notably, the impact of early sedation on patients is closely related to the depth of sedation; early deep sedation is associated with significantly increased rates of delirium, duration of mechanical ventilation, and mortality compared with early light sedation35.
Stroke is also a risk factor for SAD. Some of the current predictive models associated with delirium tend to exclude stroke from their exclusion criteria, possibly due to the difficulty in distinguishing overlapping symptoms between delirium and stroke. However, in recent years, there has been an increasing number of studies on delirium in stroke patients. A systematic review of delirium in neuro ICU(NICU) patients suggests the need for delirium assessment in stroke patients, with current tools being applicable for monitoring delirium in both stroke and brain injury patients37. The CAM-ICU score can accurately diagnose delirium after stroke, with a study by Mitasova et al. finding a sensitivity of 76%, specificity of 98%, and accuracy of 94% for the CAM-ICU in diagnosing delirium in stroke patients38. In addition, stroke-related delirium may interfere with the diagnosis of SAD, so we excluded pre-sepsis delirium in our exclusion criteria. Studies have shown that the incidence of delirium in stroke patients ranges from 10.7 to 16%39,40, while the incidence of delirium in the NICU ranges from 12 to 43%37. Infection is one of the risk factors for delirium in stroke patients41. The incidence of delirium is higher in sepsis patients with concomitant stroke; in our study, the incidence of delirium reached 50% in sepsis patients with stroke and 56.2% for SAD in the NICU.
Our results indicate that CVICU is a favorable factor for SAD, with an incidence rate of 19.9% in CVICU, similar to some studies42. The initial 24-h GCS score is also an important predictor of SAD, consistent with the results of the two most recent delirium prediction models18,19. Other predictive factors such as AKI, temperature, anion gap, blood sodium, vasopressors, respiratory rate, age, bicarbonate, platelets, and white blood cells have also been validated by similar studies or predictive models19,20,21,22,23,24,25. PDPs suggest that some of these predictors have a nonlinear relationship with the occurrence of SAD. For example, GCS score, temperature, sodium, and bicarbonate.
Our study has several limitations. First, there is currently no definitive diagnostic criterion for SAD. Although we established several inclusion and exclusion criteria, misdiagnosis and missed diagnoses remain inevitable. Second, we used LASSO regression for feature selection due to its efficiency in handling large numbers of variables, which may not be optimal for all models and may miss complex, non-linear relationships within the data. Third, it's important to note that the risk factor analysis based on PDPs may be subject to the assumption of feature independence. Finally, we did not further analyze the effects of sedative drug types, doses, and duration of use on SAD, which may complicate our predictive variables.
Conclusion
SAD is common in ICU sepsis patients, with higher mortality rates and longer ICU stays than sepsis alone. Using our machine learning-based early prediction model, we can predict the risk of SAD earlier than delirium can be detected by traditional tools such as CAM-ICU, and this model can be applied to patients who are difficult to assess conventionally. The establishment of this model facilitates early risk identification and the implementation of preventive measures, potentially reducing the incidence and mortality of SAD.
Data availability
Publicly available data sets were analyzed in this study. These data can be found here: https://physionet.org/about/database/.
References
Singer, M. et al. The third international consensus definitions for sepsis and septic shock (sepsis-3). JAMA 315, 801–810. https://doi.org/10.1001/jama.2016.0287 (2016).
Rudd, K. E. et al. Global, regional, and national sepsis incidence and mortality, 1990–2017: Analysis for the global burden of disease study. Lancet 395, 200–211. https://doi.org/10.1016/S0140-6736(19)32989-7 (2020).
European Delirium, A. & American Delirium, S. The DSM-5 criteria, level of arousal and delirium diagnosis: Inclusiveness is safer. BMC Med. 12, 141. https://doi.org/10.1186/s12916-014-0141-2 (2014).
Kim, Y., Jin, Y., Jin, T. & Lee, S. M. Risk factors and outcomes of sepsis-associated delirium in intensive care unit patients: A secondary data analysis. Intens. Crit. Care Nurs. 59, 102844. https://doi.org/10.1016/j.iccn.2020.102844 (2020).
Yamamoto, T. et al. Incidence, risk factors, and outcomes for sepsis-associated delirium in patients with mechanical ventilation: A sub-analysis of a multicenter randomized controlled trial. J. Crit. Care 56, 140–144. https://doi.org/10.1016/j.jcrc.2019.12.018 (2020).
Girard, T. D. et al. Clinical phenotypes of delirium during critical illness and severity of subsequent long-term cognitive impairment: A prospective cohort study. Lancet Respir. Med. 6, 213–222. https://doi.org/10.1016/S2213-2600(18)30062-6 (2018).
Vasilevskis, E. E. et al. The cost of ICU delirium and coma in the intensive care unit patient. Med. Care 56, 890–897. https://doi.org/10.1097/MLR.0000000000000975 (2018).
Tokuda, R. et al. Sepsis-associated delirium: A narrative review. J. Clin. Med. https://doi.org/10.3390/jcm12041273 (2023).
Barr, J. et al. Clinical practice guidelines for the management of pain, agitation, and delirium in adult patients in the intensive care unit. Crit. Care Med. 41, 263–306. https://doi.org/10.1097/CCM.0b013e3182783b72 (2013).
Atterton, B., Paulino, M. C., Povoa, P. & Martin-Loeches, I. Sepsis associated delirium. Medicina https://doi.org/10.3390/medicina56050240 (2020).
Lei, W. et al. Immunological risk factors for sepsis-associated delirium and mortality in ICU patients. Front. Immunol. 13, 940779. https://doi.org/10.3389/fimmu.2022.940779 (2022).
Johnson, A., Bulgarelli, Lucas, Pollard, Tom, Horng, Steven, Celi, Leo Anthony, and Roger Mark. MIMIC-IV Clinical Database Demo (version 2.2). PhysioNet (2023).
Johnson, A., Pollard, Tom, Badawi, Omar, and Jesse Raffa. eICU Collaborative Research Database Demo (version 2.0.1). PhysioNet (2021).
Ely, E. W. et al. Evaluation of delirium in critically ill patients: Validation of the confusion assessment method for the intensive care unit (CAM-ICU). Crit. Care Med. 29, 1370–1379. https://doi.org/10.1097/00003246-200107000-00012 (2001).
Van Buuren, S. & Groothuis-Oudshoorn, K. mice: Multivariate imputation by chained equations in R. J. Stat. Softw. 45, 1–67 (2011).
Friedman, J., Hastie, T. & Tibshirani, R. Regularization paths for generalized linear models via coordinate descent. J. Stat. Softw. 33, 1 (2010).
Lundberg, S. M. & Lee, S.-I. A unified approach to interpreting model predictions. Advances in neural information processing systems 30 (2017).
van den Boogaard, M. et al. Development and validation of PRE-DELIRIC (PREdiction of DELIRium in ICu patients) delirium prediction model for intensive care patients: Observational multicentre study. BMJ 344, e420. https://doi.org/10.1136/bmj.e420 (2012).
Gong, K. D. et al. Predicting intensive care delirium with machine learning: Model development and external validation. Anesthesiology 138, 299–311. https://doi.org/10.1097/ALN.0000000000004478 (2023).
Hur, S. et al. A machine learning-based algorithm for the prediction of intensive care unit delirium (PRIDE): Retrospective study. JMIR Med. Inform. 9, e23401. https://doi.org/10.2196/23401 (2021).
Peng, L. et al. Machine learning approach for the prediction of 30-day mortality in patients with sepsis-associated encephalopathy. BMC Med. Res. Methodol. 22, 183. https://doi.org/10.1186/s12874-022-01664-z (2022).
Yang, Y. et al. Development of a nomogram to predict 30-day mortality of patients with sepsis-associated encephalopathy: A retrospective cohort study. J. Intensive Care 8, 45. https://doi.org/10.1186/s40560-020-00459-y (2020).
Zhao, Q., Xiao, J., Liu, X. & Liu, H. The nomogram to predict the occurrence of sepsis-associated encephalopathy in elderly patients in the intensive care units: A retrospective cohort study. Front. Neurol. 14, 1084868. https://doi.org/10.3389/fneur.2023.1084868 (2023).
Ge, C. et al. Machine learning for early prediction of sepsis-associated acute brain injury. Front. Med. 9, 962027. https://doi.org/10.3389/fmed.2022.962027 (2022).
Zhao, L., Wang, Y., Ge, Z., Zhu, H. & Li, Y. Mechanical learning for prediction of sepsis-associated encephalopathy. Front. Comput. Neurosci. 15, 739265. https://doi.org/10.3389/fncom.2021.739265 (2021).
Awan, O. M., Buhr, R. G. & Kamdar, B. B. Factors Influencing CAM-ICU Documentation and Inappropriate “Unable to Assess” Responses. Am. J. Crit. Care 30, e99–e107. https://doi.org/10.4037/ajcc2021599 (2021).
Dos Santos, F. C. M. et al. Delirium in the intensive care unit: Identifying difficulties in applying the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU). BMC Nurs. 21, 323. https://doi.org/10.1186/s12912-022-01103-w (2022).
Kotfis, K. et al. Multicenter assessment of sedation and delirium practices in the intensive care units in Poland: Is this common practice in Eastern Europe?. BMC Anesthesiol. 17, 120. https://doi.org/10.1186/s12871-017-0415-2 (2017).
Terry, K. J., Anger, K. E. & Szumita, P. M. Prospective evaluation of inappropriate unable-to-assess CAM-ICU documentations of critically ill adult patients. J. Intensive Care 3, 52. https://doi.org/10.1186/s40560-015-0119-y (2015).
Pandharipande, P. et al. Lorazepam is an independent risk factor for transitioning to delirium in intensive care unit patients. Anesthesiology 104, 21–26. https://doi.org/10.1097/00000542-200601000-00005 (2006).
Han, L. et al. Use of medications with anticholinergic effect predicts clinical severity of delirium symptoms in older medical inpatients. Arch. Intern. Med. 161, 1099–1105 (2001).
Pandharipande, P. P. et al. Effect of sedation with dexmedetomidine vs lorazepam on acute brain dysfunction in mechanically ventilated patients: The MENDS randomized controlled trial. JAMA 298, 2644–2653. https://doi.org/10.1001/jama.298.22.2644 (2007).
Kawazoe, Y. et al. Effect of dexmedetomidine on mortality and ventilator-free days in patients requiring mechanical ventilation with sepsis: A randomized clinical trial. JAMA 317, 1321–1328. https://doi.org/10.1001/jama.2017.2088 (2017).
Hughes, C. G. et al. Dexmedetomidine or propofol for sedation in mechanically ventilated adults with sepsis. N. Engl. J. Med. 384, 1424–1436. https://doi.org/10.1056/NEJMoa2024922 (2021).
Stephens, R. J. et al. Practice patterns and outcomes associated with early sedation depth in mechanically ventilated patients: A systematic review and meta-analysis. Crit. Care Med. 46, 471–479. https://doi.org/10.1097/CCM.0000000000002885 (2018).
Shehabi, Y. et al. Early goal-directed sedation versus standard sedation in mechanically ventilated critically ill patients: A pilot study. Crit. Care Med. 41, 1983–1991. https://doi.org/10.1097/CCM.0b013e31828a437d (2013).
Patel, M. B. et al. Delirium monitoring in neurocritically Ill patients: A systematic review. Crit. Care Med. 46, 1832–1841. https://doi.org/10.1097/CCM.0000000000003349 (2018).
Mitasova, A. et al. Poststroke delirium incidence and outcomes: Validation of the confusion assessment method for the intensive care unit (CAM-ICU). Crit. Care Med. 40, 484–490. https://doi.org/10.1097/CCM.0b013e318232da12 (2012).
Qu, J. et al. Delirium in the acute phase of ischemic stroke: Incidence, risk factors, and effects on functional outcome. J. Stroke Cerebrovasc Dis. 27, 2641–2647. https://doi.org/10.1016/j.jstrokecerebrovasdis.2018.05.034 (2018).
Nydahl, P. et al. Prevalence for delirium in stroke patients: A prospective controlled study. Brain Behav. 7, e00748. https://doi.org/10.1002/brb3.748 (2017).
Pasinska, P. et al. Frequency and predictors of post-stroke delirium in PRospective Observational POLIsh Study (PROPOLIS). J.. Neurol 265, 863–870. https://doi.org/10.1007/s00415-018-8782-2 (2018).
Cai, S., Li, J., Gao, J., Pan, W. & Zhang, Y. Prediction models for postoperative delirium after cardiac surgery: Systematic review and critical appraisal. Int. J. Nurs. Stud. 136, 104340. https://doi.org/10.1016/j.ijnurstu.2022.104340 (2022).
Funding
This study was funded by National Natural Science Foundation of China, under Grant Number 82072134.
Author information
Authors and Affiliations
Contributions
Y.Z. conceived the idea, performed the analysis, and drafted the manuscript. M.Y. and T.H. interpreted the results and helped to revise the manuscript. J.H. and J.Z. helped to formulate the idea of the study. Z.Z. contributed to the analysis of the data. All authors read and approved the final version of the manuscript. All the authors agree to the publication of this work.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Zhang, Y., Hu, J., Hua, T. et al. Development of a machine learning-based prediction model for sepsis-associated delirium in the intensive care unit. Sci Rep 13, 12697 (2023). https://doi.org/10.1038/s41598-023-38650-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-023-38650-4
- Springer Nature Limited
This article is cited by
-
Prediction of carbapenem-resistant gram-negative bacterial bloodstream infection in intensive care unit based on machine learning
BMC Medical Informatics and Decision Making (2024)
-
A scoping review of machine learning for sepsis prediction- feature engineering strategies and model performance: a step towards explainability
Critical Care (2024)
-
Post-sepsis psychiatric disorder: Pathophysiology, prevention, and treatment
Neurological Sciences (2024)
-
Comparison of Different Fusion Radiomics for Predicting Benign and Malignant Sacral Tumors: A Pilot Study
Journal of Imaging Informatics in Medicine (2024)