Abstract
Background
Effective delirium prevention could benefit from automatic risk stratification of older inpatients using routinely collected clinical data.
Aim
Primary aim was to develop and validate a delirium prediction model (DELIKT) suitable for implementation in hospitals. Secondary aim was to select an anticholinergic burden scale as a predictor.
Method
We used one cohort for model development and another for validation with electronically available data collected within the first 24 h of admission. Included were patients aged ≥ 65, hospitalised ≥ 48 h with no stay > 24 h in an intensive care unit. Predictors, such as administrative and laboratory variables or an anticholinergic burden scale, were selected using a combination of feature selection filter method and forward/backward selection. The final model was based on logistic regression and the DELIKT was derived from the β-coefficients. We report the following performance measures: area under the curve, sensitivity, specificity and odds ratio.
Results
Both cohorts were similar and included over 10,000 patients each (mean age 77.6 ± 7.6 years) with 11% experiencing delirium. The model included nine variables: age, medical department, dementia, hemi-/paraplegia, catheterisation, potassium, creatinine, polypharmacy and the anticholinergic burden measured with the Clinician-rated Anticholinergic Scale (CrAS). The external validation yielded an AUC of 0.795. With a cut-off at 20 points in the DELIKT, we received a sensitivity of 79.7%, specificity of 62.3% and an odds ratio of 5.9 (95% CI 5.2, 6.7).
Conclusion
The DELIKT is a potentially automatic tool with predictors from standard care including the CrAS to identify patients at high risk for delirium.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Impact statements
-
Routinely collected data within the first 24 h of admission can be integrated into a prevention tool to automatically predict delirium in hospitalised older patients.
-
The cumulative anticholinergic burden measured with the Clinician-rated Anticholinergic Scale is a reversible predictor for incident delirium, thus tailored medication lists with clear alternatives could installed as preventive measures.
-
The DELIKT has the potential to be implemented and tested in a impact study to investigate its clinical effectiveness.
Introduction
Delirium is common in hospitalised older patients, with an incidence rate ranging from 20% to 29% in geriatric units and 11% to 14% in general medical wards [1]. Moreover, delirium is a costly complication, leading to longer hospitalisations, and is associated with increased post-discharge mortality, institutionalisation and dementia [2, 3]. Delirium is a syndrome characterised by a sudden onset of altered and fluctuating disturbances in cognition and consciousness, inattention and disorganised thinking [4]. It has multiple risk factors, such as age, dementia, depression, history of stroke, vision or hearing loss, malnutrition, catheterisation, electrolyte misbalance, infection and polypharmacy [1].
Drugs with anticholinergic (ACH) properties are of particular interest, especially in the case of polypharmacy. The prevalence of drug use with ACH activity has nearly doubled over the past two decades [5]. The intake of ACH drugs is associated with a cumulative ACH burden due to age-related physiological changes, such as increased permeability of the blood–brain barrier, reduced renal and hepatic clearance and higher susceptibility and sensitivity to ACH medications [6]. In a recent publication, we found that a high cumulative ACH burden score of three points or more, measured with any of the published anticholinergic burden scales (ABSs) within the first 24 h of admission, is significantly associated with incident delirium in patients aged 65 years or older [7].
As delirium diagnosis is purely clinical and laboratory tests are lacking, a variety of detection and screening tools have been developed [8]. Despite all these tools, the high incidence and its association with negative clinical outcocmes, delirium remains an underdiagnosed event [9]. However, Inouye et al. showed that the management of delirium risk factors using standardised protocols could reduce incident delirium cases by approximately a third [10]. Thus, prediction models represent a valuable approach in the framework of ‘Personalised Medicine’ because they stratify individuals into groups by their level of disease risk or assign a risk score to a patient based on the number of modifiable or non-modifiable risk factors [11]. Several models have recently been developed, although they have variable predictive capabilities and limited feasibility for implementation in the clinical workflow, as most of the prediction models rely on questionnaires and non-routinely collected data [12, 13].
We believe that effective prevention of delirium requires an automated, predictive tool that accurately identifies high-risk patients early after admission, ideally using routinely collected clinical data.
Aim
Primary aim was to develop and validate a delirium prediction model (DELIKT) suitable for implementation in hospitals. Secondary aim was to select an anticholinergic burden scale as a predictor.
Ethics approval
The Swiss ethics review committee approved the protocol written for this study (EKNZ Project ID: 2018-01,000, June 11, 2018).
Method
Source of data
We used electronic health record (EHR) data from the first 24 h after admission for patients hospitalised between January 2015 and December 2018 at a tertiary teaching hospital in Switzerland. The years 2015/2016 were used for development and 2017/2018 for external validation. The cohort selection criteria, outcome definition and predictors are summarised below and have been described elsewhere in more detail [7]. This study was undertaken per the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement [14].
Participants
Inclusion criteria were inpatients aged 65 years or older with a length of stay ≥ 48 h and with no stay > 24 h in an intensive care unit (ICU), because the ICU did not use EHRs. Patients experiencing delirium within the first 24 h of hospitalisation or those with delirium related to substance abuse defined by International Classification of Disease 10 (ICD-10) codes were excluded.
Outcome
Delirium during hospitalisation was a binary outcome. It was defined as having an ICD-10 coded diagnosis (F05.0, F05.1, F05.8 and F05.9), a positive result in the Confusion Assessment Method (CAM) or a daily mean score of three points or more in the Delirium Observation Screening Scale (DOSS).
Predictors
Potential predictors were considered from the clinical data warehouse if they fulfilled four criteria: (1) previously identified in the literature including all 19 ABSs published to date [1, 15]; (2) available for data extraction from the hospital EHRs; (3) assessed within the first 24 h of admission; and (4) with at least 80% available data.
We extracted the following data for each patient from the EHR: demographic and administrative characteristics, diagnoses (ICD-10 codes), laboratory values and medication intake. All variables were dichotomised to facilitate the application of the prediction tool. The cut-offs were set at clinical importance based on a literature review and guidelines [16,17,18].
Demographic and administrative characteristics were age, sex and the hospital department. Furthermore, comorbidities were identified according to the Charlson comorbidity index based on the ICD-10 codes [19]. The following comorbidities were listed as predictors: acute myocardial infarction, congestive heart failure, peripheral vascular disease, cerebrovascular disease, dementia, chronic obstructive pulmonary disease (COPD), rheumatoid disease, peptic ulcer disease, liver disease, hemiplegia/paraplegia, renal dysfunction and cancer.
The variables from the laboratory and patient chart included glomerular filtration rate (GFR), creatinine (serum), potassium, sodium, C-reactive protein (CRP), body temperature, catheterisation and medication. All drugs administered within the first 24 h of hospitalisation were extracted. Of these, we considered all drugs using the ATC code that had so far been scored by any of the 19 ABSs and calculated a patient’s cumulative ACH burden [15]. Drugs that had not been scored previously in one of the ABSs were assumed to have no ACH activity and thus, received a score of zero points. The cumulative score for each ABS was then dichotomised into no/low ACH activity in the case of less than three points or strong ACH activity in the case of three or more points. Overall, we listed 42 potential predictor variables (Table 1).
Missing data
Variables with values missing in more than 20% of cases were not considered. Among considered variables, missing values were imputed by last observation carried forward. We filled in the overall mean (continuous) or mode (categorical/dichotomous) of the variable for each patient, if no value had previously been recorded.
Statistical analysis
For data management and analyses, we used the statistical software R (v3.6.2; R Core Team 2020) [20]. To compare the characteristics of patients with and without delirium, we used the R package tableone [21]. We performed a Pearson chi-square test for categorical and dichotomous variables, a t-test for continuous variables with normal distribution and a Mann–Whitney U test in the case of non-normal distributions. The mean ± the standard deviation or the median and interquartile range in the case of non-normal distribution are reported for continuous variables and the numbers with percentages for categorical variables.
The prediction model and DELIKT were developed and trained on the data set from the years 2015/2016. Due to the imbalanced nature of the data set, we used the synthetic minority oversampling technique (SMOTE) with five nearest neighbours on the minority class and a rate of eight on the training set prior to predictor variable selection, using the R package mlr [22]. For internal (development cohort) and external validation (validation cohort), we used the unmodified data sets. Next, predictor variables were selected as follows: (1) we used a feature selection filter method with the R package FSelectorRcpp [23] to select 25 predictors out of the 42 predictors from Table 1 based on “most information gain”; (2) on the predictors we used stepwise logistic regression with forward and backward selection; and (3) we evaluated which ABS would generate the model with the lowest AIC criterion. Additionally, we double-checked with the selected ABS if we would get the same model again. The final list of predictor variables was used to build a learner that was trained on the training set and predicted on the validation set. To describe discrimination, we drew the area under the curve (AUC) and calculated sensitivity and specificity.
The final prediction model was used to develop the DELIKT by rounding up the lowest β-coefficient to one, then multiplying the other coefficients by the same factor and finally rounding to the nearest whole number, as reported previously [24]. Next, the total DELIKT score was calculated for each patient by adding up all the integers from the applicable variables. We then computed a univariable logistic regression with the DELIKT and the delirium outcome. We reported the following measures: the Brier score for overall performance, the AUC for discrimination and a weighted calibration plot using the number of patients as weights. Finally, for clinical utility and the selection of the optimal cut-off value, we calculated the Youden index, sensitivity, specificity and performed a decision curve analysis. Additionally, we created a violin plot from the DELIKT score using the validation cohort.
Results
We included 12,052 patients in the development cohort of which 11% developed a delirium (72.0% identified by DOSS) during hospitalisation (Supplementary Figures S2.1/2.2). The mean age was 77.6 ± 7.6 years, and 51.6% of the patients were female. The validation cohort was comparable to the development cohort. The patient characteristics of the overall population in the development and validation cohort are depicted in Table 1, while those stratified by delirium for each cohort can be found in Table S1a/S1b. In addition, in both cohorts, the percentage of in-hospital mortality of patients with delirium was about five times higher than in patients without delirium. Moreover, patients with delirium had a longer hospital stay, with a median of ten days versus six days in non-delirium patients, and were more likely to be institutionalised after discharge to nursing homes or rehabilitation centres (Supplementary Table S1a/1b).
Model specification and performance
Of the 42 predictor variables, nine were included in the final model: age, medical department, dementia, hemiplegia/paraplegia, catheterisation, potassium, creatinine, polypharmacy and the ACH burden measured with the Clinician-rated Anticholinergic Scale (CrAS) [25].
The internal and external validation of the prediction model were similar in terms of AUC, 0.792 (internal) vs. 0.795 (external), respectively (Fig. 1, Table 2, Supplementary Table S2.3). According to Mandrekar et al. [26], an AUC > 0.70 is considered acceptable and > 0.80 as excellent, indicating that our model discriminates well. In terms of events per variable (EPV) ratio, our ratio was above 1:10 [27], which is usually used as a guide in order not to overfit the model and implies model stability.
DELIKT
We derived the DELIKT from the β-coefficients of the prediction model, which ranged between 0 and 98 points (Table 3) and showed a good overall performance, as represented in the low Brier Score (Table 2). The violin plot displays the distribution of the DELIKT scores in patients with and without delirium (Supplementary Figure S2.5): the higher the score, the more likely delirium is to occur. There is a large overlap, however, between 20 and 40 points. The highest score of the Youden index was at 0.42, seen between 16 and 20 points, which we used to decide on the cut-off value. A cut-off at 20 points yielded a sensitivity of 79.7%, a specificity of 62.3% and an odds ratio 5.9 (95% CI 5.2, 6.7) when comparing patients with ≤ 20 and > 20 points in the DELIKT (Table 2). Depending on the cut-off value, different sensitivity and specificity can be achieved. The weighted calibration plot of the mean observed vs. mean predicted risk using the DELIKT shows a good calibration (Table 2, Fig. 2). For clinical utility, the decision curve analysis, which considers the consequences of the decisions based on the DELIKT, shows that the DELIKT adds a benefit between a threshold of 0.05 (5%) and 0.55 (55%) (Supplementary Figure S2.6).
Discussion
Key findings
Automatic delirium risk stratification of older inpatients within the first 24 h of hospital admission might be a powerful tool for effective delirium prevention. In this single-centre retrospective cohort study, we used EHR data of over 10,000 patients during the first 24 h of admission to develop and validate a delirium prediction model from which we derived the DELIKT. With a cut-off at 20 points in the DELIKT, we received a sensitivity of 79.7%, specificity of 62.3% and an odds ratio of 5.9 (95% CI 5.2, 6.7).
Interpretation
We observed a delirium occurrence of 11%, which is at the lower end of the range found in the literature [1]. Although the DOSS is not considered to be a standard diagnostic tool, unlike the CAM, we included the DOSS in our delirium definition based on a previous sensitivity analysis [7], which did not show major differences in the effect size between the DOSS and the CAM. Additionally, including the DOSS might address the previously reported problem of delirium underdiagnosing [28]. This might also support the choice of cut-off at 20 points in the DELIKT, yielding a high sensitivity allowing for prediction of more patients at risk of delirium. At this cut-off, however, the positive predictive value (PPV) is only 21.5%, whereas a cut-off at 60 points would yield a PPV of about 55%, meaning that over half of the patients with more than 60 points would develop a delirium.
As of now, multiple delirium risk factors have been identified, which are often grouped into predisposing and precipitating factors [29]. Predisposing factors are age, dementia and other pre-existing comorbidities. Precipitating factors are most likely an acute condition, such as an infection; an additional medical problem during hospitalisation, such as a catheterisation; polypharmacy; or worsening of pre-existing conditions, such as an acute decrease of renal function [29]. One of the major challenges in clinical prediction rules is the time required to perform the risk-factor assessment, such as a cognitive screening, which can take up to 20 min [30, 31]. In our study, we focused on variables that are easily accessible during the admission and do not need any extra assessment by the physician or the nurse. Compared to other prediction models, we found similar predictors, such as age > 80 years [31, 32], dementia [32], polypharmacy and catheterisation [33]. The strongest predictor was dementia followed by age, the cumulative ACH burden measured with the CrAS, catheterisation and hemiplegia/paraplegia. Studies have shown that patients with delirium superimposed on dementia have an increased risk of in-hospital mortality [34, 35]. In addition, a recent pooled meta-analysis revealed that the odds of developing new dementia is twelve times higher in older hospitalised patients with delirium than in those without [36], suggesting that the interplay between delirium and dementia remains a vicious circle.
To our knowledge, this is the first report that includes the cumulative ACH burden measured with an ABS. In our previous publication, three points or more in the Anticholinergic Toxicity Scale (ATS) showed a stronger association with incident delirium compared to the CrAS [7]. The CrAS performed better than the ATS in this analysis, possibly due to the inclusion of more drugs in the CrAS than in the ATS, which may add more information to the prediction model in combination with the other predictor variables.
Two predictors that have previously been identified and were not included in our study were vision and hearing impairment [32]. This was due to the fact that more than 20% of the variables were missing and therefore were not considered for predictor selection. Furthermore, previous studies often used the BUN/Cr ratio or specific results from cognitive tests, such as the Mini-Mental State Examination (MMSE), which were not part of our data set. Moreover, cognitive tests would require an assessment by a physician, which would take time during admission and is not part of the daily routine [32].
We found four other prediction models for delirium that focused on medical and surgical patients [31, 37,38,39]. Of these, two included patients aged 65 years or older, and the other two considered slightly younger patients aged 60 and 50 years, respectively [38, 39]. These studies reported delirium incidences ranging between 8 and 26%, in line with our results. However, only the tool by de Wit et al. [38] and the Mayo Delirium Prediction (MDP) tool by Pagali et al. [39] aimed to develop a model that could, like ours, predict automatically, as they were also created using EHRs. While de Wit et al. [38] reported an AUC lower than ours, the MDP tool performed better with an AUC of 0.84 [39]. In addition, like our tool, the MDP uses predictors that are available at admission to calculate the probability of developing delirium during hospitalisation. Generally, when choosing risk factors in prediction modelling, it is essential to choose those that have a causal relationship to the outcome, occur before the event and could be changed within a reasonable time span in order to change a patient’s prediction. In the case of delirium, the DELIKT includes, in particular, the precipitating risk factor of the cumulative ACH burden, which could be altered during hospitalisation. Medication lists could be developed tailored to the hospitals medication stock to guide clinicans to clear alternatives, e.g. mirabegron instead of solifenacin. So far no other prediction model includes any ABS and little is known about prediction models that have been implemented to test clinical effectiveness.
Strengths and weaknesses
Diagnosis of delirium is difficult due to its fluctuating course. In addition, there are also two different subtypes of delirium (hyperactive vs. hypoactive) [1]. Our DELIKT was developed neither for subtype differentiation nor for capturing the fluctuating course of delirium. Additionally, the DELIKT does not predict delirium in patients taking medications with high potential but low or no anticholinergic activity. Regarding comorbidities considered in this report, it is important to mention, that these were drawn from ICD-10 codes. Usually, these are only available at the end of a hospital stay.
Further research
For a prospective study using the DELIKT, comorbidity variables must either be assessed using a diagnosis list or asking the patient or be replaced by a surrogate parameter, such as the CRP for infection. Alternatively, machine learning techniques could be used to scan for delirium key words written in a physician’s progress report. Finally, per TRIPOD statement our type of validation is considered “narrow”. Thus, it is highly recommended to perform a “broad” validation, meaning in a different hospital and, if possible, with prospectively collected data.
Conclusion
The DELIKT is a potentially automatic tool with predictors from standard care including the CrAS to identify patients at high risk for delirium. A DELIKT score of more than 20 points was significantly associated with incident delirium. It could be implemented in a computerised physician order entry system to automatically predict delirium risk during admission. The cut-off score can be adapted depending on what sensitivity or specificity is warranted. In a next step, the DELIKT or the CrAS alone should be implemented in a clinical station to conduct an impact study evaluating its preventive power in comparison to standard care.
References
Inouye SK, Westendorp RGJ, Saczynski JS. Delirium in elderly people. The Lancet. 2014;383:911–22.
Young J, Inouye SK. Delirium in older people. BMJ. 2007;334:842–6.
Witlox J. Delirium in elderly patients and the risk of postdischarge mortality, institutionalization, and dementia. JAMA. 2010;304:443–51.
Inouye SK, van Dyck CH, Alessi CA, et al. Clarifying confusion: the confusion assessment method. A new method for detection of delirium. Ann Intern Med. 1990;113:941–8.
Grossi CM, Richardson K, Savva GM, et al. Increasing prevalence of anticholinergic medication use in older people in England over 20 years: cognitive function and ageing study I and II. BMC Geriatr. 2020;20:267.
Collamati A, Martone AM, Poscia A, et al. Anticholinergic drugs and negative outcomes in the older population: from biological plausibility to clinical evidence. Aging Clin Exp Res. 2016;28:25–35.
Lisibach A, Gallucci G, Benelli V, et al. Evaluation of the association of anticholinergic burden and delirium in older hospitalised patients—a cohort study comparing 19 anticholinergic burden scales. Br J Clin Pharmacol. 2022;88:4915–27.
Helfand BKI, D’Aquila ML, Tabloski P, et al. Detecting delirium: a systematic review of identification instruments for non-ICU settings. J Am Geriatr Soc. 2020;69:547–55.
Lange PW, Lamanna M, Watson R, et al. Undiagnosed delirium is frequent and difficult to predict: results from a prevalence survey of a tertiary hospital. J Clin Nurs. 2019;28:2537–42.
Inouye SK, Bogardus ST Jr, Charpentier PA, et al. A multicomponent intervention to prevent delirium in hospitalized older patients. N Engl J Med. 1999;340:669–76.
Kent DM, Steyerberg E, van Klaveren D. Personalized evidence based medicine: predictive approaches to heterogeneous treatment effects. BMJ. 2018;363:k4245.
Lindroth H, Bratzke L, Purvis S, et al. Systematic review of prediction models for delirium in the older adult inpatient. BMJ Open. 2018;8:e019223.
Newman MW, O’Dwyer LC, Rosenthal L. Predicting delirium: a review of risk-stratification models. Gen Hosp Psychiatry. 2015;37:408–13.
Moons KG, Altman DG, Reitsma JB, et al. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med. 2015;162:W1-73.
Lisibach A, Benelli V, Ceppi MG, et al. Quality of anticholinergic burden scales and their impact on clinical outcomes: a systematic review. Eur J Clin Pharmacol. 2020;77:147–62.
Giannini EG, Testa R, Savarino V. Liver enzyme alteration: a guide for clinicians. CMAJ. 2005;172:367–79.
Giboney PT. Mildly elevated liver transaminase levels in the asymptomatic patient. Am Fam Physician. 2005;71:1105–10.
Oh RC, Hustead TR, Ali SM, et al. Mildly elevated liver transaminase levels: causes and evaluation. Am Fam Physician. 2017;96:709–15.
Quan H, Sundararajan V, Halfon P, et al. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005;43:1130–9.
Team RC. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing, 2019.
Kazuki Y, Bartel A. tableone: Create 'Table 1' to describe baseline characteristics with or without proensity score weights. R package version 0120, 2020.
Bischel B, Lang M, Kotthoff L et al. mlr: Machine Learning in R. R package version 2180. J Mach Learn Res, 2016.
Zawadzki Z, Kosinski M. RSelectorRcpp: Rccp Implementation of "FSelector" Entropy-Based Feature Selection Algorithms with a Sparse Matrix Support. R package version 038, 2021.
Le Gal G, Righini M, Roy PM, et al. Prediction of pulmonary embolism in the emergency department: the revised Geneva score. Ann Intern Med. 2006;144:165–71.
Han L, Agostini JV, Allore HG. Cumulative anticholinergic exposure is associated with poor memory and executive function in older men. J Am Geriatr Soc. 2008;56:2203–10.
Mandrekar JN. Receiver operating characteristic curve in diagnostic test assessment. J Thorac Oncol. 2010;5:1315–6.
Peduzzi P, Concato J, Kemper E, et al. A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1996;49:1373–9.
Partridge JS, Martin FC, Harari D, et al. The delirium experience: what is the effect on patients, relatives and staff and what can be done to modify this? Int J Geriatr Psychiatry. 2013;28:804–12.
Fong TG, Tulebaev SR, Inouye SK. Delirium in elderly adults: diagnosis, prevention and treatment. Nat Rev Neurol. 2009;5:210–20.
Knaus WA, Wagner DP, Draper EA, et al. The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. Chest. 1991;100:1619–36.
Rudolph JL, Doherty K, Kelly B, et al. Validation of a delirium risk assessment using electronic medical record information. J Am Med Dir Assoc. 2016;17:244–8.
Pendlebury ST, Lovett N, Smith SC, et al. Delirium risk stratification in consecutive unselected admissions to acute medicine: validation of externally derived risk scores. Age Ageing. 2016;45:60–5.
Inouye SK, Charpentier PA. Precipitating factors for delirium in hospitalized elderly persons. JAMA. 1996;275:852.
Morandi A, Davis D, Fick DM, et al. Delirium superimposed on dementia strongly predicts worse outcomes in older rehabilitation inpatients. J Am Med Dir Assoc. 2014;15:349–54.
Morandi A, Di Santo SG, Zambon A, et al. Delirium, dementia, and in-hospital mortality: the results from the italian delirium day 2016, a national multicenter study. J Gerontol A Biol Sci Med Sci. 2019;74:910–6.
Pereira JV, Aung Thein MZ, Nitchingham A, et al. Delirium in older adults is associated with development of new dementia: a systematic review and meta-analysis. Int J Geriatr Psychiatry. 2021;36:993–1003.
Pompei P, Foreman M, Rudberg MA, et al. Delirium in hospitalized older persons: outcomes and predictors. J Am Geriatr Soc. 1994;42:809–15.
de Wit HA, Winkens B, Mestres Gonzalvo C, et al. The development of an automated ward independent delirium risk prediction model. Int J Clin Pharm. 2016;38:915–23.
Pagali SR, Miller D, Fischer K, et al. Predicting delirium risk using an automated mayo delirium prediction tool: development and validation of a risk-stratification model. Mayo Clin Proc. 2021;96:1229–35.
Acknowledgements
We would like to thank Melanie Berger for extracting the ICD-10 codes and explaining the rules of coding. Additionally, we also thank Leo Steinberger for extracting the data from the hospital clinical information system and Lukas Higi for valuable discussions during prediction modelling.
Funding
Open access funding provided by University of Lausanne. This work was supported by the 2017 national research grant from Swiss Association of Public Health Administration and Hospital Pharmacists (GSASA). The funders had no role in study design, data collection, analysis, decision to publish or manuscript preparation.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest
The authors have no conflicts of interest to declare.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Schulthess-Lisibach, A.E., Gallucci, G., Benelli, V. et al. Predicting delirium in older non-intensive care unit inpatients: development and validation of the DELIrium risK Tool (DELIKT). Int J Clin Pharm 45, 1118–1127 (2023). https://doi.org/10.1007/s11096-023-01566-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11096-023-01566-0