Intensive Care Medicine

, Volume 44, Issue 12, pp 2038–2047 | Cite as

Development of an ICU discharge instrument predicting psychological morbidity: a multinational study

  • A. MiltonEmail author
  • A. Schandl
  • I. W. Soliman
  • K. Meijers
  • M. van den Boogaard
  • I. M. Larsson
  • C. Brorsson
  • U. Östberg
  • M. Oxenbøll-Collet
  • J. Savilampi
  • S. Paskins
  • M. Bottai
  • P. V. Sackey
Open Access



To develop an instrument for use at ICU discharge for prediction of psychological problems in ICU survivors.


Multinational, prospective cohort study in ten general ICUs in secondary and tertiary care hospitals in Sweden, Denmark and the Netherlands. Adult patients with an ICU stay ≥ 12 h were eligible for inclusion. Patients in need of neurointensive care, with documented cognitive impairment, unable to communicate in the local language, without a home address or with more than one limitation of therapy were excluded. Primary outcome was psychological morbidity 3 months after ICU discharge, defined as Hospital Anxiety and Depression Scale (HADS) subscale score ≥ 11 or Post-traumatic Stress Symptoms Checklist-14 (PTSS-14) part B score > 45.


A total of 572 patients were included and 78% of patients alive at follow-up responded to questionnaires. Twenty percent were classified as having psychological problems post-ICU. Of 18 potential risk factors, four were included in the final prediction model after multivariable logistic regression analysis: symptoms of depression [odds ratio (OR) 1.29, 95% confidence interval (CI) 1.10–1.50], traumatic memories (OR 1.44, 95% CI 1.13–1.82), lack of social support (OR 3.28, 95% CI 1.47–7.32) and age (age-dependent OR, peak risk at age 49–65 years). The area under the receiver operating characteristics curve (AUC) for the instrument was 0.76 (95% CI 0.70–0.81).


We developed an instrument to predict individual patients’ risk for psychological problems 3 months post-ICU, The instrument can be used for triage of patients for psychological ICU follow-up.

Trial registration

The study was registered at, NCT02679157.


Intensive care PICS Follow-up Depression Post-traumatic stress Anxiety 

Take-home message

Effective methods to prospectively identify patients likely to suffer from psychological problems in the months after intensive care are lacking. In this prospective multi-center study, we developed a simple online instrument, for use at ICU discharge, rendering a fairly precise individual risk for psychological problems 3 months after ICU discharge.


Several million patients are treated in intensive care units (ICUs) in Europe yearly [1]. While the majority survive, many patients suffer from psychological, physical and cognitive problems after ICU discharge [2, 3, 4, 5, 6], collectively termed the post-intensive care syndrome (PICS) [7]. Problems can persist and impede the individuals’ ability to return to life as it was prior to the episode of critical illness, including returning to work or other major activities [8, 9]. The psychological PICS components depression, post-traumatic stress (PTS) and anxiety occur in approximately one of three ICU survivors [2, 3, 4].

Increased awareness of PICS has led to an expansion of ICU follow-up [10]. Follow-up has mainly been limited to patients with longer ICU length of stay (LOS) [11] or prolonged duration of mechanical ventilation [12], due to a poorly evidenced assumption that these are the strongest risk factors for PICS.

In a lack of standardized, simple methods to identify high-risk patients that might benefit from psychological follow-up, selection of ICU survivors for follow-up is largely expert opinion-based [10, 13]. A more accurate risk prediction instrument, applicable for general ICU survivors could be of value, in order to improve triage of patients for interventional follow-up. The aim of this study was to develop a screening instrument for use at ICU discharge, in order to assess individual patients’ risk for psychological problems 3 months post-ICU. The study was published as an abstract at the 38th International Symposium on Intensive Care and Emergency Medicine [14].


This prospective multi-center cohort study was performed in ten ICUs in Sweden, Denmark and the Netherlands. We followed the TRIPOD guidelines for reporting of multivariable prediction model development studies [15]. The study protocol is provided in the electronic supplementary material (ESM). Regional ethical review boards in participating countries approved the study, which was performed in accordance with the ethical standards laid down in the 1964 Declaration of Helsinki and its later amendments. All study participants gave informed consent. The study was registered at, NCT02679157.


All patients ≥ 18 years old were consecutively screened for inclusion for up to 3.5 months, depending on the starting date for each center, during a period from January to June 2016. Patients with an ICU stay ≥ 12 h (≥ 24 h for elective postoperative care patients; those with stays < 24 h were not considered true ICU patients) were eligible for inclusion. Exclusion criteria were need for neurointensive care, previously documented cognitive impairment, lack of a formal home address, inability to communicate in the language of the study site, or ICU admission solely for an elective procedure (e.g. epidural, central line placement). Patients with more than one limitation of treatment (e.g. a do-not-resuscitate order) and moribund patients were also excluded.


The primary outcome was psychological problems 3 months after discharge from the ICU, assessed with the Hospital Anxiety and Depression Scale (HADS) and the Post-Traumatic Stress Symptoms Checklist-14 (PTSS-14). Patients scoring above the predefined cut-off in any of the questionnaires were considered to be a case. Secondary outcome was mental health-related quality of life (HRQOL), assessed with the RAND-36. All questionnaires are validated in the languages of participating countries.

HADS is a validated questionnaire for critically ill patients [16]. It consists of 14 questions; 7 screening for symptoms of depression and 7 for symptoms of anxiety [16]. Each question generates 0–3 points. A subscale score ≥ 11 was used as a cut-off for substantial symptoms of depression or anxiety [17]. PTSS-14 is a validated questionnaire assessing PTS symptoms in ICU survivors [18]. Part A has four questions regarding traumatic memories from the ICU stay, answered yes or no. Part B consists of 14 questions screening for ongoing stress symptoms, each scored from 1 (never) to 7 (always). A part B score > 45 was used as a cut-off for substantial symptoms of PTS [18]. RAND-36 is a 36-item questionnaire assessing HRQOL consisting of 8 domains that can be divided into 2 component scores, the mental health component score (MCS) and the physical health component score [19]. Scores range from 0 to 100, a higher score indicating better HRQOL. We compared scores between patients classified as cases and non-cases in the four mental domains and the MCS as secondary outcomes.

Patients alive 3 months after ICU discharge received and returned the questionnaires by postal mail. Non-responders received a reminder phone call after 2 weeks. A new set of questionnaires was sent out if the original ones were missing or if patients did not respond to the phone call.


Potential predictors were selected after searching the literature and a consensus discussion with a panel of experts. For a list of reviewed studies and more detail on definitions and categorizations of predictors, see the ESM. Data were collected at ICU discharge from the patient data management systems, medical charts, patients or their next-of-kin. The selection rendered 18 risk factors divided into 3 categories: (1) premorbid risk factors, (2) in-ICU risk factors and (3) ICU discharge risk factors.
  1. 1.

    Premorbid risk factors were age, sex, educational level, employment status, physical comorbidities assessed with the Charlson Comorbidity Index [20] and box 1 of the Simplified Acute Physiology Score (SAPS) III, being the caretaker of a child < 18 years old and having a history of psychological problems.

  2. 2.

    In-ICU risk factors were admission diagnosis (surgical, medical or trauma), acute or elective hospital admission, severity of illness assessed with the Acute Physiology and Chronic Health Evaluation (APACHE) II, ICU LOS, severe sepsis/septic shock, days with coma, hours with invasive ventilator treatment and agitation/agitated delirium during ICU stay.

  3. 3.

    ICU discharge risk factors were symptoms of depression, evaluated with the modified patient health questionnaire 2 (PHQ-2) [21]. Traumatic ICU memories were assessed with PTSS-14 part A [18]. Patients were asked about their perception of social support after hospital discharge: “Do you have a family member or a close friend who cares about you and your health who can help you when you leave the hospital?” Patients unable to answer questions at discharge were assessed at the regular ward within 24 h.


Statistical methods

Sample size

The projected patient recruitment was 800 patients, with an expected loss-to-follow-up ratio of 30%. With 30% of patients having the primary outcome, this would render a case/predictor quotient of 9.3, in the range of recommended 5–10 cases per predictor [22].

Missing data

Missing data for single items < 10% was considered negligible. Missing data due to non-responding was handled with inverse probability weighting, to minimize selection bias due to non-response [23]. Potential predictors for the probability of being a responder were analyzed in a univariable regression model. Factors with a p value < 0.1 were included in a multivariable regression model where possible interactions were analysed. The generated weighted model was applied to all the subsequent analyses.

Patients with missing items in the HADS and PTSS-14 questionnaires were regarded as non-cases if their total score remained below the predefined case cut-off after replacing all the missing questionnaire items with their respective largest possible value. Patients were regarded as cases if their score was above the cut-off after replacing all the missing items with their respective smallest possible value. Patients with ambiguous scores despite replacement were not included in the final analyses.

Statistical analysis methods

All statistical analyses were performed with STATA version 14.2 (StataCorp, College Station, TX, USA). Two-sided significance level was set to 0.05. Continuous variables were presented with medians and interquartile ranges (IQR) and categorical variables with numbers and percentages. For comparisons of categorical variables, the Chi-square test or Fisher’s exact test were used. The Mann–Whitney U test was used for continuous variables.

Associations between each risk factor and being a case were investigated with univariable logistic regression analysis. Risk factors with a significance level of p < 0.1 were included in a multivariable logistic regression model. Continuous predictors were visually evaluated with locally weighted scatterplot smoothing and tested numerically with restricted cubic splines to assess the shape of the potential relationship with the outcome. Thereafter, a supervised, non-automatic stepwise selection was performed, removing the predictors with significance level < 0.05 one at a time and re-estimating the model, generating the predictive instrument. The area under the receiver operating characteristics curve (AUC) was used to assess the predictive value of the model. For calibration of the model, the observed risk of psychological problems was plotted against predicted risk across 30% strata. Arbitrary risk groups were created with 0–29, 30–59 and ≥ 60% risk of having the outcome, and negative and positive predictive values were calculated. The model was internally validated in 500 bootstrap samples, and a shrinkage factor of regression coefficients was estimated to adjust for possible over-optimism of the predictive model.

Additional analysis

Given that ICU LOS is the eligibility criterion of choice in many ICU follow-up clinics [11, 13, 24, 25], the association between ICU LOS and psychological problems was examined. The predictive value was assessed with an AUC.


Of 2193 screened patients, 572 patients were included in the study. Fifty-five patients died before follow-up and 78% (n = 404) responded to the questionnaires (Fig. 1). Among included patients, 61% were men with a median age of 65 years and median APACHE II score of 18. The proportion of patients on mechanical ventilation was 60% and median duration of mechanical ventilation was 50 h. Median ICU LOS was 62 h (Table 1).
Fig. 1

Flow chart of inclusion and exclusion

Table 1

Patient characteristics

Patient characteristic

Sweden (n = 300)

The Netherlands (n = 166)

Denmark (n = 106)

Total population (n = 572)


65 (49–74)

63 (56–71)

66 (59–73)

65 (53–73)

Male sex

179 (60)

103 (62)

69 (65)

351 (61)

Somatic comorbidities (CCI score)

4 (1–5)

3 (2–5)

4 (2–6)

4 (2–5)


18 (13–24)

16 (12–22)

21 (16–26)

18 (13–23)

Admission diagnosis


123 (41)

55 (33)

40 (38)

218 (38)


156 (52)

92 (55)

53 (50)

301 (53)


21 (7)

19 (11)

12 (11)

52 (9)

Mechanical ventilation

153 (51)

143 (86)

47 (44)

343 (60)

Duration of mechanical ventilation (h)

68 (19–174)

34 (8–118)

24 (12–101)

50 (13–137)


66 (27–142)

67 (43–188)

47 (22–99)

62 (30–140)

Data are presented as medians (interquartile range) and proportions, n (%) where appropriate. Duration of mechanical ventilation calculated for mechanically ventilated patients only

CCI Charlson Comorbidity Index, APACHE Acute Physiology And Chronic Health Evaluation, ICU LOS intensive care unit length of stay

Three months after ICU discharge, the prevalence of psychological problems was 20% (n = 80). Eleven percent (n = 43) suffered from substantial symptoms of depression, 10% (n = 39) had symptoms of anxiety and 13% (n = 54) had symptoms of PTS. As many as 70% of patients were classified as cases scored above a cut-off in more than one questionnaire; 46% scored above a cut-off in two symptom domains and 24% above a cut-off in all three domains.

Missing data

Sixteen percent of responders had missing data for any of the predictors analyzed in the univariable model, of which 10% had only one missing variable. Ten percent of responders had incomplete primary outcome data, with missing items in the follow-up questionnaires. After item replacement as described above, five patients had ambiguous total scores and were not included in the analyses. For a complete description of missing variables and the development of the weighted model for non-response, see the ESM.

Model development

Prevalence of predictors and their univariable associations are shown in Table 2. Five predictors [previous psychological problems, age, lack of social support, traumatic memories (PTSS-14 A) and symptoms of depression (modified PHQ-2) at ICU discharge] were associated with psychological problems 3 months after ICU discharge (p < 0.1) and included in the multivariable logistic regression model. All predictors except previous psychological problems were significantly associated with the adverse outcome (p < 0.05). Thus, the final predictors were age (OR age-dependent, peak risk at age 49–65 years, Fig. S1, Table S1, ESM), lack of social support (OR 3.28, 95% CI 1.47–7.32), traumatic memories (OR 1.44, 95% CI 1.13–1.82) and symptoms of depression (OR 1.29, 95% CI 1.10–1.50) assessed at ICU discharge (Table 3). Previous psychological problems did not improve the final regression model. This predictor was strongly associated with psychological symptoms at ICU discharge (p < 0.001 for both PHQ-2 and PTSS-14 part A).
Table 2

Categorization of potential predictors for post-ICU psychological problems (cases) and no psychological problems (non-cases) and predictors’ univariate associations



Cases (n = 80)

Non-cases (n = 319)

Univariate association (p value)



64 (54–72)

65 (56–73)


Male sex


47 (59)

201 (62)

> 0.1

Education level

Elementary school

20 (25)

75 (24)

> 0.1

Senior high school

35 (44)

143 (45)



24 (30)

88 (28)


Employment status pre-ICU


1 (1)

12 (4)

> 0.1


13 (16)

30 (9)



42 (53)

168 (53)




6 (2)



23 (29)

95 (30)


Somatic comorbidities (CCI)


3 (2–5)

4 (2–5)

> 0.1

Caretaker of children < 18 years old


11 (14)

32 (10)

> 0.1

Admission diagnosis


28 (35)

116 (36)

> 0.1


46 (58)

178 (56)



6 (8)

24 (8)


Admission severity of illness (APACHE)


18 (14–23)

18 (13–23)

> 0.1

SAPS III box 1


20 (13–24)

19 (14–23)

> 0.1

Psychological problems pre-ICU


26 (33)

58 (18)

< 0.01*

Type of hospital admission


59 (74)

237 (74)

> 0.1


21 (26)

82 (26)




14 (18)

63 (20)

> 0.1

Severe sepsis


21 (26)

66 (21)

> 0.1

Duration of coma


0 (0–1)

0 (0–1)

> 0.1



61 (38–162)

54 (26–138)

> 0.1

Mechanical ventilation


52 (65)

198 (62)

> 0.1

Duration of mechanical ventilation (h)


22 (11–103)

49 (9–132)

> 0.1

Depressive symptoms (PHQ-2)


2 (0–4)

0 (0–2)

< 0.001*

Traumatic memories (PTSS-14A)


2 (1–3)

1 (0–2)

< 0.001*

Lack of social support


15 (19)

26 (8)

< 0.05*

Data are presented as medians (interquartile range) and proportions, n (%) as appropriate. Duration of mechanical ventilation calculated only for mechanically ventilated patients

NA not applicable, ICU intensive care unit, CCI Charlson Comorbidity Index, APACHE Acute Physiology and Chronic Health Evaluation, SAPS Simplified Acute Physiology Score, LOS length of stay, PHQ-2 Patient Health Questionnaire-2, PTSS-14A Post-Traumatic Symptoms Checklist 14A

*Statistically significant p value

p values for the univariate association between the predictor and the outcome

Table 3

Odds ratios and confidence intervals for risk factors included in the multivariable model

Risk factor

Odds ratio

95% Cl

p value

Regression coefficient

Lack of social support



< 0.01


Psychological problems pre-ICU



> 0.05


Depressive symptoms (PHQ-2)



< 0.01

3.39 per point

Traumatic memories (PTSS-14A)



< 0.01

4.84 per point


Separate table



Regression coefficients for risk factors in the final predictive model

CI confidence interval, CPAx Chelsea Critical Care Physical Assessment tool, ICU intensive care unit, PHQ-2 patient health questionnaire, PTSS-14A post-traumatic symptoms checklist 14 part A

The final model AUC was 0.76 (95% CI 0.70–0.81; Fig. S2, ESM). The final instrument with questions, scores and a graph to obtain patients’ individual risk is depicted in Fig. 2. The instrument is available on-line: The positive predictive value for a high-risk group with ≥ 60% predicted risk of later psychological problems was 0.83 (95% CI 0.37–0.98). The negative predictive value for a low-risk group with < 30% predicted risk for an adverse outcome was 0.84 (95% CI 0.79–0.88). Positive and negative predictive values for different risk groups are shown in Table S2 of the ESM. For calibration of the model, see Fig. S3 of the ESM.
Fig. 2

The psychological risk prediction instrument for use at ICU discharge

Internal validation

With internal validation in 500 bootstrap samples, the AUC was 0.73 (95% CI 0.73–0.74). The shrinkage factor for the final model was 0.89. The regression coefficients can be multiplied by that value to provide more reliable predictions for new patients. A maximum shrinkage factor of 1 indicates that no over-optimism occurs.

Secondary outcome

There were clinically significant differences in all RAND-36 mental domains as well as MCS between patients with and without psychological problems post-ICU. Cases had worse MCS, median 33 (IQR 22–43), than non-cases, median 72 (IQR 53–84), p < 0.001 (Fig. S4, ESM). For scores in the four mental domains, see Table S3 of the ESM.

Additional analysis

The AUC for ICU LOS as a predictor was 0.49 (95% CI 0.42–0.56; Fig. S5, ESM).


In this multinational study, we developed a clinical instrument for use at ICU discharge, predicting individual patients’ risk for adverse psychological outcome after ICU stay. The predictive value assessed as AUC was 76%. Substantial psychological problems post-ICU were associated with a significant reduction in mental HRQOL. The instrument provides clinicians with a simple and practical bedside tool for quantitative assessment of the 3-month risk for adverse psychological outcome.

The need for screening instruments for early identification of ICU survivors at risk for later morbidity has been called for in stakeholder’s meetings and national guidelines [7, 10, 26]. Previous studies have addressed this but with limited generalizability due to subgroup selection of patients [12]. Other studies have screened patients at later time points [18, 27] which may be less practical compared to screening at ICU discharge when all patients can be assessed. Predictive values in previous studies have been moderate and are based on smaller cohorts [28].

We found an increased risk for psychological morbidity in the middle age. This middle-age risk peak (Fig. S1) is not readily detected merely comparing median and IQR data (Table 2) for cases and non-cases. Previous studies of age as a risk factor for psychological problems post-ICU have shown varying results [2, 3]. Being middle aged may imply unaccounted risks for psychological reactions to critical illness. Some studies indicate that the middle age is associated with the lowest ratings of happiness and life satisfaction [29]. The finding of depressive symptoms and traumatic memories in the ICU as predictors of later psychological problems is in concordance with previous studies [30, 31, 32]. Perceived lack of social support as a risk factor is also consistent with previous research [30, 33]. The only significant predictor in the univariable analysis that did not further improve the regression model was previous psychological problems, which has been associated with later psychological morbidity in ICU survivors [3, 31, 34]. We found a strong association between previous psychological problems and psychological symptoms at ICU discharge, indicating that previous psychological problems are likely well accounted for in the psychological assessment at ICU discharge.

The final instrument is conceptually aligned with previous expert-based recommendations in the British National Institute for Health and Care Excellence (NICE) guidelines, suggesting psychological assessment before ICU discharge [10]. The predictive instrument offers clinicians a quantitative screening tool for use at ICU discharge. This first step in identifying risk patients can be followed by reevaluation and subsequent interventions. With a feasible number of specific questions, the instrument can aid the clinician to estimate the individual patient’s future risk for psychological problems, which may facilitate intervention trigger thresholds.

The instrument clearly outperforms ICU LOS as a method to triage patients for psychological follow-up. ICU LOS is the most common criterion for follow-up after ICU stay in Sweden, Denmark and the Netherlands [11, 13, 24, 25].

Strengths and limitations

Our study is multinational, prospective and includes medical and surgical patients with a broad range of ICU LOS, increasing its generalizability. To our knowledge, it is the largest psychological ICU follow-up study to date. The follow-up response rate of 78% can be considered high in an ICU survivor population. The instrument has been internally validated but needs external validation in different ICU cohorts.

A potential limitation with this kind of study is missing data. Data missing due to non-response was managed with inverse probability weighting, a recognized strategy for handling loss-to-follow-up that may not be missing completely at random [23]. A substantial proportion of patients had an ICU stay shorter than 12 h, and more patients than anticipated were transferred to other ICUs before discharge, rendering a smaller study cohort than originally projected. Based on prior agreements with study sites and resource constraints, the study was stopped at the agreed time; hence fewer participants than projected were included. Potential over-fitting of predictors due to the smaller study size was assessed, rendering a high shrinkage factor indicating little over-optimism. Fewer participants than expected had psychological problems, which could partly be explained by the stricter cut-offs for the HADS subscales, using ≥ 11 (probable case) rather than the often-used cut-off of ≥ 8 (possible case). Another limitation is the time anchoring of the PHQ-2 questionnaire, assessing symptoms during the past days, an aspect that needs consideration for patients with short ICU stays. Using self-administered questionnaires instead of psychological interviews was due to limited resources. However, the PTSS-14 and the HADS are validated questionnaires screening for psychological symptoms in ICU survivors [17, 18].

Future perspectives

The instrument facilitates identification of high-risk populations for interventional follow-up trials. This step may reduce dilution of potential beneficial effects of follow-up, a problem that may have contributed to the lack of effects in previous ICU follow-up interventions [35, 36, 37, 38, 39, 40]. The instrument has fair predictive accuracy in a mixed ICU survivor cohort, does not require special equipment or specially trained staff and enables concentration of ICU follow-up to patients most likely to benefit from post-ICU interventions. Such interventions can be initiated early and potentially reduce long-term psychological morbidity and improve HRQOL.


We developed a screening instrument for psychological morbidity 3 months after ICU stay. The instrument, freely available online, predicts psychological problems in ICU survivors more accurately than existing methods. It can be used to identify high-risk patients for follow-up already at ICU discharge, facilitating early interventions and improved long-term psychological outcome in ICU survivors.



The study was funded by the ALF Funding according to the regional agreement between Karolinska Institutet and Stockholm County Council, and by the Olle Engqvist Byggmästare Foundation. Funders had no influence on study design or reporting of the results. The authors thank Örjan Sundin, Professor in Clinical Psychology, for valuable advice.

Author contributions

PVS, AM, AS and MB designed the study. AM, AS and PVS reviewed the literature. AM, IWS, KM, MB, IML, CB, UÖ, MO-C, JS and SP were responsible for data collection and revised the study protocol. AM and MB performed the statistical analyses. AM and PS wrote the draft and all co-authors critically revised the manuscript and approved the final version for publication.

Compliance with ethical standards

Conflicts of interest

The authors declare that they have no conflict of interest.

Supplementary material

134_2018_5467_MOESM1_ESM.doc (42 kb)
Supplementary material 1 (DOC 41 kb)
134_2018_5467_MOESM2_ESM.doc (46 kb)
Supplementary material 2 (DOC 46 kb)
134_2018_5467_MOESM3_ESM.doc (50 kb)
Supplementary material 3 (DOC 49 kb)
134_2018_5467_MOESM4_ESM.doc (47 kb)
Supplementary material 4 (DOC 47 kb)
134_2018_5467_MOESM5_ESM.doc (46 kb)
Supplementary material 5 (DOC 46 kb)
134_2018_5467_MOESM6_ESM.doc (43 kb)
Supplementary material 6 (DOC 43 kb)
134_2018_5467_MOESM7_ESM.doc (29 kb)
Supplementary material 7 (DOC 29 kb)
134_2018_5467_MOESM8_ESM.doc (30 kb)
Supplementary material 8 (DOC 29 kb)
134_2018_5467_MOESM9_ESM.doc (110 kb)
Supplementary material 9 (DOC 110 kb)
134_2018_5467_MOESM10_ESM.doc (80 kb)
Supplementary material 10 (DOC 80 kb)


  1. 1.
    Wunsch H, Angus DC, Harrison DA, Collange O, Fowler R, Hoste EA et al (2008) Variation in critical care services across North America and Western Europe. Crit Care Med 36(10):pp. 2787–93, e1–9CrossRefGoogle Scholar
  2. 2.
    Parker AM, Sricharoenchai T, Raparla S, Schneck KW, Bienvenu OJ, Needham DM (2015) Posttraumatic stress disorder in critical illness survivors: a metaanalysis. Crit Care Med 43(5):1121–1129CrossRefPubMedGoogle Scholar
  3. 3.
    Rabiee A, Nikayin S, Hashem MD, Huang M, Dinglas VD, Bienvenu OJ et al (2016) Depressive symptoms after critical illness: a systematic review and meta-analysis. Crit Care Med 44(9):1744–1753CrossRefPubMedGoogle Scholar
  4. 4.
    Nikayin S, Rabiee A, Hashem MD, Huang M, Bienvenu OJ, Turnbull AE et al (2016) Anxiety symptoms in survivors of critical illness: a systematic review and meta-analysis. Gen Hosp Psychiatry 43:23–29CrossRefPubMedPubMedCentralGoogle Scholar
  5. 5.
    Schandl A, Bottai M, Holdar U, Hellgren E, Sackey P (2014) Early prediction of new-onset physical disability after intensive care unit stay: a preliminary instrument. Crit Care 18(4):455CrossRefPubMedPubMedCentralGoogle Scholar
  6. 6.
    van der Schaaf M, Beelen A, Dongelmans DA, Vroom MB, Nollet F (2009) Functional status after intensive care: a challenge for rehabilitation professionals to improve outcome. J Rehabil Med 41(5):360–366CrossRefPubMedGoogle Scholar
  7. 7.
    Needham DM, Davidson J, Cohen H, Hopkins RO, Weinert C, Wunsch H et al (2012) Improving long-term outcomes after discharge from intensive care unit: report from a stakeholders’ conference. Crit Care Med 40(2):502–509CrossRefPubMedPubMedCentralGoogle Scholar
  8. 8.
    Hopkins RO, Weaver LK, Collingridge D, Parkinson RB, Chan KJ, Orme JF Jr (2005) Two-year cognitive, emotional, and quality-of-life outcomes in acute respiratory distress syndrome. Am J Respir Crit Care Med 171(4):340–347CrossRefPubMedGoogle Scholar
  9. 9.
    Myhren H, Ekeberg O, Toien K, Karlsson S, Stokland O (2010) Posttraumatic stress, anxiety and depression symptoms in patients during the first year post intensive care unit discharge. Crit Care 14(1):R14CrossRefPubMedPubMedCentralGoogle Scholar
  10. 10.
    NICE (2017) Rehabilitation after critical illness in adults NICE Clinical guideline (CG83) 2017.
  11. 11.
    Griffiths JA, Barber VS, Cuthbertson BH, Young JD (2006) A national survey of intensive care follow-up clinics. Anaesthesia 61(10):950–955CrossRefPubMedGoogle Scholar
  12. 12.
    Jubran A, Lawm G, Duffner LA, Collins EG, Lanuza DM, Hoffman LA et al (2010) Post-traumatic stress disorder after weaning from prolonged mechanical ventilation. Intensive Care Med 36(12):2030–2037CrossRefPubMedPubMedCentralGoogle Scholar
  13. 13.
    Orwelius L (2016) Riktlinje för PostIVA uppföljning [cited 2016-02-02].
  14. 14.
    Milton A, Schandl A, Meijers K, Larsson IM, Savilampi J, Brorsson C et al (2018) Development of a multivariable prediction instrument for psychological morbidity in ICU survivors. In: 38th international symposium of intensive care and emergency medicine, 20–23 Mar 2018, BrusselsGoogle Scholar
  15. 15.
    Moons KG, Altman DG, Reitsma JB, Ioannidis JP, Macaskill P, Steyerberg EW et al (2015) Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med 162(1):W1–W73CrossRefPubMedGoogle Scholar
  16. 16.
    Jutte JE, Needham DM, Pfoh ER, Bienvenu OJ (2015) Psychometric evaluation of the Hospital Anxiety and Depression Scale 3 months after acute lung injury. J Crit Care 30(4):793–798CrossRefPubMedPubMedCentralGoogle Scholar
  17. 17.
    Brennan C, Worrall-Davies A, McMillan D, Gilbody S, House A (2010) The Hospital Anxiety and Depression Scale: a diagnostic meta-analysis of case-finding ability. J Psychosom Res 69(4):371–378CrossRefPubMedGoogle Scholar
  18. 18.
    Twigg E, Humphris G, Jones C, Bramwell R, Griffiths RD (2008) Use of a screening questionnaire for post-traumatic stress disorder (PTSD) on a sample of UK ICU patients. Acta Anaesthesiol Scand 52(2):202–208CrossRefPubMedGoogle Scholar
  19. 19.
    Hays RD, Morales LS (2001) The RAND-36 measure of health-related quality of life. Ann Med 33(5):350–357CrossRefPubMedGoogle Scholar
  20. 20.
    Charlson ME, Pompei P, Ales KL, MacKenzie CR (1987) A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis 40(5):373–383CrossRefGoogle Scholar
  21. 21.
    Kroenke K, Spitzer RL, Williams JB (2003) The Patient Health Questionnaire-2: validity of a two-item depression screener. Med Care 41(11):1284–1292CrossRefPubMedGoogle Scholar
  22. 22.
    Vittinghoff E, McCulloch CE (2007) Relaxing the rule of ten events per variable in logistic and Cox regression. Am J Epidemiol 165(6):710–718CrossRefPubMedGoogle Scholar
  23. 23.
    Narduzzi S, Golini MN, Porta D, Stafoggia M, Forastiere F (2014) Inverse probability weighting (IPW) for evaluating and “correcting” selection bias. Epidemiol Prev 38(5):335–341PubMedGoogle Scholar
  24. 24.
    Kjer CKW, Estrup S, Poulsen LM, Mathiesen O (2017) Follow-up after intensive care treatment: a questionnaire survey of intensive care aftercare in Denmark. Acta Anaesthesiol Scand 61(8):925–934CrossRefPubMedGoogle Scholar
  25. 25.
    Van Der Schaaf M, Bakhshi-Raiez F, Van Der Steen M, Dongelmans DA, De Keizer NF (2015) Recommendations for intensive care follow-up clinics; report from a survey and conference of Dutch intensive cares. Minerva Anestesiol 81(2):135–144Google Scholar
  26. 26.
    Elliott D, Davidson JE, Harvey MA, Bemis-Dougherty A, Hopkins RO, Iwashyna TJ et al (2014) Exploring the scope of post-intensive care syndrome therapy and care: engagement of non-critical care providers and survivors in a second stakeholders meeting. Crit Care Med 42(12):2518–2526CrossRefPubMedGoogle Scholar
  27. 27.
    Warlan H, Howland L, Connelly C (2016) Detection of posttraumatic stress symptoms in patients after discharge from intensive care. Am J Crit Care 25(6):509–515CrossRefPubMedGoogle Scholar
  28. 28.
    Wade DM, Hankins M, Smyth DA, Rhone EE, Mythen MG, Howell DC et al (2014) Detecting acute distress and risk of future psychological morbidity in critically ill patients: validation of the intensive care psychological assessment tool. Crit Care 18(5):519CrossRefPubMedPubMedCentralGoogle Scholar
  29. 29.
    Blanchflower DG, Oswald AJ (2008) Is well-being U-shaped over the life cycle? Soc Sci Med 66(8):1733–1749CrossRefPubMedGoogle Scholar
  30. 30.
    Deja M, Denke C, Weber-Carstens S, Schroder J, Pille CE, Hokema F et al (2006) Social support during intensive care unit stay might improve mental impairment and consequently health-related quality of life in survivors of severe acute respiratory distress syndrome. Crit Care 10(5):R147CrossRefPubMedPubMedCentralGoogle Scholar
  31. 31.
    Schandl A, Bottai M, Hellgren E, Sundin O, Sackey PV (2013) Developing an early screening instrument for predicting psychological morbidity after critical illness. Crit Care 17(5):R210CrossRefPubMedPubMedCentralGoogle Scholar
  32. 32.
    Wade DM, Howell DC, Weinman JA, Hardy RJ, Mythen MG, Brewin CR et al (2012) Investigating risk factors for psychological morbidity three months after intensive care: a prospective cohort study. Crit Care 16(5):R192CrossRefPubMedPubMedCentralGoogle Scholar
  33. 33.
    Tilburgs B, Nijkamp MD, Bakker EC, van der Hoeven H (2015) The influence of social support on patients’ quality of life after an intensive care unit discharge: a cross-sectional survey. Intensive Crit Care Nurs 31(6):336–342CrossRefPubMedGoogle Scholar
  34. 34.
    Bienvenu OJ, Friedman LA, Colantuoni E, Dinglas VD, Sepulveda KA, Mendez-Tellez P et al (2018) Psychiatric symptoms after acute respiratory distress syndrome: a 5-year longitudinal study. Intensive Care Med 44(1):38–47CrossRefPubMedGoogle Scholar
  35. 35.
    Cuthbertson BH, Rattray J, Campbell MK, Gager M, Roughton S, Smith A et al (2009) The PRaCTICaL study of nurse led, intensive care follow-up programmes for improving long term outcomes from critical illness: a pragmatic randomised controlled trial. BMJ 339:b3723CrossRefPubMedPubMedCentralGoogle Scholar
  36. 36.
    Jones C, Backman C, Capuzzo M, Egerod I, Flaatten H, Granja C et al (2010) Intensive care diaries reduce new onset post traumatic stress disorder following critical illness: a randomised, controlled trial. Crit Care 14(5):R168CrossRefPubMedPubMedCentralGoogle Scholar
  37. 37.
    Jones C, Skirrow P, Griffiths RD, Humphris GH, Ingleby S, Eddleston J et al (2003) Rehabilitation after critical illness: a randomized, controlled trial. Crit Care Med 31(10):2456–2461CrossRefPubMedGoogle Scholar
  38. 38.
    Knowles RE, Tarrier N (2009) Evaluation of the effect of prospective patient diaries on emotional well-being in intensive care unit survivors: a randomized controlled trial. Crit Care Med 37(1):184–191CrossRefPubMedGoogle Scholar
  39. 39.
    Elliott D, McKinley S, Alison J, Aitken LM, King M, Leslie GD et al (2011) Health-related quality of life and physical recovery after a critical illness: a multi-centre randomised controlled trial of a home-based physical rehabilitation program. Crit Care 15(3):R142CrossRefPubMedPubMedCentralGoogle Scholar
  40. 40.
    Schandl A, Bottai M, Hellgren E, Sundin O, Sackey P (2012) Gender differences in psychological morbidity and treatment in intensive care survivors—a cohort study. Crit Care 16(3):R80CrossRefPubMedPubMedCentralGoogle Scholar

Copyright information

© The Author(s) 2018

Open AccessThis article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International License (, which permits any noncommercial use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Authors and Affiliations

  • A. Milton
    • 1
    • 2
    Email author
  • A. Schandl
    • 3
  • I. W. Soliman
    • 4
  • K. Meijers
    • 5
  • M. van den Boogaard
    • 6
  • I. M. Larsson
    • 7
  • C. Brorsson
    • 8
  • U. Östberg
    • 9
  • M. Oxenbøll-Collet
    • 10
  • J. Savilampi
    • 11
  • S. Paskins
    • 12
  • M. Bottai
    • 13
  • P. V. Sackey
    • 1
  1. 1.Department of Physiology and PharmacologyKarolinska InstitutetStockholmSweden
  2. 2.Department of Perioperative Medicine and Intensive CareKarolinska University HospitalStockholmSweden
  3. 3.Department of Molecular Medicine and SurgeryKarolinska InstitutetStockholmSweden
  4. 4.Department of Intensive Care MedicineUniversity Medical Center Utrecht, Utrecht UniversityUtrechtThe Netherlands
  5. 5.Department of Anaesthesiology and Intensive CareSodersjukhusetStockholmSweden
  6. 6.Department of Intensive Care MedicineRadboud University Nijmegen Medical CenterNijmegenThe Netherlands
  7. 7.Department of Surgical SciencesUppsala UniversityUppsalaSweden
  8. 8.Department of Surgery and Perioperative ScienceUmeå UniversityUmeåSweden
  9. 9.Department of Anaesthesiology and Intensive CareÖstersund HospitalÖstersundSweden
  10. 10.Department of Intensive CareRigshospitalet CopenhagenCopenhagenDenmark
  11. 11.Department of Anaesthesiology and Intensive CareÖrebro University HospitalÖrebroSweden
  12. 12.Department of Intensive CareOdense University HospitalOdenseDenmark
  13. 13.Institute of Environmental MedicineKarolinska InstitutetStockholmSweden

Personalised recommendations