Background

Acute respiratory syndrome (ARDS) is characterised by respiratory failure with either a direct pulmonary (e.g. pneumonia) or extra-pulmonary cause (e.g. sepsis) that requires treatment in intensive care including mechanical ventilation [1]. Approximately 10% of all patients admitted to the ICU develop ARDS [2]. This represents a considerable amount of patients. Further, cost associated with ARDS are very high. For instance, a study from the UK estimated mean societal cost over 1 year including initial ICU treatment cost at £ 44.077 [3]. A US study estimated the median cost due to hospitalization post-discharge at $ 18.756 [4].

With mortality estimated up to 45%, the focus of ARDS research has been on mortality for a long time. With decreasing mortality rates [5] however, the interest in long-term outcomes such as mental health, return to work (RtW) and health-related quality of life (HRQoL) of ARDS patients increased [6,7,8,9,10].

A multi-centre national study in the U.S. showed that nearly half of previously employed ARDS survivors were jobless at 12 months after ARDS and that this was accompanied by substantial lost earnings [11]. If one aims at improving long-term outcome for these patients, it is important to shed light on possible determinants of outcomes such as HRQoL and RtW. We performed a systematic literature review [12] summarising the existing evidence regarding the determinants of HRQoL or RtW in ARDS patients, including 24 highly heterogeneous observational studies. One of the main findings was that the core focus of published research was on clinical and care-related determinants (performance in pulmonary function testing, duration of ICU treatment etc.) which mainly showed small, non-significant effects on HRQoL and RtW. Despite the evident role of the care provided to patients with ARDS in the ICU, surprisingly, the role of quality of care (QoC) for long-term HRQoL and RtW has not been investigated thus far while ARDS mortality has been investigated in relation to university level of care [13].

Against this background, the hypothesis underlying the study presented in this paper was that better QoC (defined by quality indicators) received during the acute ICU stay was associated with better HRQoL and a higher rate of RtW in survivors of ARDS. Thus, our aim was to identify QoC indicators predictive of HRQoL and RtW.

Methods

Study design and sample

Methods of the DACAPO (Surviving ARDS: the influence of quality of care and individual patient characteristics on health-related quality of life) study have been described in detail elsewhere [14, 15]. Briefly, adult patients with diagnosed ARDS according to the Berlin definition [16] were recruited in 61 intensive care units (ICUs) across Germany into a cohort study with three postal follow-ups (3, 6 and 12 months). Ethical approval was obtained from the ethics committee of the University of Regensburg (file number: 13–101-0262) and additionally from the ethics committees overseeing the respective study sites.

Measurements

Outcomes

The Short Form-12 self-report questionnaire (SF-12) was used to measure HRQoL [17]. Scores for the Physical Component (PCS-12) and the Mental Component Scales (MCS-12) range from 0 to 100 (higher values indicating better HRQoL). Fifty is the mean value for the general population (German norm values [18]). RtW was captured as self-report, asking whether and when people had returned to their previous or another job (only for persons in employment before admission to ICU). We included data from all participants who returned valid questionnaires up to 13 months after discharge from ICU. Mortality status and date of death were assessed either through reports from the patients’ caregivers or through local population registries.

Exposures

QoC was assessed at the level of the participating ICUs once during the period of the study. It was operationalized as structural quality (head of the ICU with additional training in intensive care medicine), process quality (implementation of daily multi-professional ward rounds with documentation of daily therapy goals), volume (number of ventilated patients per year), and general characteristics (membership of the hospital in the ARDS Network Germany). These pre-specified indicators showed limited statistical variance and were thus complemented by additional quality indicators comprising the proportion of physicians with completed specialized ICU training, the availability of weekly microbiological ward rounds, the proportion of ventilated patients on all patients, and general level of care (university hospital versus other hospital). Both the pre-specified and the additional quality indicators were largely based on the published list of German quality indicators in intensive care medicine [14, 19, 20] and together with generally accepted indicators such as volume and level of care have been used in the comprehensive QoC assessment in the DACAPO study.

Potentially confounding variables

Variables related to socio-demographic, clinical and care aspects were assessed as potentially confounding variables. The socio-demographic variables included age, sex, living situation (living with versus without a partner), nationality (German, other), and health insurance (statutory, private, other). An education score was derived from information on the participants’ educational and professional levels (according to Lampert et al. [21]). The score ranges between 1 and 7, with higher values indicating higher educational and/or professional achievements. General medical characteristics were captured with regard to body mass index (BMI: kg/m2), cause of ARDS (pulmonary / extra-pulmonary), Simplified Acute Physiology Score II (SAPS-II) [22], and Sequential Organ Failure Assessment (SOFA) [23] score, as well as self-reported physician-diagnosed mental disorder before treatment in the ICU (any, none). The Berlin definition of ARDS was modified in terms of the classification of the severity of hypoxemia (PaO2/FIO2 ratio [P/F ratio]) since the classification into two levels (P/F ratio ≤ 150 mmHg versus > 150 mmHg) may allow better selectivity between mild and severe cases [24, 25].

Statistical analysis

Owing to the data structure (patients are nested within different ICUs), we used hierarchical linear modeling, testing whether there was systematic variance between the second-level units (ICUs) in the primary outcome at the three follow-ups. For all outcomes, these analyses yielded an intraclass correlation coefficient (ICC) consistently close to zero on the basis of the fully unconditional model and non-significant p-values for the likelihood ratio tests indicating non-deterioration in model fit if the random intercept was restricted to zero (data not shown). For this reason, fixed-effects linear, logistic and Cox regression models were applied.

Outcome: health-related quality of life (HRQoL)

The twelve-month analysis was the primary analysis. For each follow-up (3, 6 and 12 months) and each exposure–outcome combination non-adjusted, minimally adjusted, and fully adjusted linear regression models were used. The minimally adjusted model contained sex, age, and ARDS severity as covariates; all socio-demographic and medical variables which were significantly (p-value < 0.05) associated with exposures or outcome at any follow-up period were included in the fully adjusted regression models. Non-standardized regression coefficients with 95% confidence intervals (CIs) were computed as were standardized regression coefficients.

Outcome: return to work (RtW)

We used Cox proportional hazards models to analyse RtW. The minimally adjusted models had sex, age, and ARDS-severity as covariates. The fully adjusted multivariate Cox models included all covariates that showed significant effects with either outcome or exposure in univariate Cox regression analyses. Observations were censored if RtW did not occur within 395 days following ICU discharge. Hazard ratios (HRs) with 95% CIs were computed.

Outcome: mortality

We examined the influence of the exposure variables on 1-year mortality in ICU survivors. The set of covariates for the fully adjusted logistic regression models was determined as described for HRQoL and RtW. Odds ratios (ORs) and 95% CIs were computed. A p-value of < 0.05 was considered statistically significant. Analyses were performed using Stata 13.1 (Stata Corporation, College Station, TX, U.S.A.).

Results

Descriptive results

We preliminarily included 1900 ARDS patients from 61 ICUs across Germany between September 2014 and April 2016. One thousand two hundred twenty five patients with informed consent formed the initial ICU sample (Fig. 1). Eight hundred seventy-seven patients formed the DACAPO survivor cohort. Four hundred eighty-one patients (54.8%) were lost to follow up for various reasons (e.g.inability to participate). Information on death or survival could not be obtained for 66 patients. At 1 year after discharge, 19.8% had died and 396 persons were followed up.

Fig. 1
figure 1

Patient flow. a For all patients who were lost to follow-up survival was assessed via local municipal population registries. b Written informed consent and patient data were transferred to the study centre with a delay of more than 12 months; thus, follow-up measurement was not possible within the scheduled follow-up period

The socio-demographic and general medical characteristics of the respondents for the twelve-month follow-up are described in an additional file (Table 4, additional file 1). In about 60% the diagnosis was made in a DACAPO ICU, the remainder was transferred. The ARDS was predominantly caused by direct (pulmonary) conditions. The majority of patients (75%) suffered from ‘moderate-to-severe’ ARDS (P/F ratio < 150). A lifetime diagnosis of a mental disorder was reported in 15%.

The general characteristics and the organizational and structural QoC indicators of the participating ICUs were as follows (Table 1): 70% of study centres were members of the German ARDS network and 28 centres were university institutions. The median number of patients ventilated per year was 493 and the median percent of patients who were ventilated was 44%. The twelve-month ARDS survivors reported a median physical SF-12 (SF-12 PCS) of 41 (IQR 35–52) and a mental SF-12 (SF-12 MCS) of 47 (IQR 33–57) Fig. 2. No substantial increase in SF-12 values was observed between 3 and 12 months. Slightly over half of the patients returned to work after 1 year.

Table 1 Characteristics of participating ICUs
Fig. 2
figure 2

SF-12 values of survivors of ARDS after 12 months (a). Probability of not returning to work (b)

Analytical results

The main analysis refers to the effect of QoC on HRQoL (Table 5, additional file 2) and RtW (Table 2) after 12 months, and additional analyses were computed for three (Table 6, additional file 3) and 6 months (Table 7, additional file 4) and mortality (Table 3).

Table 2 Cox regression analyses of RtW on quality of care in 12 months respondents
Table 3 Logistic regression analyses of mortality on quality of care in ICU survivors

Main analytical results

There was no significant association between most QoC variables and HRQoL at 12 months (Table 5, additional file 2). However, in the fully adjusted analysis, treatment in ICUs that had a higher percentage of ventilated patients was significantly associated with a decreased PCS-12. The analysis of the effects of QoC on RtW after 12 months (Cox regression analyses, Table 2) showed a significantly decreased hazard of RtW for patients treated in institutions with a higher proportion of ventilated of patients but no significant association was found for all further variables.

Additional analytical results

In the fully adjusted analysis of the three-month follow-up (Table 6, additional file 3), a higher percentage of patients ventilated was significantly associated with a decreased PCS-12. There was a trend towards a decreased PCS-12 for patients treated in university hospitals (p = 0.054). No significant associations were observed for any QoC parameter and 6 months HRQoL (Table 7, additional file 4).

Based on a logistic regression analysis among ICU survivors twelve-month mortality risk (Table 3) was significantly elevated for patients treated in institutions with a higher number of ventilated patients per year. Additionally, patients treated in university hospitals had a significantly increased twelve-month mortality risk (OR 1.946, p = 0.032) compared to non-university institutions. A trend was seen for a reduced mortality risk in patients treated in ICUs with a higher percentage of ICU specialist physicians.

Discussion

Key findings

The main finding of our study was that of all the quality indicators investigated – taking important confounding factors into account – only the proportion of ventilated patients on all patients showed a significant (negative) association with both twelve-months physical HRQoL (PCS-12) and RtW. Secondary findings were a negative significant association of the proportion of ventilated patients on all patients and positive significant associations between the number of ventilated patients per year and university hospital level of care with post ICU mortality risk. No other quality indicator was significantly associated with the outcomes of interest. The DACAPO survivor cohort was characterized by a reduced HRQoL compared to the general population, with a greater impairment in the physical component compared to the mental component. 50% of the surviving patients who were in employment before ARDS had returned to work one year after transferred from the ICU.

Interpretation, in relation to literature

Our results need careful interpretation. A study by Raymondos et al. [13] showed that the hospital mortality risk of ARDS patients was considerably higher in patients who were treated in non-university hospitals compared to university institutions. However, the present study did not demonstrate a similar effect for HRQoL or RtW 1 year after discharge. A systematic review [26] demonstrated that critically ill patients generally benefit from institutions with high volume regarding mortality with more substantial effects in high risk patients, and there was evidence that this relationship is in part mediated by key hospital or ICU organizational factors. We could not confirm this evidence.

It must be noted though that in contrast to mortality, HRQoL is a complex construct containing individual aspects (multiple dimensions, often operationalized as social, somatic and psychological variables [27]. Our above mentioned systematic review [12] demonstrated significant associations with HRQoL after ARDS only for determinants which were closely related to the scales of the HRQoL instruments and which were measured at the same time as HRQoL.

We were unable to consider variables pertaining to the period after discharge although the post ICU period may play an important role in terms of HRQoL. For instance, a prospective one-year follow-up of 126 patients who received prolonged mechanical ventilation by Unroe et al. [28] showed that these experienced multiple ‘trajectories’ after their transfer from the ICU, resulting in frequent readmissions or transitions to various healthcare institutions.

It might be argued that we did not find strong associations between our exposures of interest (i.e. parameters of QoC) and the different outcomes because 1) the exposures showed little variability and 2) effects may have been seen if intermediary outcomes such as length of ventilation or prevention of multiorgan failure would have been considered. However, when it became clear that the quality indicators that were chosen initially did not show sufficient variability, we considered further quality indicators which were related to those that were chosen initially. These indicators did indeed show variability. Second, our research interest was precisely to study modifiable institutional-level indicators of quality of care in relation to patient-level outcomes. We are coming from a public health/health care research perspective in which we can improve health or achieve better disease outcomes, even if we do not know the mechanisms linking exposure to outcome. In light of this background, we did not attempt to explore pathways between QIs, HRQoL, RtW or mortality through intermediary outcomes. Treatment-related exposures not assessed on the institutional but on the individual patient level (parameters of the intensity of acute care management and critical events) have been investigated in a separate paper [29].

Strenghts and limitations

We were successful in the conduct of a prospective patient cohort study with regular follow-ups. Unfortunately, the number of people lost to follow-up was considerable which may have introduced attrition bias. ICU mortality was not even used as outcome in secondary analysis because the recruitment strategies used focused on the survivor cohort as baseline. For instance, only surviving patients or patients with a legal guardian providing informed consent could be included at some sites, while consent by next-of-kin was acceptable at other sites. Any analysis of factors predictive of ICU mortality would therefore be seriously biased.

Although we adjusted for ARDS severity in our minimally adjusted models, and further corrected for SAPS-II and SOFA scores in the fully adjusted regression models, residual confounding may still be present in relation to ARDS severity/case-mix which might explain our findings. Treatment received before or after ICU care was also not corrected for which might have further contributed to residual confounding.

Measuring QoC in the critical care setting is challenging. In a review by Flaatten et al. [30] 63 quality indicators (QI) measuring quality of structure, process and outcome of care were identified, which are in use with a large variation between countries and no single QI was common for all. QIs for structure predominantly refer to the qualification and quantity of health care professionals, as well as the number of ventilated patients per year [31] process quality indicators are more complex, numerous and they refer to actual recommendations of guidelines (ventilation strategies, nutrition, transfusion strategy etc.). These indicators must be defined by experts or Delphi rounds and they are difficult to be monitored continuously in clinical practice. Usually QIs for outcome include standardized mortality (ICU, hospital, 60- or 90-days) or the incidence of decubiti [31]. No previous investigation used QIs for an assessment of the association with HRQoL. In our study we had to use established QIs only assuming that they have value to describe sufficiently the effect of care on patient-reported outcomes.

Future research

Further, in this paper, we only selected some QIs from the full set. One idea for future research might be to use the full set of QIs to develop a scoring system predictive of patient-level outcome. Such an attempt however is beyond the scope of this paper.

Given the importance of next of kin / family during ICU stay [32], it would be interesting to additionally look at patient-family satisfaction and patient-family engagement in future research.

Conclusions

In conclusion, most indicators of acute QoC were not significantly associated with one-year HRQoL or RtW in ARDS survivors. Post-ICU exposure of ARDS survivors may have attenuated the assumed effects of high-volume care. Overall, we cannot rule out residual confounding by case mix, treatment variables before or during ICU stay and variables pertaining to the post ICU period.