Measurement of quality of life using EQ-5D in patients on prolonged mechanical ventilation: comparison of patients, family caregivers, and nurses

Abstract

Purpose

This study reports how QOL (quality of life) assessments differ between patients on prolonged mechanical ventilation (PMV) and their proxies (family caregivers and nurses).

Methods

We enrolled consecutive subjects on PMV for more than 21 days from five institutions. We conducted QOL assessments using the Taiwanese version of the EQ-5D in face-to-face interviews. Direct caregivers (family members and nurses) also completed the EQ-5D from the patient’s point of view.

Results

For 55 of the 142 enrolled patients who were able to assess their QOL, we recruited 44 patient–family caregiver pairs, 53 patient–nurse pairs, and 42 family caregiver–nurse pairs. There were 81 family caregiver–nurse pairs out of 87 patients with poor cognition. The agreement between patient–family caregiver pairs was generally higher than that of patient–nurse pairs. As the proportions of exact agreement between family caregivers and nurses for patients with poor cognition were 98–99% for observable dimensions of mobility, self-care, and usual activities, they lead to a minimal difference in the final values.

Conclusions

QOL assessments from family caregivers agreed more closely with patients than did those from nurses using EQ-5D evaluations for patients with clear cognition, but either proxy was acceptable for rating PMV patients with poor cognition.

Introduction

Patients who require prolonged mechanical ventilation (PMV) are rapidly increasing in number, as the improved quality of care in ICUs (intensive care units) has resulted in long-term survival for many patients [1, 2]. However, these patients often require continued respiratory care after transfer to a rehabilitation facility, skilled nursing facility, or home care, creating financial burdens for the insurance system and/or the patients’ families [1, 3]. Several studies have reported [1, 46], however, that survivors often feel their quality of life (QOL) to be acceptable.

The National Health Insurance (NHI) of Taiwan uses a system of comprehensive coverage for various health care services, including maintenance hemodialysis and chronic respiratory care. The NHI was first established in 1995 and has been extended to cover over 99% of Taiwanese citizens [7, 8]. In 1998, the Bureau of NHI drafted a prospective payment program to encourage integrated care for mechanically ventilated patients, which was implemented in July 2000 [9]. After several revisions, this program ultimately covered four types of mechanical ventilator care: ICU care (acute stage, <21 days), respiratory care center (RCC, a sub-acute stage for weaning training of up to 42 days), respiratory care ward (RCW, a chronic stage or long-term care), and home care service (stable stage, in which the patient is cared for directly by family caregivers).

Unlike patients on PMV in other countries [1014], many patients in Taiwan suffer from concomitant cognitive impairments that preclude direct assessment of their subjective QOL, making evaluation by proxy unavoidable in many cases. The objective of this study was to evaluate the utility assessment of QOL in patients on PMV and to compare patients’ own QOL assessments with those made on their behalf by proxies (family caregivers and professional nurses).

Methods

Subjects and methods

We recruited subjects from five institutions in northern and southern Taiwan and consecutively enrolled current PMV subjects who had already been on mechanical ventilation for at least for 21 days at various levels of care (ICU, RCC, and RCW): 1 medical center, 1 regional hospital, and 3 small local hospitals were included. The study began after approval was obtained from the Institutional Review Boards (IRBs) of the National Taiwan University Hospital and the Chia-Yi Christian Hospital. The three local hospitals also approved the study after reviewing the approval documents of the two major IRBs above. For subjects with basic cognition who were able to communicate (including through clear body language) and who scored at least 15 on the mini-mental status examination (MMSE) [15], we conducted QOL measurements using the EQ-5D in direct, face-to-face interviews. The primary caregivers (family members and nurses) were also asked to independently complete the EQ-5D questionnaire from the patient’s point of view, i.e., each proxy rated how he or she thought the patient would rate his or her own QOL on the day of the interview. All the interviews with the patient and his/her proxy were required to be finished within 3 days, and we also made sure that the individual patient’s clinical condition was stable by verifying with the medical records. The proxy’s results were directly compared with the patient’s own rating, which was considered to be the gold standard.

Quality of life measured by EQ-5D

The utility value of the QOL for patients on PMV was estimated using the EuroQol five-dimensional (EQ-5D) questionnaire, a generic preference-based instrument. The five dimensions assessed by the EQ-5D are mobility, self-care, usual activities, pain/discomfort, and anxiety/depression, with three levels of severity (no problems, some/moderate problems, and severe/extreme problems). This provides a utility value that ranges from 0 to 1 based upon the five-dimensional health state classification, in which 0 represents the worst health status and 1 represents perfect health [16, 17]. The EQ-5D instrument is a valid and reliable tool for measuring health status that has been extensively used in many countries as an outcome measure, including for critically ill patients [1820]. It was also recently applied in Taiwan with good validity and moderate reliability [21]. We applied the value systems of the United States and the United Kingdom as a comparison [17, 22]. There is general agreement that patients are the best raters of their QOL; however, when a patient’s mental status is too poor, family caregivers and nurses may be considered as proxies [1113]. QOL assessment by EQ-5D was conducted by three research assistants who were first trained in the standard operating procedure. For each patient and his/her proxy, the researcher recorded characteristics including age, gender, education, marital status, relationship to the patient, whether or not the proxy lived with the patient, frequency of caring for the patient, location (ICU or RCC or RCW), Glasgow Coma Scale (GCS), presence/absence of tracheotomy and duration of mechanical ventilation, and history of depression. The duration-to-date for each measurement was defined as beginning on the first day after PMV and ending on the date of interview by our researcher.

Statistical analysis

Binary and categorical variables were summarized using frequency counts and percentages. Continuous variables are presented as means if normally distributed. The agreement between QOL scores from patients, family caregivers, and nurses for each dimension was determined for each pair by calculating weighted kappa scores [23]. To evaluate any systematic tendency for proxy respondents to overestimate or underestimate QOL, we computed the patient–proxy and proxy–proxy mean differences in the final utility value of the EQ-5D. The mean difference between pair-scores and values were tested with the rank sum and paired t-tests to detect any significant difference when the sample size is small. We calculated the effect size by dividing the mean patient–proxy difference by the standard deviation of the patient responses. The magnitude of the standardized difference can be interpreted as follows: |d| = 0.2, a small difference; |d| = 0.5, a moderate difference; and |d| = 0.8, a large difference [24]. The agreement between patients and proxies of the summary index of EQ-5D was assessed with one-way intra-class correlation coefficients (ICC) [25, 26]. An ICC or weighted kappa less than 0.4 was considered to indicate poor agreement, 0.40–0.75 indicated moderate to good agreement, and values >0.75 indicated excellent agreement [23, 2729]. Because the group was homogeneous in disease status and marginal distribution, the statistical ICC and weighted kappa underrate agreement [30]. Thus, we calculated the proportion of exact agreement, defined as the number of same response categories chosen between the index subject and the proxy divided by the total number of rating pairs [31].

Results

Basic characteristics of respondents

A total of 177 patients were invited for this study; 142 patients accepted interviews producing a response rate of 80%, as summarized in Fig. 1. For the 55 patients able to assess their own QOL, we collected 44 patient–family caregiver pairs, 53 patient–nurse pairs, and 42 family caregiver–nurse pairs. We successfully collected 81 family caregiver–nurse pairs for 87 patients who were unable to assess their own QOL. We were unable to recruit any proxy for six patients with poor cognition.

Fig. 1
figure1

Recruitment process for study participants

The first proxy group (family caregivers) consisted of 129 persons; 57% were the patients’ children, 58% lived with the patients, and 67% contacted the patients everyday. The second proxy group (nurses) consisted of 135 persons, 27% of whom were directly responsible for the patients’ everyday care (Table 1).

Table 1 Characteristics of study subjects and proxies (family caregivers and nurses)

Agreement in each dimension

Although the weighted kappa scores indicated poor to moderate agreement (0.21–0.58) in the observable dimensions (mobility, self-care, and usual activities) and poor agreement (0.00–0.35) in the subjective dimensions (pain/discomfort and anxiety/depression), the proportions of exact agreement were more than 75 and 28% for observable and subjective dimensions, respectively, indicating high agreement on the former dimension for both family caregivers and nurses (Table 2). Family caregivers in particular displayed better agreement with the patients compared to nurses on subjective feelings of pain/discomfort and anxiety/depression. In patients with poor cognition, the proportions of exact agreement of family caregiver–nurse pairs were all above 98% in the observable dimensions but only 37–38% in the subjective dimensions (Table 3).

Table 2 Frequency distribution of agreement among patients with fair to good cognition (mini-mental status examination score >15) for each dimension of the EQ-5D
Table 3 Frequency distribution of agreement among patients with poor cognition and their proxies for each dimension in the EQ-5D

Agreement of EQ-5D index

The mean EQ-5D index among the 55 patients was 0.23 ± 0.20. The mean differences in the EQ-5D index were −0.03 ± 0.14 and 0.03 ± 0.22 for patient–family caregiver pairs and patient–nurse pairs, respectively; this difference was not statistically significant (Table 4). In PMV patients with poor cognition, the average EQ-5D index assigned by family caregivers and nurses were 0.12 ± 0.10 (0–0.44) and 0.14 ± 0.11 (0–0.63), respectively. The effect size of the mean differences for these measurements was 0.13, which is small [24]. The ICC of the EQ-5D index for patient–family caregiver pairs was excellent (0.76), which seems much higher than that of the patient–nurse pairs (0.36) (Table 4).

Table 4 Differences and reliabilities of EQ-5D index measured in patients on PMV (prolonged mechanical ventilation) and their proxies, according to value systems established in the United Kingdom (UK) and United States (US)

Discussion

To our knowledge, this study is the first that validates agreement on QOL between PMV patients and their proxies (family caregivers and nurses) as measured by the EQ-5D preference instrument; in addition, these conclusions were validated in both PMV patients with good and poor cognition. Our findings demonstrate that family caregivers tended to rate all dimensions as being more severe than did patients themselves and that family caregivers’ assessments were in closer agreement with patients’ assessments than were those of their nurses, using either observable dimensions or subjective feelings. Moreover, agreement on the observable dimensions between family caregivers and nurses was higher (proportions of exact agreement = 98–99%) in PMV patients with poor cognition.

Our study corroborates previous investigations finding better agreement between patients and their proxies for directly observable dimensions (mobility, self-care, and usual activities) than for assessments of subjective feelings and mental health (pain/discomfort and anxiety/depression) [3234]. However, family caregivers tended to rate all dimensions at a slightly higher severity than did patients themselves, while nurses gave less severe ratings compared to patients (Table 2). Family caregivers were generally allowed to stay with patients after their hospitalization in RCW institutions, which may partially explain why they were apparently able to perceive so accurately the feelings of PMV patients, with all proportions of the exact agreement above 86% for observable dimensions and 52% for subjective dimensions. In addition, no significant differences were identified between the final EQ-5D utility values from the patient–family caregiver pairs (Table 4). In contrast, only 27% of the interviewed nurses had daily contact with the patients, as they generally rotated and took days off each week (Table 1). We applied multiple regression analysis to estimate the potential effect of this determinant on the mean difference between patient–nurse pairs, but it did not show any statistical significance. Overall, the agreement within patient–family caregiver pairs is consistently closer than that of patient–nurse pairs, indicating that family caregivers may be a more suitable proxy for PMV patients in the Taiwanese culture.

In PMV patients with poor cognition, it is not surprising that both the weighted kappa (Table 3) and ICC (Table 4) were very low, because these patients were generally bed-ridden in RCC/RCW units, and there is almost zero variation in the observable dimensions of mobility, self-care, and usual activities. Thus, such extremely limited distributions hamper the values of weighted kappa and ICC, and we must also provide the results of proportions of exact agreement, which were as high as 37–99% (Table 3) to avoid misinterpretation.

Nonetheless, there was no statistically significant difference between the final utility values of EQ-5D from patient–family caregiver and patient–nurse pairs in PMV patients with partial cognition. Because the EQ-5D value system of Taiwan has not yet been published, we applied the values obtained from the United States and United Kingdom for sensitivity analysis [17, 22]. Although the values based on the US system seem smaller than those from the United Kingdom, they yielded similar results, apparently due to the limited variation of health states in these patients (Table 4). Thus, the nurse’s rating appears as acceptable as that of a family caregiver for use as a proxy to rate the utility value of the EQ-5D in PMV patients with poor cognition, even though the ICC of these pairs was only 0.00.

A possible limitation of this study was its cross-sectional design. Although we conducted a multiple regression analysis using the utility value of EQ-5D as the dependent variable and the duration of mechanical ventilation as an independent variable in the model, there was no significant difference. Thus, we were unable to answer whether the agreement of QOL measurements between patients and proxies may change longitudinally over different time points. Another possible limitation was the 80% response rate and the degree to which our sample was representative of the population as a whole. There was no statistically significant difference in patient characteristics between respondents and non-respondents. However, because family members of 22 of the 35 non-respondents did not come to visit the patients during our 3–4 week study period, those patients might have a poorer QOL compared to that of the others. Ten family caregivers refused to be interviewed at the time of our request, as they were coping with their relative’s deteriorating condition. Thus, our results might have overestimated the QOL of PMV patients. Finally, the extremely skewed responses in the objective dimensions of the EQ-5D in patients with poor cognition result in a generally low weighted kappa (Table 3), reflecting the inappropriateness of using such indicators. Thus, we have calculated the proportion of exact agreement to allow us to make a suitable inference.

Conclusions

Although the sensitivity analysis did not show any significant differences in overall utility value of QOL measurements using EQ-5D between patients on PMV and their proxies, family caregivers exhibited closer agreement with the patients than did nurses on QOL evaluation, especially on rating subjective feelings of pain/discomfort and anxiety/depression. However, there was no difference between the two proxies in the final utility values for PMV patients with poor cognition. Further research into these issues is still needed in subjects from different cultures to corroborate our findings.

Abbreviations

PMV:

Prolonged mechanical ventilation

QO:

Quality of life

ICU:

Intensive care unit

RCC:

Respiratory care center

RCW:

Respiratory care ward

IRB:

Institutional review board

MMSE:

Mini-mental status examination

EQ-5D:

EuroQol five-dimensional

ICC:

Intra-class correlation coefficient

References

  1. 1.

    Carson, S. S. (2006). Outcomes of prolonged mechanical ventilation. Current Opinion in Critical Care, 12(5), 405–411. doi:10.1097/01.ccx.0000244118.08753.dc.

    Article  PubMed  Google Scholar 

  2. 2.

    Carson, S. S., Cox, C. E., Holmes, G. M., & Howard, A. (2006). The changing epidemiology of mechanical ventilation: A population-based study. Journal of Intensive Care Medicine, 21(3), 173–182. doi:10.1177/0885066605282784.

    Article  PubMed  Google Scholar 

  3. 3.

    Cox, C. E., Carson, S. S., Holmes, G. M., & Howard, A. (2004). Increase in tracheotomy for prolonged mechanical ventilation in North Carolina, 1993–2002. Critical Care Medicine, 32(11), 2219–2226. doi:10.1097/01.CCM.0000145232.46143.4.

    PubMed  Google Scholar 

  4. 4.

    Douglas, S. L., Daly, B. J., Gordon, N., & Brennan, P. F. (2002). Survival and quality of life: Short term versus long-term ventilator patients. Critical Care Medicine, 30, 2655–2662. doi:10.1097/01.CCM.0000034688.55283.6.

    Article  PubMed  Google Scholar 

  5. 5.

    Combes, A., Costa, M. A., Trouillet, J. L., Baudot, J., Mokhtari, M., Gibert, C., et al. (2003). Morbidity, mortality, and quality-of-life outcomes of patients requiring ≧14 days of mechanical ventilation. Critical Care Medicine, 31, 1373–1381. doi:10.1097/01.CCM.0000065188.87029.C3.

    Article  PubMed  Google Scholar 

  6. 6.

    Chatila, W., Kreimer, D. T., & Criner, G. J. (2001). Quality of life in survivors of prolonged mechanical ventilatory support. Critical Care Medicine, 29(4), 737–742. Retrieved from http://journals.lww.com/ccmjournal/pages/default.aspx.

  7. 7.

    Department of Statistics, Ministry of the Interior (2009). Number of population. Available online at: http://www.moi.gov.tw/stat/english/monthly.asp. Accessed August 24, 2009.

  8. 8.

    Bureau of National Health Insurance (2009). Insurance coverage. Available online at: http://www.nhi.gov.tw/webdata. Accessed August 24, 2009.

  9. 9.

    Bureau of National Health Insurance (2009). Prospective payment system of ventilator dependents managed care demonstration. Available online at. http://www.nhi.gov.tw/webdata. (In Chinese). Accessed August 24, 2009.

  10. 10.

    Coucill, W., Bryan, S., Bentham, P., Buckley, A., & Laight, A. (2001). EQ-5D in patients with dementia: An investigation of inter-rater agreement. Medical Care, 39(8), 760–771. Retrieved from http://journals.lww.com/lww-medicalcare/pages/default.aspx.

  11. 11.

    Bryan, S., Hardyman, W., Bentham, P., Buckley, A., & Laight, A. (2005). Proxy completion of EQ-5D in patients with dementia. Quality of Life Research, 14(1), 107–118. doi:10.1007/s11136-004-1920-6.

    Article  CAS  PubMed  Google Scholar 

  12. 12.

    Pickard, A. S., & Knight, S. J. (2005). Proxy evaluation of health-related quality of life: A conceptual framework for understanding multiple proxy perspectives. Medical Care, 43(5), 493–499. Retrieved from http://journals.lww.com/lww-medicalcare/pages/default.aspx.

  13. 13.

    McPhail, S., Beller, E., & Haines, T. (2008). Two perspectives of proxy reporting of health-related quality of life using the Euroqol-5D, an investigation of agreement. Medical Care, 46(11), 1140–1148. doi:10.1097/MLR.0b013e31817d69a6.

    Article  PubMed  Google Scholar 

  14. 14.

    Sneeuw, K. C. A., Sprangers, M. A. G., & Aaronson, N. K. (2002). . The role of health care providers and significant others in evaluating the quality of life of patients with chronic disease. Journal of Clinical Epidemiology, 55(11), 1130–1143. Retrieved from http://www.sciencedirect.com/science/journal/08954356.

    Google Scholar 

  15. 15.

    Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975). “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12(3), 189–198. Retrieved from http://www.sciencedirect.com/science/journal/00223956.

    Google Scholar 

  16. 16.

    EuroQol Group (1990). EuroQol-a new facility for the measurement of health-related quality of life. Health Policy, 16(3), 199–208. Retrieved from http://www.sciencedirect.com/science/journal/01688510.

  17. 17.

    Szende, A., Oppe, M., & Devlin, N. (2007). EQ-5D value sets: Inventory, comparative review and user guide. UK: EuroQol Group.

    Google Scholar 

  18. 18.

    Badia, X., Diaz-Prieto, A., Rue, M., & Patrick, D. L. (1996). Measuring health and health state preferences among critically ill patients. Intensive Care Medicine, 22(12), 1379–1384. doi:10.1007/s001340050267.

    Article  CAS  PubMed  Google Scholar 

  19. 19.

    Cristina, G., Armando, T. P., & Altamiro, C. P. (2002). Quality of life after intensive care—evaluation with EQ-5D questionnaire. Intensive Care Medicine, 28(7), 898–907. doi:10.1007/s00134-002-1345-z.

    Article  Google Scholar 

  20. 20.

    Granja, C., Dias, C., Costa-Pereira, A., & Sarmento, A. (2004). Quality of life of survivors from severe sepsis and septic shock may be similar to that of others who survive critical illness. Critical Care, 8, R91–R98. Retrieved from http://journals.lww.com/lww-medicalcare/pages/default.aspx.

  21. 21.

    Chang, T. J., Tarn, Y. H., Hsieh, C. L., Liou, W. S., Shaw, J. W., & Chiou, X. G. (2007). Taiwanese version of the EQ-5D: Validation in a representative sample of the Taiwanese population. Journal of the Formosan Medical Association, 106(12), 1023–1031. Retrieved from http://fma.mc.ntu.edu.tw/.

    Google Scholar 

  22. 22.

    Shaw, J. W., Johnson, J. A., & Coons, S.J. (2007). US valuation of the EQ-5D health states: Development and testing of the D1 valuation model. Med Care, 43(3), 203–220. Retrieved from http://journals.lww.com/lww-medicalcare/pages/default.aspx.

  23. 23.

    Altman, D. G. (1991). Practical statistics for medical research (1st ed.). London: Chapman and Hall.

    Google Scholar 

  24. 24.

    Cohen, J. (1988). Statistical power analysis for the behavior sciences (2nd ed.). New Jersey: Lawrence Erlbaum Associates.

    Google Scholar 

  25. 25.

    Deyo, R. A., Diehr, P., & Patrick, D. L. (1991). Reproducibility and responsiveness of health status measures. Statistics and strategies for evaluation. Controlled Clinical Trials, 12(4Suppl), 142S–158S. Retrieved from http://www.sciencedirect.com/science/journal/01972456.

  26. 26.

    Schrout, P., & Fleiss, J. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychiatric Bulletin, 86(2), 420–428. Retrieved from http://pb.rcpsych.org/.

  27. 27.

    Nunnally, J. C. (1994). Psychometric theory. New York: McGraw-Hill.

    Google Scholar 

  28. 28.

    Lee, J., Koh, D., & Ong, C. N. (1989). Statistical evaluation of agreement between two methods for measuring a quantitative variable. Computers in Biology & Medicine, 19(1), 61–70. Retrieved from http://www.sciencedirect.com/science/journal/00104825.

  29. 29.

    Fleiss, J. L. (1986). The design and analysis of clinical experiments. New York: Wiley.

    Google Scholar 

  30. 30.

    Agresti, A., & Ghosh, A. (1995). Rank kappa: Describing potential impact of marginal distributions on measures of agreement. Biometrical Journal, 37(7), 811–820. doi:10.1002/bimj.4710370705.

    Article  Google Scholar 

  31. 31.

    Novella, J. L., Jochum, C., Jolly, D., et al. (2004). Agreement between patients’ and proxies’ reports of quality of life in Alzheimer’s disease. Quality of Life Research, 10(5), 443–452. doi:10.1023/A:1012522013817.

    Article  Google Scholar 

  32. 32.

    Tamim, H., McCusker, J., & Dendukuri, N. (2002). Proxy reporting of quality of life using the EQ-5D. Medical Care, 40(12), 1186–1195. Retrieved from http://journals.lww.com/lww-medicalcare/pages/default.aspx.

  33. 33.

    Pickard, A. S., Johnson, J. A., Feeny, D. H., Shuaib, A., Carriere, K. C., & Nasser, A. M. (2004). Agreement between patient and proxy assessments of health-related quality of life after stroke using the EQ-5D and health utilities index. Stroke, 35(2), 607–612. doi:10.1161/01.STR.0000110984.91157.BD.

    Article  PubMed  Google Scholar 

  34. 34.

    Andresen, E. M., Vahle, V. J., & Lollar, D. (2001). Proxy reliability: Health-related quality of life (HRQoL) measures for people with disability. Quality of Life Research, 10, 609–619. doi:10.1023/A:1013187903591.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgments

This work was partially supported by grants from the National Health Research Institute (NHRI, Grant 97A1-HDPP01-014 and 98A1-PHAPHD-014), Chia-Yi Christian Hospital (CYCH, Grant R98-3), and the National Science Council (NSC, Grant 98-2341-B-002-129) in Taiwan. The authors also thank the members of the respiratory care ward of Chia-Yi Hospital, the Department of Health, Executive Yuan, Taiwan; the private Chen Ren-Der Hospital; Yang Ming Hospital (Chia-Yi); and the National Taiwan University Hospital for helping us to recruit study subjects.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Jung-Der Wang.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Hung, M., Yan, Y., Fan, P. et al. Measurement of quality of life using EQ-5D in patients on prolonged mechanical ventilation: comparison of patients, family caregivers, and nurses. Qual Life Res 19, 721–727 (2010). https://doi.org/10.1007/s11136-010-9629-1

Download citation

Keywords

  • Prolonged mechanical ventilation
  • Proxy
  • Quality of life
  • EQ-5D
  • Utility