Abstract
Background
Effective shared decision-making relies on some degree of alignment between families and the medical team regarding a patient’s likelihood of recovery. Patients with severe acute brain injury (SABI) are often unable to participate in decisions, and therefore family members make decisions on their behalf. The goal of this study was to evaluate agreement between prognostic predictions by families, physicians, and nurses of patients with SABI regarding their likelihood of regaining independence and to measure each group’s prediction accuracy.
Methods
This observational cohort study, conducted from 01/2018 to 07/2020, was based in the neuroscience and medical/cardiac intensive care units of a single center. Patient eligibility included a diagnosis of SABI—specifically stroke, traumatic brain injury, or hypoxic ischemic encephalopathy—and a Glasgow Coma Scale ≤ 12 after hospital day 2. At enrollment, families, physicians, and nurses were asked separately to predict a patient’s likelihood of recovering to independence within 6 months on a 0–100 scale, regardless of whether a formal family meeting had occurred. True outcome was based on modified Rankin Scale assessment through a family report or medical chart review. Prognostic agreement was measured by (1) intraclass correlation coefficient; (2) mean group prediction comparisons using paired Student’s t-tests; and (3) prevalence of concordance, defined as an absolute difference of less than 20 percentage points between predictions. Accuracy for each group was measured by calculating the area under a receiver operating characteristic curve (C statistic) and compared by using DeLong’s test.
Results
Data were collected from 222 patients and families, 45 physicians, and 103 nurses. Complete data on agreement and accuracy were available for 187 and 177 patients, respectively. The intraclass correlation coefficient, in which 1 indicates perfect correlation and 0 indicates no correlation, was 0.49 for physician-family pairs, 0.40 for family-nurse pairs, and 0.66 for physician-nurse pairs. The difference in mean predictions between families and physicians was 23.5 percentage points (p < 0.001), 25.4 between families and nurses (p < 0.001), and 1.9 between physicians and nurses (p = 0.38). Prevalence of concordance was 39.6% for family-physician pairs, 30.0% for family-nurse pairs, and 56.2% for physician-nurse pairs. The C statistic for prediction accuracy was 0.65 for families, 0.82 for physicians, and 0.76 for nurses. The p values for differences in C statistics were < 0.05 for family-physician and family-nurse groups and 0.18 for physician-nurse groups.
Conclusions
For patients with SABI, agreement in predictions between families, physicians, and nurses regarding likelihood of recovery is poor. Accuracy appears higher for physicians and nurses compared with families, with no significant difference between physicians and nurses.
Similar content being viewed by others
Change history
20 September 2023
Article was updated to correct the abbreviated name spelling of Dr. Rachel Rutz Voumard.
References
Adelman EE, Zahuranec DB. Surrogate decision making in neurocritical care. Continuum (Minneap Minn). 2012;18(3):655–8.
Armstrong MJ. Shared decision-making in stroke: an evolving approach to improved patient care. Stroke Vasc Neurol. 2017;2(2):84–7.
Boyd EA, Lo B, Evans LR, Malvar G, Apatira L, Luce JM, et al. “It’s not just what the doctor tells me:” factors that influence surrogate decision-makers’ perceptions of prognosis. Crit Care Med. 2010;38(5):1270–5.
Ford D, Zapka J, Gebregziabher M, Yang C, Sterba K. Factors associated with illness perception among critically ill patients and surrogates. Chest. 2010;138(1):59–67.
Newman AR. Nurses’ perceptions of diagnosis and prognosis-related communication: an integrative review. Cancer Nurs. 2016;39(5):E48-60.
Reinke LF, Shannon SE, Engelberg RA, Young JP, Curtis JR. Supporting hope and prognostic information: nurses’ perspectives on their role when patients have life-limiting prognoses. J Pain Symptom Manag. 2010;39(6):982–92. https://doi.org/10.1016/j.jpainsymman.2009.11.315.
Butler R, Monsalve M, Thomas GW, Herman T, Segre AM, Polgreen PM, et al. Estimating time physicians and other health care workers spend with patients in an intensive care unit using a sensor network. Am J Med. 2018;131(8):972.e9-972.e15.
Creutzfeldt CJ, Longstreth WT, Holloway RG. Predicting decline and survival in severe acute brain injury: the fourth trajectory. BMJ. 2015;351:h3904.
White DB, Ernecoff N, Buddadhumaruk P, Hong S, Weissfeld L, Curtis JR, et al. Prevalence of and factors related to discordance about prognosis between physicians and surrogate decision makers of critically ill patients. JAMA. 2016;315(19):2086–94.
Frick S, Uehlinger DE, Zuercher Zenklusen RM. Medical futility: predicting outcome of intensive care unit patients by nurses and doctors—a prospective comparative study. Crit Care Med. 2003;31(2):456–61.
Detsky ME, Harhay MO, Bayard DF, et al. Discriminative accuracy of physician and nurse predictions for survival and functional outcomes 6 months after an ICU admission. JAMA. 2017;317(21):2187–95.
Hwang DY, Dell CA, Sparks MJ, et al. Clinician judgment vs formal scales for predicting intracerebral hemorrhage outcomes. Neurology. 2016;86(2):126–33.
Kiker WA, Rutz Voumard R, Andrews LIB, Holloway RG, Brumback LC, Engelberg RA, et al. Assessment of discordance between physicians and family members regarding prognosis in patients with severe acute brain injury. JAMA Netw Open. 2021;4(10):e2128991.
Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81.
Mirr MP. Decisions made by family members of patients with severe head injury. AACN Clin Issues Crit Care Nurs. 1991;2(2):242–51.
Qureshi AI, Palesch YY, Barsan WG, et al. Intensive blood-pressure lowering in patients with acute cerebral hemorrhage. N Engl J Med. 2016;375(11):1033–43.
Hofmeijer J, Kappelle LJ, Algra A, et al. Surgical decompression for space-occupying cerebral infarction (the Hemicraniectomy After Middle Cerebral Artery infarction with Life-threatening Edema Trial [HAMLET]): a multicentre, open, randomised trial. Lancet Neurol. 2009;8(4):326–33.
Liu J, Tang W, Chen G, Lu Y, Feng C, Tu XM. Correlation and agreement: overview and clarification of competing concepts and measures. Shanghai Arch Psychiatry. 2016;28(2):115–20.
Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307–10.
Guo B, Yuan Y. A comparative review of methods for comparing means using partially paired data. Stat Methods Med Res. 2017;26(3):1323–40.
Lloyd CB, Nietert PJ, Silvestri GA. Intensive care decision making in the seriously ill and elderly. Crit Care Med. 2004;32:649–54.
Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143(1):29–36.
DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44(3):837–45.
Lang F, Quill T. Making decisions with families at the end of life. Am Fam Physician. 2004;70(4):719–23.
Balaban RB. A physician’s guide to talking about end-of-life care. J Gen Intern Med. 2000;15(3):195–200.
Pratt AK, Chang JJ, Sederstrom NO. A fate worse than death: prognostication of devastating brain injury. Crit Care Med. 2019;47(4):591–8.
Palstam A, Sjödin A, Sunnerhagen KS. Participation and autonomy five years after stroke: a longitudinal observational study. PLoS One. 2019;4(7):e0219513.
Pallesen H, Aadal L, Moe S, Arntzen C. Gateway to recovery: a comparative analysis of stroke patients’ experiences of change and learning in Norway and Denmark. Rehabil Res Pract. 2019;2019:1726964.
You JJ, Downar J, Fowler RA, et al. Barriers to goals of care discussions with seriously ill hospitalized patients and their families: a multicenter survey of clinicians [published correction appears in JAMA Intern Med. 2015;175(4):659]. JAMA Intern Med. 2015;175(4):549–56.
Wilson ME, Dobler CC, Zubek L, et al. Prevalence of disagreement about appropriateness of treatment between ICU patients/surrogates and clinicians. Chest. 2019;155(6):1140–7.
Schutz RE, Coats HL, Engelberg RA, Curtis JR, Creutzfeldt CJ. Is there hope? Is she there? How families and clinicians experience severe acute brain injury. J Palliat Med. 2017;20(2):170–6.
Clayton JM, Hancock K, Parker S, et al. Sustaining hope when communicating with terminally ill patients and their families: a systematic review. Psychooncology. 2008;17(7):641–59.
Becker KJ, Baxter AB, Cohen WA, et al. Withdrawal of support in intracerebral hemorrhage may lead to self-fulfilling prophecies. Neurology. 2001;56(6):766–72.
Creutzfeldt CJ, Becker KJ, Weinstein JR, et al. Do-not-attempt-resuscitation orders and prognostic models for intraparenchymal hemorrhage. Crit Care Med. 2011;39(1):158–62.
Izzy S, Compton R, Carandang R, Hall W, Muehlschlegel S. Self-fulfilling prophecies through withdrawal of care: do they exist in traumatic brain injury, too? Neurocrit Care. 2013;19(3):347–63.
Acknowledgements
We would like to thank Kaley Dugger, Allison Kunze, Nathan McLaughlin, Erik Risa, and Dr. Kim Matsumoto and for assistance with data collection.
Funding
National Institute of Neurological Disorders and Stroke, K23 NS099421, for Claire J Creutzfeldt, MD; National Institutes of Health, National Heart Lung, and Blood Institute, 5 T32 HL125195-02, for Whitney Kiker (Funding obtained by Curtis JR, Kross EK, Rosenberg AR).
Author information
Authors and Affiliations
Contributions
Dr. Kiker and Dr. Creutzfeldt had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Concept and design: Kiker, Longstreth, Curtis, and Creutzfeldt. Acquisition, analysis, or interpretation of data: Kiker, Rutz Voumard, Plinke, Curtis, and Creutzfeldt. Drafting of the article: Kiker and Creutzfeldt. Critical revision of the article for important intellectual content: all authors. Statistical analysis: Kiker and Creutzfeldt. Obtained funding: Kiker, Rutz Voumard, Creutzfeldt, and Curtis. Supervision: Curtis and Creutzfeldt. All authors have approved of the final manuscript.
Corresponding author
Ethics declarations
Conflicts of interest
There are no conflicts of interest to report.
Ethical approval/informed consent
The University of Washington Institutional Review Board approved this study (study 00003393).
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
12028_2022_1501_MOESM1_ESM.docx
Supplemental Fig. 1 ROC curves for each group, stratified by GCS. n = 44 for GCS 3–5; n = 71 for GCS 6–8; n = 72 for GCS 9–12. GCS, Glasgow Coma Scale, ROC, receiver operating characteristic. (DOCX 4642 kb)
12028_2022_1501_MOESM2_ESM.tiff
Supplemental Fig. 2 ROC Curves by participant group with CMO patients (n = 61) removed. n = 116. CMO, comfort measures only, ROC, receiver operating characteristic. (TIFF 1428 kb)
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Kiker, W.A., Rutz Voumard, R., Plinke, W. et al. Prognosis Predictions by Families, Physicians, and Nurses of Patients with Severe Acute Brain Injury: Agreement and Accuracy. Neurocrit Care 37, 38–46 (2022). https://doi.org/10.1007/s12028-022-01501-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12028-022-01501-7