INTRODUCTION

Care transitions are a vulnerable time for patients, with 20 % of Medicare patients readmitted within 30 days of hospital discharge.1 Despite widespread efforts using a variety of approaches for reducing readmissions, the effects of readmission reduction programs have been equivocal.2 5 In addition, debate continues on the preventability of hospital readmissions, with a systematic review estimating that as few as 27 % of readmissions are truly preventable.6

The high rate of hospital readmissions and uncertain effects of readmission reduction programs may, in part, stem from incomplete understanding of the reasons for readmission or strategies to prevent readmission among physicians—key leaders and architects of institutional change surrounding care transitions and initiators of specific services targeted for individual patients. Physician opinions in this realm have not been investigated on a large scale. Prior studies designed to better understand reasons for readmission assessed patient perspectives on hospital readmissions but did not include physician perspectives.7 9 Disagreement among physicians regarding factors contributing to readmissions and potential preventive strategies could contribute to poorly targeted readmission prevention efforts at both the individual patient level and the broader system level, both of which could result in limited success.

In the present study, we sought to examine agreement between primary care physicians (PCPs) and inpatient physicians regarding the major reasons for hospital readmission and regarding interventions that might have prevented the readmission in a large cohort of patients readmitted to 12 US hospitals.

METHODS

Setting and Participants

Our study is part of a collaborative effort of the Hospital Medicine Reengineering Network (HOMERuN), a national network of investigators at 12 academic medical centers (Online Supplementary Appendix).10

Patients were eligible for inclusion in our study if they were discharged from a general medicine service and had an unscheduled readmission to a general medicine service within 30 days of the index discharge. Eligible patients were readmitted between April 1, 2012, and March 31, 2013; were 18 years of age or older; and spoke English as their primary language or had a caregiver present who spoke English as their primary language. At each site, within the eligible sample, we applied a random-digit generation schema to prospectively select up to five patients per week for study participation. Patients were approached for consent in their hospital room during the readmission. If a patient declined participation, or was too sick to participate, unavailable, or otherwise unwilling after identification, the next randomly selected patient was approached for enrollment.

Following patient enrollment, we emailed or faxed a survey to each patient’s PCP (when identifiable through electronic medical records), the discharging physician from the index admission based on the hospital discharge summary, and the admitting physician from the readmission based on the admission note. Only attending physicians were surveyed.

Our study was approved by the institutional review boards at the University of California-San Francisco (UCSF; the data-coordinating center) and all participating HOMERuN sites.

Survey Development and Data Collection

Surveys were developed by the HOMERuN investigators and pretested by the investigators as well as physicians not associated with the study. Successive refinements were made based on repeated rounds of feedback. The surveys to PCPs and inpatient physicians contained identical questions designed to ascertain the respondent’s opinion on factors potentially contributing to the readmission as well as the probability that different types of interventions might have prevented the readmission. We asked, “In your opinion, which of the following factors may have contributed to the readmission? (CHECK ALL THAT APPLY).” Contributing factors were grouped into five major categories, based in part on a conceptual framework of the ideal transition in care,11 and respondents were asked to endorse all pre-specified individual factors that applied within each of these categories: 1) patient understanding and ability to self-manage (e.g. patient or caregiver inability to manage his/her symptoms); 2) continuity of care and provider communication (e.g. insufficient communication with post-acute care providers regarding the post-discharge plan); 3) social supports (e.g. inadequate support for non-clinical issues); 4) problems with index (initial) admission (e.g. misdiagnosis or failure to treat the condition adequately); and 5) problems with triage after index (initial) discharge (e.g. patient inappropriately went/was sent to emergency department or inappropriately readmitted from emergency department). In addition, they were asked, “How probable do you think each of [the following] potential types of interventions might have been in preventing this readmission?”. Response options under each pre-specified intervention included: no probability, slightly probable, slightly less than 50-50, slightly more than 50-50, strongly probable, and nearly certain. See the Online Supplementary Appendix for full text of the surveys.

Surveys were developed and administered using the research electronic data capture (REDCap) application, an NIH-sponsored, HIPAA compliant, free secure web-based application.12 A unique survey link was emailed or faxed to each physician every 3 days until either a response was received or 14 calendar days elapsed.

Additional patient-level and admission-level data were collected via structured medical record review performed by trained research assistants.

Statistical Analysis

We report the frequency with which PCPs, discharging physicians, and readmitting physicians selected each of the pre-specified factors contributing to readmission, grouped by major category (representing selection of at least one individual factor within that category) as well as by each individual factor. For strategies to prevent readmission, we report the frequency with which the three physician groups reported anything other than “no probability” for each of the potential preventive strategies (i.e. slightly probable, slightly less than 50-50, slightly more than 50-50, strongly probable, nearly certain). We chose this threshold because we were interested in any degree of preventability, and in order to maximize sample size for comparisons. To assess whether using a higher threshold to define endorsement of potential preventive strategies would lead to higher concordance levels, we performed a sensitivity analysis in which we used “slightly more than 50-50,” “strongly probable,” or “nearly certain” to indicate endorsement of a possible way to have prevented the readmission.

To gauge agreement among physicians on the factors contributing to and potential strategies to have prevented each individual readmission, we calculated kappa statistics for each dyad (PCP–discharging physician, PCP–admitting physician, admitting–discharging physician) for each major category of contributing factor and each potential preventive factor. As a measure of overall agreement for provider dyads, we calculated the average kappa for each dyad across all contributing factors, and across all potential preventive strategies. All analyses were performed using SAS software version 9.2 (SAS Institute Inc., Cary, NC).

Sensitivity Analysis

To maximize sample size and make use of all available information, our main analysis included readmission events with at least one physician response (PCP, discharging, or admitting physician), and for comparisons, had non-missing data for the dyad being compared. For example, a readmission event with a missing PCP survey could still be included in the admitting and discharging physician tabulations and comparisons. Since this approach results in different patient subgroups, thus potentially influencing the results, we performed a secondary analysis in the subgroup of readmissions for which complete survey data were available (PCP, discharging, and admitting physician surveys all completed).

RESULTS

Table 1 lists the characteristics of the 993 readmitted patients included in our study. We received survey responses from 356 PCPs (36 % of readmission events), 675 discharging physicians (68 % of readmission events), and 737 admitting physicians (74 % of readmission events).

Table 1 Patient and Admission Characteristics as Documented During Index Admission (N = 993)

Table 2 summarizes the factors contributing to readmissions that were endorsed by PCPs, discharging physicians, and readmitting physicians. The contributing factors most commonly cited by both PCPs and inpatient physicians related to “patient understanding and ability to self-manage.” Although PCPs and inpatient physicians cited the individual factors and major categories with similar frequency, agreement about their contribution to an individual readmission event was poor, with a mean kappa of 0.16 across all major categories and physician dyads (range 0.02–0.30). Levels of agreement were almost identical between provider dyads (average kappa 0.16, 0.15, and 0.16 for PCP–discharging physician, PCP–admitting physician, and admitting–discharging physician dyads, respectively). The highest levels of agreement between providers were seen in the category “patient understanding and ability to self-manage.”

Table 2 PCP, Discharging Physician, and Readmitting Physician Perceptions Regarding Factors Contributing to Readmission*

Physicians’ three most commonly cited potential strategies for preventing readmission all involved providing patients with enhanced post-discharge instructions or support (Table 3): 1) improved self-management plan at discharge, 2) greater engagement of home and community supports, and 3) provision of resources to manage care and symptoms after discharge. Although PCPs and inpatient physicians cited potential prevention strategies with similar frequencies, agreement about the specific strategies that would be useful for an individual patient was poor, with a mean kappa of 0.13 (range 0.00–0.28). Again, levels of agreement were almost identical between provider dyads (average kappa 0.14, 0.13, and 0.13 for PCP–discharging physician, PCP–admitting physician, and admitting–discharging physician dyads, respectively). Using a higher threshold to define endorsement of a strategy that may have prevented the readmission had no substantial effect on the results (Online Appendix Table 1). Agreement remained poor, and average kappa values were again similar between provider dyads (0.03, 0.10, and 0.08 for PCP–discharging physician, PCP–admitting physician, and admitting–discharging physician dyads, respectively).

Table 3 PCP, Discharging Physician, and Readmitting Physician Perceptions Regarding Potential Strategies for Preventing Readmission

Sensitivity Analysis

After restricting our analysis to only those patients with survey data from all three physician groups (n = 155 for contributing factors, n = 138 for potential preventive strategies), our results were similar (Online Appendix Table 2 and Online Appendix Table 3). Agreement remained poor, and average kappa values were again almost identical between provider dyads for contributing factors (0.22, 0.21, and 0.24 for PCP–discharging physician, PCP–admitting physician, and admitting–discharging physician dyads, respectively) and preventive strategies (0.13, 0.11, and 0.11 for PCP–discharging physician, PCP–admitting physician, and admitting–discharging physician dyads, respectively).

DISCUSSION

In this large national study of PCP and inpatient physician opinions on readmission within 30 days of discharge, the contributing factors most commonly endorsed by both PCPs and inpatient physicians related to patient understanding of and ability to self-manage their illness. Similarly, the most commonly endorsed potential preventive strategies involved providing patients with enhanced post-discharge instructions and/or support. However, when examined within individual patients, agreement as to the specific factors and strategies that applied was poor. Our results highlight the importance of communication between inpatient and outpatient providers at the time of discharge, in order to ensure that all vantage points are represented in the development of readmission prevention strategies for a given patient. Our findings also suggest that multifaceted, broadly applied interventions may be more successful than those that rely on individual providers choosing specific services based on perceived risk factors for a particular patient.

A prior study demonstrated that inpatient physicians were unable to accurately predict which patients would be readmitted.13 Our study extends these findings, suggesting that not only are physicians unable to predict who will be readmitted, but physicians caring for the same patient have different views on why that patient was readmitted and on actions that could have prevented the readmission. While our study did not investigate the reasons for these differing views, it seems likely that some of the observed differences reflect the differing vantage points of inpatient and outpatient physicians. However, the fact that discordant views were just as prevalent between inpatient physicians as they were between PCPs and inpatient physicians suggests that our findings are not solely reflective of the differing vantage points across the inpatient–outpatient divide. Our findings may reflect the lack of a clear and objective answer regarding what caused a readmission in most cases, as well as the multifactorial nature of readmissions. Different opinions by different providers may also be due to common cognitive biases such as confirmation bias, availability heuristic, focusing effect, and outcome bias.

Regardless of the reason for the differing viewpoints, when taken together, these findings emphasize the importance of communication between inpatient and outpatient providers at the time of discharge, and of incorporating multiple vantage points when designing interventions to prevent readmission; each provider views the transition through a different lens, and interventions that fail to incorporate these differing perspectives may have limited impact. However, our results also underscore the difficulty in developing effective and individually targeted prevention strategies—even after incorporating multiple provider perspectives—when the key causes of readmissions are not agreed upon. Lack of agreement weakens our ability to develop a valid understanding of the key factors contributing to readmissions, and accordingly, limits the development of successful preventive approaches, particularly if they are too patient-specific. A possible corollary is that multifaceted, broadly applied interventions may be more successful than those that rely on individual providers choosing specific services based on perceived risk factors for a particular patient. These ideas are supported by a recent systematic review of randomized trials to prevent readmissions, in which interventions with many components and those involving more individuals in care delivery were found to be significantly more effective than other interventions.14

Our finding that both PCPs and inpatient physicians cited patient-related factors and prevention strategies more commonly than physician- or system-oriented factors or strategies (e.g. problems relating to the initial admission, improved attention to medication safety) suggests a patient-focused view on why readmissions happen and how they can be prevented. While this could reflect the inherent difficulty in recognizing the flaws of the systems in which we are enmeshed and the tendency to assign fault to others, it could also reflect physician belief that we are not yet delivering sufficiently patient-centered care in this realm. While we may disagree on specific ways to prevent a given readmission, our results do suggest that physicians—PCPs and inpatient physicians alike—believe that a large portion of readmissions could be prevented by strategies focused on enhancing patient understanding and the ability to self-manage with help from home and community supports. Recent studies support these physician beliefs: a systematic review found that strategies supporting patient capacity for self-care and providing comprehensive post-discharge support to patients and caregivers were more effective at preventing readmissions than were other interventions, and a recent analysis of hospitalized adult medical patients in an urban academic safety-net hospital demonstrated that patients with lower levels of patient activation had a higher rate of 30-day hospital readmission.14 , 15 In addition, a recent cohort study investigating predictors of early versus late readmissions demonstrated that social determinants of health, including barriers to learning, were significantly associated with readmissions, regardless of timing.16 Developing and testing broad-based strategies to enhance patient activation and patient capacity for self-care is a potential target of future research. Utilizing an objective risk assessment tool such as the Patient Activation Measure could help identify the patients who stand to benefit most from such interventions.17

Our study has several strengths, including the large multicenter design, with data collection at the time of the readmission, and the inclusion of multiple physician viewpoints. There are also several limitations. First, because we focused on general medicine patients readmitted to general medicine services at academic hospitals, our results may not be generalizable to non-academic hospitals or patients discharged by or readmitted to other services. It is possible that levels of physician agreement would be different when focusing on patients readmitted to other services. Furthermore, we did not include advanced practice providers or the physicians of patients who speak languages other than English, and our results therefore may not be generalizable to these groups. In addition, although the inpatient physician response rate was high, the PCP response rate was low, and thus these responses may not be representative of the population of PCPs from which they were drawn.

The fact that our survey has not been validated is an additional limitation. Although we included a comprehensive list of factors and preventive measures based on a conceptual framework of the ideal transition in care,11 our findings are limited to those domains included in our categorization scheme. While the validity of this approach is partially supported by the finding that readmission reduction programs including more domains from this framework had significantly higher effectiveness, it is nonetheless possible that this categorization scheme failed to sufficiently capture some of the true contributors to readmission.4 We also did not test inter-rater reliability, test–retest reliability, parallel-forms reliability, or internal consistency reliability of our survey instrument, a limitation which may have contributed to failure to accurately or reproducibly measure the constructs in which we were interested. While gaps in psychometric testing of our surveys may have limited accuracy in factor identification by individual physicians, it is less clear how this limitation might have effected physicians differentially and, in turn, how and whether it might have impacted our findings regarding concordance of viewpoints, particularly when physicians did not appear to have difficulty in identifying at least one contributor in each case. Finally, the contributors and strategies identified by physicians in our study are based on their own perceptions and may not accurately reflect the true contributors to or strategies for preventing readmission.

A final limitation relates to the fact that kappa is influenced by the prevalence of an item. For example, in situations where physicians chose a particular readmission contributor infrequently, chance agreement is high and kappa is accordingly reduced. While this “penalty” is felt by many to be appropriate,18 20 we attempted to minimize this phenomenon by reporting kappa values only for aggregate categories of factors predicting readmissions. The fact that kappa was generally low even for highly prevalent selections argues that the prevalence phenomenon does not explain the low rates of agreement we observed.

In conclusion, in this multicenter study on readmissions to general medicine services within 30 days of hospital discharge, we found that inpatient and outpatient physicians shared a common belief that interventions aimed at enhancing patient understanding and ability to self-manage may be most effective in preventing readmissions. The differing physician opinions that we observed regarding factors contributing to individual readmissions highlights the importance of communication between inpatient and outpatient providers at the time of discharge in order to share their different viewpoints, and suggests that multifaceted, broadly applied interventions may be more successful than those that rely on individual providers choosing specific services based on perceived risk factors for a particular patient.