INTRODUCTION

The stresses and challenges of medicine residency threaten learners’ well-being and burnout risk is high. Concerns about resident well-being have driven the National Academy of Medicine’s Committee on Systems Approaches to Improve Patient Care by Supporting Clinician Well-Being call to action, where they urged healthcare organizations to adopt and apply principles to improve the work environment and balance job demands and job resources.1, 2 A key recommendation included professional development of faculty to promote positive role model behaviors.3, 4

Well-documented challenges affecting residents include excessive workload, inefficient practice, work-life integration, lack of autonomy and control, loss of meaning in work, disconnection with and structural inequities within organizational culture, and high stress environment.5,6,7,8 These challenges affect the learning environment, as well as resident motivation, decision-making, quality of care, and communication at work.9, 10 In response, residents use a variety of coping strategies, often without prior experience or reflection to help them understand what may or may not work for them. Physicians with lower resilience and who report lacking the skills to help them function well under stress are more likely to experience burnout.10, 11

Learning effective coping strategies may improve burnout. Prior research indicates that both individual-focused and systems-based strategies can improve well-being.4, 12 Few examples exist of programmatic interventions that combine both approaches as levers of change. Coaching is an example of such a resource to support residents in managing stress and adapting to change through development of coping behaviors, increasing positive emotions, and fostering positive relationships with faculty.5, 13,14,15 Coaching is a relationship between an individual coachee and a coach with a specific purpose to help the coachee design and achieve professional or personal goals.14, 15 Coaching allows for both structured and unstructured conversation, emphasizes active listening, and enhances strengths.13,14,15,16 The coaching literature suggests that the process of coaching is highly complex, and multiple moderating and mediating factors in the individual and the approach contribute to the success of a coaching intervention (coachee motivations and expectations, the coaching relationship, using an internal vs. external coach, coachee self-efficacy).13 To our knowledge, the exploration of these mechanisms is limited in the literature.

By engaging faculty trained in positive psychology and coaching skills, we endeavored to develop and disseminate a systems-based solution focused on individuals to improve physician well-being in the Professional Development Coaching Program (PDCP). Our initial work reported on a single-center positive psychology coaching program and demonstrated that in those residents who participated and reported a positive coaching experience, their opportunities to reflect increased, as did coping and relationship skills.17 Those residents with poor or fair opportunities to reflect exhibited higher emotional exhaustion scores on the Maslach Burnout Inventory (MBI).18, 19 While it was clear that some benefitted from the program more than others, program size limited a more comprehensive assessment of other factors that might be used to predict who came into the program with better coping and resiliency practices and might benefit more or less from the program.

In 2016–2017, we expanded the PDCP to five institutions to assess the generalizability of a positive psychology coaching program. In this study, we explored how coachee attributes and behaviors at baseline contribute to their well-being and impact their experience with a coaching program. In baseline data of participants, there was no correlation between burnout (using MBI) and a well-being scale known as PERMA (Positive Emotion, Engagement, Relationships, Meaning, and Accomplishments).20, 21 This prompted exploration of the associations between participant characteristics and changes in well-being and burnout in a multivariate model to assess how to maximize the benefit of the coaching program. Using primary outcome variables of MBI and PERMA, and controlling for resident coachee demographics and program site, our predictors included skills the PDCP was designed to enhance through the intervention (intolerance of uncertainty, hardiness/resilience, gratitude, and coping) and previously identified outcomes of the coaching relationship (self-reported practice of goal setting, reflection, and feedback).

METHODS

Design

This was a prospective, pre-post study of 272 interns in internal medicine training programs at five institutions (Boston Medical Center, University Hospitals Cleveland Medical Center, Duke University, Emory University, and Massachusetts General Hospital) who were enrolled in the previously described PDCP during the 2016–2017 academic year.18 Participants were surveyed in October of intern year to assess baseline burnout and well-being, as well as modifiers/mediators and key skills necessary to achieve well-being. October was chosen as interns would have 3+ months of work experience to ensure measurement reflected their internship baseline, rather than July which might mistakenly reflect well-being and burnout from medical school. They were then surveyed with the same tools in May of intern year.

Survey data are available for 235 interns at baseline; paired data are available for 129 interns. Effect size was calculated comparing pooled baseline samples to pooled end of year samples and calculated comparing pre- and post-intervention paired data.

Intervention

The PDCP has been previously described.18 All interns were paired with a faculty coach at their institution and outside their field of specialty interest. Coaches were provided a 3-h skills-based training in positive psychology and coaching principles and given curricular guides for 1:1 meetings with their coachees. Each coach was assigned 1–2 coachees; pairs were expected to meet quarterly. A typical coaching meeting was 45–60 min in length. Themes and skills to practice reflection, processing feedback, and goal setting were woven throughout the program. Coaching meetings focused on strengths evaluation, resiliency, and constructing a framework of positive well-being (PERMA).18 Appendix Figure 1 outlines the curriculum. Survey and program participation were voluntary; there was no consequence for not meeting with their coach. Dr. Palamara led the faculty coach trainings at each site. Each site had an appointed champion(s) present for trainings, creating a “train the trainer” model for sustainability beyond the pilot. Champions were in regular communication with Dr. Palamara to oversee the implementation and administration of the program. Site-specific curricular materials were created and stored in a cloud-based system for coaches to access for meetings.

Surveys were administered by a research team at MGH. Sites did not have access to the data but were asked to encourage survey completion at their site. Sites determined the use of incentives for survey participation; the amount and type varied.

Measurements

Survey metrics were grouped into 3 categories: (1) study outcomes—MBI score for burnout (7-point frequency [0–6], 9 items for EE and 5 items for DP, range 0–54 for EE and 0–30 for DP); PERMA score as a metric of well-being (5-point frequency [1–5], 15 items, range 0–75); (2) baseline predictors (modifiers)—program site and resident demographics, the Intolerance of Uncertainty Scale (IUS, 5-point frequency [1–5], 12 items, range 0–60); HRS or hardiness-resilience scoring (DRS-15, 4-point frequency [0–3], 15 items, range 0–45), gratitude (GR-2, 7-point frequency [1–7], 2 items from the GQ-6 scale, range 0–14) and a 3-item measure of coping (Measurement of Current Status; MOCS3, 5-point frequency [1–5], 3 items, range 0–15), self-reported reflection and goal setting; and (3) post program predictors (mediators)—self-reported reflection, goal setting during follow-up.19, 21,22,23,24,25,26

Statistical Analysis

Participant characteristics were summarized for all respondents to the baseline survey grouped by completion of follow-up survey. We then restricted the remaining analysis to those who answered both baseline and follow-up surveys. Due to considerable variation in resident survey response and participation level by site, we controlled for program site in all analyses. For the primary outcomes of burnout and well-being, a positive change in PERMA indicates improvement in well-being. For EE and DP, a negative change indicates improvement in burnout. For independent variables, scoring measures that were continuous (HRS, IUS, MOCS, and GR2) were divided the scores into quartiles and dichotomized further as top quartile vs. lower quartiles.

We performed bivariate analysis for the primary outcomes to measure three differences in scores outcomes for participants who answered both baseline and follow-up surveys. For each predictor, we performed a one-way ANCOVA test while adjusting for baseline score of each respective outcome. The sample size limited our ability to use all possible predictors in our models; we used our pre-specified predictors based on prior knowledge and bivariate analyses to perform multiple linear regression modeling for the three outcomes separately to examine predictors including baseline score, demographics (gender, race, site), goal setting, HRS, GR-2, IUS at baseline, and reflection at follow-up. A two-sided p-value <0.05 was considered statistically significant. All analyses were conducted using SAS version 9.4 (SAS Institute, Cary, NC).

RESULTS

A total of 235 participants answered the baseline survey. Of those, 129 responded to the post-survey. In Table 1, we compared participant characteristics and survey responses of responders with non-responders. To examine selection bias, we compared demographics between responders and non-responders and found no significant differences in baseline characteristics. As previously noted, we controlled for site in all multivariate analyses.

Table 1 Comparison of Participant Characteristics Between Those Who Did Not Complete Follow-up Survey and Those Who Did Complete the Follow-up Survey

In Table 2 and Figure 1, we show the bivariate analysis to assess associations of each predictor with the differences in scores between baseline and follow-up measures of primary outcomes PERMA and MBI subscales of EE and DP. Among all respondents, there were declines in PERMA, MBI, and EE scores, and a small increase in DP. The change is calculated from subtracting baseline score from the follow-up score. A positive change in PERMA and a negative change in EE or DP indicate improvement.

Table 2 Examination of Change (Post-Pre) in Outcome Scores for PERMA, Emotional Exhaustion, and Depersonalization for Each Predictor. This Analysis Is Limited to the Number of Persons Providing Complete Data
Figure 1
figure 1

Graphical display of selected predictors that are associated with change in PERMA, emotional exhaustion, and depersonalization scores. PERMA, Positive Emotion, Engagement, Relationships, Meaning, and Accomplishments; HRS, Hardiness-Resilience Scale; IUS, intolerance of uncertainty; GR2, Gratitude Scale. For PERMA, males indicated an average positive change (0.83), and females a negative change (−1.41). Participants who reported their post-program opportunity to reflect was “Excellent” showed mean positive change in PERMA (1.93) while those who answered “Poor/Fair” and “Good” had mean decreases (−1.72, −0.66). Examining burnout in terms of EE, those who were non-Hispanic white had a mean decrease of EE (−1.86). Higher HRS and lower IUS at baseline are associated with decreases in EE on average (−2.28, −1.57). Those who reported that they “Never/Rarely” practiced goal setting at baseline had improved DP with average reduction of −1.34. Lower GR2 and lower IUS at baseline were associated with increases in DP (0.29, 0.18).

PERMA changed from baseline to follow-up in all participants, with significant differences between male and female coachees—males indicated a small positive change, females a negative change in PERMA (males 0.83 vs. females −1.41, p = 0.04). Of several other predictors, few were significantly associated with a change in PERMA except for participant-reported self-reflection at follow-up, a key program skill. Participants who reported their post-program opportunity to reflect was “Excellent” showed mean positive change in well-being (PERMA) (1.93, p = 0.009).

We also examined bivariate associations of changes in the MBI and its subscales. Examining burnout, those who were non-Hispanic white had a mean decrease of EE (−1.86, p = 0.021). Those who reported that they “Never/Rarely” practiced goal setting at baseline had improved EE and DP during the program year with a respective average reduction of −3.45 (p = 0.056) and − 1.34 (p = 0.099). Also, for EE, higher HRS and lower IUS scores at baseline were associated with lower burnout on average (−2.28, p = 0.034; −1.57, p = 0.002).

Given our hypothesis that program site, participant characteristics, and other factors might influence participant experience and receptivity to program mediators, we conducted multiple linear regression modeling to examine these multiple factors in predicting our primary outcomes (see Table 3). Covariates included in these models included baseline scores, gender, race (Black/Asian/Hispanic/other vs. non-Hispanic white), site, post-opportunity to reflect, baseline goal setting, HRS, gratitude score, and IUS score, all of which were significant in bivariate analyses. In general, if a participant had higher well-being (PERMA) at baseline, there was less improvement seen (−0.407, p = <0.001). Those whose resilience improved as measured by higher HRS score (vs. lower at baseline) also experienced a positive change in well-being (3.474, p = 0.008). However, controlling for all factors, females see a significant negative change (−2.475, p = 0.012) in well-being (PERMA) compared to males. Participants with improved post-reflection (report “Excellent” vs. poor/fair reflection at baseline) experienced a positive change (4.025, p = 0.011).

Table 3 Modeling of Change (Post-Pre) in Outcome Scores for PERMA, Emotional Exhaustion (EE), and Depersonalization (DP) for Pre-specified Predictors

Participants experiencing higher burnout at baseline, measured by higher baseline EE and DP scores, were more likely to improve and experience lower burnout in the program year (−0.393, p = <0.001; −0.476, p = <0.001). Those who are Black/Asian/Hispanic/other were significantly more likely to have an increase in EE (2.608, p = 0.046) compared to non-Hispanic white participants. Higher HRS score at baseline is significantly associated with improvement in EE (−4.469, p = 0.003), whereas higher IUS score at baseline is significantly associated with more EE (6.022, p = 0.0002) and DP (2.555, p = 0.025) when compared to lower scores in HRS and IUS, respectively. Respondents with higher gratitude scores vs. lower scores at baseline are more likely to report an improvement in DP (−1.865, p = 0.065).

Finally, in another aspect of the survey, we included direct measures of the residents’ own perceptions of whether coaching had helped them cope with key stressors in internship year (work-life balance, cultural competence, working relationships, work hour restrictions, administrative burdens, self-confidence, and information processing). Appendix Table 1 reports whether interns “definitely” or “somewhat” agreed or disagreed with the following statement: “In previous research, the following have been noted as major challenges for trainees. For each one, please indicate if you believe the coaching program has improved your ability to cope.” The strongest agreement was seen with self-confidence (89.3%), working relationships (89.1%), information processing (84.7%), cultural competence (75.7%), work hour restrictions (73.9%), and work-life balance (73.8%). The lowest agreement was with administrative burdens (60.5%).

DISCUSSION

These data are taken from a multisite implementation of the PDCP, a program targeted at residents in medicine to improve well-being and decrease burnout through positive psychology coaching and the introduction of new skills in goal setting, reflection, and receiving feedback. These analyses reveal the complex relationships that are likely to exist in the lives of new physicians and in the global measures of burnout and well-being. If we look at the entire cohort, those outcomes do not change very much during this program year, though the overall minor changes mask significant differences by gender and race, as female residents are more likely to experience decreased well-being and residents who are Black/Asian/Hispanic/other are more likely to experience burnout (EE and DP). Those with higher scores in resilience and gratitude at baseline do better in our primary outcomes, and those with high intolerance of uncertainty experience significantly higher EE and DP.

The positive psychology component of this program allows for the opportunity to explore the modifiable traits that can impact an individual’s well-being and burnout, including effective response to stress and tolerance of uncertainty. Goal setting, reflection, and receiving feedback are core components of a coaching relationship. In our bivariate and multivariate analyses, the increased practice of reflection was significantly associated with improved well-being and goal setting practices with reduced burnout. This finding is consistent with our prior research, which linked high EE with reflecting less often.17 Reflection is a core coaching skill emphasized in trainings; which helps coachees explore their experiences, motivations, positive emotions, and strengths.13, 14 Based on this analysis, we propose that a coaching program can offer deliverables to support resident well-being, including time, space, and tools for setting goals, reflecting, and receiving feedback.

Interns in this study showed high resilience at baseline, similar to West et al.’s study.11 The finding of better EE and PERMA in those with the highest resilience suggests learning skills to help cope with stress effectively may be useful to improve well-being for interns. Previously, the PDCP has been shown to provide coping skills in areas of greatest stress for interns, such as work-life balance, working relationships, information processing, work hours, and self-confidence.17 Greater than two-thirds of respondents agreed that this program helped them with coping skills to respond to stressors in these areas, suggesting that this program can be useful to develop skills to improve resilience, which is shown here to be strongly protective against burnout. Managing uncertainty, a key skill throughout physician practice, and developing coping skills through reflection opportunities are target areas for further evolution of the coaching program, and we believe this finding is useful in helping residency programs address well-being.

In previous evaluations of this coaching program, our ability to analyze gender, race, and ethnicity was limited. In this analysis, we learn that Black/Asian/Hispanic/other residents experience higher burnout than their non-Hispanic white peers, and male residents experience higher well-being than female residents. This warrants further exploration in future studies to discover if different coaching approaches are needed to address structural racism and gender bias within the coaching intervention or within organizations. In recent years, multiple studies have explored resident experience of bias.27,28,29,30 These experiences can lead to increased stress, lower well-being, impaired coping, and increased burnout.31, 32 The coaching relationship may provide an important layer of support for residents to address the role implicit bias, imposter phenomenon, and microaggressions may have in daily intern experiences.

We acknowledge several limitations in this multisite study. This study is not a randomized controlled trial (RCT). This study is also limited by a low survey response rate that varied across sites. Sites are heterogenous in their experiences and local culture, which may impact generalizability in understanding and applying these results. While coaches at all sites were trained by the same subject matter expert, the implementation and support at each site were variable. Based on this experience, we recommend institutions wishing to adopt such a program have an appointed faculty champion with administrative support and incentives to improve participation in measurements. We also do not have a means to evaluate the efficacy of the coach themselves, understanding that this is high-level communication skill that we are teaching over the course of a 3-h workshop. Future studies on the efficacy of the coach as well as the role the coach’s well-being may play in the relationship would be useful. Additionally, in this study, we address differences in outcomes based on race and ethnicity though we are limited by the low number of interns who are under-represented in medicine (URiM). A future study with greater number of URiM interns can help explore these associations and outcomes further.

A potential limitation to these findings might be the perceived impact that small differences in these scales have on physician burnout or well-being. We believe the subtle nuances within these parameters may provide insight into the multifactorial nature of physician well-being. While this cannot be answered in a prospective cohort study such as this, we anticipate that an RCT might further elucidate these subtleties and the impact of coaching. One hypothesis that could be explored in an RCT is whether no change is actually an improvement compared to someone who is not receiving coaching. Given the many ways that internship can change an individual in this formative time, it may be that stability is in fact success, given what is known about increasing rates of burnout across the trajectory of a physician’s career.3, 4, 11

The costs of this program were minimized for sustainability. Coaching materials have been published to aid residencies in onboarding a similar program.18 Still, we recognize that not all programs can implement a program like this. For these programs, we believe that incorporating coaching into existing advising and mentorship programs would benefit resident well-being. The question of the difference between coaching and mentoring is often raised, and why coaching is needed if well-structured mentoring programs exist. It should be noted that this coaching program was initiated in residencies with existing mentorship programs, who were seeking additional ways to support trainee well-being. Coaching provides a non-evaluative, safe space where the personal and professional journeys of these trainees can co-exist and be explored.

Residency programs should consider formal assessments of well-being and predictive factors early in the intern year to help target support for residents who may not arrive at internship with coping, resilience, and other skills. Organizational investments in faculty education in coaching and communication skills may help residents build in time and space for goal setting and reflection. Organizations also need to measure and understand factors in their culture that may contribute to disparities in the resident experience by race and gender. Providing support, coaching, or otherwise, that targets tolerance of uncertainty, resilience, and reflection, may improve resident burnout and well-being.