Abstract
Purpose
Physician wellbeing is critical to high-quality sustainable healthcare and optimal patient experience. Few objective measures exist to assay wellbeing (as opposed to just pathology) in surgery, or to evaluate the efficacy of wellbeing interventions. Flourishing (as measured by the Mental Health Continuum, MHC) has been suggested as a concise measure of global wellbeing in surgeons. We aimed to establish validity evidence for flourishing in a large national sample of surgical trainees, explore differences by gender and race, and confirm support for the underlying constructs.
Methods
This cross-sectional study of all General Surgery residents at 16 ACGME-accredited academic programs included an online survey of published measures distributed in February 2021. The Mental Health Continuum (MHC), a three-factor model, assesses emotional, social, and psychological wellbeing and is an established metric of psychosocial thriving in non-physicians. A global score cut-off exists for flourishing which represents high wellbeing. Correlation between flourishing and established measures of risk and resilience in surgery were assessed for validity evidence. Differences by gender and race were explored. A confirmatory factor analysis (CFA) was performed to confirm the three-factor structure in surgical trainees.
Results
300 residents (60% non-male, 41% non-white) responded to the survey. For the overall group, flourishing was significantly positively correlated with all wellbeing resilience factors and negatively correlated with all risk factors. This held true for race and gender subgroups based on interaction analyses. CFA and sensitivity analysis results supported the three-factor structure.
Conclusions
Our findings offer validity evidence for flourishing as a measure of global wellbeing and confirm the three-factor structure of emotional, social, and psychological wellbeing in surgical trainees. Thus, the MHC may be a concise tool for assaying wellbeing, within and across subgroups, and for assessing wellbeing intervention effectiveness within the surgery.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Background
A critical balance exists between the inherent physical, psychological, and existential challenges of surgery and each surgeon’s reservoir of wellbeing [10, 25]. As a profession, surgery has the potential to deliver deep satisfaction and a sense of realized purpose. Yet, endless non-medical administrative responsibilities, the erosion of work-life boundaries, and an increasingly industrialized approach to healthcare threaten to overwhelm the rewards of this profession [77]. As a result, surgeons are at risk for pathology such as burnout and post-traumatic stress disorder [29, 41, 44], and patients are at risk of suboptimal care or loss of the precious physician–patient bond. International consensus recognizes that safe sustainable healthcare, best outcomes for patients, and the maintenance of ethical standards in medicine depend on prioritizing workplace systems and culture that promote physician wellbeing [6, 8, 10, 42, 43, 67].
However, due to the lack of tools for assessing global wellbeing in surgeons, a critical gap in our understanding remains. Without an established measure of wellbeing (one that accounts for individual differences and the modern conceptualization of wellbeing as a complex state of positive affect, belonging, and purpose), [18, 21,22,23, 64], our ability to evaluate individual wellbeing status, assess intervention efficacy, and target precious resources is limited.
In non-physicians, flourishing (as measured by the Mental Health Continuum-Short Form, MHC-SF; for simplicity referred to herein as MHC) is an established metric of clinically-relevant psychosocial thriving defined as emotional, social, and psychological wellbeing. Grounded in theory and empirical evidence, the MHC is widely regarded as an assay of ‘fulfillment’ (as opposed to more fleeting ‘happiness’), reflecting the conceptualization of wellbeing as a state of positive emotions, positive relationships, and a healthy sense of community [19, 34, 36, 61, 63]. In our prior work [42, 43], using a cross-sectional single institution survey, we showed a correlation between flourishing and multiple established wellbeing risk and resilience factors in General Surgery residents, suggesting flourishing may be an accurate metric of psychosocial thriving in surgeons. Further, we found flourishing to be influenced by the (inherent) mindfulness tendencies of residents and by elements of workplace support, suggesting it may be sensitive to certain individual and workplace-level interventions. In a subsequent longitudinal cohort study of mixed-specialty postgraduate year (PGY)-1 trainees who received a tailored mindfulness-based intervention called Enhanced Stress Resilience Training (ESRT) [45], we found flourishing to be significantly positively associated with higher individual mindfulness, higher perceived workplace support, and lower negative emotions (e.g., stress, anxiety), both cross-sectionally and longitudinally. These preliminary studies reinforced our line of reasoning that flourishing may be a measure of global wellbeing in surgical trainees and that modifiable individual and workplace factors exist which may influence flourishing (and, therefore, trainee wellbeing). A large body of research in both behavioral psychology and occupational science shows that individual cognitive training [8, 24], and the provision of workplace support can mitigate workplace stress, increase job satisfaction, and improve clinician wellbeing overall [2, 77, 79]. Nonetheless, knowledge gaps remain that our single-center focus and small sample size could not address.
In the current national study of academic General Surgery programs, we aimed to establish validity evidence for flourishing as a measure of global (i.e., multi-faceted) wellbeing in surgical trainees, exploring differences by gender and race. We hypothesized flourishing would be associated with the presence of factors shown in surgery to influence resilience [37, 42, 43, 45, 57, 58, 79] (i.e., “resilience factors”, like mindfulness, personal accomplishment, and workplace social support) and distress (i.e., “risk factors”, like burnout, job dissatisfaction, and depression) [30, 44, 65, 66, 79]. We further aimed to evaluate the three-factor structure of the MHC using a confirmatory factor analysis (CFA). Thus, the MHC and flourishing may provide metrics for the selection of high impact targets in wellbeing research, measures to assess intervention efficacy in real time, and the means to evaluate individual surgeon wellbeing in a comprehensive and efficient fashion.
Methods
Study design
An online survey instrument was distributed in January 2021 to all preliminary and categorical General Surgery residents (both clinically active and in research) at 16 ACGME-accredited academic training programs representing Western, Mountain, Central and Eastern regions of the US, ranging in size from 21 to 108 residents. Participating programs comprise the General Surgery Research Collaborative on Resident Wellbeing, which evolved during the first surge of Coronavirus Disease 2019 due to outreach from the UCSF Center for Mindfulness in Surgery. Champions at participating programs disseminated the survey to their respective resident bodies. 891 residents across the 16 programs received the survey, which remained open for six weeks. The study was approved by UCSF’s institutional review board and informed consent was obtained for all participants.
Survey instrument
The anonymous survey collected basic demographic information and measured the presence of resilience, which is characterized by high positive emotions, nonreactivity to stressors, and connectedness (as defined by seminal works in the field of resilience science [18, 23, 50, 51, 59, 69] and used in prior studies as proxy measures of wellbeing [10, 42, 42, 43, 43, 44, 46, 53]). The survey further measured distress, characterized by high burnout, stress, anxiety or depressive symptoms (as defined by multiple works exploring distress in surgery and perceived in the literature to be discordant with wellbeing [28, 44, 46]. These Likert scale-based measures, found reliable in our prior work with surgical trainees, were scored according to published methods described hereinafter.
Our primary outcome variable, flourishing, was assessed through the Mental Health Continuum-Short Form (MHC-SF), a 14-item measure of psychosocial wellbeing with a three-factor model reflecting social, emotional, and psychological mental health domains, with high internal consistency (> 0.80) [33] and supporting literature base of clinical relevance [25]. Similar to standard diagnostic criteria for depression, the MHC-SF items are scored according to the frequency with which respondents experience each symptom of positive mental health. Per convention, categorical designation using this measure is not limited to a specific numeric cut-off. Rather, flourishing represents experiencing high positive functioning and high positive emotions ‘every day’ or ‘almost every day.’ Scores can also be treated continuously [40]. In our work, we use both the categorical (i.e., ‘flourishing’) and continuous (i.e., ‘MHC score’) forms.
To assess individual-level risk and resilience factors, we used several published, widely accepted measures from our prior work. The Cognitive Affective Mindfulness Scale-Revised (CAMS-R) is a 10-item measure of both dispositional and trained mindfulness in the form of attention, present-focus, awareness, and acceptance, with internal consistency (0.7–0.74) [20] and a calculated global score sensitive to mindfulness training [25]. Higher CAMS-R scores are associated with lower odds of distress in surgical trainees [20, 44]. The abbreviated Maslach Burnout Inventory (MBI) is a 9-item validated screen [48] for high emotional exhaustion, depersonalization, and personal accomplishment (use and scoring described by McManus et al. [52]) associated with multiple negative sequelae in surgical trainees [17, 37, 42,43,44]. Cohen’s Perceived Stress Scale (PSS) is a 10-item widely-used measure of stress, with high internal consistency (> 0.80) [12, 54] with normative data for men and women aged 18–34. High PSS scores correlate with cognitive impairment, missed work and disability [55]. Spielberger’s State Trait Anxiety Index (STAI) is a 6-item measure of subjective feelings (e.g., apprehension, tension) and autonomic arousal [1, 26, 39, 71, 73] correlated with state anxiety. A cutoff of ≥ 40 was used in other studies to denote high anxiety [1, 39]. In surgical trainees, during real-life and simulated trauma scenarios the STAI has high internal consistency (0.92) ([72]. The Patient Health Questionnaire-8 (PHQ-8) is an 8-item rigorously evaluated and validated depression screening tool [15] with high internal consistency (0.88) [68]. A total score of > / = 10 is correlated with increased use of clinical resources [63].
Finally, we explored the influence of risk and resilience factors within the workplace through the Swedish Demand-Control-Support Questionnaire (DCSQ), which is a 16-item measure of job strain with good internal consistency (0.7–0.85) [57, 58] rooted in Job Demand-Resource theory, with subdomains for Demand, Control and Support. High workplace demand and low control are known risks for job strain, while high workplace control and social support are shown to decrease risk and mitigate the effects of demand [13, 57, 58]. High subdomain designations are defined as scores within the upper third of the total possible score [57, 58].
Data analysis
Survey respondents of all PGY-years (including research residents) were included in our data analysis given our aim to establish validity evidence for flourishing as a measure of global wellbeing in residents undergoing surgical training at academic programs, which by default include residents undertaking research years. Correlation between the binary flourishing variable and each risk and resilience factor was assessed using logistic regression. Correlation between total MHC score and each risk and resilience factor was assessed using linear regression. Unadjusted logistic regression models for flourishing vs. all risk and resilience factors and unadjusted linear regression models for MHC score vs. all risk and resilience factors with gender and race interaction were performed. Hypothesis tests were two-sided, and the significance threshold was set to 0.05. Statistical analyses were performed using SAS version 9.4.
To evaluate the three-factor structure of the MHC in surgical trainees, confirmatory factor analysis (CFA) of the MHC’s three factors (emotional, social, and psychological wellbeing) was conducted using a Full Information Maximum Likelihood (FIML) method of the CALIS procedure in SAS. CFA is a hypothesis testing analytic technique belonging to the structural equation modeling framework. It examines the covariance structure of variables to “confirm” (verify) the hypothesized relationship using a smaller number of unobserved (latent) variables called factors. We hypothesized that the three-factor model would be supported, verifying that the MHC measures social, emotional, and psychological mental health domains. Demonstrating the three-factor structure in surgical trainees would allow relationships between latent factors and other concepts (such as the risk of developing suicidality or workplace absenteeism) to be reliably compared across groups, allowing us to attribute differences in scores to the groups themselves, not to the items functioning differently.
To assess the adequacy of the model, we examined multiple indices, rather than a single fit index [4, 7, 11, 76], including Bentler’s Comparative Fit Index (CFI) [3], the maximum likelihood (ML)-based standardized root mean residual (SRMR), and root mean square error of approximation (RMSEA) [9, 74]. CFI values of at least 0.9 and SRMR values less than 0.08 were used to indicate acceptable fit, by convention using 0.6 as the cut-off for acceptable loading [27]. Values of 0.05 or less on the RMSEA were used to indicate a close fit, values above 0.05 and below 0.1 indicate adequate fit, and values greater than 0.1 are unacceptable. Standardized loading estimates and subscale correlations were calculated and were used together with information from the multiple fit indices, to determine the wellness of fit [11]. A sensitivity CFA was also performed, removing two items from the model with the lowest loading estimates.
Results
Respondents
300 residents (60% non-male, 41% non-white) responded to the survey, representing a 34% response rate (Table 1). While the distribution of our respondents by PGY-level is on par with the demographics of the entire body of US General Surgery residents [17, 81], it is slightly skewed toward non-male and non-white residents.
Validity evidence for flourishing as a measure of wellbeing in surgical trainees
Both flourishing as defined by MHC cut-off and total MHC score were significantly positively correlated with all measured resilience factors (high mindfulness, personal accomplishment, workplace support and perceived workplace control) and significantly negatively correlated with all measured risk factors (high depression, emotional exhaustion, depersonalization, stress, anxiety, and perceived workplace demand) (Table 2).
Validity evidence for flourishing as a measure of wellbeing by race and gender
Our sample was not powered to perform subgroup analyses. Thus, to establish validity evidence for flourishing as a measure of global wellbeing across gender and race subgroups, we performed interaction analyses exploring for differences in the influence of risk and resilience factors on flourishing/MHC score by gender-identity and race. DCSQ-control was positively associated with MHC score for males and non-males, but the effect was significantly greater for males with a 1.36 greater increase in MHC score per each unit increase in DCSQ-control (interaction estimate = 1.36, SE = 0.68, p = 0.05). Interaction analysis did not reveal any other significantly different effects in terms of gender or race.
Confirmatory factor analysis
The sample size was sufficient for the CFA [5, 38, 62]. Overall determination of model fit was based on three methods: model fit indices, covariance structure, and factor correlations representing internal consistency. The model had the following fit index values: CFI = 0.89, SRMR = 0.066, RMSEA = 0.126. By conventional standards, CFI and the RMSEA each indicate an inadequate fit (CFI < 0.9, RMSEA > 0.1), but the SRMR indicates acceptable fit (< 0.08) representing a lack of consensus. Table 3 presents the covariance structure analysis, the standardized factor loading estimates, and standard errors for each item. All factor loadings are statistically significant (p < 0.0001), indicating that the prescribed relationships between each item and its allotted factor exist, and all loading estimates are greater than 0.6. In addition, all factors are significantly correlated with each other (p < 0.001 for correlation), as expected. The covariance structure analysis and factor correlations (Table 3) largely support the proposed model, overall confirming the three-factor structure.
Sensitivity analysis
A sensitivity analysis was conducted to determine the impact of removing two items from the model with the lowest loading estimates, both from the construct subdomain of social wellbeing (MHC7 ‘During the past month, how often did you feel…that people are basically good?’, estimate 0.617, and MHC8 ‘…that the way our society works made sense to you?’, estimate 0.648). Removal of these two items produced similar results but with improved fit index values (CFI = 0.97, SRMR = 0.032, RMSEA = 0.077), making the SRMR and RMSEA both acceptable (< 0.08) and the CFI fit good (> 0.95). Table 4 presents standardized factor loading estimates from the sensitivity analysis model.
Discussion
In this national cross-sectional study of mixed-PGY trainees at 16 academic General Surgery Residency programs, we aimed to 1) establish validity evidence for flourishing as a measure of global wellbeing in surgical trainees, 2) assess whether evidence of validity remains regardless of gender or race, and 3) confirm that the three-factor construct underlying the MHC is supported. Our results revealed three key findings regarding General Surgery trainees: first, our data offer validity evidence for flourishing as a measure of individual global wellbeing within this population, regardless of gender or race; second, the magnitude of the effect of workplace control on MHC score differs by gender; and third, the three-factor construct of the MHC (as a measure of emotional, social and psychological wellbeing) holds.
Our first finding, that our data offer validity evidence for flourishing as a measure of individual global wellbeing in General Surgery trainees is evidenced by the positive association between flourishing and established resilience factors in surgery such as high coping skills (i.e., mindfulness) [42, 43, 47], self-efficacy (i.e., personal accomplishment) [37], and job satisfaction (i.e., perceived workplace support and control) [2, 77, 79]. This is further evidenced by the negative association between flourishing and established risk factors in surgery such as signs of distress (i.e., high stress, depression, and anxiety) [25, 30, 44, 65, 66, 79], and job strain (i.e., high perceived workplace demand) [13, 29, 42, 43]. These same relationships were reiterated across gender and race subgroups and for the total MHC score as a continuous variable.
By definition, flourishing represents the presence of high emotional, social, and psychological functioning, fundamental characteristics of the resilient phenotype as demonstrated in multiple high-stress populations [51, 69, 70, 78, 80]. There is a substantial body of literature demonstrating the clinical relevance of both trait resilience and high MHC/flourishing, linking them to reduced risk of mental illness, suicidality, burnout and healthcare utilization [42, 43, 61], thus supporting their relevance to other metrics of high interest in regard to surgeon performance, health and longevity [19, 35, 36, 61]. As such, the MHC could serve as a 14-item screen for wellbeing among individual trainees, allowing us a more nimble means of assessing individual status both cross-sectionally and longitudinally. This represents a shift, away from the current focus on trainee pathology and towards the pursuit of multi-dimensional thriving within trainees and in the field. Finally, the sensitivity of flourishing (and MHC score) to individual factors as well as workplace systems (Control and Demand) and culture (Support), suggests this measure might be useful to both assess the efficacy of interventions and to identify maladaptive workplace elements—providing guidance for resources and targets.
Our second finding, that the magnitude of the effect of workplace control on MHC score differs by gender, is evidenced by the significantly greater increase in MHC score per each unit increase in DCSQ-control score for males compared to non-males, as determined by interaction analysis. Job Demand-Resource theory suggests that job strain (which includes burnout) develops in settings where workplace demands outstrip resources [14, 56] resulting in job dissatisfaction and even pathology [49, 57, 58, 60]. A large body of empirical work shows that the negative effects of demanding work can be mitigated through increased workplace control (i.e., decision-making latitude) and support (i.e., internal resources such as coping skills, and/or external resources such as acknowledgement and appreciation) [57, 58]. In the general population, control is especially influential on job satisfaction vs strain in males [57, 58] and this relationship appears to be reiterated among male surgical trainees. This suggests that interventions aimed at understanding and increasing workplace control may prove especially beneficial to male trainee wellbeing.
Our third finding, that the three-factor construct of the MHC holds for surgical trainees, is evidenced by our confirmatory factor analysis (CFA) and sensitivity analysis (SA) which respectively show acceptable or good index fit. The latter was obtained with the removal of MHC questions 7, “How often did you feel…that people are basically good?”, and 8, “…that the way our society works made sense to you?”, which is intriguing considering the presumed prevalence of high altruism and high efficacy in surgical trainees. However, according to the MHC’s creator [32], item 7 is actually meant to reflect ‘acceptance’ and item 8 ‘social coherence’. This may explain our findings, as the ‘surgical personality’ has often been described as decisively assertive (not particularly accepting) and independent (not necessarily oriented toward being part of the group) [75]. This raises the question of how to best conceptualize social wellbeing in surgeons, suggesting value in further exploration.
Support for the MHC factor structure has been shown across cultures [31], demographics, health indicators, and time, suggesting that differences in score between groups can be attributed to the group rather than to items functioning differently. This is particularly important because it allows us to link MHC scores in surgery to risks and diagnoses established in other settings. Moreover, a multifaceted construct allows for wellbeing to be evaluated as a complex and individual experience comprising elements (and ratios of elements) that differ across individuals. As such, support for a three-factor construct means we may be able to evaluate wellbeing in spite of differences between individuals and within individuals as they change over time. This remains to be tested.
Limitations
While our findings are promising in terms of offering validity evidence for a clinically relevant, and sensitive measure of global wellbeing in surgical trainees, they should be viewed in the context of several limitations. Our study sample size was adequate for our analyses but inadequate for performing subgroup analyses such as interaction effects by individual PGY-level and CFA by gender, race or individual PGY-level. More granular exploration of this type is essential to our comprehensive understanding of the MHC instrument and how flourishing relates to surgical training, but will require additional research. Our study population was limited to Academic General Surgery programs, which precludes capturing the differential experience of residents at Military or Community-based programs, thus limiting the generalizability of our results. Our response rate was 34% and thus possibly biased toward particularly high-performing trainees (with more discretionary time to reply) or those who are particularly distressed (with more need for an outlet). Similarly, the higher prevalence of non-male and non-white respondents in our survey may reflect over-representation of individuals with uniquely high resilience (able to overcome the adversity inherent to underrepresented groups advancing in medicine) [16] or those with uniquely high distress (due to inherent discrimination) [28]. In all these regards, reproducing our study in a comprehensive national sample would be the ideal setting to confirm and expand on our findings. Finally, our survey did not inquire about experiences with wellbeing interventions prior to residency, participants’ conceptualization of wellbeing, nor individuals current strategies to improve wellbeing. These elements were outside the scope of the present study and are reserved for future exploration.
Conclusions
Our results offer validity evidence for flourishing, as measured by the MHC, as a metric of global wellbeing in surgical trainees and suggest that the three-factor construct of emotional, social and psychological wellbeing is supported. Thus, the MHC has promise as a measure of multifaceted wellbeing in individual trainees, as a method for identifying impactful targets, and as a means of evaluating the efficacy of wellbeing interventions.
Data availability
The datasets generated and analyzed during the current study are available from the corresponding author on reasonable request.
References
Addolorato G, Ancona C, Capristo E, Graziosetto R, Di Rienzo L, Maurizi M, Gasbarrini G. State and trait anxiety in women affected by allergic and vasomotor rhinitis. J Psychosom Res. 1999;46(3):283–9. https://doi.org/10.1016/s0022-3999(98)00109-3.
Baathe F, Rosta J, Bringedal B, Rø KI. How do doctors experience the interactions among professional fulfilment, organisational factors and quality of patient care? A qualitative study in a Norwegian hospital. BMJ Open. 2019;9(5): e026971. https://doi.org/10.1136/bmjopen-2018-026971.
Bentler PM. Comparative fit indexes in structural models. Psychol Bull. 1990;107(2):238–46. https://doi.org/10.1037/0033-2909.107.2.238.
Bentler PM. On tests and indices for evaluating structural models. Personality Individ Differ. 2007;42(5):825–9. https://doi.org/10.1016/j.paid.2006.09.024.
Bentler PM, Chou C-P. Practical issues in structural modeling. Sociol Methods Res. 1987;16(1):78–117. https://doi.org/10.1177/0049124187016001004.
Bodenheimer T, Sinsky C. From triple to quadruple aim: care of the patient requires care of the provider. Ann Fam Med. 2014;12(6):573–6. https://doi.org/10.1370/afm.1713.
Bollen KA, Long JS. Testing structural equation models. Sage Publications; 1993.
Brigham T, Barden C, Dopp AL, Hengerer A, Kaplan J, Malone B, Martin C, McHugh M, Nora LM. A journey to construct an all-encompassing conceptual model of factors affecting clinician well-being and resilience. NAM Perspectives; 2018. https://doi.org/10.31478/201801b
Browne MW, Cudeck R. Alternative ways of assessing model fit. In: Bollen K, Long J, editors. Testing structural equation models. Sage Publications; 1993. p. 136–62.
Carayon P, Cassel C, Dzau VJ. Improving the system to support clinician well-being and provide better patient care. JAMA. 2019;322(22):2165–6. https://doi.org/10.1001/jama.2019.17406.
Chen F, Curran PJ, Bollen KA, Kirby J, Paxton P. An empirical evaluation of the use of fixed cutoff points in RMSEA test statistic in structural equation models. Sociol Methods Res. 2008;36(4):462–94. https://doi.org/10.1177/0049124108314720.
Cohen S, Janicki-Deverts D. Who’s stressed? Distributions of psychological stress in the United States in probability samples from 1983, 2006, and 20091: PSYCHOLOGICAL STRESS IN THE U.S. J Appl Social Psychol. 2012;42(6):1320–34. https://doi.org/10.1111/j.1559-1816.2012.00900.x.
Crawford ER, Lepine JA, Rich BL. Linking job demands and resources to employee engagement and burnout: a theoretical extension and meta-analytic test. J Appl Psychol. 2010;95(5):834–48. https://doi.org/10.1037/a0019364.
Demerouti E, Bakker AB, Nachreiner F, Schaufeli WB. The job demands-resources model of burnout. J Appl Psychol. 2001;86(3):499–512. https://doi.org/10.1037/0021-9010.86.3.499.
Dhingra SS, Kroenke K, Zack MM, Strine TW, Balluz LS. PHQ-8 days: a measurement option for DSM-5 major depressive disorder (MDD) severity. Popul Health Metrics. 2011;9(1):11. https://doi.org/10.1186/1478-7954-9-11.
Dyrbye LN, Power DV, Massie FS, Eacker A, Harper W, Thomas MR, Szydlo DW, Sloan JA, Shanafelt TD. Factors associated with resilience to and recovery from burnout: a prospective, multi-institutional study of US medical students. Med Educ. 2010;44(10):1016–26. https://doi.org/10.1111/j.1365-2923.2010.03754.x.
Ellis RJ, Nicolas JD, Cheung E, Zhang L, Ma M, Turner P, Nussbaum MS, Are C, Smink DS, Etkin C, Bilimoria KY, Hu Y-Y. Comprehensive characterization of the general surgery residency learning environment and the association with resident burnout. Ann Surg. 2021;274(1):6–11. https://doi.org/10.1097/SLA.0000000000004796.
Farb N, Daubenmier J, Price CJ, Gard T, Kerr C, Dunn BD, Klein AC, Paulus MP, Mehling WE. Interoception, contemplative practice, and health. Front Psychol. 2015;6:763. https://doi.org/10.3389/fpsyg.2015.00763.
Faulk KE, Gloria CT, Steinhardt MA. Coping profiles characterize individual flourishing, languishing, and depression. Anxiety Stress Coping. 2013;26(4):378–90. https://doi.org/10.1080/10615806.2012.708736.
Feldman G, Hayes A, Kumar S, Greeson J, Laurenceau J-P. Mindfulness and emotion regulation: the development and initial validation of the cognitive and affective mindfulness scale-revised (CAMS-R). J Psychopathol Behav Assess. 2006;29(3):177. https://doi.org/10.1007/s10862-006-9035-8.
Fredrickson BL. The broaden-and-build theory of positive emotions. Philos Trans R Soc London B, Biol Sci. 2004;359(1449):1367–78. https://doi.org/10.1098/rstb.2004.1512.
Fredrickson BL, Branigan C. Positive emotions broaden the scope of attention and thought-action repertoires. Cogn Emot. 2005;19(3):313–32. https://doi.org/10.1080/02699930441000238.
Garland EL, Farb NA, Goldin P, Fredrickson BL. Mindfulness broadens awareness and builds eudaimonic meaning: a process model of mindful positive emotion regulation. Psychol Inq. 2015;26(4):293–314. https://doi.org/10.1080/1047840X.2015.1064294.
Garland EL, Gaylord SA, Fredrickson BL. Positive reappraisal mediates the stress-reductive effects of mindfulness: an upward spiral process. Mindfulness. 2011;2(1):59–67. https://doi.org/10.1007/s12671-011-0043-8.
Grant F, Guille C, Sen S. Well-being and the risk of depression under stress. PLoS ONE. 2013;8(7): e67395. https://doi.org/10.1371/journal.pone.0067395.
Harvey A, Bandiera G, Nathens AB, LeBlanc VR. Impact of stress on resident performance in simulated trauma scenarios. J Trauma Acute Care Surg. 2012;72(2):497–503. https://doi.org/10.1097/ta.0b013e31821f84be.
Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling. 1999;6(1):1–55. https://doi.org/10.1080/10705519909540118.
Hu Y-Y, Ellis RJ, Hewitt DB, Yang AD, Cheung EO, Moskowitz JT, Potts JR, Buyske J, Hoyt DB, Nasca TJ, Bilimoria KY. Discrimination, abuse, harassment, and burnout in surgical residency training. N Engl J Med. 2019;381(18):1741–52. https://doi.org/10.1056/NEJMsa1903759.
Jackson TN, Jackson DL, Nelson PR, Kim DY, Agrawal V, Truitt MS. Traumatized attendings—when the doctor has the disease. Am J Surg. 2021;S0002–9610(21):00290–7. https://doi.org/10.1016/j.amjsurg.2021.05.010.
Jackson TN, Pearcy CP, Khorgami Z, Agrawal V, Taubman KE, Truitt MS. The physician attrition crisis: a cross-sectional survey of the risk factors for reduced job satisfaction among US surgeons. World J Surg. 2018;42(5):1285–92. https://doi.org/10.1007/s00268-017-4286-y.
Joshanloo M, Wissing MP, Khumalo IP, Lamers SMA. Measurement invariance of the Mental Health Continuum-Short Form (MHC-SF) across three cultural groups. Personality Individ Differ. 2013;55(7):755–9. https://doi.org/10.1016/j.paid.2013.06.002.
Keyes CLM. The mental health continuum: from languishing to flourishing in life. J Health Soc Behav. 2002;43(2):207–22.
Keyes CLM. Mental illness and/or mental health? Investigating axioms of the complete state model of health. J Consult Clin Psychol. 2005;73(3):539–48. https://doi.org/10.1037/0022-006X.73.3.539.
Keyes CLM, Dhingra SS, Simoes EJ. Change in level of positive mental health as a predictor of future risk of mental illness. Am J Public Health. 2010;100(12):2366–71. https://doi.org/10.2105/AJPH.2010.192245.
Keyes CLM, Eisenberg D, Perry GS, Dube SR, Kroenke K, Dhingra SS. The relationship of level of positive mental health with current mental disorders in predicting suicidal behavior and academic impairment in college students. J Am Coll Health. 2012;60(2):126–33. https://doi.org/10.1080/07448481.2011.608393.
Keyes CLM, Simoes EJ. To flourish or not: positive mental health and all-cause mortality. Am J Public Health. 2012;102(11):2164–72. https://doi.org/10.2105/AJPH.2012.300918.
Khorfan R, Hu Y-Y, Agarwal G, Eng J, Riall T, Choi J, Are C, Shanafelt T, Bilimoria KY, Cheung EO. The role of personal accomplishment in general surgery resident well-being. Ann Surg. 2021;274(1):12–7. https://doi.org/10.1097/SLA.0000000000004768.
Kline RB. Principles and practice of structural equation modeling. Guilford; 2015.
Knight RG, Waal-Manning HJ, Spears GF. Some norms and reliability data for the state-trait anxiety inventory and the zung self-rating depression scale. Br J Clin Psychol. 1983;22(4):245–9. https://doi.org/10.1111/j.2044-8260.1983.tb00610.x.
Lamers SMA, Westerhof GJ, Bohlmeijer ET, ten Klooster PM, Keyes CLM. Evaluating the psychometric properties of the Mental Health Continuum-Short Form (MHC-SF). J Clin Psychol. 2011;67(1):99–110. https://doi.org/10.1002/jclp.20741.
Lebares CC. From challenge to change in surgery. Am J Surg. 2021. https://doi.org/10.1016/j.amjsurg.2021.09.002.
Lebares CC, Coaston TN, Delucchi KL, Guvva EV, Shen WT, Staffaroni AM, Kramer JH, Epel ES, Hecht FM, Ascher NL, Harris HW, Cole SW. Enhanced stress resilience training in surgeons: iterative adaptation and biopsychosocial effects in 2 small randomized trials. Ann Surg. 2021;273(3):424–32. https://doi.org/10.1097/SLA.0000000000004145.
Lebares CC, Greenberg AL, Ascher NL, Delucchi KL, Reilly LM, van der Schaaf M, Baathe F, O’Sullivan P, Isaksson Rø K. Exploration of individual and system-level well-being initiatives at an academic surgical residency program: a mixed-methods study. JAMA Netw Open. 2021;4(1): e2032676. https://doi.org/10.1001/jamanetworkopen.2020.32676.
Lebares CC, Guvva EV, Ascher NL, O’Sullivan PS, Harris HW, Epel ES. Burnout and stress among US surgery residents: psychological distress and resilience. J Am Coll Surg. 2018;226(1):80–90. https://doi.org/10.1016/j.jamcollsurg.2017.10.010.
Lebares CC, Guvva EV, Olaru M, Sugrue LP, Staffaroni AM, Delucchi KL, Kramer JH, Ascher NL, Harris HW. Efficacy of mindfulness-based cognitive training in surgery: additional analysis of the mindful surgeon pilot randomized clinical trial. JAMA Netw Open. 2019;2(5): e194108. https://doi.org/10.1001/jamanetworkopen.2019.4108.
Lebares CC, Hershberger AO, Guvva EV, Desai A, Mitchell J, Shen W, Reilly LM, Delucchi KL, O’Sullivan PS, Ascher NL, Harris HW. Feasibility of formal mindfulness-based stress-resilience training among surgery interns: a randomized clinical trial. JAMA Surg. 2018;153(10): e182734. https://doi.org/10.1001/jamasurg.2018.2734.
Lindsay EK, Chin B, Greco CM, Young S, Brown KW, Wright AGC, Smyth JM, Burkett D, Creswell JD. How mindfulness training promotes positive emotions: dismantling acceptance skills training in two randomized controlled trials. J Pers Soc Psychol. 2018;115(6):944–73. https://doi.org/10.1037/pspa0000134.
Maslach C, Leiter MP. Understanding the burnout experience: recent research and its implications for psychiatry. World Psychiatry. 2016;15(2):103–11. https://doi.org/10.1002/wps.20311.
Maslach C, Schaufeli WB, Leiter MP. Job burnout. Ann Rev Psychol. 2001;52(1):397–422. https://doi.org/10.1146/annurev.psych.52.1.397.
Masten AS. Ordinary magic. Resilience processes in development. Am Psychologist. 2001;56(3):227–38. https://doi.org/10.1037//0003-066x.56.3.227.
Masten AS, Obradovic J. Competence and resilience in development. Ann N Y Acad Sci. 2006;1094:13–27. https://doi.org/10.1196/annals.1376.003.
McManus I, Winder B, Gordon D. The causal links between stress and burnout in a longitudinal study of UK doctors. The Lancet. 2002;359(9323):2089–90. https://doi.org/10.1016/S0140-6736(02)08915-8.
Moutier CY, Myers MF, Feist JB, Feist JC, Zisook S. Preventing clinician suicide: a call to action during the COVID-19 pandemic and beyond. Acad Med. 2021;96(5):624–8. https://doi.org/10.1097/ACM.0000000000003972.
Nielsen MG, Ørnbøl E, Vestergaard M, Bech P, Larsen FB, Lasgaard M, Christensen KS. The construct validity of the Perceived Stress Scale. J Psychosom Res. 2016;84:22–30. https://doi.org/10.1016/j.jpsychores.2016.03.009.
Nordin M, Nordin S. Psychometric evaluation and normative data of the Swedish version of the 10-item perceived stress scale. Scand J Psychol. 2013;54(6):502–7. https://doi.org/10.1111/sjop.12071.
Pelfrene E, Vlerick P, Mak RP, De Smet P, Kornitzer M, De Backer G. Scale reliability and validity of the Karasek “Job Demand-Control-Support” model in the Belstress study. Work Stress. 2001;15(4):297–313. https://doi.org/10.1080/02678370110086399.
Sanne B, Mykletun A, Dahl AA, Moen BE, Tell GS. Testing the Job Demand-Control-Support model with anxiety and depression as outcomes: The Hordaland Health Study. Occup Med (Oxford, England). 2005;55(6):463–73. https://doi.org/10.1093/occmed/kqi071.
Sanne B, Torp S, Mykletun A, Dahl AA. The Swedish Demand-Control-Support Questionnaire (DCSQ): factor structure, item analyses, and internal consistency in a large population. Scand J Public Health. 2005;33(3):166–74. https://doi.org/10.1080/14034940410019217.
Sapienza JK, Masten AS. Understanding and promoting resilience in children and youth. Curr Opin Psychiatry. 2011;24(4):267–73. https://doi.org/10.1097/YCO.0b013e32834776a8.
Schaufeli WB. Applying the job demands-resources model. Organ Dyn. 2017;46(2):120–32. https://doi.org/10.1016/j.orgdyn.2017.04.008.
Schotanus-Dijkstra M, Ten Have M, Lamers SMA, de Graaf R, Bohlmeijer ET. The longitudinal relationship between flourishing mental health and incident mood, anxiety and substance use disorders. Eur J Pub Health. 2017;27(3):563–8. https://doi.org/10.1093/eurpub/ckw202.
Schreiber JB, Stage FK, King J, Nora A, Barlow EA. Reporting structural equation modeling and confirmatory factor analysis results: a review. J Educ Res. 2006;99(6):323–37. https://doi.org/10.3200/JOER.99.6.323-338.
Sen S, Kranzler HR, Krystal JH, Speller H, Chan G, Gelernter J, Guille C. A prospective cohort study investigating factors associated with depression during medical internship. Arch Gen Psychiatry. 2010;67(6):557–65. https://doi.org/10.1001/archgenpsychiatry.2010.41.
Senturk JC, Melnitchouk N. Surgeon burnout: defining, identifying, and addressing the new reality. Clin Colon Rectal Surg. 2019;32(6):407–14. https://doi.org/10.1055/s-0039-1692709.
Shanafelt TD, Balch CM, Bechamps GJ, Russell T, Dyrbye L, Satele D, Collicott P, Novotny PJ, Sloan J, Freischlag JA. Burnout and career satisfaction among American surgeons. Ann Surg. 2009;250(3):463–71. https://doi.org/10.1097/SLA.0b013e3181ac4dfd.
Shanafelt TD, Balch CM, Bechamps G, Russell T, Dyrbye L, Satele D, Collicott P, Novotny PJ, Sloan J, Freischlag J. Burnout and medical errors among American surgeons. Ann Surg. 2010;251(6):995–1000. https://doi.org/10.1097/SLA.0b013e3181bfdab3.
Shanafelt TD, Noseworthy JH. executive leadership and physician well-being: nine organizational strategies to promote engagement and reduce burnout. Mayo Clin Proc. 2017;92(1):129–46. https://doi.org/10.1016/j.mayocp.2016.10.004.
Shin C, Lee S-H, Han K-M, Yoon H-K, Han C. Comparison of the usefulness of the PHQ-8 and PHQ-9 for screening for major depressive disorder: analysis of psychiatric outpatient data. Psychiatry Invest. 2019;16(4):300–5.
Southwick SM, Bonanno GA, Masten AS, Panter-Brick C, Yehuda R. Resilience definitions, theory, and challenges: interdisciplinary perspectives. Eur J Psychotraumatol. 2014. https://doi.org/10.3402/ejpt.v5.25338.
Southwick SM, Vythilingam M, Charney DS. The psychobiology of depression and resilience to stress: implications for prevention and treatment. Annu Rev Clin Psychol. 2005;1:255–91. https://doi.org/10.1146/annurev.clinpsy.1.102803.143948.
Spielberger CD, Gorsuch RL, Lushene RE. Manual for the state-trait anxiety inventory; 1970 http://ubir.buffalo.edu/xmlui/handle/10477/2895
Spielberger C, Gorsuch R, Lushene R, Vagg P, Jacobs G. Manual for the state-trait anxiety inventory (Form Y1–Y2), vol. IV. Palo Alto, CA: Consulting Psychologists Press; 1983.
Stefanidis D, Anton NE, Howley LD, Bean E, Yurco A, Pimentel ME, Davis CK. Effectiveness of a comprehensive mental skills curriculum in enhancing surgical performance: results of a randomized controlled trial. Am J Surg. 2017;213(2):318–24. https://doi.org/10.1016/j.amjsurg.2016.10.016.
Steiger JH. Point estimation, hypothesis testing, and interval estimation using the RMSEA: some comments and a reply to Hayduk and Glaser. Struct Equ Modeling. 2000;7(2):149–62. https://doi.org/10.1207/S15328007SEM0702_1.
Symer MM, Abelson JS, Yeo HL, Sosa JA, Rosenthal MZ. The surgical personality: does surgery resident motivation predict attrition? J Am Coll Surg. 2018;226(5):777–83. https://doi.org/10.1016/j.jamcollsurg.2018.02.007.
Tanaka JS. Multifaceted conceptions of fit in structural equation models. In: Bollen K, Long J, editors. Testing structural equation models. Sage Publications; 1993. p. 10–40.
Tawfik DS, Profit J, Webber S, Shanafelt TD. Organizational factors affecting physician well-being. Curr Treatment Options Pediatrics. 2019;5(1):11–25. https://doi.org/10.1007/s40746-019-00147-6.
Tugade MM, Fredrickson BL. Resilient individuals use positive emotions to bounce back from negative emotional experiences. J Pers Soc Psychol. 2004;86(2):320–33. https://doi.org/10.1037/0022-3514.86.2.320.
van Wulfften Palthe ODR, Neuhaus V, Janssen SJ, Guitton TG, Ring D, Science of Variation Group. Among musculoskeletal surgeons, job dissatisfaction is associated with burnout. Clin Orthop Related Res. 2016;474(8):1857–63. https://doi.org/10.1007/s11999-016-4848-6.
Vythilingam M, Nelson EE, Scaramozza M, Waldeck T, Hazlett G, Southwick SM, Pine DS, Drevets W, Charney DS, Ernst M. Reward circuitry in resilience to severe trauma: an fMRI investigation of resilient special forces soldiers. Psychiatry Res. 2009;172(1):75–7. https://doi.org/10.1016/j.pscychresns.2008.06.008.
Zhang LM, Ellis RJ, Ma M, Cheung EO, Hoyt DB, Bilimoria KY, Hu Y-Y. Prevalence, types, and sources of bullying reported by US general surgery residents in 2019. JAMA. 2020;323(20):2093–5. https://doi.org/10.1001/jama.2020.2901.
Acknowledgements
Statistical support was expertly provided by Miss Amy Shui, MA from the Biostatistics Core, which is funded by the UCSF Department of Surgery. The Authors within the General Surgery Research Collaborative on Resident Wellbeing includes Celia Divino, MD, Department of Surgery, Icahn School of Medicine at Mount Sinai, New York, NY; Jennifer N. Choi, MD, Department of Surgery, Indiana University, Indianapolis, IN; Jennifer E. Hrabe, MD, Department of Surgery, University of Iowa, Iowa City, IA; Julia S. Shelton, MD, MPH, Department of Surgery, University of Iowa, Iowa City, IA; Christopher M. Foglia, MD, Department of Surgery, New York Presbyterian-Queens, Flushing, NY; Varuna Sundaram, MD, Department of Surgery, New York Presbyterian-Queens, Flushing, NY; Brooke Gurland, MD, Department of Surgery, Stanford University, Stanford, California; David A. Spain, MD, Department of Surgery, Stanford University, Stanford, California; Matthew Hanlon, MD. Department of Surgery, SUNY Upstate Medical University, Syracuse, NY; Andreas H. Meier, MD, MEd, Dr med, Department of Surgery, SUNY Upstate Medical University, Syracuse, NY; Kelly R. Haisley, MD, Department of Surgery, The Ohio State University Wexner Medical Center, Columbus, OH; Alan Harzman, MD, Department of Surgery, The Ohio State University Wexner Medical Center, Columbus, OH; Emily Huang, MD, Department of Surgery, The Ohio State University Wexner Medical Center, Columbus, OH; Jennifer Preston, MD, Department of Surgery, University of Arizona, Phoenix, AZ; Valentine Nfonsam, MD, MS, Department of Surgery, University of Arizona, Tucson, AZ; Taylor S. Riall, MD, PhD, FACS, Department of Surgery, University of Arizona, Tucson, AZ; Barnard J. A. Palmer, MD, MEd, Department of Surgery, UCSF-East Bay, Oakland, CA; Gregory P. Victorino, MD, Department of Surgery, UCSF-East Bay, Oakland, CA; Tim R. Donahue, MD, Department of Surgery, David Geffen School of Medicine at University of California Los Angeles, Los Angeles, CA; Veronica F. Sullins, MD, Department of Surgery, David Geffen School of Medicine at University of California Los Angeles, Los Angeles, CA; Anya L. Greenberg, MBA, Department of Surgery, University of California, San Francisco, San Francisco, CA; Kenzo Hirose, MD, Department of Surgery, University of California, San Francisco, San Francisco, CA; Carter C. Lebares, Department of Surgery, University of California, San Francisco, San Francisco, CA; Linda M. Reilly, MD, Department of Surgery, University of California, San Francisco, San Francisco, CA; Kshama R. Jaiswal, MD, Department of Surgery, University of Colorado, Denver, CO; Mark R. Nehler, MD, Department of Surgery, University of Colorado, Denver, CO; Melissa Brunsvold, MD, Department of Surgery, University of Minnesota, Minneapolis, MN; Daniel E. Kendrick, MD, Department of Surgery, University of Minnesota, Minneapolis, MN; M. Timothy Nelson, MD, Department of Surgery, University of Oklahoma at Tulsa, Tulsa, OK; Robert B. Lim, MD, Department of Surgery, University of Oklahoma at Tulsa, Tulsa, OK; Karen D. Horvath, MD, Department of Surgery, University of Washington, Seattle, WA; Lorrie A Langdale, MD, FACS, Department of Surgery, University of Washington, Seattle, WA; Rebecca Maine, MD, MPH, Department of Surgery, University of Washington, Seattle, WA.
Funding
This study was funded, in part, by the Association for Surgical Education Foundation Platinum Grant (No. 2021-ASEF-P).
Author information
Authors and Affiliations
Consortia
Contributions
Study conception and design: CCL; Acquisition of data: CCL, ALG, CG, JNC, JEH, JSS, CMF, VS, BG, DAS, MH, AHM, KRH, AH, EH, JP, VN, TSR, BJAP, GPV, TRD, VFS, KH, LMR, KRJ, MRN, MB, DEK, MTN, RBL, KDH, LAL, RM; Analysis and interpretation of data: CCL, ALG, CB; Drafting of manuscript: CCL, ALG; Review and editing: CCL.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no competing interests.
Ethical approval
This study was reviewed and approved by the Institutional Review Board at the University of California, San Francisco (UCSF): Study Number 20-32517.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Additional information
The list of authors in the General Surgery Research Collaborative on Resident Wellbeing is mentioned in the Acknowledgements section.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Lebares, C.C., Greenberg, A.L., Gonzales, P.A. et al. Validity evidence for flourishing as a measure of global wellbeing: a national multicenter study of academic general surgery residents. Global Surg Educ 1, 1 (2022). https://doi.org/10.1007/s44186-022-00008-1
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s44186-022-00008-1