What this paper adds

  • A medical student’s ability to utilize resilience strategies to self-regulate behavior is important to the student’s future career as a physician. Educational strategies to facilitate this are important. This study examines the use of a Personal Development competency in a portfolio assessment system to engender reflection on resilience strategies. The study shows that students, with mentorship, are able to identify stressors and articulate resilience strategies to address those stressors.

Introduction

Medical school training is well known to be stressful and associated with a higher than normal risk for burnout [1]. Pressures to perform, heavy workloads, struggles to maintain life balance, limited control, and the unique transformative nature of experiences (i. e. dissecting cadavers, physical exams on patients, dealing with life and death issues with patients, etc.) are but a few of the contributing factors. In addition to dealing with stress directly generated by school experiences, students often, like the rest of us, have to cope with personal life stresses. Hojat and colleagues (1999), in studying 1157 first and second year medical students at one school, noted that 42% of students experienced financial problems, 36% experienced a change in the health of a relative, 26% experienced a personal illness or injury, and 15% experienced a death in the family [2]. Beside personal life issues, studies have examined a variety of other aspects and their relation to student stress, including issues of gender, marriage and children, ethnicity, and personality [1]. It is well known that these student stresses predispose to higher risks of depression, anxiety, substance abuse, struggles with interpersonal relationships, suicide, and burnout (emotional exhaustion, depersonalization and a sense of low personal accomplishment) [3, 4]. Student stressors have also been shown to impact professional effectiveness by contributing to problems with attention, concentration, cynicism, academic dishonesty, poor decision-making and communication skills [3, 4]. The associated risks and impacts of stress on professional life are not just confined to medical school training; they continue during residency and in the subsequent practice of medicine [5, 6]. A recent longitudinal study of 6880 physicians found that 54.4% of physicians reported at least one symptom of burnout in 2014 (up from 45.5% in 2011) and that satisfaction with work-life balance declined from 2011 (48.5%) to 2014 (40.9%) [7].

The literature documenting stressors associated with medical student education is sizeable. Shapiro et al. (2000) found over 600 articles published from 1966–1999 on the subject [3]. However, the literature documenting interventions to prevent distress in medical students is much more limited. They found only 24 studies of the over 600 papers reviewed that reported intervention programmes; only six of these were judged to have employed a rigorous scientific methodology. Schools that did have stress-management programmes demonstrated decreased depression and anxiety among their students, improved knowledge of the effects of stress, a greater utilization of coping strategies, and a better ability to resolve role conflicts. There is some suggestion, in the physician-focused literature, that coaching and supportive relations may contribute to more successful adaptation [8, 9]. A need exists to explore the resilience strategies medical students employ to address this challenge.

In 2004, the Cleveland Clinic Lerner College of Medicine (CCLCM) programme of Case Western Reserve University five-year medical school programme (32 students per class) matriculated its first class with the goal of training physician scientists. Instead of utilizing a traditional, grade-based assessment system for student performance, a portfolio assessment process was adopted to document student performance in nine competencies [10]. For each competency, students are asked to reflect on their performance and formative feedback and self-assess how they are doing with regard to performance standards or milestones. The process is carried out in dialogue with a physician advisor, who serves as a mentor and reality check for the student. Students are encouraged to construct a learning plan [11] in order to address performance deficits and monitor progress. Over the course of the five years, students submit a series of formative portfolios and/or learning plans to their physician advisor for review and discussion. Additionally, at the end of years 1, 2, and 4, students submit summative portfolios to a promotion committee for assessment of progress with regard to meeting competency milestones.

Of the nine CCLCM defined competencies, most of which map to the Accreditation Council for Graduate Medical Education (ACGME) residency competencies, the Personal Development competency is the most unique. This competency is critical in being able to optimally master the other eight competencies; if our future physicians are unable to take care of themselves in the arenas of personal health, stress and time management, and life-balance, how can they do their best job in taking care of patients? Prompts provided to students to facilitate reflection on the milestones in this competency ask students to (1) critically reflect on personal values and priorities with the goal of developing strategies to promote personal growth and (2) identify challenges between personal and professional responsibilities and develop strategies to deal with them. Portfolios provide opportunities for students to self-reflect on their medical school and personal life experiences as they relate to this competency. Our experiences, as a physician advisor since the inception of the programme (RAP) and Director of Student Assessment (EFD), have provided multiple opportunities to review students’ portfolios and note that students discussed resilience strategies in the venue of the Personal Development competency essays.

CCLCM’s assessment system’s emphasis on Personal Development provides a unique opportunity to identify the resilience strategies medical students adopt to alleviate stressors and develop work-life balance. This study uses a retrospective, content analysis of students’ portfolios to explore resilience strategies students employ at different time points to self-regulate their behaviours for the Personal Development competency.

Methods and materials

Institutional Review Board (IRB) approval was obtained prior to commencement of the study.

Forty-nine students were randomly selected in an anonymous fashion from three classes (graduating classes of 2011, 2012 and 2013) with 17 students from the class of 2011, 16 students from the class of 2012 and 16 students from the class of 2011 forming the study group; this corresponds to approximately half of students in each of these classes which was felt to provide a fair representation of students’ perspectives. The Personal Development competency essays from the year 1, year 2 and year 5 summative portfolios were extracted and anonymized by a research coordinator for each of the study subjects. A directed content analysis [12] of the portfolios was performed utilizing a previously defined framework for examining resilience strategies in physicians [9]. Each essay was independently reviewed by two experienced medical educators (RAP, EFD), looking for documentation of resilience strategies. The strategies were coded into one of six general categories (valuing the physician role, self-awareness, personal arena, professional arena, professional support and personal support) based on previous work describing attributes and approaches in building resilience in physicians by Jensen et al. (2008) [9]. The types of strategies included with each of the six categories are summarized in Table 1. In instances where there was a discrepancy in coding, the issue was discussed until an agreement was reached; discrepancies in coding occurred in less than 2% of instances. The Appendix to this paper provides a sampling of quotes taken from various portfolio essays for each of the six coding categories.

In writing their portfolio essays, students are encouraged to cite specific evidence from feedback they have received to substantiate their discussion. Feedback evidence most commonly originated from written assessments provided by faculty and peers [13]. Students are encouraged to also be creative and are permitted to employ other sources of evidence such as emails, reflective pieces they may have written for course work, copies of schedules, etc. The number of pieces of cited evidence for each essay was also documented.

Results

Table 1 summarizes the results of the resilience strategy coding for the 49 reviewed portfolios organized by the student’s year in training during which the portfolio essay was written. All strategies were documented in a subset of portfolio essays in each year. In all years, the most frequently documented strategies were in the personal arena (ranging from 87.8% of year 5 portfolios to 98.0% of year 2 portfolios). In their portfolios, pertinent to this category, students described their extracurricular activities. This included school-related activities, as well as endeavours outside of school, including recreational activities and a wide assortment of personal hobbies. Students also sometimes discussed vacations as part of taking time for themselves and as an opportunity to spend time with family or friends. Less frequently, students discussed their religious beliefs and/or practices as being important to them. Students frequently mentioned exercise, nutrition and sleep-related issues.

Table 1 Summary of resilience strategies documented on portfolios (n = 49 students)

The least cited strategies were those related to professional support in the school environment (ranging from 28.6% in year 5 essays to 42.8% in the year 1 essays). In this arena, students valued the support they received from their peers. They discussed the importance of particular mentors who helped them either in a professional or personal capacity. Rarely did students discuss seeking help from health care professionals in the management of personal, health-related issues.

The most notable difference between 1st and 5th year portfolios was with documentation of personal support strategies, which were much more commonly discussed in year 5 portfolios (79.6%) versus year 1 portfolios (53.1%). Students commonly discussed the role partners, significant others, family and friends play as support systems. Students also occasionally recognized other individuals such as personal physicians or religious figures outside the immediate school environment as sources of support.

The majority of students in all years (>85%) discussed the importance of activities within the professional arena as useful strategies. Many of these centred around activities or curriculum in the school around a variety of aspects of medical school life and included issues such as time management, pursuing a master’s degree, shadowing physicians in order to help with career decision making, skills’ building in the communication arena, career development, assuming leadership roles in various student organizations as well as in activities outside the school venue, reflecting on how to set limits, and strategies focused on how to deal with board exam preparation.

Roughly half of students across all years discussed valuing the physician role and self-awareness issues in their portfolios. Discussions around valuing the physician role focused on subjects of maintaining interest in being a medical student committed to a career as a physician, the importance of contribution to the field of medicine and to patient care, struggling in learning to accept the professional demands of their career choices, the appreciation of the privilege and implications of that responsibility in their current roles and future roles as physicians, learning how to interface with the lives of others (especially patients), maintaining enthusiasm about their patient care role, teaching patients, issues of work ethic and professionalism and extending outside the hospital setting to serving others in the capacity of volunteer work or community service projects.

Discussions around the subject of self-awareness focused on topics of accepting personal limits, stress management, dealing with health issues, finances, self-regulation and self-reflection, and issues related to reflective/portfolio writing itself.

All students formally cited at least one piece of evidence to support their discussions in each essay. The mean number of cited pieces of evidence decreased from 1st to 5th year portfolios: year 1 portfolios – mean of 8 pieces of evidence cited (range 1–31); year 2 portfolios – mean 6 pieces of evidence cited (range 1–30); and year 5 portfolios – mean 5 pieces of evidence cited (range 1–13).

Discussion

The purpose of the current study is to explore resilience strategies students employ in self-regulating their behaviours in the Personal Development arena, as documented in portfolios for different levels of learners. The portfolio provides a tool by which students can engage in reflective practice and provides a potential vehicle for open discussion and possible intervention for students with respect to resilience strategies to address various stressors. Engaging in reflective practice creates an opportunity for the learner to pause and consider varying perspectives, while maintaining an open mind [14]. Reflective practice requires being engaged in actively processing, analyzing and synthesizing experiences and feedback. It challenges one to examine goals, practices and beliefs. Its purpose is to gain insights which culminate in action. To this end and in reflecting on Personal Development, students are encouraged to consider the following: 1) Why do you do what you do? 2) What are the implications of what you do (both immediate and long-term)? 3) Why is it important to change? 4) What is the best way to effect change? and 5) How do you know whether your approach to change is working or not?

Given that it is important to have oversight in high stakes assessments, the student’s physician advisor is an integral part of the CCLCM learning environment and plays a key role in facilitating and monitoring this process, reality checking a student’s perceptions, providing a safe person with whom issues and concerns can be vetted and ensuring an ongoing dialogue around the competencies. Inclusion of Personal Development as a competency on par with eight other competencies (medical knowledge, communication, research, professionalism, interprofessional collaboration, clinical reasoning and skills, health care systems, and reflective practice) sends the message that consideration of this is important; after all, we assess what we value. Milestones provide guidelines which allow students to monitor development in the competency over time.

The current study demonstrated that many students are indeed cognizant of some of the stressors associated with their role and can identify resilience strategies to employ in dealing with some of these stressors. This study also suggests that many students are able to employ external feedback (as documented by cited evidence) to help identify potential issues in this arena, although not all to the same extent.

Not surprisingly, resilience strategies documented in year 1 and 2 are similar. The classroom environment in the first two years of school, which serves as fodder for the first two summative portfolios, creates a relatively stable and predictable learning environment upon which to reflect. The year 5 summative portfolio follows both the clinical rotations and a year of research. The impact that these experiences may have on students’ perceptions and reflections may explain some for the shift in content focus observed in the portfolios. The most notable change seen was increased documentation of personal support strategies. It is conjectural to say what accounts for these differences and there are a variety of factors that might account for this, including experiences related to the stresses of clinical clerkships and rotations, changes in class dynamic and learning environment as the student cohort moves from the classroom and are scattered to hospital or research laboratory learning environments, effects of research year experiences, and personal life circumstances (e. g. increasing numbers of students in relationships and starting families). This shift in learning environment may also explain, in part, the downward trend in documentation of professional support. Class attendance in the first two years of the programme is mandatory, which results in all 32 students spending all their class time together. During clerkships and especially during the research year, they do not have nearly as much contact on a daily basis with their peers and opportunities for peer support are less common. This shift may also account for the slightly decreased documentation of personal arena issues; there is less time available during clinical rotations for hobbies and extracurricular and recreational activities. More interaction with patients and physicians during clerkships likely engenders students to give more consideration of their roles as caregivers and physicians-to-be.

There are a number of limitations to the current study. The structure of the programme and its assessment system are somewhat unique among medical school programmes; the impact of the learning environment created, as a result, could impact what and how students document in their portfolios. The portfolio essay, due to word restrictions, may not fully capture all resilience strategies students employ. Documentation does not necessarily guarantee implementation. Although mentors play an important role in helping students learn how to process feedback and reflect, biases of perspective may be introduced by the advisors which may impact what students feel they should or do not need to include in their portfolios.

The goal of using the portfolio assessment approach is to promote self-regulation, a skill which entails monitoring, self-assessment, and modulation of performance via goal setting and implementation of strategies to improve [15]. As future physicians, self-regulation of learning and behaviour, how the learner understands social values and extrinsic contingencies and transforms them into a personal value system and self-motivation [16] are critical skills in meeting performance standards for the profession. The portfolio provides a potential instrument for encouraging students to reflect on stressors they are currently experiencing and may experience in the future as practising physicians and identify potential strategies to mitigate some of these stressors. The ability to internalize this practice will hopefully arm students as future physicians in dealing with issues of stress and burnout that unfortunately plague many practising physicians in the current medical climate. It would be interesting to know how strategies shift, change or evolve/devolve at transition points over time, if at all, e. g. as students transition from medical school to residency and from residency to staff.