Abstract
Lifelong learning in medicine is an important skill and ethical obligation, but many residents do not feel prepared to be effective self-directed learners when training ends. The learning sciences offer evidence to guide self-directed learning, but these insights have not been integrated into a practical and actionable plan for residents to improve their clinical knowledge and reasoning. We encourage residents to establish a self-directed learning plan, just as an athlete employs a training plan in the pursuit of excellence. We highlight four evidence-based learning principles (spaced practice, mixed practice, retrieval practice, and feedback) and four training strategies comprising a weekly training plan: case tracking, simulated cases, quizzing, and new evidence integration. We provide tips for residents to implement and refine their approach and discuss how residency programs can foster these routines and habits. By optimizing their scarce self-directed learning time with a training plan, residents may enhance patient care and their career satisfaction through their pursuit of clinical mastery.
Avoid common mistakes on your manuscript.
INTRODUCTION
Lifelong learning is a regulatory requirement (ACGME practice-based learning and improvement) and an essential habit to transform clinical experience into clinical expertise, but many graduating residents do not feel prepared to direct their own learning when independent practice begins.1 Insights from the learning sciences 2 have not been translated into specific practices to help residents optimize their scarce self-directed learning time and establish routines that extend beyond residency.
A resident’s commitment to a self‐directed learning plan parallels an athlete who follows a training routine in the pursuit of excellence. Unlike most professional athletes, however, a resident must also learn to be her own coach and select activities that improve performance. To prepare the self-directed resident for these dual roles, we first highlight evidence-based learning principles. We then recommend specific strategies that can be integrated into a weekly training plan which residents can adopt and continue during fellowship or independent practice.
We focus our advice on the development of a resident’s clinical knowledge and decision-making. However, these same principles can be applied to enhance other skills relevant to clinical mastery: communication, teamwork, and health and social system navigation. The development and execution of a training plan is more than an intellectual pursuit. This commitment to lifelong learning can support other clinical practice goals, including medical error reduction and the provision of high-value care.
LEARNING SCIENCE PRINCIPLES
A self-directed learning plan to enhance clinical knowledge and reasoning should accelerate the development of mental models that guide diagnosis and management decisions. An illness script is a mental representation of a disease that encapsulates the epidemiology, pathophysiology, and clinical features of that condition (e.g., post-streptococcal glomerulonephritis).3 A schema is a systematic approach to analyze a defined clinical problem (e.g., acute kidney injury) that provides a framework (e.g., pre-renal, intra-renal, and post-renal) to categorize relevant illness scripts.4,5 Although the script and schema concepts have been utilized widely to characterize diagnostic decision-making, recent work has also emphasized the role of these knowledge structures in guiding management reasoning.6,7,8,9
Scripts and schemas reside in long-term memory, guide the selection and analysis of data in a patient encounter, drive clinical decisions, and continuously evolve as they are repeatedly accessed and utilized.9,10 The goal of a self-directed learning plan is to develop these mental models in concert with experience from diagnostic and management decisions in patient care activities. Four principles from the learning sciences, a multidisciplinary field that examines strategies for building and maintaining knowledge in long-term memory, can inform the activities in a self-directed training plan: spaced practice, mixed practice, retrieval practice, and feedback.
Learning is more durable when it is separated over time (spaced practice) instead of concentrated in one session (massed practice).11 A trial involving instruction of a new surgical skill (microvascular anastomosis) randomized resident physicians to a single 3-hour (massed) or three 1-hour (spaced) practice sessions, and the latter group demonstrated superior long-term knowledge retention and technical outcomes.12 Spacing is underutilized because its efficacy is counterintuitive. In massed practice, rapid gains at the end of a single session are apparent to the learner, but the forgetting that follows goes unnoticed. In spaced practice, the forgetting between sessions is apparent when the brain is rechallenged with the same topic. The extra effort expended to relearn a forgotten concept is essential to consolidating knowledge.13
Mixed practice is the purposeful intermingling of two or more related subjects, skills, or problem types in a practice session. Mixed practice is distinguished from blocked practice, in which a single problem type is clustered.13 A study of college baseball players demonstrated that players exposed to blocked batting practice (a sequence of 15 fastballs, 15 curveballs, and 15 changeups) had less improvement than players exposed to mixed practice (45 randomly selected pitches) on measures of hitting skill 6 weeks later.14 In a study which randomly assigned medical students to blocked practice (e.g., a set of ECGs with myocardial ischemia followed by a set of ECGs with pericarditis) or mixed practice (ECGs of all diagnoses interweaved), the mixed practice group more accurately diagnosed subsequent novel ECGs.15 (In a similar study of early medical students where mixed practice did not lead to improved ECG diagnostic accuracy, the investigators suggested that basic competence in a subject may be important for mixed practice to be effective).16 Blocked learning circumvents the challenge of discriminating problem type (e.g., identifying the type of pitch that is thrown). However, determining the nature of a problem (e.g., is this myocardial ischemia or pericarditis?) is a fundamental skill in medicine. Blocked practice can produce impressive short-term knowledge gains (e.g., “cramming” to pass an exam), but mixed practice leads to superior long-term knowledge.13
Retrieval practice, deliberately designed activities which challenge the learner to recall information (e.g., quizzing), leads to enhanced knowledge compared to passive re-exposure to information (e.g., re-reading).17 Medical students 18 and residents 19 randomized to repeated testing of knowledge instead of repeated self-study demonstrated improved retention of course material 6 months later. Retrieval attempts that are more cognitively effortful (e.g., answering open-ended as opposed to multiple-choice questions) may also lead to better long-term retention of complex information.20 Learners may gravitate towards re-exposure (e.g., re-reading a book chapter) because familiarity with the information is comforting. However, familiarity is easily mistaken for true understanding. Retrieval practice reveals forgotten information, allowing the learner to focus their relearning accordingly.
Feedback is an essential element of learning. Experts across a wide range of fields utilize feedback in their practice methods to help close the gap between actual and goal performance.21,22 Medical students 23, residents 24, and attending physicians 25 all engage in tracking of patient outcomes to enhance their learning. However, efficiently obtaining and learning from feedback is challenging without an effective health information technology system and a coach who can guide reflection and recalibration.
CORE TRAINING STRATEGIES
Just as an athlete’s coach sets a training plan with essential exercise routines, residents can design their own training program. We suggest three training strategies, informed by the learning sciences, that should comprise a self-directed learning plan: case tracking, simulated cases, and quizzing.
Case tracking is the systematic follow-up of patient outcomes. Just as athletes study their “game tape,” master clinicians regularly identify and reinforce learning points from their clinical experiences.26,27 Optimal case tracking begins with a specific question (e.g., “will the pleural fluid cytology be positive for malignancy?”) recorded in a log so the anticipated and ultimate outcome can be compared and a learning point discerned.28 Learners should prioritize tracking common issues (e.g., sore throat, erythematous leg) where recalibration will have the greatest long-term impact. It is also important that residents track situations where they feel confident so that strongly held but ultimately inaccurate projections can inform future forecasts. Reviewing the “game tape” of a clinical decision uses both spaced learning and feedback to transform experience into expertise.
Experience with varied clinical situations is a foundation of clinical expertise.26 Simulated cases allow residents to increase their cognitive workload without increasing their clinical workload. Simulated cases are featured in medical journals, apps, podcasts, videos, and social media platforms (Table 1). Although published cases do not unfold according to the reader’s decisions, learners can approximate real-world practice by pausing periodically to commit to a differential diagnosis or management plan before reviewing the expert discussion and decisions.29,30 Continuous engagement with multiple sources of simulated cases, which feature unannounced and heterogeneous clinical challenges, typifies mixed practice.
Quizzing is a deliberate method of testing understanding. Structured quizzing is available through journals, apps, and questions banks (Table 1). A learner can also design her own quizzes (e.g., using a digital flashcard program 31) to reinforce knowledge from a simulated case or from questions that arise during patient care.32 Learning opportunities at the point of care are often lost to the time pressures of clinical medicine.33 A resident who develops a system to capture lessons in real time (e.g., by making notes on a smartphone during rounds) can quiz herself on these insights during subsequent self-directed learning time. Retrieval practice through deliberately designed quizzing reveals knowledge gaps and installs information in long-term memory through reinforcement.
These three strategies—case tracking, simulated cases, and quizzing—are informed by learning theory and are problem-based. A final training strategy—new evidence integration—addresses the imperative that a learner upgrade her mental models by incorporating emerging medical knowledge into practice. An individual clinician cannot stay abreast of all new studies in a field 34, and exclusive reading of primary literature is not an efficient strategy to make changes to clinical practice.35 Instead, residents should develop a system of interacting with the secondary literature, which scans and summarizes important studies.36 Journal summary programs are a convenient, high‐yield resource to maintain awareness of new research (Table 1). Social media platforms, such as Twitter, can connect residents to medical communities that disseminate infographics or contextualize studies through digital journal clubs. Medical podcasts discuss important studies in a medium that learners can integrate with other daily activities (e.g., commuting or exercising).
IMPLEMENTATION CONSIDERATIONS FOR THE LEARNER
Just as an athlete consolidates the most effective training methods into a series of workouts, learners can map core training strategies in a weekly plan (Table 2) that fits with their clinical and personal duties.
Short and frequent sessions capitalize on learning science principles (i.e., spaced and mixed practice throughout the week instead of massed or blocked practice on one day). Planning a specific time and location increases the likelihood of executing a training session.37 Exploiting a pre-existing routine as a cue to begin a session (e.g., riding the bus to work) can help solidify these activities into self-sustaining habits.38
Picking only 1 or 2 training strategies at the outset may increase the chance of successful completion, particularly if the behavior can be captured as a SMART goal (i.e., specific, measurable, achievable, relevant, and bound to the weekly timeline).39 An example SMART goal for case tracking could be “I will add 2 new cases and review 2 previous cases in my case log every week.”
At the conclusion of the week, the learner can step into the role of coach to reflect on progress. The learner should review updated scripts and schemas and perform an honest appraisal of setbacks (with self-compassion if goals are not fully realized). The weekly reflection should finish with a modification of the training plan based on the upcoming week’s activities and schedule. Planning for realistic—not aspirational—training time is required to maintain week-to-week consistency and establish a habit.
IMPLEMENTATION CONSIDERATIONS FOR RESIDENCY PROGRAMS
Although self-directed training is an individualized pursuit, residency programs and faculty are strong sociocultural influence on the formation and optimization of learning plans.40 Programs can set an expectation that residents develop learning plans with peer and faculty coaching. For example, as interns develop their plans, senior residents can share their preferred learning resources. Programs where attendings and residents provide feedback to nighttime admitting residents 41,42 or where faculty review long-term patient outcomes with residents 24 can establish a culture of case tracking. Residency programs can designate faculty learning coaches who model and develop self‐directed learning plans, guide reflections, advise on the selection of high‐quality case simulation and medical literature resources, and assure the establishment of a habit by the end of residency.
CONCLUSION
Lifelong learning is an essential skill and an ethical obligation of the physician. Before residents enter independent practice, we suggest they establish a training program grounded in the learning sciences that is strategically mapped into their limited discretionary time. A self-sustaining learning plan aligns with intrinsic motivators at work including autonomy (self-direction), purpose (connection to a higher goal), and mastery (getting better at a craft).43 Our recommendations are evidence-informed but not field-tested. We hope the articulation of self-directed learning plans can lead to their study, critique, and refinement to ensure they realize the promise of improving the experience of medicine for physicians and patients alike.
References
Nothnagle M, Anandarajah G, Goldman RE, Reis S. Struggling to be self-directed: residents’ paradoxical beliefs about learning. Acad Med J Assoc Am Med Coll. 2011 Dec;86(12):1539–44.
Hoof TJV, Doyle TJ. Learning science as a potential new source of understanding and improvement for continuing education and continuing professional development. Med Teach. 2018 Sep 2;40(9):880–5.
Custers EJFM. Thirty years of illness scripts: Theoretical origins and practical applications. Med Teach. 2015 May 4;37(5):457–62.
Martin M, Sedighi Manesh R, Henderson MC, Critchfield JM. Diagnostic Scheming. J Gen Intern Med. 2015 Dec;30(12):1874–8.
McLaughlin K, Coderre S, Mortis G, Mandin H. Expert-type knowledge structure in medical students is associated with increased odds of diagnostic success. Teach Learn Med. 2007;19(1):35–41.
Cook DA, Durning SJ, Sherbino J, Gruppen LD. Management Reasoning: Implications for Health Professions Educators and a Research Agenda. Acad Med. 2019 Sep;94(9):1310–6.
Cook DA, Sherbino J, Durning SJ. Management Reasoning: Beyond the Diagnosis. JAMA. 2018 Jun 12;319(22):2267.
Abdoler EA, O’Brien BC, Schwartz BS. Following the Script: An Exploratory Study of the Therapeutic Reasoning Underlying Physicians’ Choice of Antimicrobial Therapy. Acad Med. 2020 Aug;95(8):1238–47.
Parsons AS, Wijesekera TP, Rencic JJ. The Management Script: A Practical Tool for Teaching Management Reasoning. Acad Med. 2020 Aug;95(8):1179–85.
Charlin B, Boshuizen HPA, Custers EJ, Feltovich PJ. Scripts and clinical reasoning. Med Educ. 2007;41(12):1178–84.
Versteeg M, Hendriks RA, Thomas A, Ommering BWC, Steendijk P. Conceptualising spaced learning in health professions education: A scoping review. Med Educ. 2020 Mar;54(3):205–16.
Moulton C-AE, Dubrowski A, MacRae H, Graham B, Grober E, Reznick R. Teaching Surgical Skills: What Kind of Practice Makes Perfect? Ann Surg. 2006 Sep;244(3):400–9.
Brown PC, Roediger HL, McDaniel MA. Make It Stick: The Science of Successful Learning. Cambridge, MA: The Belknap Press of Harvard University Press; 2014.
Hall KG, Domingues DA, Cavazos R. Contextual interference effects with skilled baseball players. Percept Mot Skills. 1994 Jun;78(3 Pt 1):835–41.
Hatala RM, Brooks LR, Norman GR. Practice makes perfect: the critical role of mixed practice in the acquisition of ECG interpretation skills. Adv Health Sci Educ Theory Pract. 2003;8(1):17–26.
Monteiro S, Melvin L, Manolakos J, Patel A, Norman G. Evaluating the effect of instruction and practice schedule on the acquisition of ECG interpretation skills. Perspect Med Educ. 2017 Aug;6(4):237–45.
Green ML, Moeller JJ, Spak JM. Test-enhanced learning in health professions education: A systematic review: BEME Guide No. 48. Med Teach. 2018 Apr 3;40(4):337–50.
Larsen DP, Butler AC, Iii HLR. Comparative effects of test-enhanced learning and self-explanation on long-term retention. Med Educ. 2013;47(7):674–82.
Larsen DP, Butler AC, Iii HLR. Repeated testing improves long-term retention relative to repeated study: a randomised controlled trial. Med Educ. 2009;43(12):1174–81.
McDaniel MA, Anderson JL, Derbish MH, Morrisette N. Testing the testing effect in the classroom. Eur J Cogn Psychol. 2007 Jul 1;19(4–5):494–513.
Ericsson KA, Pool R. Peak: Secrets from the New Science of Expertise. Boston: Houghton Mifflin Harcourt; 2016.
Fernandez Branson C, Williams M, Chan TM, Graber ML, Lane KP, Grieser S, et al. Improving diagnostic performance through feedback: the Diagnosis Learning Cycle. BMJ Qual & Saf. Published Online First: 2021 Aug 20; https://doi.org/10.1136/bmjqs-2020-012456
Brisson GE, Neely KJ, Tyler PD, Barnard C. Should medical students track former patients in the electronic health record? An emerging ethical conflict. Acad Med J Assoc Am Med Coll. 2015 Aug;90(8):1020–4.
Narayana S, Rajkomar A, Harrison JD, Valencia V, Dhaliwal G, Ranji SR. What Happened to My Patient? An Educational Intervention to Facilitate Postdischarge Patient Follow-Up. J Grad Med Educ. 2017 Oct;9(5):627–33.
Bowen JL, O’Brien BC, Ilgen JS, Irby DM, Ten Cate O. Chart stalking, list making, and physicians’ efforts to track patients’ outcomes after transitioning responsibility. Med Educ. 2018 Apr;52(4):404–13.
Murthy VK, O’Brien B, Dhaliwal G. An Inquiry Into the Early Careers of Master Clinicians. J Grad Med Educ. 2018 Oct;10(5):500–6.
Bowen JL, Ilgen JS, Irby DM, ten Cate O, O’Brien BC. “You Have to Know the End of the Story”: Motivations to Follow Up After Transitions of Clinical Responsibility. Acad Med. 2017 Nov;92(11S):S48–54.
Dhaliwal G. Inpatient Notes: Diagnostic Excellence Starts With an Incessant Watch. Ann Intern Med. 2017 Oct 17;167(8):HO2–3.
Manesh R, Dhaliwal G. Digital Tools to Enhance Clinical Reasoning. Med Clin North Am. 2018 May;102(3):559–65.
Dhaliwal G. Clinical Excellence: Make It a Habit. Acad Med. 2012 Nov;87(11):1473.
Deng F, Gluckstein JA, Larsen DP. Student-directed retrieval practice is a predictor of medical licensing examination performance. Perspect Med Educ. 2015 Dec;4(6):308–13.
@haematognomist. (2021, August 4). What an awesome tweetorial! Something I’m working on that #medtwitter might be interested in is how to translate pearls into spaced learning. My draft Anki card: Do this daily for the pearls you hear on rounds, from consultants, podcasts, twitter & the growth will come!. [Twitter post]. Retrieved from: https://twitter.com/haematognomist/status/1423000657670414353
Dhaliwal G. Known Unknowns and Unknown Unknowns at the Point of Care. JAMA Intern Med. 2013 Nov 25;173(21):1959–61.
Alper BS, Hand JA, Elliott SG, Kinkade S, Hauan MJ, Onion DK, et al. How much effort is needed to keep up with the literature relevant for primary care? J Med Libr Assoc. 2004 Oct;92(4):429–37.
McKibbon KA, Wilczynski NL, Haynes RB. What do evidence-based secondary journals tell us about the publication of clinically important articles in primary healthcare journals? BMC Med. 2004 Sep 6;2(1):33.
Straus SE, Glasziou P, Richardson WS, Haynes RB, Pattani R, Angeliki Veroniki A. Evidence-Based Medicine: How to Practice and Teach EBM. 5th ed. Elsevier; 2019.
Saddawi-Konefka D, Schumacher DJ, Baker KH, Charnin JE, Gollwitzer PM. Changing Physician Behavior With Implementation Intentions: Closing the Gap Between Intentions and Actions. Acad Med. 2016 Sep;91(9):1211–6.
Duhigg C. The Power of Habit: Why We Do What We Do in Life and Business. Random House; 2012.
Conzemius A, O’Neill J. The Power of SMART Goals: Using Goals to Improve Student Learning. Solution Tree Press; 2006.
Ricotta DN, Richards JB, Atkins KM, Hayes MM, McOwen K, Soffler MI, et al. Self-Directed Learning in Medical Education: Training for a Lifetime of Discovery. Teach Learn Med. 2021 Jul 19;0(0):1–11.
Lim H, Raffel KE, Harrison JD, Kohlwes RJ, Dhaliwal G, Narayana S. Decisions in the Dark: An Educational Intervention to Promote Reflection and Feedback on Night Float Rotations. J Gen Intern Med. 2020 Nov;35(11):3363–7.
Lane KP, Chia C, Lessing JN, Limes J, Mathews B, Schaefer J, et al. Improving Resident Feedback on Diagnostic Reasoning after Handovers: The LOOP Project. J Hosp Med. 2019 Oct 1;14(10):622–5.
Pink DH. Drive: The Surprising Truth About What Motivates Us. New York: Riverhead Books; 2009.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Declarations
None
Conflict of Interest
Dr. Krimmel-Morrison is a contributor for Practical Reviews, for which he receives a fee for writing summaries of internal medicine research articles.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Krimmel-Morrison, J.D., Dhaliwal, G. How to Keep Training—After Residency Training. J GEN INTERN MED 37, 1524–1528 (2022). https://doi.org/10.1007/s11606-021-07240-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11606-021-07240-3