Abstract
Workplace-based interactions between residents and pharmacists, though relatively underexplored, might contribute substantially to learning. This international study sought to investigate the affordances residents use for informal learning about medications, their interactions with pharmacists and patterns of resident-pharmacist engagement, as well as residents’ perceived impact of these interactions on their learning. Contextual differences between US and Dutch residency training and electronic health record (EHR) may impact informal learning about medications. We conducted a cross-sectional, online, 25-item survey study, including closed-format and open-response questions among current resident physicians (post-graduate years 1–6, from a variety of residency programs n = 803) from the University of California San Francisco, the University of Minnesota, and the University Medical Center Utrecht. Responses from 173 residents in both countries revealed that these physician trainees were afforded opportunities to engage in a wide variety of pharmacotherapy-related activities but engaged differently with social and environmental resources for support. Residents from the United States (US) utilized pharmacists and Up-To-Date, whereas Dutch residents preferentially utilized the online Dutch medication information site and EHR-embedded medication resources. US residents interacted with pharmacists significantly more frequently than Dutch residents. Pharmacists provided residents with a wide range of useful information, much of which is integrated into the medication resources in the Dutch EHR-based decision-support system. While US residents reported overwhelmingly that informal interactions with pharmacists contribute to their learning about medications, Dutch residents’ responses did not confirm this. Intentionally designing residents’ training to include opportunities for interactions with pharmacists could potentially positively impact residents’ informal workplace learning.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
Most learning in postgraduate medical education happens informally in the clinical workspace. Such learning takes place in the context of everyday work activities, is generally unstructured, often tacit, and may be unplanned or intentional [1,2,3,4,5]. Despite considerable interest in residents’ informal learning processes, gaps exist in our understanding of pharmacists’ contributions to residents’ learning in the clinical environment. Affordances for this interprofessional learning may differ, depending on culture and country. Workplace-based interactions between residents and pharmacists, though relatively underexplored [4], likely contribute substantially to learning.
Informal learning in the health professions is primarily experiential, occurring as trainees participate in clinical care [6, 7]. According to Billett’s workplace learning theory, learning and working are interdependent and the quality of learning is dependent on: 1) the affordances for learning – including opportunities for learners to participate in relevant workplace tasks and activities as well as access to the support and guidance of experts, co-workers, and resources; and 2) the learner’s engagement with these affordances [8,9,10,11]. Informal learning in the clinical workplace is an important contributor to residents’ competency development [4, 12].
Western medicine approaches rely heavily on pharmacotherapy with 66% of US adults and 63% of the Dutch population currently using prescription medications [13, 14]. Resident physicians are expected to develop the knowledge-base and skillset required to plan, implement, and monitor and optimize pharmacotherapy-based treatments (i.e., Accreditation Council for Graduate Medical Education Core Competencies, CanMEDS Physician Competency Framework). Such learning occurs through both formal and informal interactions with pharmacists, other physicians, and interaction with online medical information resources and decision-support tools embedded in electronic health records (EHR). Unfortunately, this learning process is not always sufficient, as evidenced by some practicing physicians’ inadequate drug knowledge and inexperience, which contribute to preventable medication errors, a significant source of morbidity and mortality worldwide [15]. To explore how residents learn pharmacotherapy, we investigated the extent and impact of informal resident-pharmacist interactions in the clinical workplace.
We examined three different health care settings (two in the US and one in the Netherlands) and all years of resident training to answer the following questions: What affordances do residents use for informal learning about medications? How do residents and pharmacists engage with one another in the clinical workplace? And, how do residents perceive the impact of interactions with pharmacists on their learning?
Methods
We conducted a cross-sectional, online, twenty-one-item survey study among residents at three institutions – two in the US and one in the Netherlands. The Institutional Review Boards of UCSF (#20–31758; Ref. #288894), UMN (#STUDY00010438), and the Netherlands Association of Medical Education Ethics Review Board (NVMO-ERB Dossier #2020.6.4) approved the study.
Participants and Contexts
We conducted this study among resident physicians of medical and surgical training programs at the University of California San Francisco (UCSF), the University of Minnesota (UMN), and the University Medical Center Utrecht (UMCU) in the Netherlands. US residency training begins after four years of medical training that occurs after four-years of undergraduate study. After secondary school, Dutch medical trainees first complete six undergraduate years, then usually work for multiple years as a ward-physician before starting residency [16]. Relevant for physician’s training regarding medications is that EHR systems in both countries vary substantially. In the US, EHR systems differ depending on the institution and don’t universally contain sophisticated decision-support systems. In the Netherlands, there is a national EHR system that has, embedded within it, online medication resources and a powerful decision-support system (including a drug-drug/drug-patient/drug-gene interaction database; recommended dose adjustments in renal and hepatic compromise; and interpretation of drug levels). This makes the roles of pharmacists different. In the US, pharmacists are often included in ward teams, whereas in the Netherlands, they are available on call but are not generally included in ward teams.
Survey Development
Following established guidelines [17], we conducted a literature search but found no existing survey related to informal, interprofessional workplace learning. Using Billett’s workplace learning theory, focused on affordances and learner engagement constructs [8,9,10,11], we drafted questionnaire items and gathered feedback from three physicians and two pharmacists with training in health professions education research. For expert validation, five panelists – medicine or pharmacy faculty members from the United States, United Kingdom, the Netherlands, and Canada; chosen for their expertise in workplace learning theory, interprofessional education, and pharmacology education – critically reviewed the draft survey to ensure that the constructs of interest were well-represented. Guided by panelist input, we modified the initial draft, producing an online survey including twenty-one closed-response and four open-response questions.
Next, five medical residents (n = 2 UCSF, n = 1 UMN; n = 2 UMCU) completed a cognitive interview while answering survey items [18], with post-interview discussion. We iteratively modified the survey to improve clarity and ensure adequate coverage of workplace learning constructs.
We piloted the survey with three medical residents (n = 1, UCSF; n = 2 UMN) and one clinical fellow (UMCU) to assess feasibility. Before distribution, we pilot tested the final survey with four residents (n = 3 US; n = 1, UMCU). The final survey (see Supplementary Material) was distributed via Qualtrics (Qualtrics, 2020).
Data Collection and Analysis
Data were collected in English during the fall of 2020, in the midst of COVID. The target group of respondents included current medical and surgical residents from UCSF, UMN, and UMCU. A link to the survey, including an explanation of the study purpose and informed consent statement, was distributed by email between October 1 and October 5 to 803 residents at three medical centers (UCSF, n = 251; UMN, n = 117; and UMCU, n = 435), which represent a variety of residents at their institutions (e.g., family and internal medicine, pediatrics, general surgery, OB/GYN programs, and smaller specialty programs). To maximize survey responses [19], residents were sent periodic reminders until survey closure (November 15, 2020).
Most questions related to residents’ experiences during the prior three months of training, during which time residents may have engaged with pharmacists (either in person or through EHR communications) in multiple clinical rotations. Quantitative questions included either a Likert-type scale or a nominal response format. To minimize the length of the survey while allowing us to gather a broad dataset, some quantitative questions allowed for multiple answers. Questions requesting multiple responses resulted in response counts in excess of the total number of respondents (n = 173). For each question, we determined response totals and associated percentages by postgraduate year (PGY) and institution. We performed Chi-square tests, looking for associations between the variable of interest, PGY, and institution. When data from the US institutions were not substantially different, US populations were combined for statistical analysis.
We analyzed open-response questions using directed qualitative content analysis [20]. The first author (LCF) developed a coding system. A second author (i.e., either ALP or IW) checked all response codes. Disputes were reconciled through discussion. Code counts for comparison across groups were performed using R [21] and qualitative findings were summarized in narrative form.
Results
Participants
Our study population included current resident physicians, PGY1-6, from UCSF, UMN, and UMCU ((n = 803; including medical (e.g., internal medicine, peds, psych, etc.), OB/GYN, and surgical residents at UCSF (n = 251), UMN (n = 117) and UMCU (n = 435)). Between mid-October and mid-November 2020, 175 residents initiated the survey. After removing two respondents (1 UMCU pathology resident deemed unlikely to regularly interact with pharmacists and 1 UMN resident with unspecified specialty), statistical analyses were conducted on data from 173 respondents, yielding an overall response rate of 21.5%. This compares well with other online surveys of academics and health professionals [22, 23] (See Table 1).
While over 70% of resident respondents from the US were in their first two years of training (UCSF (72.1%), UMN (n = 71.6%)), only 20% of UMCU respondents were in their first two years of training, which is attributable to the different structure of residency education in the Netherlands.
During the three months before the survey, resident respondents worked inpatient (85.5%; n = 148 of 173), in ambulatory clinics (45.7%; n = 79 of 173), or both settings (32.4%; n = 56 of 173).
Affordances for Learning
Resources for Informal Learning about Medications
Residents were asked to select up to three resources for informal learning about medications from a list of ten options (n = 398 responses; n = 251 US; n = 147 Netherlands). Table 2 includes the top-ranked resources used by country and PGY. US residents learned about medications from Up-to-Date (n = 66 of 251, 26.3%) and interactions with pharmacists (n = 64, 25.5%), followed by senior residents or fellows (n = 41, 16.3%). Dutch residents’ resource use varied by PGY. Across PGYs, they learned about medications most often from EHR-embedded resources (n = 51 of 147, 34.7%); from interactions with attendings (n = 35, 23.8%) (i.e., PGY1, 3, and 4 + residents); and from interactions with pharmacists (n = 26, 17.7%).
Informal Interactions with Pharmacists
Half of the residents (50.3%; n = 87 of 173) indicated that a pharmacist was regularly present as a member of the clinical team in at least one clinical setting, though significantly more often in the US than in the Netherlands (X2 = 37.2, p = < 0.0001). Nearly three-quarters of the respondents interacted with inpatient pharmacists at least weekly (n = 102 of 139, 73.4%). In ambulatory care, resident-pharmacist interactions were relatively infrequent, with over two-thirds interacting less than once weekly (n = 90 of 128, 70.3%).
Responding to the open-response question of “What could have led you to interact more often with a pharmacist during your training so far?”, over two-thirds of residents (n = 99 of 141; 70.2%) stated that having both easy and regular access to pharmacists during practice, including dedicated opportunities to work together (e.g., having pharmacists available on rounds, as regular members of their clinical teams, and as participants in multidisciplinary meetings) could have led them to interact more often with pharmacists. As one resident [PGY3, surgery, UMN] responded, “…when you are on an ICU service, you interact with the pharmacists multiple times daily. I think I have a lot of good interaction with pharmacists in the hospital.” As another resident [PGY3, medicine, UCSF] described, “I wish we had a pharmacist on every inpatient team who rounds with us.” To a lesser extent, residents focused on increased opportunities for didactics and other educational sessions with pharmacists. Of note, over half of these responses related to more formal learning sessions came from UMCU residents.
Residents were also asked if pharmacists, when asked for advice, had taken time to explain things to them. Most residents, independent of PGY, agreed or strongly agreed (n = 140 of 161, 86.9%) that pharmacists had taken the time to explain things to them.
Learner Engagement with Pharmacists
Frequency of Resident-Pharmacist Interactions
Though UCSF-based residents maintained at least weekly contact across training years, PGY1-2 residents at UMN and PGY1 residents at UMCU engaged in significantly more frequent interactions with inpatient pharmacists than did the more senior residents (X2 = 34.0, p = < 0.0001). Dutch residents interacted significantly less often with inpatient pharmacists (i.e., ≤ 1x/week) than US-based residents (X2 = 68.6, p = < 0.0001) (See Table 3).
US-based residents, especially PGY1s and PGY2s, contacted pharmacists significantly more often than did Dutch residents (n = 161 responses; n = 62 Netherlands; n = 99 US; X2 = 46.6, p = < 0.0001). Nearly half of US residents (47.5%; n = 47) contacted pharmacists at least multiple times per week, while 98.4% of Dutch respondents (n = 61) reported contacting pharmacists ≤ 1x/week. From PGY 3–6, while US residents contacted pharmacists progressively less often, Dutch residents’ contacts increased (X2 = 30, p = 0.0004) (See Fig. 1).
Pharmacists contacted US residents (n = 99) significantly more often than Dutch residents (n = 62) (X2 = 75.1, p < 0.0001), from multiple times per week (n = 27, 27.3% vs. n = 1, 1.5% Netherlands) up to daily (n = 17, 17.2% vs. 0% Netherlands) – especially in PGY1 and 2 (X2 = 38, p < 0.0001). Dutch residents reported infrequent contacts from pharmacists (i.e., ≤ 1X/week; n = 54, 87.1%). Pharmacists commonly contacted residents for questions related to medication or prescription errors and dosing; monitoring drug levels or pharmacokinetic issues; medication availability; drug regimen optimization; and medication selection. Of the twenty-three residents who were never contacted, five were from the US and eighteen were from the Netherlands.
Motivation to Engage with Pharmacists
Across PGYs, the most common questions or issues for which US residents contacted a pharmacist were related to dosing (i.e., dose, administration rate, adjustment for organ failure); followed by selecting appropriate medications. Drug side effects and interactions as well as monitoring drug levels and pharmacokinetic issues were also common reasons for all but PGY4 + residents to contact pharmacists. Across training years, Dutch residents’ most common questions were related equally to medication dosing, side effects and interactions; followed by drug-level monitoring and pharmacokinetic issues; and, lastly, drug availability. Eighteen residents (n = 13 Netherlands; n = 5 US) never contacted a pharmacist.
Modes of Engagement for Learning
Residents were asked to select from a list of six common ways that they had learned from pharmacists in the past three months. The most common ways that residents learned from pharmacists (n = 293 responses; n = 208 US; n = 85 Netherlands), varied significantly by country (X2 = 25.3, p < 0.0001) but were independent of PGY, included asking questions ((n = 119 of 293, (n = 79 US and n = 40 Netherlands), 40.6%)), caring for patients together ((n = 63 (n = 55 US and n = 8 Netherlands), 21.5%)), and engaging in discussions ((n = 58 (n = 44 US and n = 14 Netherlands), 19.8%)).
In an open-response survey question, residents – mostly in PG years 1–4 – provided details about other ways that they had learned from pharmacists over the course of their training. The most common general content area that respondents from all institutions mentioned were drug dosing, administration and optimization. This content area was mentioned twice as often by UCSF respondents relative to those from UMN or UMCU. The most common process by which residents from all institutions learned from pharmacists was through caring for patients together (including multidisciplinary meetings and coordination of care) and disease state management. While UMCU residents were 3-5-fold more likely than UMN or UCSF residents to mention didactics and formal education as a mechanism for learning from pharmacists, residents from UMN and UCSF were approximately three-fold more likely than UMCU residents to mention ward rounding – especially in the ICU – as a process by which they had learned from pharmacists. As one UMN resident [PGY 3, surgery, UMN] explained, “Having a pharmacist on rounds in the ICU is extremely advantageous, and it allows us to get real-life clinical experience with various medications.”
Perceived Learning Impact
Perceived Learning Impact of Pharmacist Interactions
Significantly more US residents (n = 89 of 98; 90.1%) strongly agreed or agreed that informal interactions with pharmacists contributed to their learning compared to Dutch residents (n = 30 of 61; 49.2%) (X2 = 52.0, p < 0.0001). US residents’ reported learning from pharmacists was significantly associated with earlier training years (i.e., PGY1-3), independent of specialty (X2 = 47.1, p < 0.0001) (See Fig. 2).
Pharmacists provided a wide range of information that was useful for residents’ learning needs. PGY1-2 trainees found information related to selection of new medications, dosing, medication errors, and optimization most useful for their learning. Residents in PGY4 + were more likely than PGY1-2 trainees to have found information about side effects, interactions, monitoring drug levels, and pharmacokinetic issues most useful. An open response question revealed a broad range of positive impacts that informal interactions with pharmacists had on residents’ learning including: learning about medications, prescribing, patient care, evidence-based medicine, and drug safety issues.
The majority of resident respondents (n = 83 of 99, 83.8% US and n = 45 of 62, 72.6% Netherlands) expressed that they would have liked to have had even more opportunities to learn from pharmacists during their training.
Impact of COVID on Interactions with and Learning from Pharmacists
In two open response questions, we asked residents from all three institutions to report about the impact that COVID-19 had on their interactions with and learning from pharmacists. Approximately one third of responses reflected that the pandemic had had little impact on either their interactions with or their learning from pharmacists during their recent training, but about the same number of responses (i.e., about one third) – mostly from UMN and UCSF medicine residents in PG years 1–3 – reflected that residents’ in-person interactions with pharmacists had been reduced in frequency with a corresponding increase in telephonic communication.
This move away from face-to-face interactions and towards increased usage of phones, pagers, video conferencing negatively impacted learning for a small number of residents. One resident [PGY1, medicine, UMN] said, “When they (pharmacists) aren't in person, it’s so much worse. Less communication. Harder to get a hold of… If they are in clinic less, then I can't ask them my "on the fly" questions where most of my learning is done.”
Discussion
Residents in both the US and the Netherlands were afforded opportunities to engage in a wide variety of activities and resources related to pharmacotherapy but interacted in a different manner with pharmacists, other physicians, and online information resources for guidance and in support of those activities. US residents relied mostly on pharmacists and Up-To-Date for medication-related questions. Dutch residents relied mostly on the EHR-embedded medication resources. Compared to their Dutch counterparts, US residents primarily interacted with, and learned from, pharmacists during informal, face-to face encounters on the wards. In the Netherlands, residents interact with pharmacists more during on call consultations, multidisciplinary patient consultations, and formal educational settings, especially in the early years. Pharmacists provided a wide range of information useful for resident learning, much of which is incorporated within the Dutch EHR. While US residents report that informal interactions with pharmacists contribute to their learning about medications, Dutch residents’ responses did not confirm this affordance.
To help answer medication-related questions, US-based residents utilized pharmacists as medication information resources more often than Dutch residents. This difference in utilization of pharmacists is likely multi-factorial and impacted by greater accessibility of pharmacists in the US relative to the Netherlands as well as Dutch residents’ substantial pre-training practice experience relative to their counterparts in the US. Dutch residents tend to have more clinical experience than US residents for the same level of postgraduate training because many of them have several years of clinical working experience before entering formal residency training. In addition, most Dutch residents start their early training years in a general hospital setting whereas senior postgraduate years are usually spent at a university hospital setting. The need for interaction might, in addition, also be impacted by the integration of key medication information and decision-support in the Dutch medication resource and EHR.
Residents in both countries relied heavily on indirect support provided by online medication information resources. This finding reflects the growing imperative for evidence-based clinical decision making [24] and highlights the Dutch residents’ ease of access to the Dutch medication information site and EHR-embedded medication resources as an especially important affordance. Our findings parallel those of Chong and colleagues who found that most Australian junior doctors utilized online clinical resources heavily in their daily practice [25]. To support residents’ learning, pharmacists might purposefully model how they integrate online resources in their own clinical decision-making processes.
One of the most salient, and to some extent surprising, findings was the difference in reported resident-pharmacist interaction frequency internationally. While most US residents interacted with pharmacists daily or weekly, Dutch residents interacted much less often with pharmacists. In the US, pharmacists were frequently present on the wards and participated in ward rounds, and informal interactions happened naturally. Rounding with pharmacists was an especially impactful affordance for learning for US-based residents in our study, but rarely occurred in the Netherlands. At UMCU, like many teaching hospitals in the Netherlands, pharmacists are available on-call, attend multidisciplinary patient consultations, and provide therapeutic recommendations to physicians on demand (through phone calls and via chart notes in the EHR) and during patient consultations, but they do not regularly serve on clinical wards. Though Dutch residents highlighted formal didactics from pharmacists as important learning activities, informal interaction with pharmacists was less often recognized as an affordance. Currently, Dutch pharmacists’ regular service on clinical wards is becoming more common in practice, but this is hospital-dependent and certainly not common practice throughout all hospitals.
Will the presence of pharmacists on clinical wards affect the eventual knowledge, skills, and attitudes of residents? While we presume that it might, there are two contrasting hypotheses. One is that, as US residents seem to confirm, frequent interactions with pharmacists in the clinical workplace enhances resident knowledge. The other hypothesis is that Dutch residents, with infrequent opportunities to interact with clinical pharmacists, are forced to engage in active learning by answering their own questions. While we did not test these hypotheses, we recognize that integrating Dutch pharmacists in daily ward rounds would promote interactions between pharmacists and residents. Whether such increased interprofessional interactions on rounds would be viewed by Dutch residents as a learning affordance (as did the US residents) and/or would improve Dutch residents’ learning from pharmacists remains to be studied [26, 27].
A majority of residents across contexts reported that pharmacists took time to explain things to them and they wanted even more opportunities to learn from pharmacists. This comports with Noble and colleagues’ finding that direct instruction and guidance, assistance in decision-making, and feedback from pharmacists were key affordances supporting residents’ learning to prescribe [28]. Similarly, Tubb & Loesch reported that internal medicine residents who interacted with pharmacists in acute care rounds “always” wanted a pharmacist team member, appreciated pharmacists’ recommendations, and felt that these interactions had improved their drug knowledge [27]. However, a small contingent of residents, mainly from the Netherlands, never contacted a pharmacist. Reasons for lack of engagement with pharmacists may include: lack of opportunity to interact; lack of awareness that pharmacists could be useful learning resources; greater clinical experience of entry-level Dutch residents compared to entry-level US residents; more readily available clinical decision-making tools and information provided through the Dutch EHR; or a workplace microculture and organization of health care (i.e., fewer number of Dutch pharmacists in clinical care and greater involvement of pharmacy technicians with a broader scope of practice than pharmacy technicians in the US) that does not support resident-pharmacist interaction [29, 30]. For some residents, especially in the US, COVID safety protocols limited their interactions with pharmacists. Residents in the current study suggested brief internships, ward rounds, and presence in clinic as mechanisms to increase opportunities for interactions with pharmacists.
While most studies related to pharmacist-physician interactions have focused on junior doctors’ prescribing practices [28, 31,32,33], we characterize how residents across training years engage with pharmacists, formularies and EHRs during pharmacotherapy-related activities and how they value these interactions for learning. We have also provided an international context by exploring the impact of practice differences across countries and how these differences reflect available affordances. Our study has identified that pharmacists are an affordance for residents’ learning in the clinical workplace that, in some cases, is not fully utilized and highlights the need to train current pharmacists as well as pharmacy learners to assume this important role as resident educators. Since we found that pharmacists serve as important learning resources for some residents, future research may focus on identifying interventions to enhance access to and utilization of pharmacists to optimally support residents’ learning and on identifying how informal physician- pharmacist interaction influences knowledge, skills, and attitudes towards pharmacotherapy and, thereby, influences professional performance.
The primary limitations of our study were the limited access to some resident populations for recruitment at the US institutions as well as the low response rate at UCSF and UMCU. Although the number of respondents was relatively equal across institutions, the disproportionate number of surveys sent out between the institutions was unequal and could have skewed the data. The low response rate also creates the potential for bias (i.e., non-responder and responder bias) and limits the generalizability of our findings. However, we believe that the patterns of behavior reported by residents and our interpretations of them offer useful insights into workplace learning between pharmacists and residents. The reasons for the low response rates are most likely multifactorial and may include resident prioritization of clinical duties during the fall of 2020 with COVID-19 surges as well as survey fatigue [34]. Since we did not measure residents’ pharmacotherapeutic knowledge and skills, we are unable to draw conclusions about the direct effects of resident-pharmacist interactions on resident learning.
Conclusion
Informal, interprofessional workplace learning occurs in the midst of residents’ interactions with pharmacists. For some medical residents, pharmacists have been identified as significant contributors to their development of pharmacotherapeutic knowledge. Dutch residents’ informal interactions with pharmacists were more limited and the Dutch medication information site and electronic health record-embedded medication resources, as well as formal education, served instead as important affordances for their learning about medications. Intentionally designing residents’ training to include opportunities for interactions with pharmacists could potentially impact residents’ informal workplace learning, especially in the US. To what extent Dutch residents’ learning would benefit from these interactions remains to be further studied.
References
Eraut M. Learning from other people in the workplace. Oxf Rev Educ. 2007;33(4):403–22. https://doi.org/10.1080/03054980701425706.
Eraut M. Informal learning in the workplace. Stud Contin Educ. 2004;26(2):247–73. https://doi.org/10.1080/158037042000225245.
Marsick VJ, Watkins KE, Callahan MW, Volpe M. Reviewing theory and research on informal and incidental learning. Online Submission to Academy of Human Resource Development Conference Proceedings. 2006. Retrieved from ERIC on January 2, 2023. https://files.eric.ed.gov/fulltext/ED492754.pdf.
Varpio L, Bidlake E, Casimiro L, Hall P, Kuziemsky C, Brajtman S, et al. Resident experiences of informal education: how often, from whom, about what and how. Med Educ. 2014;48(12):1220–34. https://doi.org/10.1111/medu.12549.
Berkhout JJ, Helmich E, Teunissen PW, van der Vleuten CP, Jaarsma ADC. Context matters when striving to promote active and lifelong learning in medical education. Med Educ. 2018;52(1):34–44. https://doi.org/10.1111/medu.13463.
Marsick VJ, Volpe M, Watkins KE. Theory and practice of informal learning in the knowledge era. Adv Dev Hum Resour. 1999;1(3):80–95. https://doi.org/10.1177/152342239900100309.
Fluit L, Verduijn M, Peerdeman S. Interprofessional Learning and Working. Personalized Specialty Care: Springer; 2021. pp 153–60. https://doi.org/10.1007/978-3-030-63746-0_19.
Billett S. Learning through work: workplace affordances and individual engagement. J Workplace Learn. 2001. https://doi.org/10.1108/EUM0000000005548.
Billett S. Learning through health care work: premises, contributions and practices. Med Educ. 2016;50(1):124–31. https://doi.org/10.1111/medu.12848.
Billett S. Learning in the workplace: Strategies for effective practice: Routledge; 2020.
Billett SR. Securing intersubjectivity through interprofessional workplace learning experiences. J Interprof Care. 2014;28(3):206–11. https://doi.org/10.3109/13561820.2014.890580.
Balmer DF, Da Lisby, Catherine Harris M, Slap GB. Do pediatric fellows recognize the importance and contribution of training to mastery of the general competencies? Med Teach. 2008;30(7):687–92. https://doi.org/10.1080/01421590802047240.
Prescription Drugs. Retrieved January 2, 2023, from https://hpi.georgetown.edu/rxdrugs/.
Share of individuals using prescribed medicine in the Netherlands in 2020, by type. Retrieved January 2, 2023, from https://www.statista.com/statistics/544017/prescribed-medicine-usage-in-the-netherlands-by-type/.
Jaam M, Naseralallah LM, Hussain TA, Pawluk SA. Pharmacist-led educational interventions provided to healthcare providers to reduce medication errors: A systematic review and meta-analysis. PLOS ONE. 2021;16(6):e0253588. https://doi.org/10.1371/journal.pone.0253588.
Weggemans MM, Van Dijk B, Van Dooijeweert B, Veenendaal AG, Ten Cate O. The postgraduate medical education pathway: an international comparison. GMS J Medical. 2017;34(5):1–16. https://doi.org/10.3205/zma001140.
Artino AR Jr, La Rochelle JS, Dezee KJ, Gehlbach H. Developing questionnaires for educational research: AMEE Guide No. 87. Med Teach. 2014;36(6):463–74. https://doi.org/10.3109/0142159X.2014.889814.
Charters E. The use of think-aloud methods in qualitative research an introduction to think-aloud methods. Brock Educ J. 2003;12(2):68–82. https://doi.org/10.26522/Brocked.v12I2.38.
Dillman DA, Phelps G, Tortora R, Swift K, Kohrell J, Berck J, et al. Response rate and measurement differences in mixed-mode surveys using mail, telephone, interactive voice response (IVR) and the Internet. Soc Sci Res. 2009;38(1):1–18. https://doi.org/10.1016/j.ssresearch.2008.03.007.
Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88. https://doi.org/10.1177/1049732305276687.
R Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. 2020. http://www.r-project.org/.
Hardigan PC, Succar CT, Fleisher JM. An analysis of response rate and economic costs between mail and web-based surveys among practicing dentists: a randomized trial. J Community Health. 2012;37(2):383–94. https://doi.org/10.1007/s10900-011-9455-6.
Desselle SP, Zgarrick DP, Ramachandran S. Faculty members’ opinions of what defines a “star” in academic pharmacy. Am J Pharm Educ. 2021;85(8):843–50. https://doi.org/10.5688/ajpe8581.
Djulbegovic B, Guyatt GH. Progress in evidence-based medicine: a quarter century on. Lancet. 2017;390(10092):415–23. https://doi.org/10.1016/S0140-6736(16)31592-6.
Chong HT, Weightman MJ, Sirichai P, Jones A. How do junior medical officers use online information resources? A survey. BMC Med Educ. 2016;16(1):1–6. https://doi.org/10.1186/s12909-016-0645-x.
Gallagher RM, Gallagher HC. Improving the working relationship between doctors and pharmacists: is inter-professional education the answer? Adv Health Sci Educ. 2012;17(2):247–57. https://doi.org/10.1007/s10459-010-9260-5.
Tubb SM, Loesch EB. Internal medicine residents’ perceptions of pharmacist involvement in medical rounds. Inov Pharm. 2021;12(2):1–7. https://doi.org/10.24926/iip.v12i2.3808.
Noble C, Brazil V, Teasdale T, Forbes M, Billett S. Developing junior doctors’ prescribing practices through collaborative practice: Sustaining and transforming the practice of communities. J Interprof Care. 2017;31(2):263–72. https://doi.org/10.1080/13561820.2016.1254164.
Hafferty FW, Franks R. The hidden curriculum, ethics teaching, and the structure of medical education. Acad Med. 1994. https://doi.org/10.1097/00001888-199411000-00001.
Mulder H, Ter Braak E, Chen HC, Ten Cate O. Addressing the hidden curriculum in the clinical workplace: A practical tool for trainees and faculty. Med Teach. 2019;41(1):36–43. https://doi.org/10.1080/0142159X.2018.1436760.
Noble C, Billett S. Learning to prescribe through co-working: junior doctors, pharmacists and consultants. Med Educ. 2017;51(4):442–51. https://doi.org/10.1111/medu.13227.
Axon DR, Lim RHM, Lewis PJ, Sandher S, Thondee J, Edwards K, et al. Junior doctors’ communication with hospital pharmacists about prescribing: findings from a qualitative interview study. Eur J Hosp Pharm. 2018;25(5):257–61. https://doi.org/10.1136/ejhpharm-2017-001449.
Lee C, McCrory R, Tully MP, Carrington A, Donnelly R, Dornan T. Readiness to prescribe: Using educational design to untie the Gordian Knot. PloS one. 2020;15(1):e0227865. https://doi.org/10.1371/journal.pone.0227865.
O’Reilly-Shah VN. Factors influencing healthcare provider respondent fatigue answering a globally administered in-app survey. PeerJ. 2017;5:e3785. https://doi.org/10.7717/peerj.3785.
Acknowledgements
The authors would like to thank Drs. Timothy Dornan, Karen Keijsers, Jody Lounsbery, Jean Moon, and Kerry Wilbur for their expert review of the survey. We thank Drs. Laura Byerly, Katherine Gruenberg, Lynnea Mills, Marilyn Stebbins, and Gustavo Valbuena for their support and scholarly critiques. We would also like to express our gratitude to the resident physicians of University of California, San Francisco, University of Minnesota, and Utrecht University who participated in this study.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethics Approval
The Institutional Review Boards of UCSF (#20–31758; Ref. #288894), UMN (#STUDY00010438), and the Netherlands Association of Medical Education Ethics Review Board (NERB Dossier #2020.6.4) approved the study.
Consent to Participate
A link to the survey, including an explanation of the study purpose and informed consent statement, was distributed by email. All respondents consented to participate.
Conflict of Interest
The authors LCF, ALP, IW, DI, and OtC declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Floren, L.C., Pittenger, A.L., Wilting, I. et al. Medical Residents’ Informal Learning from Pharmacists in the Clinical Workplace. Med.Sci.Educ. 33, 701–710 (2023). https://doi.org/10.1007/s40670-023-01784-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40670-023-01784-1