Abstract
Objective
Feedback is a critically important tool in medical education. This pilot program applies and evaluates a competency-based approach to develop residents’ skills in providing feedback to medical students.
Methods
In 2018–2019, a competency-based resident feedback skills program incorporating videorecording of skills, multi-source feedback using assessment tools with validity evidence, and sequential deliberate practice was piloted in a single-center, prospective study at the University of Rochester. Study participants included eight second-year psychiatry residents and 23 third-year clerkship students. After an introduction to foundational feedback concepts in didactic sessions, residents were videorecorded providing feedback to medical students. Recordings were reviewed with a faculty member for feedback. Skills were assessed by students who had received resident feedback, residents, and faculty utilizing a tool with validity evidence. Observations were repeated a total of three times.
Results
Mean feedback scores increased from 2.70 at the first feedback observation, to 2.77 at the second feedback observation, to 2.89 at the third feedback observation (maximum 3.00 points). The differences between the first and third sessions (0.19) and second and third sessions (0.12) were statistically significant (p values were < .001 and .007, with SE of 0.4 and 0.4, respectively).
Conclusions
The observed competency-based feedback skills training program for residents using sequential, multi-source review and feedback was feasible and effective. Direct observation is a key component of high-quality feedback, and videorecording is an efficient methodology for observations, enabling both direct observation by the assessor and opportunity for enhanced self-assessment by residents viewing themselves in the feedback encounter.
This is a preview of subscription content, log in via an institution to check access.
Data Availability
The data that support the findings of this study are not openly available due to reasons of sensitivity and are available from the corresponding author upon reasonable request. Data are located in controlled access data storage at the University of Rochester.
References
Iobst WF, Sherbino J, Cate OT, Richardson DL, Dath D, Swing SR, et al. Competency-based medical education in postgraduate medical education. Med Teach. 2010;32(8):651–6.
Holmboe ES, Sherbino J, Long DM, Swing SR, Frank JR. The role of assessment in competency-based medical education. Med Teach. 2010;32(8):676–82.
Kogan JR, Hatala R, Hauer KE, Holmboe E. Guidelines: the do’s, don’t and don’t knows of direct observation of clinical skills in medical education. Perspect Med Educ. 2017;6:286–305.
Accreditation Council for Graduate Medical Education. The program director guide to the common program requirements. 2023. Version 3. https://www.acgme.org/meetings-and-educational-activities/program-directors-guide-to-the-common-program-requirements/. Accessed 12 Sept 2023.
Tuck KK, Murchison C, Flores C, Kraakevik J. Survey of residents’ attitudes and awareness toward teaching and student feedback. J Grad Med Educ. 2014;6(4):698–703.
Liaison Committee on Medical Education. Functions and structure of a medical school, standards for accreditation of medical education programs leading to the MD degree. 2021. https://lcme.org/publications/. Accessed 12 Sept 2023.
Louie AK, Beresin EV, Coverdale J, Glendon RT, Balon R, Roberts LW. Residents as teachers. Acad Psychiatry. 2013;37(1):1–5.
Hattie J, Timperley H. The power of feedback. Rev Educ Res. 2007;99(1):81–112.
Milan F, Parish SJ, Reichgott MJ. A model for educational feedback based on clinical communication skills strategies: beyond the “feedback sandwich.” Teach Learn Med. 2006;18(1):42–7.
Ramani S, Konings KD, Ginsburg S, van der Vleuten CPM. Relationships as the backbone of feedback: exploring preceptor and resident perceptions of their behaviors during feedback conversations. Acad Med. 2020;95(7):1073–81.
Bree KK, Whicker SH, Fromme HB, et al. Residents-as-teachers publications: what can programs learn from the literature when starting a new or refining an established curriculum? J Grad Med Educ. 2014;6(2):237–48.
Crisp-Han H, Chambliss RB, Coverdale J. Teaching psychiatry residents to teach: a national survey. Acad Psychiatry. 2013;37(1):23–6.
Bing-You R, Hayes V, Varaklis K, Trowbridge R, Kemp H, McKelvy D. Feedback for learners in medical education: what is known? A scoping review. Acad Med. 2017;92:1346–54.
McKeon BA, Ricciotti HA, Sandora TJ, Ramani S, Pels R, Miloslavsky EM, Haviland MJ, Cho TA. A consensus guideline to support resident-as-teacher programs and enhance the culture of teaching and learning. J Grad Med Educ. 2019;11(3):313–18.
Halman S, Dudek N, Wood T, Pugh D, Touchie C, McAleer S, Humphrey-Murto S. Direct Observation of Clinical Skills Feedback Scale: development and validity evidence. Teach Learn Med. 2016;28(4):385–94.
Sullivan GM, Feinn R. Using effect size—or why the p value is not enough. J Grad Med Educ. 2012;4(3):279–82.
Frank JR, Snell LS, Cate OT, Holmboe ES, Carraccio C, Swing SR, et al. Competency-based medical education: theory to practice. Med Teach. 2010;32(8):638–45.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Disclosures
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Cardella, L., Lang, V., Cross, W. et al. Applying a Competency-Based Medical Education Framework to Development of Residents’ Feedback Skills. Acad Psychiatry (2024). https://doi.org/10.1007/s40596-024-01973-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s40596-024-01973-z