Abstract
Introduction
Teaching is an important competency in graduate medical education (GME). Many residency programs have implemented curricula to develop residents’ teaching skills and observed structured teaching experiences (OSTEs) have been used to assess these skills. There is an increasing focus on building teaching skills earlier in the medical education continuum, however, there is limited literature on assessing medical students’ teaching skills. The authors developed an OSTE for medical students enrolled in a students-as-teachers course to address this gap and provide formative feedback on teaching skills.
Materials and Methods
OSTEs were conducted for fourth-year medical students (M4s) enrolled in a Students as Teachers Advanced Elective at a US medical school. An M4 observed a first-year medical student (M1) during a simulated encounter with a standardized patient. The M4 gave feedback and a chalk talk. A physician observer assessed the M4’s teaching using the modified Stanford Faculty Development Program (SFDP) questionnaire. The M1s and M4s also completed the SFDP. The M4 completed pre- and post-OSTE self-efficacy surveys (score range 6-30) and a post-OSTE acceptability survey.
Results
All (30/30) M4s completed the OSTE. The SFDP identified common teaching strengths and areas for growth. ANOVA tests demonstrated significant differences between the mean (SD) scores from physician assessors, M1s, and M4s [4.56 (0.63) vs. 4.87 (0.35) vs. 4.08 (0.74), p<0.001]. There was a statistically significant difference in mean (SD) self-efficacy scores pre- and post-OSTE [18.72 (3.39) vs. 23.83 (3.26), p<0.001]. All M4s (30/30) somewhat or strongly agreed with all three OSTE acceptability questions.
Lessons Learned
The authors successfully conducted an OSTE in an M4 advanced elective. The OSTE was highly acceptable to participants, and M4s demonstrated improved teaching self-efficacy. Further research should explore the validity of the OSTE to measure medical students’ teaching skills and the long-term impact of developing teaching skills in medical school.
Similar content being viewed by others
Data Availability
Deidentified data is available from the authors on request.
References
McKeon BA, Ricciotti HA, Sandora TJ, et al. A consensus guideline to support resident-as-teacher programs and enhance the culture of teaching and learning. J Grad Med Educ. 2019;11(3):313–8. https://doi.org/10.4300/JGME-D-18-00612.1.
Smith CC, Newman LR, Huang GC. Those who teach, can do: characterizing the relationship between teaching and clinical skills in a residency program. J Grad Med Educ. 2018;10(4):459–63. https://doi.org/10.4300/JGME-D-18-00039.1.
Zackoff MW, Real FJ, DeBlasio D, et al. Objective assessment of resident teaching competency through a longitudinal, clinically integrated, resident-as-teacher curriculum. Acad Pediatr. 2019;19(6):698–702. https://doi.org/10.1016/j.acap.2019.01.011.
Trowbridge RL, Snydman LK, Skolfield J, Hafler J, Bing-You RG. A systematic review of the use and effectiveness of the Objective Structured Teaching Encounter. Med Teach. 2011;33(11):893–903. https://doi.org/10.3109/0142159X.2011.577463.
Jhaveri VV, Currier PF, Johnson JH. Bridging the gap between do one and teach one: impact of a procedural objective structured teaching encounter on resident procedural teaching proficiency. Med Sci Educ. 2020;30(2):905–10. https://doi.org/10.1007/s40670-020-00972-7. Published 2020 May 6.
Jones N, Milanes L, Banales V, Price I, Gomez I, Hughes S. Difficult interpersonal encounters with medical students and residents: Two Objective Standardized Teaching Encounters. MedEdPORTAL. 2017;13:10640. Published 2017 Oct 11. https://doi.org/10.15766/mep_2374-8265.10640.
Bahar RC, O’Shea AW, Li ES, et al. The pipeline starts in medical school: characterizing clinician-educator training programs for U.S. medical students. Med Educ Online. 2022;27(1):2096841. https://doi.org/10.1080/10872981.2022.2096841.
Mintz M, Southern DA, Ghali WA, Ma IW. Validation of the 25-item Stanford Faculty Development Program Tool on clinical teaching effectiveness. Teach Learn Med. 2015;27(2):174–81. https://doi.org/10.1080/10401334.2015.1011645.
Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O’Neal L, McLeod L, Delacqua G, Delacqua F, Kirby J, Duda SN, REDCap Consortium. The REDCap consortium: building an international community of software partners. J Biomed Inform. 2019;95:103208. https://doi.org/10.1016/j.jbi.2019.103208.
Rosenzveig A, Raiche I, Fung BSC, Gawad N. Self-assessment in general Surgery applicants: an insight into interview performance. J Surg Res. 2022;273:155–60. https://doi.org/10.1016/j.jss.2021.12.031.
Acknowledgements
This case used in the OSTE was originally written and developed by Hannah G. Kay, MD and Jill Braddock-Watson, MA-CCC-SLP. The authors wish to thank Jill Braddock-Watson and the Center for Experiential Learning and Assessment (CELA) at Vanderbilt University Medical Center for assistance with case simulation design and implementation.
Funding
No funds, grants, or other support was received.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing Interests
The authors have no relevant financial or non-financial interests to disclose.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards. This study was deemed to be exempt by the Vanderbilt IRB (##210874).
Consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Mahoney, M.R., Gayoso, M.E., Belsky, N.A. et al. Observed Structured Teaching Experiences (OSTEs) in a Students as Teachers Course. Med.Sci.Educ. 34, 13–18 (2024). https://doi.org/10.1007/s40670-023-01952-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40670-023-01952-3