Hand-off Education and Evaluation: Piloting the Observed Simulated Hand-off Experience (OSHE)
Rent the article at a discountRent now
* Final gross prices may vary according to local VAT.Get Access
The Observed Simulated Hand-off Experience (OSHE) was created to evaluate medical students’ sign-out skills using a real-time assessment tool, the Hand-off CEX.
Thirty-two 4th year medical students participated as part of an elective course.
One week following an interactive workshop where students learned effective hand-off strategies, students participated in an experience in which they performed a hand-off of a mock patient using simulated history and physical examination data and a brief video.
Internal medicine residents served as standardized hand-off receivers and were trained on expectations. Students were provided feedback using a newly developed Hand-off CEX, based on the “Mini-CEX,” which rates overall hand-off performance and its components on a 9-point Likert-type scale. Outcomes included performance ratings and pre- and post-student self-assessments of hand-off preparedness. Data were analyzed using Wilcoxon signed-rank tests and descriptive statistics. Resident receivers rated overall student performance with a mean score of 6.75 (range 4–9, maximum 9). Statistically significant improvement was observed in self-perceived preparedness for performing an effective hand-off (67% post- vs. 27% pre-reporting ‘well-prepared,’ p < 0.009).
This brief, standardized hand-off training exercise improved students’ confidence and was rated highly by trained observers. Future work focuses on formal validation of the Hand-off CEX instrument.
- ACGME Resident duty hours language. www.acgme.org/acwebsite/dutyhours/dh_lang703.pdf ; accessed October 9, 2009.
- Horwitz, LI, Krumholz, HM, Green, ML, Huot, SJ (2006) Transfers of patient care between house staff on the internal medicine wards: A national survey. Arch Intern Med 166: pp. 1173-7 CrossRef
- Sharit, J, McCane, L, Thevenin, DM, Barach, P (2008) Examining links between sign-out reporting during shift changeovers and patient management risks. Risk Anal 28: pp. 969-81 CrossRef
- Kitch, BT, Cooper, JB, Zapol, JM (2008) Hand-offs causing patient harm: a survey of medical and surgical house staff. Jt Comm J Qual Improv 34: pp. 563-70
- Horwitz, LI, Moin, T, Krumholz, HM, Wang, L, Bradley, EH (2008) Consequences of inadequate sign-out for patient care. Arch Intern Med 168: pp. 1755-60 CrossRef
- Singh, H, Thomas, EJ, Petersen, LA, Studdert, DM (2007) Medical errors involving trainees: a study of closed malpractice claims from 5 insurers. Arch Intern Med 167: pp. 2030-6 CrossRef
- Greenberg, CC, Regenbogen, SE, Studdert, DM (2007) Patterns of communication breakdowns resulting in injury to surgical patients. J Am Coll Surg 204: pp. 533-40 CrossRef
- Arora, V, Kao, J, Lovinger, D, Seiden, S, Meltzer, DO (2007) Medication discrepancies during patient hand-offs: Frequency, characteristics and potential to harm. J Hosp Med 2: pp. 3
- Jagsi, R, Kitch, BT, Weinstein, DF, Campbell, EG, Hutter, M, Weissman, JS (2005) Residents report on adverse events and their causes. Arch Intern Med 165: pp. 2607-13 CrossRef
- Arora, V, Johnson, J, Lovinger, D, Humphrey, HJ, Meltzer, DO (2005) Communication failures in patient sign-out and suggestions for improvement: a critical incident analysis. Qual Saf Health Care 14: pp. 401-7 CrossRef
- Institute of Medicine report. Resident Duty Hours: Enhancing Sleep, Supervision, and Safety. December 2008.
- Sinha, M, Shriki, J, Salness, R, Blackburn, PA (2007) Need for standardized sign-out in the emergency department: a survey of emergency medicine residency and pediatric emergency medicine fellowship program directors. Acad Emerg Med 14: pp. 192-6 CrossRef
- Langdale, L, Schaad, D, Wipf, J, Marshall, S, Vontver, L, Scott, CS (2003) Preparing graduates for the first year of residency: are medical schools meeting the need?. Acad Med 78: pp. 39-44 CrossRef
- Harden, RM, Stevenson, M, Downie, WW, Wilson, GM (1975) Assessment of clinical competence using objective structured examination. BMJ 1: pp. 447-51 CrossRef
- Cohen, DS, Colliver, JA, Marcy, MS, Fried, ED, Swartz, MH (1996) Psychometric properties of a standardized-patient checklist and rating-scale form used to assess interpersonal and communication skills. Acad Med 71: pp. S87-9 CrossRef
- Newble, D (2004) Techniques for measuring clinical competence: objective structured clinical examination. Med Educ 38: pp. 199-203 CrossRef
- Varkey, P, Gupta, P, Bennet, KE (2008) An innovative method to assess negotiation skills necessary for quality improvement. Am J Med Qual 23: pp. 350-5 CrossRef
- Zabar, S, Hanley, K, Stevens, DL, Kalet, A (2007) Measuring the competence of residents as teachers. JGIM 19: pp. 530-3 CrossRef
- Norcini, J, Blank, L, Duffy, FD, Fortna, GS (2003) The Mini-CEX: A Method for Assessing Clinical Skills. Ann of Internal Med 138: pp. 476-81
- Arora, V, Johnson, J (2006) A model for building a standardized hand-off protocol. Joint Comm J Qual, Patient Saf 32: pp. 646-55
- Arora, VM, Johnson, JK, Meltzer, DO, Humphrey, HJ (2008) A theoretical framework and competency-based approach to improving hand-offs. Qual Saf Health Care 17: pp. 11-4 CrossRef
- Horwitz, LI, Moin, T, Green, ML (2007) Development and implementation of an oral sign-out skills curriculum. JGIM 22: pp. 1470-4 CrossRef
- Vidyarthi, A, Arora, VM, Schnipper, J (2006) Managing discontinuity in academic medical centers: strategies for a safe and effective resident sign-out. J Hosp Med 1: pp. 257-66 CrossRef
- Carvalho PV, Dos Santos IL, Vidal MC. Safety implications of cultural and cognitive issues in nuclear power plant operation. Appl Ergon. 2005.
- Helmreich, RL (2000) On error management: lessons from aviation. BMJ 320: pp. 781-5 CrossRef
- Horwitz, LI, Meredith, T, Schuur, JD, Shah, NR, Kulkarni, RG, Jenq, GY (2009) Dropping the Baton: a qualitative analysis of failures during the transition from emergency department to inpatient care. Ann Emerg Med 53: pp. 701-10 CrossRef
- Hand-off Education and Evaluation: Piloting the Observed Simulated Hand-off Experience (OSHE)
Journal of General Internal Medicine
Volume 25, Issue 2 , pp 129-134
- Cover Date
- Print ISSN
- Online ISSN
- Additional Links
- residency education
- Industry Sectors
- Author Affiliations
- 1. Section of Hospital Medicine, Department of Medicine, The University of Chicago, 5841 South Maryland Ave., MC 2007, Room W216, Chicago, IL, 60637, USA
- 3. The University of Chicago, Pritzker School of Medicine, Chicago, IL, USA
- 4. Center for Outcomes Research and Evaluation, Yale-New Haven Hospital, New Haven CT; Section of General Internal Medicine, Department of Medicine, Yale University School of Medicine, New Haven, CT, USA
- 5. Centre for Clinical Governance Research, Faculty of Medicine, University of New South Wales, Sydney, Australia
- 2. Section of General Internal Medicine, Department of Medicine, The University of Chicago, Chicago, IL, USA