Hand-off Education and Evaluation: Piloting the Observed Simulated Hand-off Experience (OSHE)
Rent the article at a discountRent now
* Final gross prices may vary according to local VAT.Get Access
The Observed Simulated Hand-off Experience (OSHE) was created to evaluate medical students’ sign-out skills using a real-time assessment tool, the Hand-off CEX.
Thirty-two 4th year medical students participated as part of an elective course.
One week following an interactive workshop where students learned effective hand-off strategies, students participated in an experience in which they performed a hand-off of a mock patient using simulated history and physical examination data and a brief video.
Internal medicine residents served as standardized hand-off receivers and were trained on expectations. Students were provided feedback using a newly developed Hand-off CEX, based on the “Mini-CEX,” which rates overall hand-off performance and its components on a 9-point Likert-type scale. Outcomes included performance ratings and pre- and post-student self-assessments of hand-off preparedness. Data were analyzed using Wilcoxon signed-rank tests and descriptive statistics. Resident receivers rated overall student performance with a mean score of 6.75 (range 4–9, maximum 9). Statistically significant improvement was observed in self-perceived preparedness for performing an effective hand-off (67% post- vs. 27% pre-reporting ‘well-prepared,’ p < 0.009).
This brief, standardized hand-off training exercise improved students’ confidence and was rated highly by trained observers. Future work focuses on formal validation of the Hand-off CEX instrument.
- ACGME Resident duty hours language. www.acgme.org/acwebsite/dutyhours/dh_lang703.pdf ; accessed October 9, 2009.
- Horwitz LI, Krumholz HM, Green ML, Huot SJ. Transfers of patient care between house staff on the internal medicine wards: A national survey. Arch Intern Med. 2006;166:1173–7. CrossRef
- Sharit J, McCane L, Thevenin DM, Barach P. Examining links between sign-out reporting during shift changeovers and patient management risks. Risk Anal. 2008;28(4):969–81. CrossRef
- Kitch BT, Cooper JB, Zapol JM. Hand-offs causing patient harm: a survey of medical and surgical house staff. Jt Comm J Qual Improv. 2008;34:563–70.
- Horwitz LI, Moin T, Krumholz HM, Wang L, Bradley EH. Consequences of inadequate sign-out for patient care. Arch Intern Med. 2008;168(16):1755–60. CrossRef
- Singh H, Thomas EJ, Petersen LA, Studdert DM. Medical errors involving trainees: a study of closed malpractice claims from 5 insurers. Arch Intern Med. 2007;167(19):2030–6. CrossRef
- Greenberg CC, Regenbogen SE, Studdert DM, et al. Patterns of communication breakdowns resulting in injury to surgical patients. J Am Coll Surg. 2007;204(4):533–40. CrossRef
- Arora V, Kao J, Lovinger D, Seiden S, Meltzer DO. Medication discrepancies during patient hand-offs: Frequency, characteristics and potential to harm. J Hosp Med. 2007;2(S2):3.
- Jagsi R, Kitch BT, Weinstein DF, Campbell EG, Hutter M, Weissman JS. Residents report on adverse events and their causes. Arch Intern Med. 2005;165(22):2607–13. CrossRef
- Arora V, Johnson J, Lovinger D, Humphrey HJ, Meltzer DO. Communication failures in patient sign-out and suggestions for improvement: a critical incident analysis. Qual Saf Health Care. 2005;14(6):401–7. CrossRef
- Institute of Medicine report. Resident Duty Hours: Enhancing Sleep, Supervision, and Safety. December 2008.
- Sinha M, Shriki J, Salness R, Blackburn PA. Need for standardized sign-out in the emergency department: a survey of emergency medicine residency and pediatric emergency medicine fellowship program directors. Acad Emerg Med. 2007;14(2):192–6. CrossRef
- Langdale L, Schaad D, Wipf J, Marshall S, Vontver L, Scott CS. Preparing graduates for the first year of residency: are medical schools meeting the need? Acad Med. 2003;78(1):39–44. CrossRef
- Harden RM, Stevenson M, Downie WW, Wilson GM. Assessment of clinical competence using objective structured examination. BMJ. 1975;1(5955):447–51. CrossRef
- Cohen DS, Colliver JA, Marcy MS, Fried ED, Swartz MH. Psychometric properties of a standardized-patient checklist and rating-scale form used to assess interpersonal and communication skills. Acad Med. 1996;71:S87–9. CrossRef
- Newble D. Techniques for measuring clinical competence: objective structured clinical examination. Med Educ. 2004;38:199–203. CrossRef
- Varkey P, Gupta P, Bennet KE. An innovative method to assess negotiation skills necessary for quality improvement. Am J Med Qual. 2008;23(5):350–5. CrossRef
- Zabar S, Hanley K, Stevens DL, Kalet A, et al. Measuring the competence of residents as teachers. JGIM. 2007;19(5):530–3. CrossRef
- Norcini J, Blank L, Duffy FD, Fortna GS. The Mini-CEX: A Method for Assessing Clinical Skills. Ann of Internal Med. 2003;138(6):476–81.
- Arora V, Johnson J. A model for building a standardized hand-off protocol. Joint Comm J Qual, Patient Saf. 2006;32(11):646–55.
- Arora VM, Johnson JK, Meltzer DO, Humphrey HJ. A theoretical framework and competency-based approach to improving hand-offs. Qual Saf Health Care. 2008;17(1):11–4. CrossRef
- Horwitz LI, Moin T, Green ML. Development and implementation of an oral sign-out skills curriculum. JGIM. 2007;22(10):1470–4. CrossRef
- Vidyarthi A, Arora VM, Schnipper J, et al. Managing discontinuity in academic medical centers: strategies for a safe and effective resident sign-out. J Hosp Med. 2006;1(4):257–66. CrossRef
- Carvalho PV, Dos Santos IL, Vidal MC. Safety implications of cultural and cognitive issues in nuclear power plant operation. Appl Ergon. 2005.
- Helmreich RL. On error management: lessons from aviation. BMJ. 2000;320:781–5. CrossRef
- Horwitz LI, Meredith T, Schuur JD, Shah NR, Kulkarni RG, Jenq GY. Dropping the Baton: a qualitative analysis of failures during the transition from emergency department to inpatient care. Ann Emerg Med. 2009;53(6):701–10. CrossRef
- Hand-off Education and Evaluation: Piloting the Observed Simulated Hand-off Experience (OSHE)
Journal of General Internal Medicine
Volume 25, Issue 2 , pp 129-134
- Cover Date
- Print ISSN
- Online ISSN
- Additional Links
- residency education
- Industry Sectors
- Author Affiliations
- 1. Section of Hospital Medicine, Department of Medicine, The University of Chicago, 5841 South Maryland Ave., MC 2007, Room W216, Chicago, IL, 60637, USA
- 3. The University of Chicago, Pritzker School of Medicine, Chicago, IL, USA
- 4. Center for Outcomes Research and Evaluation, Yale-New Haven Hospital, New Haven CT; Section of General Internal Medicine, Department of Medicine, Yale University School of Medicine, New Haven, CT, USA
- 5. Centre for Clinical Governance Research, Faculty of Medicine, University of New South Wales, Sydney, Australia
- 2. Section of General Internal Medicine, Department of Medicine, The University of Chicago, Chicago, IL, USA