Journal of General Internal Medicine

, Volume 25, Issue 2, pp 129–134 | Cite as

Hand-off Education and Evaluation: Piloting the Observed Simulated Hand-off Experience (OSHE)

  • Jeanne M. Farnan
  • J. A. M. Paro
  • R. M. Rodriguez
  • S. T. Reddy
  • L. I. Horwitz
  • J. K. Johnson
  • V. M. Arora
Innovations in Education

Abstract

Aim

The Observed Simulated Hand-off Experience (OSHE) was created to evaluate medical students’ sign-out skills using a real-time assessment tool, the Hand-off CEX.

Setting

Thirty-two 4th year medical students participated as part of an elective course.

Program description

One week following an interactive workshop where students learned effective hand-off strategies, students participated in an experience in which they performed a hand-off of a mock patient using simulated history and physical examination data and a brief video.

Program evaluation

Internal medicine residents served as standardized hand-off receivers and were trained on expectations. Students were provided feedback using a newly developed Hand-off CEX, based on the “Mini-CEX,” which rates overall hand-off performance and its components on a 9-point Likert-type scale. Outcomes included performance ratings and pre- and post-student self-assessments of hand-off preparedness. Data were analyzed using Wilcoxon signed-rank tests and descriptive statistics. Resident receivers rated overall student performance with a mean score of 6.75 (range 4–9, maximum 9). Statistically significant improvement was observed in self-perceived preparedness for performing an effective hand-off (67% post- vs. 27% pre-reporting ‘well-prepared,’ p < 0.009).

Discussion

This brief, standardized hand-off training exercise improved students’ confidence and was rated highly by trained observers. Future work focuses on formal validation of the Hand-off CEX instrument.

Key Words

hand-offs simulation residency education 

Supplementary material

11606_2009_1170_MOESM1_ESM.pdf (800 kb)
Appendix AOSHE student education teaching slides (PDF 799 kb)
11606_2009_1170_MOESM2_ESM.pdf (31 kb)
Appendix BStandardized Hand-off mock chart (PDF 30.7 kb)
11606_2009_1170_MOESM3_ESM.pdf (21 kb)
Appendix COSHE training goals and objectives (PDF 21.3 kb)
11606_2009_1170_MOESM4_ESM.pdf (13 kb)
Appendix DStandardized written hand-off template (PDF 12.7 kb)
11606_2009_1170_MOESM5_ESM.pdf (867 kb)
Appendix EOSHE rater training slides (PDF 867 kb)

References

  1. 1.
    ACGME Resident duty hours language. www.acgme.org/acwebsite/dutyhours/dh_lang703.pdf ; accessed October 9, 2009.
  2. 2.
    Horwitz LI, Krumholz HM, Green ML, Huot SJ. Transfers of patient care between house staff on the internal medicine wards: A national survey. Arch Intern Med. 2006;166:1173–7.CrossRefPubMedGoogle Scholar
  3. 3.
    Sharit J, McCane L, Thevenin DM, Barach P. Examining links between sign-out reporting during shift changeovers and patient management risks. Risk Anal. 2008;28(4):969–81.CrossRefPubMedGoogle Scholar
  4. 4.
    Kitch BT, Cooper JB, Zapol JM. Hand-offs causing patient harm: a survey of medical and surgical house staff. Jt Comm J Qual Improv. 2008;34:563–70.Google Scholar
  5. 5.
    Horwitz LI, Moin T, Krumholz HM, Wang L, Bradley EH. Consequences of inadequate sign-out for patient care. Arch Intern Med. 2008;168(16):1755–60.CrossRefPubMedGoogle Scholar
  6. 6.
    Singh H, Thomas EJ, Petersen LA, Studdert DM. Medical errors involving trainees: a study of closed malpractice claims from 5 insurers. Arch Intern Med. 2007;167(19):2030–6.CrossRefPubMedGoogle Scholar
  7. 7.
    Greenberg CC, Regenbogen SE, Studdert DM, et al. Patterns of communication breakdowns resulting in injury to surgical patients. J Am Coll Surg. 2007;204(4):533–40.CrossRefPubMedGoogle Scholar
  8. 8.
    Arora V, Kao J, Lovinger D, Seiden S, Meltzer DO. Medication discrepancies during patient hand-offs: Frequency, characteristics and potential to harm. J Hosp Med. 2007;2(S2):3.Google Scholar
  9. 9.
    Jagsi R, Kitch BT, Weinstein DF, Campbell EG, Hutter M, Weissman JS. Residents report on adverse events and their causes. Arch Intern Med. 2005;165(22):2607–13.CrossRefPubMedGoogle Scholar
  10. 10.
    Arora V, Johnson J, Lovinger D, Humphrey HJ, Meltzer DO. Communication failures in patient sign-out and suggestions for improvement: a critical incident analysis. Qual Saf Health Care. 2005;14(6):401–7.CrossRefPubMedGoogle Scholar
  11. 11.
    Institute of Medicine report. Resident Duty Hours: Enhancing Sleep, Supervision, and Safety. December 2008.Google Scholar
  12. 12.
    Sinha M, Shriki J, Salness R, Blackburn PA. Need for standardized sign-out in the emergency department: a survey of emergency medicine residency and pediatric emergency medicine fellowship program directors. Acad Emerg Med. 2007;14(2):192–6.CrossRefPubMedGoogle Scholar
  13. 13.
    Langdale L, Schaad D, Wipf J, Marshall S, Vontver L, Scott CS. Preparing graduates for the first year of residency: are medical schools meeting the need? Acad Med. 2003;78(1):39–44.CrossRefPubMedGoogle Scholar
  14. 14.
    Harden RM, Stevenson M, Downie WW, Wilson GM. Assessment of clinical competence using objective structured examination. BMJ. 1975;1(5955):447–51.CrossRefPubMedGoogle Scholar
  15. 15.
    Cohen DS, Colliver JA, Marcy MS, Fried ED, Swartz MH. Psychometric properties of a standardized-patient checklist and rating-scale form used to assess interpersonal and communication skills. Acad Med. 1996;71:S87–9.PubMedCrossRefGoogle Scholar
  16. 16.
    Newble D. Techniques for measuring clinical competence: objective structured clinical examination. Med Educ. 2004;38:199–203.CrossRefPubMedGoogle Scholar
  17. 17.
    Varkey P, Gupta P, Bennet KE. An innovative method to assess negotiation skills necessary for quality improvement. Am J Med Qual. 2008;23(5):350–5.CrossRefPubMedGoogle Scholar
  18. 18.
    Zabar S, Hanley K, Stevens DL, Kalet A, et al. Measuring the competence of residents as teachers. JGIM. 2007;19(5):530–3.CrossRefGoogle Scholar
  19. 19.
    Norcini J, Blank L, Duffy FD, Fortna GS. The Mini-CEX: A Method for Assessing Clinical Skills. Ann of Internal Med. 2003;138(6):476–81.Google Scholar
  20. 20.
    Arora V, Johnson J. A model for building a standardized hand-off protocol. Joint Comm J Qual, Patient Saf. 2006;32(11):646–55.Google Scholar
  21. 21.
    Arora VM, Johnson JK, Meltzer DO, Humphrey HJ. A theoretical framework and competency-based approach to improving hand-offs. Qual Saf Health Care. 2008;17(1):11–4.CrossRefPubMedGoogle Scholar
  22. 22.
    Horwitz LI, Moin T, Green ML. Development and implementation of an oral sign-out skills curriculum. JGIM. 2007;22(10):1470–4.CrossRefPubMedGoogle Scholar
  23. 23.
    Vidyarthi A, Arora VM, Schnipper J, et al. Managing discontinuity in academic medical centers: strategies for a safe and effective resident sign-out. J Hosp Med. 2006;1(4):257–66.CrossRefPubMedGoogle Scholar
  24. 24.
    Carvalho PV, Dos Santos IL, Vidal MC. Safety implications of cultural and cognitive issues in nuclear power plant operation. Appl Ergon. 2005.Google Scholar
  25. 25.
    Helmreich RL. On error management: lessons from aviation. BMJ. 2000;320:781–5.CrossRefPubMedGoogle Scholar
  26. 26.
    Horwitz LI, Meredith T, Schuur JD, Shah NR, Kulkarni RG, Jenq GY. Dropping the Baton: a qualitative analysis of failures during the transition from emergency department to inpatient care. Ann Emerg Med. 2009;53(6):701–10.CrossRefPubMedGoogle Scholar

Copyright information

© Society of General Internal Medicine 2009

Authors and Affiliations

  • Jeanne M. Farnan
    • 1
  • J. A. M. Paro
    • 3
  • R. M. Rodriguez
    • 3
  • S. T. Reddy
    • 1
    • 3
  • L. I. Horwitz
    • 4
  • J. K. Johnson
    • 5
  • V. M. Arora
    • 2
    • 3
  1. 1.Section of Hospital Medicine, Department of MedicineThe University of ChicagoChicagoUSA
  2. 2.Section of General Internal Medicine, Department of MedicineThe University of ChicagoChicagoUSA
  3. 3.The University of Chicago, Pritzker School of MedicineChicagoUSA
  4. 4.Center for Outcomes Research and Evaluation, Yale-New Haven Hospital, New Haven CT; Section of General Internal Medicine, Department of MedicineYale University School of MedicineNew HavenUSA
  5. 5.Centre for Clinical Governance Research, Faculty of MedicineUniversity of New South WalesSydneyAustralia

Personalised recommendations