Academic Psychiatry

, Volume 26, Issue 3, pp 134–161 | Cite as

Creating, Monitoring, and Improving a Psychiatry OSCE

A Guide for Faculty
  • Brian Hodges
  • Mark Hanson
  • Nancy McNaughton
  • Glenn Regehr
Special Article


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Harden RM, Gleeson FA: Assessment of clinical competence using an observed structured clinical examination. Med Educ 1979; 13: 41–47PubMedGoogle Scholar
  2. 2.
    Barrows HS, Abrahamson S: The programmed patient: a technique for appraising student performance in clinical neurology. Journal of Medical Education 1964; 39: 802–805PubMedGoogle Scholar
  3. 3.
    van der Vleuten CPM, Swanson D: Assessment of clinical skills with standardized patients: state of the art. Teaching and Learning in Medicine 1990; 2: 58–76CrossRefGoogle Scholar
  4. 4.
    Abrahmson S (ed): The oral examination: the case for and against, in Evaluating the Clinical Skills of Medical Specialists. Evanston, IL, American Board of Medical Specialties, 1983, pp 121–124Google Scholar
  5. 5.
    McGuire CH: The oral examination as a measure of professional competence. Journal of Medical Education 1966; 41: 267–274PubMedGoogle Scholar
  6. 6.
    Davidson RG: A point of view: oral examinations (letter). Annals of the Royal College of Physicians and Surgeons of Canada [Annals RCPSC] 1983; 16: 114Google Scholar
  7. 7.
    Valberg LS, Stuart RK: A point of view: university in-training evaluation and oral examinations in internal medicine. Annals RCPSC 1983; 16: 513–515Google Scholar
  8. 8.
    Jayawickramarajah PT: Oral examinations in medical education. Med Educ 1985; 19: 290–293PubMedCrossRefGoogle Scholar
  9. 9.
    Muzzin LJ, Hart L: Oral examinations, in Assessing Clinical Competence, edited by Neufeld VR, Norman GR. New York, Springer, 1985, pp 71–93Google Scholar
  10. 10.
    Leichner P, Sisler GC, Harper D: A study of the reliability of the clinical oral examination in psychiatry. Can J Psychiatry 1984; 29: 394–397PubMedGoogle Scholar
  11. 11.
    Leichner P, Sisler GC, Harper D: The clinical oral examination in psychiatry: the patient variable. Annals RCPSC 1986; 19: 283–284Google Scholar
  12. 12.
    Rothman AI, Cohen R: Understanding the objective structured clinical examination (OSCE): issues and options. Annals RCPSC 1995; 28: 283–287Google Scholar
  13. 13.
    Kowlovitz V, Hoole AJ, Sloane PD: Implementing the objective structured clinical examination in a traditional medical school. Acad Med 1991; 66: 345–347CrossRefGoogle Scholar
  14. 14.
    Matsell DG, Wolfish NM, Hsu E: Reliability and validity of the objective structured clinical examination in paediatrics. Med Educ 1991; 25: 293–299PubMedCrossRefGoogle Scholar
  15. 15.
    Sloan DA, Donnelly MB, Johnson SB, et al: Use of an objective structured clinical examination to measure improvement in clinical competence during the surgical internship. Surgery 1993; 114: 343–351PubMedGoogle Scholar
  16. 16.
    McFaul PB, Taylor DJ, Howie PW: The assessment of clinical competence in obstetrics and gynecology in two medical schools by an objective structured clinical examination. British Journal of Obstetrics and Gynaecology 1993; 100: 842–846PubMedCrossRefGoogle Scholar
  17. 17.
    Cohen R, Rothman A, Ross J, et al: A comprehensive assessment of graduates of foreign medical schools. Annals RCPSC 1989; 21: 505–509Google Scholar
  18. 18.
    Hodges B, Turnbull J, Cohen R, et al: Evaluating communication skills in the OSCE format: reliability and generalizability. Med Educ 1996; 30: 38–43PubMedCrossRefGoogle Scholar
  19. 19.
    Loschen EL: Using the objective structured clinical examination in a psychiatry residency. Academic Psychiatry 1993; 17: 95–104Google Scholar
  20. 20.
    Famuyiwa OO, Zachariah MP, Ilechukwu STC: The objective structured clinical exam in psychiatry. Med Educ 1991; 25: 45–50PubMedCrossRefGoogle Scholar
  21. 21.
    Hodges B, Lofchy J: Examining psychiatry clinical clerks with a mini-OSCE. Academic Psychiatry 1997; 21: 219–225Google Scholar
  22. 22.
    Hodges B, Regehr G, Hanson M, et al: Evaluating psychiatric clinical clerks with an objective structured clinical examination. Acad Med 1997; 72: 715–721PubMedCrossRefGoogle Scholar
  23. 23.
    Hodges B, Regehr G, Hanson M, et al: The objective structured clinical exam in psychiatry: a validation study. Acad Med 1998; 73: 74–76CrossRefGoogle Scholar
  24. 24.
    Hanson M, Hodges B, McNaughton N, et al: The integration of child psychiatry into a psychiatry clerkship OSCE. Can J Psychiatry 1998; 43: 614–618PubMedGoogle Scholar
  25. 25.
    Hodges B, Hanson M, McNaughton N, et al: What do psychiatry residents think of an objective structured clinical examination? Academic Psychiatry 1999; 23: 1–7Google Scholar
  26. 26.
    McNaughton N, Tiberius R, Hodges B: Effects of portraying psychologically and emotionally complex standardized patient roles. Teaching and Learning in Medicine 1999; 11: 135–141CrossRefGoogle Scholar
  27. 27.
    Cusimano MD, Cohen R, Tucker W, et al: A comparative analysis of the costs of administration of an OSCE. Acad Med 1994; 69: 571–576PubMedCrossRefGoogle Scholar
  28. 28.
    Reznick R, Regehr G, Yee G, et al: Process rating forms versus task-specific checklists in an OSCE for medical licensure. Acad Med 1998; 73(10, suppl): S97–S99PubMedCrossRefGoogle Scholar
  29. 29.
    Regehr G, MacRae H, Reznick R, et al: Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE-format examination. Acad Med 1998; 73: 993–997PubMedCrossRefGoogle Scholar
  30. 30.
    Regehr G, Freeman R, Robb A, et al: OSCE performance evaluations made by standardized patients: comparing checklist and global rating scores. Acad Med 1999; 74(10, suppl): S135–S137PubMedCrossRefGoogle Scholar
  31. 31.
    Hunter DM, Jones RM, Randhawa BS: The use of holistic versus analytic scoring for large-scale assessment of writing. The Canadian Journal of Program Evaluation 1996; 11: 61–85Google Scholar
  32. 32.
    Charlin B, Tardif J, Boshuizen PA: Scripts and medical diagnostic knowledge: theory and applications for clinical reasoning instruction and research. Acad Med 2000; 72: 182–190CrossRefGoogle Scholar
  33. 33.
    Hodges B, Regehr G, McNaughton N, et al: OSCE checklists do not capture increasing levels of expertise. Acad Med 1999; 74: 1129–1134PubMedCrossRefGoogle Scholar
  34. 34.
    Hodges B, McNaughton N, Regehr G, et al: The challenge of creating OSCE measures to capture the characteristics of expertise. Med Educ (in press)Google Scholar
  35. 35.
    Regehr G, Freeman R, Hodges B, et al: Assessing the generalizability of OSCE measures across content domains. Acad Med 1999; 74: 1320–1322PubMedCrossRefGoogle Scholar
  36. 36.
    Barrows HS: Simulated Patients (Programmed Patients): Development and Use of a New Technique in Medical Education. Springfield, IL, CC Thomas, 1971Google Scholar
  37. 37.
    Stillman P, Ruggill JS, Rutala PJ, et al: Patient instructors as teachers and evaluators. Journal of Medical Education 1980; 55: 186–193PubMedGoogle Scholar
  38. 38.
    King A, Perkowski-Roger L, Pohl S: Planning standardized patient programs: case development, patient training and costs. Teaching and Learning in Medicine 1994; 6: 6–14CrossRefGoogle Scholar
  39. 39.
    Hanson M, Tiberius R, Hodges B, et al: Adolescent standardized patients: methods of selection and assessment of benefits and risks. Teaching and Learning in Medicine 2002; 14: 104–113PubMedCrossRefGoogle Scholar
  40. 40.
    Educating Future Physicians for Ontario: How to Run an OSCE (video and manual). University of Toronto, University of Ottawa, Queen’s University, McMaster University, and University of Western Ontario, 1994 [See Appendix B for ordering information.]Google Scholar
  41. 41.
    Hodges B, Russell L, MacRury K, et al: The anatomy of an OSCE station: augmenting classical item statistics with expert item classification (abstract). Proceedings of the International Ottawa Conference on Assessment, Maastricht, The Netherlands, 1996Google Scholar
  42. 42.
    Hambleton RK, Powell S: A framework for viewing the process of standard setting. Evaluation and the Health Professions 1983; 6: 3–24PubMedCrossRefGoogle Scholar
  43. 43.
    Meskauskas JA: Setting standards for credentialling examinations: an update. Evaluation and the Health Professions 1986; 9: 187–203CrossRefGoogle Scholar

Copyright information

© Academic Psychiatry 2002

Authors and Affiliations

  • Brian Hodges
    • 1
  • Mark Hanson
    • 2
  • Nancy McNaughton
    • 2
  • Glenn Regehr
    • 2
  1. 1.Department of Psychiatry and Wilson Centre for Research in Education, Faculty of MedicineUniversity of TorontoTorontoCanada
  2. 2.Psychiatric Skills Assessment Project teamUniversity of TorontoTorontoCanada

Personalised recommendations