Academic Psychiatry

, Volume 38, Issue 1, pp 26–34 | Cite as

The Psychiatry OSCE: A 20-Year Retrospective

  • Brian D. Hodges
  • Elisa Hollenberg
  • Nancy McNaughton
  • Mark D. Hanson
  • Glenn Regehr
IN DEPTH ARTICLE: Systematic Review

Abstract

Objective

Twenty years ago researchers at the University of Toronto launched the Psychiatry Skills Assessment Project (PSAP), a research program exploring Objective Structured Clinical Examinations (OSCEs) in psychiatry. Between 1994 and 2005 PSAP produced publications on the feasibility, reliability, validity, ethics, and practical concerns of OSCEs in psychiatry. The current review has two parts: a review of the state of the art of OSCEs in psychiatry 20 years after they were introduced and documentation of the impact of the PSAP research program.

Methods

A literature search identified all publications on OSCEs and psychiatry. Articles were coded thematically, and locations of agreement and controversies were identified. Bibliometric analysis identified citations of PSAP research papers, which were analyzed thematically.

Results

As of May 2013, there were 250 publications related to OSCEs in psychiatry (not including 10 PSAP papers), published in 29 different countries and ten languages. Prominent topics were the validity and acceptability of OSCEs and SPs, systems issues in adopting OSCEs in psychiatry, and the effects on learning. Eighty-eight percent of all publications cited PSAP work (300 citations). Citations were employed for four purposes: as evidence/justification (54 %); to frame replication research (14 %); to support adaptation of OSCEs in other countries and professions (15 %); and for debate (18 %).

Conclusions

Over the past 20 years, use of OSCEs has grown steadily in psychiatry, and several national certification organizations have adopted OSCEs. PSAP work, introduced two decades ago, continues to provide a scholarly foundation for psychometric, practical, and ethical issues of interest to this field.

Keywords

Medical education Psychiatry education Assessment Objective structured clinical examination 

References

  1. 1.
    Loschen EL. Using the objective structured clinical examination in a psychiatry residency. Acad Psychiatry. 1993;17:95–104.PubMedCrossRefGoogle Scholar
  2. 2.
    Famuyiwa OO, Zachariah MP, Ilechukwu STC. The objective structured clinical exam in psychiatry. Med Educ. 1991;25:45–50.PubMedCrossRefGoogle Scholar
  3. 3.
    Hodges B, Lofchy J. Evaluating psychiatry clinical clerks with a mini-objective structured clinical examination. Acad Psychiatry. 1997;21:219–25.PubMedCrossRefGoogle Scholar
  4. 4.
    Robinson DJ. A training and examination program to prepare psychiatric residents for OSCE-style exams. Acad Psychiatry. 2009;33:331–4.PubMedCrossRefGoogle Scholar
  5. 5.
    Thompson CM. Will the CASC stand the test? A review and critical evaluation of the new MRCPsych clinical examination. Psychiatrist. 2009;33:145–8.Google Scholar
  6. 6.
    Schowalter JE. Standardized patients: a future possibility? Am Board Psychiatry Neurol Newsl. 2001;7:3.Google Scholar
  7. 7.
    Taghva A, Mir-Sepassi GR, Zarghami M. A brief report on the implementation of an objective structured clinical examination (OSCE) in the 2006 Iranian Board of Psychiatry Examination. Iran J Psychiatry Behav Sci. 2007;1:39–40.Google Scholar
  8. 8.
    Al Sinawi H, Al Sharbati M, Obaid Y, et al. Preparing and conducting objective structured clinical examination for Oman medical specialty board R1–R4 residents. Oman Med J. 2012;27:246–8.PubMedCentralPubMedCrossRefGoogle Scholar
  9. 9.
    Hodges B, Regehr G, Hanson M, et al. The objective structured clinical examination for evaluating psychiatric clinical clerks. Acad Med. 1997;72:715–21.PubMedCrossRefGoogle Scholar
  10. 10.
    Hodges B, Regehr G, Hanson M, et al. Validation of an objective structured clinical examination in psychiatry. Acad Med. 1998;73:910–2.PubMedCrossRefGoogle Scholar
  11. 11.
    Hanson M, Hodges B, McNaughton N, et al. The integration of child psychiatry into a psychiatry clerkship OSCE. Can J Psychiatry. 1998;43:614–8.PubMedGoogle Scholar
  12. 12.
    Hodges B, Hanson M, McNaughton N, et al. What do psychiatry residents think of an OSCE? Acad Psychiatry. 1999;23:198–204.Google Scholar
  13. 13.
    McNaughton N, Tiberius R, Hodges B. Effects of portraying psychologically and emotionally complex standardized patient roles. Teach Learn Med. 1999;11:135–41.CrossRefGoogle Scholar
  14. 14.
    Hanson M, Tiberius R, Hodges B, et al. Adolescent standardized patients: methods of selection and assessment of benefits and risks. Teach Learn Med. 2002;14:104–13.PubMedCrossRefGoogle Scholar
  15. 15.
    Hanson M, Tiberius R, Hodges B, et al. Implications of suicide contagion for the selection of adolescent standardized patients. Acad Med. 2002;77:S100–2.PubMedCrossRefGoogle Scholar
  16. 16.
    Hodges B, Hanson M, McNaughton N, et al. Creating, monitoring and improving a psychiatry OSCE: a guide for faculty. Acad Psychiatry. 2002;26:134–61.PubMedCrossRefGoogle Scholar
  17. 17.
    Sauer J, Hodges B, Santhouse A, et al. The OSCE has landed: one small step for British psychiatry? Acad Psychiatry. 2005;29:310–5.PubMedCrossRefGoogle Scholar
  18. 18.
    Barrows HS, Abrahamson S. The programmed patient: a technique for appraising student performance in clinical neurology. J Med Educ. 1964;39:802–5.PubMedGoogle Scholar
  19. 19.
    Harden RM, Stevenson M, Downie WW, et al. Assessment of clinical competence using objective structured examinations. Br Med J. 1975;1:447–51.PubMedCentralPubMedCrossRefGoogle Scholar
  20. 20.
    Hodges BD. The objective structured clinical examination: a socio-history. Koln: LAP; 2009.Google Scholar
  21. 21.
    Park RS, Chibnall JT, Blaskiewicz RJ, et al. Construct validity of an objective structured clinical examination (OSCE) in psychiatry: associations with the clinical skills examination and other indicators. Acad Psychiatry. 2004;28:122–8.PubMedCrossRefGoogle Scholar
  22. 22.
    Walters K, Osborn D, Raven P. The development, validity and reliability of a multimodality objective structured clinical examination in psychiatry. Med Educ. 2005;39:292–8.PubMedCrossRefGoogle Scholar
  23. 23.
    Vaidya NA. Psychiatry clerkship objective structured clinical examination is here to stay. Acad Psychiatry. 2008;32:177–9.PubMedCrossRefGoogle Scholar
  24. 24.
    Amr M, Amin T. Assessment methods of an undergraduate psychiatry course at a Saudi university. Sultan Qaboos Univ Med J. 2012;12:214–20.PubMedCentralPubMedGoogle Scholar
  25. 25.
    Ismail WSW, ZamZam R, Jaafar NRN, et al. Objective structured clinical examination (OSCE) in psychiatry new curriculum undergraduate posting and its standard setting procedure: an experience in Universiti Kebangsaan Malaysia (Ukm). ASEAN J Psychiatry. 2010;11:118–27.Google Scholar
  26. 26.
    Benning T, Broadhurst M. The long case is dead—long live the long case loss of the Mrcpsych long case and holism in psychiatry. Psychiatrist. 2007;31:441–2.Google Scholar
  27. 27.
    Rasoulian M, Taghva A, Panaghi L, et al. A qualitative study of psychiatrists’ view about a pilot objective structured clinical examination (OSCE) in Iran. Iran J Psychiatry Behav Sci. 2007;1:27–9.Google Scholar
  28. 28.
    Marwaha S. Objective structured clinical examinations (OSCEs), psychiatry and the clinical assessment of skills and competencies (CASC) same evidence, different judgment. BMC Psychiatry. 2011;11:85.PubMedCentralPubMedCrossRefGoogle Scholar
  29. 29.
    Taghva A, Panaghi L, Rasoulian M, et al. Evaluation of reliability and validity of the psychiatry OSCE in Iran. Acad Psychiatry. 2010;34:154–7.PubMedCrossRefGoogle Scholar
  30. 30.
    Yudkowsky R. Should we use standardized patients instead of real patients for high-stakes exams in psychiatry? Acad Psychiatry. 2002;26:187–92.PubMedCrossRefGoogle Scholar
  31. 31.
    Taghva A, Bolhari J, Bahador H, et al. How to run psychiatry OSCE in three days. Iran J Psychiatry Behav Sci. 2008;2:5–9.Google Scholar
  32. 32.
    Ramchandani D. End of third-year objective structured clinical examination: boon or bane? Acad Psychiatry. 2008;32:173–6.PubMedCrossRefGoogle Scholar
  33. 33.
    Birndorf CA, Kaye ME. Teaching the mental status examination to medical students by using a standardized patient in a large group setting. Acad Psychiatry. 2002;26:180–3.PubMedCrossRefGoogle Scholar
  34. 34.
    Dave S. Simulation in psychiatric teaching. Adv Psychiatr Treat. 2012;18:292–8.CrossRefGoogle Scholar
  35. 35.
    Hall MJ, Adamo G, McCurry L, et al. Use of standardized patients to enhance a psychiatry clerkship. Acad Med. 2004;79:28–31.PubMedCrossRefGoogle Scholar
  36. 36.
    Sadeghi M, Taghva A, Mirsepassi G, et al. How do examiners and examinees think about role-playing of standardized patients in an OSCE setting? Acad Psychiatry. 2007;31:358–62.PubMedCrossRefGoogle Scholar
  37. 37.
    Brenner A. Uses and limitations of simulated patients in psychiatric education. Acad Psychiatry. 2009;33:112–9.PubMedCrossRefGoogle Scholar
  38. 38.
    Krahn LE, Bostwick JM, Sutor B, et al. The challenge of empathy: a pilot study of the use of standardized patients to teach introductory psychopathology to medical students. Acad Psychiatry. 2002;26:26–30.PubMedCrossRefGoogle Scholar
  39. 39.
    Merckelbach H, Merten T. A note on cognitive dissonance and malingering. Clin Neuropsychol. 2012;26:1217–29.PubMedCrossRefGoogle Scholar
  40. 40.
    Boerjan M, Boone F, Anthierens S, et al. The impact of repeated simulation on health and healthcare perceptions of simulated patients. Patient Educ Couns. 2008;73:22–7.PubMedCrossRefGoogle Scholar
  41. 41.
    Bokken L, van Dalen J, Rethans JJ. The impact of simulation on people who act as simulated patients: a focus group study. Med Educ. 2006;40:781–6.PubMedCrossRefGoogle Scholar
  42. 42.
    Gerzina HA, Porfeli EJ. Mindfulness as a predictor of positive reappraisal and burnout in standardized patients. Teach Learn Med. 2012;24:309–14.PubMedCrossRefGoogle Scholar
  43. 43.
    Hodges BD, McNaughton N. Who should be an OSCE examiner? Acad Psychiatry. 2009;33:282–4.PubMedCrossRefGoogle Scholar
  44. 44.
    Whelan P, Church L, Kadry K. Using standardized patients’ marks in scoring postgraduate psychiatry OSCEs. Acad Psychiatry. 2009;33:319–22.PubMedCrossRefGoogle Scholar
  45. 45.
    Melding P, Coverdale J, Robinson E. A ‘fair play’? Comparison of an objective structured clinical examination of final year medical students training in psychiatry and their supervisors’ appraisals. Australas Psychiatry. 2002;10:344–7.CrossRefGoogle Scholar
  46. 46.
    McMullen I, Checinski K, Halliwell S, et al. Peer observation in simulated CASC events and its effects on learning. Psychiatrist. 2013;37:111–5.CrossRefGoogle Scholar
  47. 47.
    Wallace J, Rao R, Haslam R. Simulated patients and objective structured clinical examinations: review of their use in medical education. Adv Psychiatr Treat. 2002;8:342–8.CrossRefGoogle Scholar
  48. 48.
    Yak A, Abdul-Hamid WK, Chad R. The objective structured clinical examination (OSCE). Psychiatrist. 2004;28:265–6.Google Scholar
  49. 49.
    Rudland J, Wilkinson T, Smith-Han K, et al. “You can do it late at night or in the morning. You can do it at home, I did it with my flatmate”. The educational impact of an OSCE. Med Teach. 2008;30:206–11.PubMedCrossRefGoogle Scholar
  50. 50.
    Zahid MA, Al-Zayed A, Ohaeri J, et al. Introducing the objective structured clinical examination (OSCE) in the undergraduate psychiatric curriculum: evaluation after one year. Acad Psychiatry. 2011;35(6):365–9.PubMedCrossRefGoogle Scholar
  51. 51.
    Brewin J, Cantwell R. Implementing the OSCE in Nottingham. Psychiatrist. 1997;21:30–2.Google Scholar

Copyright information

© Academic Psychiatry 2014

Authors and Affiliations

  • Brian D. Hodges
    • 1
  • Elisa Hollenberg
    • 1
  • Nancy McNaughton
    • 1
  • Mark D. Hanson
    • 1
  • Glenn Regehr
    • 2
  1. 1.Toronto General HospitalTorontoCanada
  2. 2.University of British ColumbiaVancouverCanada

Personalised recommendations