Academic Psychiatry

, Volume 33, Issue 4, pp 319–322

Using Standardized Patients’ Marks in Scoring Postgraduate Psychiatry OSCEs

Brief Report

Abstract

Objective

Standardized patients (SPs) do not contribute scores in postgraduate psychiatry objective structured clinical examinations (OSCEs) in the United Kingdom. However, this may change in the near future. The primary aim of this study was to measure the degree of agreement between scores given by examiners and those given by SPs in an OSCE.

Methods

The authors measured the degree of agreement in two consecutive postgraduate OSCEs for psychiatric residents on a London training scheme.

Results

Fifty-five candidates participated in the two OSCEs. There was a moderate degree of agreement between examiner and SP scores for communication and for the overall mark. However, there was a stronger relationship between the examiner score for communication and the candidates’ overall mark.

Conclusion

Examiners and SPs scored candidates differently. Therefore, the decision to include SP scores in the marking scheme for postgraduate OSCEs would be a significant development.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Kowlowitz VHA, Sloane PD: Implementing the Objective Structured Clinical Examination in a traditional medical school. Acad Med 1991; 66: 345–347PubMedCrossRefGoogle Scholar
  2. 2.
    Hodges B, Hanson M, McNaughton N, et al: What do psychiatric residents think of an OSCE? Acad Psychiatry 1999; 23: 198–204Google Scholar
  3. 3.
    Hodges B, Regehr G, Hanson M, et al: Validation of an Objective Structured Clinical Examination in psychiatry. Acad Med 1998; 73: 910–912PubMedCrossRefGoogle Scholar
  4. 4.
    Sauer J, Hodges B, Santhouse A, et al: The OSCE has landed: one small step for British psychiatry? Acad Psychiatry 2005; 29: 310–315PubMedCrossRefGoogle Scholar
  5. 5.
    Whelan P, Lawrence-Smith G, Church L, et al: Goodbye OSCE, hello CASC: organizing and evaluating a mock CASC examination and course. Psychiatr Bull 2009; 33: 149–153CrossRefGoogle Scholar
  6. 6.
    McLay MA, Rodenhauser P, Anderson DS, et al: Simulating a full length psychiatric interview with a complex patient. Acad Psychiatry 2002; 26: 162–167PubMedCrossRefGoogle Scholar
  7. 7.
    Iramaneerat C, Yudkowsky R: Rater errors in a clinical skills assessment of medical students. Eval Health Prof 2007; 30: 266–283PubMedCrossRefGoogle Scholar
  8. 8.
    Altman DG: Practical statistics for medical research. London, Chapman & Hall, 1991Google Scholar
  9. 9.
    Greco M, Pocklington S: Incorporating patient feedback into vocational training: an interpersonal skills development exercise for GP trainers and registrars. Educ Prim care 2001; 12: 285–291Google Scholar
  10. 10.
    McLaughlin K, Gregor L, Jones A, et al: Can standardized patients replace physicians as OSCE examiners? BMC Med Educ 2006; 6: 12PubMedCentralPubMedCrossRefGoogle Scholar
  11. 11.
    Mazor KM, Ockene JK, Rogers HJ, et al: The relationship between checklist scores on a communication OSCE and analogue patients’ perceptions of communication. Adv Health Sci Educ Theory Pract 2005; 10: 37–51PubMedCrossRefGoogle Scholar

Copyright information

© Academic Psychiatry 2009

Authors and Affiliations

  1. 1.Old Age Psychiatry, Guy’s HospitalSouth London and Maudsley NHS TrustLondonUK

Personalised recommendations