Skip to main content
SpringerLink
Log in

The Coordinators of Psychiatric Education (COPE) Residency In-Training Exam: A Preliminary Psychometric Assessment

  • Original Article
  • Published:
Academic Psychiatry Aims and scope Submit manuscript

Abstract

Objective

The Coordinators of Psychiatric Education (COPE) Residency In-Training Exam is a formative exam for Canadian psychiatric residents that was reconstructed using assessment best practices. An assessment of psychometric properties was subsequently performed on the exam to ensure preliminary validity and reliability.

Methods

An exam blueprint was developed based on the 2007 Royal College objectives for psychiatric training. A minimum pass level was established using a modified Angoff method. The exam was administered to all Canadian psychiatric residents in postgraduate years 2 to 5 with test reliability (Cronbach alpha) and item analysis performed. Exam validity was assessed through blueprint adherence and cross-year resident performance analysis.

Results

Four hundred two exams were suitable for analysis. The overall mean score for all residents was 69.6% (SD=8.5) with significant differences in total scores between each of the postgraduate year groups, with consistently better performance with increasing time in residency. Cronbach alpha was 0.79.

Conclusion

The present study provides preliminary support that the reconstructed COPE Residency In-Training Exam demonstrates adequate reliability and validity, including showing the capacity to discriminate between levels of training.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Kearney RA, Sullivan P, Skakun E: Performance on ANA-ASA in-training examination predicts success for RCPSC certification. Can J Anaesth 2000; 47:914–918

    Article  CAS  PubMed  Google Scholar 

  2. Holomboe ES, Hawkins RE: Methods for evaluating the clinical competence of residents in internal medicine: a review. Ann Intern Med 1998; 129:42–48

    Article  Google Scholar 

  3. Waxman H, Braunstein G, Dantzker D, et al: Performance on the internal medicine second-year residency in-training examination predicts the outcome of the ABIM certifying examination. J Gen Int Med 1994; 9:692–694

    Article  CAS  Google Scholar 

  4. Wade TP, Andrus CH, Kaminski DL: Evaluations of surgery resident performance correlate with success in board examinations. Surgery 1993; 113:644–648

    CAS  PubMed  Google Scholar 

  5. Cox SM, Herbert WN, Grosswald SJ, et al: Assessment of the resident in-training examination in obstetrics and gynecology. Obstet Gynecol 1994; 84:1051–1054

    CAS  PubMed  Google Scholar 

  6. Webb LC, Juul D, Reynolds CF, et al: How well does the Psychiatry Residency In-Training Examination predict performance on the American Board of Psychiatry and Neurology Part I Examination? Am J Psychiatry 1996; 153:831–832

    CAS  PubMed  Google Scholar 

  7. Woodman C, Schultz SK: Faculty assessment of residents and the Psychiatry Resident In-Training Examination: is there a correlation? Acad Psychiatry 1999; 23:137–141

    Google Scholar 

  8. Smeltzer DJ, Jones BA: Reliability and validity of the Psychiatry Resident In-Training Examination. Acad Psychiatry 1990; 14:115–121

    Google Scholar 

  9. The American College of Psychiatrists: The Psychiatry Resident-In-Training Examination (PRITE). Available at www.acpsych.org/prite/prite.html

  10. Royal College of Physicians and Surgeons of Canada: Objectives for Training in Psychiatry, 2007. Available at rcpsc.medical.org/residency/certification/training/psychiatry_e.html

  11. Hopkins K: Educational and Psychological Measurement and Evaluation. Needham Heights, Mass Allyn & Bacon, 1998

    Google Scholar 

  12. Webb LC, Sexson S, Scully J, et al: Training directors opinions about the Psychiatry Resident In-Training Examination (PRITE). Am J Psychiatry 1992; 149:521–524

    CAS  PubMed  Google Scholar 

  13. Sadock BJ, Sadock VA: Kaplan & Sadock’s Synopsis of Psychiatry: Behavioral Sciences/Clinical Psychiatry, 9th ed. Philadelphia, Lippincott Williams & Wilkins, 2003

    Google Scholar 

  14. Sadock BJ, Sadock VA: Kaplan & Sadock’s Comprehensive Textbook of Psychiatry, 8th ed. Philadelphia, Lippincott Williams & Wilkins, 2005

    Google Scholar 

  15. Chaisson GM: The development and utilization of in-training examinations in graduate medical education. Med Educ 1978; 53:502–504

    CAS  Google Scholar 

  16. Norcini JJ: Setting standards on educational tests. Med Educ 2003; 37:464–469

    Article  PubMed  Google Scholar 

  17. Cizek GJ, Bunch MB: Standard Setting. Thousand Oaks, Calif, Sage Publications, 2007

    Google Scholar 

  18. Royal College of Physicians and Surgeons of Canada: Pass percentage rates, 2007. Available at rcpsc.medical.org/residency/certification/pass_rate_percentages_e.php

Download references

Author information

Authors and Affiliations

  1. Department of Psychiatry, University of Calgary in Calgary, Alberta, Canada

    Gregory P. J. Montgomery M.D. & David N. Crockford M.D.

  2. Department of Veterinary Clinical and Diagnostic Sciences, University of Calgary in Calgary, Alberta

    Kent Hecker Ph.D.

Authors
  1. Gregory P. J. Montgomery M.D.
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. David N. Crockford M.D.
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kent Hecker Ph.D.
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gregory P. J. Montgomery M.D..

Rights and permissions

Reprints and permissions

About this article

Cite this article

Montgomery, G.P.J., Crockford, D.N. & Hecker, K. The Coordinators of Psychiatric Education (COPE) Residency In-Training Exam: A Preliminary Psychometric Assessment. Acad Psychiatry 34, 203–207 (2010). https://doi.org/10.1176/appi.ap.34.3.203

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1176/appi.ap.34.3.203

Keywords

Search

Navigation