Academic Psychiatry

, Volume 29, Issue 1, pp 76–81

Residents’ Perception of Effectiveness of Twelve Evaluation Methods for Measuring Competency

  • Kay K. Cogbill
  • Patricia S. O’Sullivan
  • James Clardy
Original Article


Objective: The authors assessed residents’ perceptions of techniques used to evaluate competency. Methods: Psychiatry residents from a single program rated 12 evaluation techniques for their effectiveness to measure resident competency. They rated each method for 25 selected skills reflecting the six general competencies. Results: Sixteen residents (70%) completed the survey. Responses indicated that different methods were effective for different competencies. Residents saw objective structured clinical examinations and standardized patients as equally effective. They favored the 360° evaluation method for all competencies except medical knowledge. Resident perception of the effective techniques differed from preferred techniques identified by measurement experts. Conclusions: Residency program directors using guidelines from the Accreditation Council for Graduate Medical Education (ACGME) to select preferred evaluations may find that residents do not have the same perceptions.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Mavis BE, Cole BL, Hoppe RB: A survey of information sources used for progress decisions about medical students. Medical Education Online 2000; 5: 1–5Google Scholar
  2. 2.
    Morgan PJ, Cleave-Hogg D: A Canadian simulation experience: faculty and student opinions of a performance evaluation study. Br J Anaesthesia 2000; 85: 779–781CrossRefGoogle Scholar
  3. 3.
    Veloski JJ, Rabinowitz HK, Robeson MR, et al: Patients don’t present with five choices: an alternative to multiple choice tests in assessing physicians’ competence. Acad Med 1999; 74: 539–546PubMedCrossRefGoogle Scholar
  4. 4.
    Albanese M: Rating educational quality: factors in erosion of professional standards. Acad Med 1999; 74: 652–658PubMedCrossRefGoogle Scholar
  5. 5.
    Lindblom-Ylänne S, Lonka K: Students’ perceptions of assessment practices in a traditional medical curriculum. Adv Health Sci Educ 2001; 6: 121–140CrossRefGoogle Scholar
  6. 6.
    Day SC, Grosso LJ, Norcini JJ Jr, et al: Residents’ perception of evaluation procedures used by their training program. J Gen Intern Med 1990; 5: 421–426PubMedCrossRefGoogle Scholar
  7. 7.
    Fried JL, Devore L, Dailey J: A study of Maryland dental hygienists’ perceptions regarding self-assessment. J Dent Hyg 2001; 75: 121–129PubMedGoogle Scholar
  8. 8.
    O’Sullivan PS, Cogbill KK, McClain T, et al: Portfolios as a novel approach for residency evaluation. Acad Psychiatry 2002; 26: 173–179PubMedCrossRefGoogle Scholar

Copyright information

© Academic Psychiatry 2005

Authors and Affiliations

  • Kay K. Cogbill
    • 1
  • Patricia S. O’Sullivan
    • 1
  • James Clardy
    • 1
  1. 1.College of Medicine, Department of Psychiatry and Office of Educational DevelopmentUniversity of Arkansas for Medical SciencesLittle RockUSA

Personalised recommendations