Academic Psychiatry

, Volume 28, Issue 3, pp 190–196 | Cite as

Can One Portfolio Measure the Six ACGME General Competencies?

  • Robert M. Jarvis
  • Patricia S. O’Sullivan
  • Tina McClain
  • James A. Clardy
Original Article

Abstract

Objective: To determine that portfolios, useable by any program, can provide needed evidence of resident performance within the ACGME general competencies. Methods: Eighteen residents constructed portfolios with selected entries from thirteen psychiatric skills. Two raters assessed whether entries reflected resident performance within the general competencies. They indicated no (0), some (1), or definite evidence (2) for each competency. Median scores were reported by competency and psychiatric skill. Results: Eighty entries were rated: 100% of the psychiatric skills reflected some evidence for medical knowledge; 92% provided some evidence for patient care, communication and interpersonal skills, and professionalism; 77% provided some evidence for systems-based practice, and 31% provided some evidence for practice-based learning. Ten of the 13 skills reflected evidence for at least five of the competencies. Conclusions: Any combination of five entries reflects all competencies with the exception of practice-based learning. This deficit can be corrected with revision of portfolio guidelines.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Accreditation Council for Graduate Medical Education: Competencies and Outcome Assessment (http://www.acgme.org/outcome/comp/compHome.asp, accessed 2002)
  2. 2.
    Accreditation Council for Graduate Medical Education: Competencies and Outcome Assessment (http://www.acgme.org/outcome/asses/toolbox.pdf, accessed 2002)
  3. 3.
    Snadden D, Thomas M: The use of portfolio learning in medical education. Med Teach 1998; 20: 192–208CrossRefGoogle Scholar
  4. 4.
    O’Sullivan PS, Cogbill K, McClain C, Clardy J, Reckase M: Portfolios as a novel approach for residency evaluations. Acad Psychiatry 2002; 26: 1–7CrossRefGoogle Scholar
  5. 5.
    Reckase MD: Portfolio assessment: a theoretical estimate of score reliability. Ed Measure: Issues and Practice 1995; 14: 12–31Google Scholar
  6. 6.
    Landis J, Koch GG: The measurement of observer agreement for categorical data. Biometrics 1977; 33: 159–174PubMedCrossRefGoogle Scholar
  7. 7.
    Swing S: Assessing the General Competencies: ACGME Work in Progress. ACGME Bulletin Nov 2002; 6–7Google Scholar

Copyright information

© Academic Psychiatry 2004

Authors and Affiliations

  • Robert M. Jarvis
    • 1
  • Patricia S. O’Sullivan
    • 1
  • Tina McClain
    • 2
  • James A. Clardy
    • 1
  1. 1.Department of PsychiatryUniversity of Arkansas for Medical SciencesLittle RockUSA
  2. 2.Department of Veterans AffairsNorth Little RockUSA

Personalised recommendations