Academic Psychiatry

, Volume 26, Issue 3, pp 173–179 | Cite as

Portfolios as a Novel Approach for Residency Evaluation

  • Patricia S. O’Sullivan
  • Kay K. Cogbill
  • Tina McClain
  • Mark D. Reckase
  • James A. Clardy
Original Article


The authors describe the development process for a portfolio that programs may use for evaluating psychiatry residents. A committee carefully developed the portfolio requirements for 13 necessary skills in psychiatry. Psychiatrists were trained to rate portfolios. Review of the development and training process suggested that portfolios provided information both on individual residents and on the residency program itself. The process requires orientation of both residents and faculty, attention to time demands, and availability of examples and resources.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Priest H, Roberts P: Assessing students’ clinical performance. Nursing Standard 1998; 12(48): 37–41PubMedGoogle Scholar
  2. 2.
    Thompson R, Farrow T: The workbook portfolio: facilitating undergraduate student learning in the mental health clinical area. Nursing Praxis in New Zealand 1999; 14: 21–30Google Scholar
  3. 3.
    Sorrel J, Silva M, Kohlenberg E: Use of writing portfolios for interdisciplinary assessment of critical thinking outcomes of nursing students. Nursing Forum 1997; 32(4): 12–24CrossRefGoogle Scholar
  4. 4.
    Wenzel LS, Briggs KL, Puryear BL: Portfolio: authentic assessment in the age of the curriculum revolution. J Nurs Educ 1998; 37: 208–212PubMedGoogle Scholar
  5. 5.
    Jasper MA: The potential of the professional portfolio for nursing. Journal of Clinical Nursing 1995; 4: 249–255PubMedCrossRefGoogle Scholar
  6. 6.
    Grant J, Ramsay A, Bain J: Community hospitals and general practice: extended attachments for medical students. Med Educ 1997; 31: 364–368PubMedCrossRefGoogle Scholar
  7. 7.
    Challis M, Mathers NJ, Howe AC, et al: Portfolio-based learning: continuing medical education for general practitioners—a mid-point evaluation. Med Educ 1997; 31: 22–26PubMedCrossRefGoogle Scholar
  8. 8.
    Donen N: No to mandatory continuing medical education, yes to mandatory practice auditing and professional educational development. CMAJ 1998; 158: 1044–1046PubMedCentralPubMedGoogle Scholar
  9. 9.
    Parboosingh J: Learning portfolios: potential to assist health professionals with self-directed learning. The Journal of Continuing Education in the Health Professions 1996; 16: 75–81CrossRefGoogle Scholar
  10. 10.
    Campbell CM, Parboosingh JT, Gondocz ST, et al: Study of physicians’ use of a software program to create a portfolio of their self-directed learning. Acad Med 1996; 71: S49–S51PubMedCrossRefGoogle Scholar
  11. 11.
    Beasley BW, Wright SM, Cofancesco J Jr, et al: Promotion criteria for clinician-educators in the United States and Canada: a survey of promotion committee chairpersons. JAMA 1997; 278: 723–728PubMedCrossRefGoogle Scholar
  12. 12.
    Finlay I, Maughan T, Webster D: A randomized controlled study of portfolio learning in undergraduate cancer education. Med Educ 1998; 32: 172–176PubMedCrossRefGoogle Scholar
  13. 13.
    Mathers NJ, Challis M, Howe AC, et al: Portfolios in continuing medical education: effective and efficient? Med Educ 1999; 33: 521–530PubMedCrossRefGoogle Scholar
  14. 14.
    Fung MFK, Walker M, Fung KFK, et al: An Internet-based learning portfolio in resident education: the KOALATM Multicentre Programme. Medical Education 2000; 34: 474–479PubMedCrossRefGoogle Scholar
  15. 15.
    Lim J, Chan N, Cheong P: Experience with portfolio-based learning in family medicine for Master of Medicine Degree. Singapore Med J 1998; 39: 543–546PubMedGoogle Scholar
  16. 16.
    Gordon MJ: Cutting the Gordian knot: a two-part approach to the evaluation and professional development of residents. Acad Med 1997; 72: 876–880PubMedCrossRefGoogle Scholar
  17. 17.
    Pleasants HM, Johnson CB, Johnson CB, et al: Reflecting, reconceptualizing, and revising: the evolution of a portfolio assignment in a multicultural teacher education course. Remedial and Special Educator 1998; 12: 46–58CrossRefGoogle Scholar
  18. 18.
    Stecher BM, Herman JL: Using portfolios for large-scale assessment, in Handbook of Classroom Assessment Learning, Achievement, and Adjustment. Edited by Phye GD. New York, Academic Press, 1997, pp 491–516Google Scholar
  19. 19.
    Tierney RJ, Clark C, Fenner L, et al: Portfolio: assumptions, tensions, and possibilities. Reading Research Quarterly 1998; 33: 474–486CrossRefGoogle Scholar
  20. 20.
    Hirvela A, Pierson H: Portfolios: vehicles for authentic self-assessment, in Learner-Directed Assessment in ESL. Edited by Ekbatani G, Pierson H. Mahwah, NJ, Lawrence Erlbaum, 2000, pp 105–164Google Scholar
  21. 21.
    Supovitz JA, MacGowan A, Slattery J: Assessing agreement: an examination of the interrater reliability of portfolio assessment in Rochester, New York. Educational Assessment 1997; 4: 237–259CrossRefGoogle Scholar
  22. 22.
    Gottleib M: Portfolio practices in elementary and secondary school: toward learner-directed assessment, in Learner-Directed Assessment in ESL. Edited by Ekbatani G, Pierson H. Mahwah, NJ, Lawrence Erlbaum, 2000, pp 89–104Google Scholar
  23. 23.
    Koch L, Schultz D, Cusick J: Teaching tips: encouraging rehabilitation counseling students to develop a portfolio as a career development tool. Rehabilitation Education 1998; 12: 261–267Google Scholar
  24. 24.
    Reckase MD: Portfolio assessment: a theoretical estimate of score reliability. Educational Measurement: Issues and Practice 1995; 14: 12–31Google Scholar
  25. 25.
    American Medical Association: Program Requirements for Residency Education in Psychiatry, in Graduate Medical Education Directory 1998–1999. Chicago, American Medical Association, 1998Google Scholar
  26. 26.
    Slater SC, Boulet JR: Predicting holistic ratings of written performance assessments from analytic scoring. Advances in Health Sciences Education 2001; 6: 103–119PubMedCrossRefGoogle Scholar
  27. 27.
    Crandall SE: Portfolios link education with practice. Radio-logic Technology 1998; 69: 479–482Google Scholar
  28. 28.
    Feldt LS, Brennan RL: Reliability, in Educational Measurement, 3rd edition. Edited by Linn RL. New York, American Council on Education/Macmillan, 1989, pp 105–146Google Scholar

Copyright information

© Academic Psychiatry 2002

Authors and Affiliations

  • Patricia S. O’Sullivan
    • 1
  • Kay K. Cogbill
    • 2
  • Tina McClain
    • 2
    • 3
  • Mark D. Reckase
    • 4
  • James A. Clardy
    • 2
  1. 1.Office of Educational DevelopmentUniversity of Arkansas for Medical SciencesLittle RockUSA
  2. 2.Department of PsychiatryUniversity of Arkansas for Medical SciencesLittle RockUSA
  3. 3.VA PsychiatryCentral Arkansas Veterans Healthcare SystemLittle RockUSA
  4. 4.School of EducationMichigan State UniversityLansingUSA

Personalised recommendations