Abstract
Objective
With the emergence of physician-manager (PM) curricula in medical education, more effective assessment tools are needed to evaluate psychiatry trainees in this role. The aim of this study was to determine psychiatry residents’, program directors’, and PM educators’ perceptions about PM role-assessment.
Methods
Psychiatry residents at two Canadian programs were given a survey on PM assessment and the use of portfolios to assess PM competency. Qualitative interviews of Canadian psychiatry educators and program directors were used to determine faculty perceptions on PM assessment. Authors analyzed survey data with descriptive statistics, and qualitative interviews were analyzed using a grounded theory approach.
Results
Nearly 55% of psychiatry residents responded to the survey; 47% of residents did not want to change the way they were assessed by the PM role. Residents identified an array of assessment methods for each of the specific PM domains. Educator interview themes included supervisor and resident barriers to assessment, the need for new PM assessment approaches integrating multiple assessment methods, and a role for the use of portfolios if sufficient infrastructure was available.
Conclusion
The data supported a preference for a multimodal approach to assessment of the PM role. Future research should examine the implementation of the proposed PM assessment tool.
This is a preview of subscription content, log in via an institution to check access.
References
Schneller ES: The leadership and executive potential of physicians in an era of managed care systems. Hosp Health Serv Adm 1991; 36:43–55
Frank JR (ed): The CanMEDS 2005 Physician Competency Framework: Better Standards, Better Physicians, Better Care. Ottawa, Canada, The College of Surgeons and Physicians of Canada, 2005
Stergiopoulos V, Lieff S, Razack S, et al: Canadian residents’ perceived manager training needs. Med Teach 2010; 32:e479–e485
Frank J, Cole G, Lee C, et al (eds): Progress in Paradigm Shift: The RCPSC CanMEDS Implementation Survey. Office of Education, Royal College of Physicians and Surgeons of Canada, University of Ottawa, Ottawa, Canada. Annual Meeting of the Association of Canadian Medical Colleges; 2003; Quebec City, Quebec
ACGME Outcome Project: website: http://www.acgme.org/outcome; accessed February 5th, 2007
NHS Institute for Innovation and Improvement and Academy of Medical Royal Colleges. Medical Leadership Competency Framework, 2009
Ham C: DIckinson H. Engaging Doctors in Leadership: What Can We Learn From International Experience and Research Evidence? Birmingham, UK, NHS Institute for Innovation and Improvement, Health Services Management Centre, University of Birmingham, 2008
Sockalingam S, Stergiopoulos V, Maggi J: Physicians as managers: psychiatry residents’ perceived gaps in knowledge and skills in administrative psychiatry. Acad Psychiatry 2007; 31:304–307
Sockalingam S, Stergiopoulos V, Maggi J: Residents’ perceived physician-manager educational needs: a national survey of psychiatry residents. Can J Psychiatry 2008; 53:745–752
Card SE, Snell L, O’Brien B: Are Canadian general internal medicine training program graduates well prepared for their future careers? BMC Med Educ 2006; 6:56
Razack S, Patel H, Taylor L, et al: Manager Role Training for Senior Trainees. Pediatric Postgraduate Training Program-McGill University; January 30, 2004.
Somers JL, Goldner EM, Leseage AD, et al: Filling gaps in psychiatric education: skills in administrative psychiatry and knowledge of mental health systems, services, and policy. Can J Psychol 2004; 49:1–6 [insert]
Stergiopoulos V, Maggi J, Sockalingam S: Teaching the physician-manager role to psychiatric residents: development and implementation of a pilot curriculum. Acad Psychiatry 2009; 33:125–130
Bandiera G, SherbinoJ, Frank JR: The CanMEDS Assessment Tools Handbook. Ottawa, Canada, The Royal College of Physicians and Surgeons of Canada, 2006
Turnbull J, MacFadyen J, Van Barneveld C, et al: Clinical work sampling: a new approach to the problem of in-training evaluation. J Gen Intern Med 2000; 15:556–561
Govaerts MJ, van der Vleuten CP, Schuwirth LW, et al: Broadening perspectives on clinical performance assessment: rethinking the nature of in-training assessment. Adv Health Sci Educ Theory Pract 2007; 12:239–260
Kogan JR, Holmboe ES, Hauer KE: Tools for direct observation and assessment of clinical skills of medical trainees: a systematic review. JAMA 2009; 302:1316–1326
Watling CJ, Kenyon CF, Schulz V, et al: An exploration of faculty perspectives on the in-training evaluation of residents. Acad Med 2010; 85:1157–1162
Dudek NL, Marks MB, Regehr G: Failure to fail: the perspectives of clinical supervisors. Acad Med 2005; 80(Suppl): S84–S87
Van Tartwijk J, Driessen EW: Portfolios for assessment and learning: AMEE Guide No. 45. Med Teach 2009; 31:790–801
Davis MH, Friedman Ben-David M, Harden RM, et al: Portfolio assessment in medical students’ final examinations. Med Teach 2001; 23:357–366
Friedman Ben David M, Davis MH, Harden RM, et al: AMEE Medical Education Guide No. 24: portfolios as a method of student assessment. Med Teach 2001; 23:535–551
Buckley S, Coleman J, Khan K: Best evidence on the educational effects of undergraduate portfolios. Clin Teach 2010; 7: 187–191
Pitts J, Coles C, Thomas P: Educational portfolios in the assessment of general practice trainers: reliability of assessors. Med Educ 1999; 33:515–520
O’Sullivan PS, Cogbill KK, McClain T, et al: Portfolios as a novel approach for residency evaluation. Acad Psychiatry 2002; 26:173–179
Schuwirth L, van der Vleuten C: Merging views on assessment. Med Educ 2004; 38:1208–1210
Webb C, Endacott R, Gray MA, et al: Evaluating portfolio assessment systems: what are the appropriate criteria? Nurs Educ Today 2003; 23:600–609
Norcini J, Anderson B, Bollela V, et al: Criteria for good assessment: consensus statement and recommendations from the Ottawa 2010 Conference. Med Teach 2011; 33:206–214
Cogbill KK, O’Sullivan PS, Clardy J: Residents’ perception of effectiveness of twelve evaluation methods for measuring competency. Acad Psychiatry 2005; 29:76–81
Glaser BG, Strauss AL: The Discovery of Grounded Theory: Strategies for Qualitative Research. Edited by Gruyter AD. New York, Aldine, 1967.
Charmaz K: Grounded theory, in Approaches to Qualitative Research: A Reader on Theory and Practice. Edited by Hesse-Biber SN, Leavy P. New York, Oxford University Press, 2004, pp 409–425
Sockalingam S, Stergiopoulos V, Maggi J, et al: Quality education: a pilot quality improvement curriculum for psychiatry residents. Med Teach 2010; 32:e221–e226
Lewis KO, Baker RC: The development of an electronic educational portfolio: an outline for medical education professionals. Teach Learn Med 2007; 19:139–147
Kalet AL, Sanger J, Chase J, et al: Promoting professionalism through an online professional development portfolio: successes, joys, and frustrations. Acad Med 2007; 82:1065–1072
Branch WT Jr, Paranjape A: Feedback and reflection: teaching methods for clinical settings. Acad Med 2002; 77:1185–1188
Conlon M: Appraisal: the catalyst of personal development. BMJ 2003; 327:389–391
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Sockalingam, S., Stergiopoulos, V., Maggi, J.D. et al. Evaluating Psychiatry Residents as Physician-Managers: Development of an Assessment Tool. Acad Psychiatry 37, 11–17 (2013). https://doi.org/10.1176/appi.ap.12010006
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1176/appi.ap.12010006