Abstract
Self-regulation in medicine depends on accurate self-assessment. The purpose of the present study was to examine the discrepancy between self and peer assessments for a group of specialist physicians from internal medicine (IM), pediatrics, and psychiatry clinical domains (i.e., patient management, clinical assessment, professional development, and communication). Data from 304 psychiatrists, pediatricians and internal medicine specialists were used. Each physician had data from an identical self and 8 peer (38 item/4 clinical domains assessment). A total of 2306 peer assessments were available. Physicians were classified into quartiles based on mean assessment peer data and compared with self-assessment data. The analyses showed that self and peer assessment profiles were consistent across specialties and domains. Physicians assessed in the lowest and highest quartiles (i.e., <25th and >75th) by colleagues tended to rate themselves 30–40 percentile ranks higher and lower than peers, respectively. This study suggests that practicing physicians are inaccurate in assessing their own performance. These data suggest that systems to provide practicing physicians with regular and routine feedback may be appropriate if we are to ensure physicians are able to accurately assess themselves in a profession in which self-regulation is predicated upon the assumption that physicians know their capabilities and limitations.
Similar content being viewed by others
References
Accreditation Council for Graduate Medical Education (2006). ACGME Outcome Project. General competencies, http://www.acgme.org/outcome/comp/compFull.asp#3. Accessed January 5
CanMEDs 2000 Project (1996). Skills for the new millennium: report of the societal needs working group. Royal College of Physicians and Surgeons of Canada: http://rcpsc.medical.org/canmeds/index.php. Accessed November 24, 2004
College of Physicians and Surgeons of Alberta (2004). Physician Achievement Review Program http://www.par-program.org/ Accessed November 23
L.J. Cronbach (1990) Essentials of Psychological Measurement EditionNumber2 Macmillan New York
K.W. Eva J.P.W. Cunnington H.I. Reiter D.R. Keane G.R. Norman (2004) ArticleTitleHow can I know what I don’t know? Poor self assessment in a well-defined domain Advances in Health Sciences Education 9 211–224 Occurrence Handle10.1023/B:AHSE.0000038209.65714.d4
R. Evans G. Elwyn A. Edwards (2004) ArticleTitleReview of instruments for peer assessment of physicians British Medical Journal 328 IssueID7450 1243
L. Festinger (1954) ArticleTitleA theory of social comparison processes Human Relations 7 117–140 Occurrence Handle10.1177/001872675400700202
J.T. Fitzgerald L.D. Gruppen C.B. White (2000) ArticleTitleThe influence of task formats on the accuracy of medical students’ self-assessments Academic Medicine 75 737–741 Occurrence Handle10.1097/00001888-200007000-00019
C.P. Friedman G.G. Gatti T.M. Franz G.C. Murphy F.M. Wolf P.S Heckerling P.L. Fine T.M. Miller A.S. Elstein (2005) ArticleTitleDo physicians know when their diagnoses are correct? Implications for decision support and error reduction Journal of General Internal Medicine 20 334–339 Occurrence Handle10.1111/j.1525-1497.2005.30145.x
R.D. Fox P.E. Mazmanian R.W. Putnam (1989) Changing and Learning in the Lives of Physicians Prager Publishers New York, NY
W. Hall C. Violato R. Lewkonia J. Lockyer H. Fidler J. Toews P. Jennett M. Donoff D. Moores (1999) ArticleTitleAssessment of physician performance in Alberta: The physician achievement review Canadian Medical Association Journal 161 52–57
B.J. Harvey A.I. Rothman R.C. Frecker (2003) ArticleTitleEffect of an undergraduate medical curriculum on students’ self-directed learning Academic Medicine 78 1259–1265 Occurrence Handle10.1097/00001888-200312000-00015
B. Hodges G. Regehr D. Martin (2001) ArticleTitleDifficulties in recognizing one’s own incompetence: Novice physicians who are unskilled and unaware of it Academic Medicine 76 S87–S89 Occurrence Handle10.1097/00001888-200110001-00029
J. Kruger D. Dunning (1999) ArticleTitleUnskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments Journal of Personality and Social Psychology 77 1121–1134 Occurrence Handle10.1037/0022-3514.77.6.1121
D. Leach (2000) ArticleTitleEvaluation of Competence: An ACGME perspective American Journal of Physical Medicine and Rehabilitation 79 487–489 Occurrence Handle10.1097/00002060-200009000-00020
J.M. Lockyer C. Violato (2004) ArticleTitleAn examination of the appropriateness of using a common peer assessment instrument to assess physician skills across specialties Academic Medicine 10 IssueIDsupplement S5–S8 Occurrence Handle10.1097/00001888-200410001-00002
K.V. Mann M.H. Gelula (2003) How to facilitate self-directed learning D. Davis B.E. Barnes R. Fox (Eds) The Continuing Development of Physicians AMA Press Chicago 121–143
J.T. Parboosingh M.C. Badet D.L. Wooster (2003) Individualized learning strategies D. Davis B.E. Barnes R. Fox (Eds) The Continuing Development of Physicians AMA Press Chicago 145–167
H.I. Reiter K.W. Eva R.M. Hatala G.R. Norman (2002) ArticleTitleSelf and peer assessment in tutorials: Application of a relative-ranking model Academic Medicine 77 1134–1139 Occurrence Handle10.1097/00001888-200211000-00016
L. Ross D. Greene P. House (1977) ArticleTitleThe false consensus effect: An egocentric bias in social perception and attributional processes Journal of Experimental Social Psychology 13 279–301 Occurrence Handle10.1016/0022-1031(77)90049-X
J. Sargeant K. Mann S. Ferrier (2005) ArticleTitleUnderstanding family physicians reactions to MSF performance assessment: Perceptions of credibility and usefulness Medical Education 39 497–504 Occurrence Handle10.1111/j.1365-2929.2005.02124.x
J.M. Sargeant K.V. Mann S.N. Ferrier D.B. Langille P.D. Muirhead D.E. Sinclair (2003) ArticleTitleResponses of rural family physicians and their colleagues and coworker raters to a multi-source feedback process: A pilot study Academic Medicine 78 IssueID10 suppl S42–S44 Occurrence Handle10.1097/00001888-200310001-00014
J.C. Sibley D.L. Sackett V. Neufeld B. Gerrard R.V. Rudnick W. Fraser (1982) ArticleTitleA randomized trial of continuing medical education New England Journal of Medicine 306 511–515 Occurrence Handle10.1056/NEJM198203043060904
C. Violato J. Lockyer H. Fidler (2003) ArticleTitleMulti source feedback: A method of assessing surgical practice British Medical Journal 326 IssueID7388 546–548
Violato, C., Lockyer, J., Fidler, H., Toews, J., (2006). Testing a theoretical model of multi source feedback physician performance using structural equation modeling. Paper presented at the 5th Hawaii International Conference on Statistics, Mathematics and Related Fields, January 16–18
M. Ward L. Gruppen G. Regehr (2002) ArticleTitleMeasuring self-assessment: Current state of the art Advances in Health Sciences Education 7 63–80 Occurrence Handle10.1023/A:1014585522084
M. Ward H. MacRae C. Schlachta J. Mamazza E. Puolin R. Reznick G. Regher (2003) ArticleTitleResident self-assessment of operative performance American Journal of Surgery 185 IssueID6 521–524 Occurrence Handle10.1016/S0002-9610(03)00069-2
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Violato, C., Lockyer, J. Self and Peer Assessment of Pediatricians, Psychiatrists and Medicine Specialists: Implications for Self-Directed Learning. Adv Health Sci Educ Theory Pract 11, 235–244 (2006). https://doi.org/10.1007/s10459-005-5639-0
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/s10459-005-5639-0