Skip to main content
Log in

Self and Peer Assessment of Pediatricians, Psychiatrists and Medicine Specialists: Implications for Self-Directed Learning

  • Published:
Advances in Health Sciences Education Aims and scope Submit manuscript

Abstract

Self-regulation in medicine depends on accurate self-assessment. The purpose of the present study was to examine the discrepancy between self and peer assessments for a group of specialist physicians from internal medicine (IM), pediatrics, and psychiatry clinical domains (i.e., patient management, clinical assessment, professional development, and communication). Data from 304 psychiatrists, pediatricians and internal medicine specialists were used. Each physician had data from an identical self and 8 peer (38 item/4 clinical domains assessment). A total of 2306 peer assessments were available. Physicians were classified into quartiles based on mean assessment peer data and compared with self-assessment data. The analyses showed that self and peer assessment profiles were consistent across specialties and domains. Physicians assessed in the lowest and highest quartiles (i.e., <25th and >75th) by colleagues tended to rate themselves 30–40 percentile ranks higher and lower than peers, respectively. This study suggests that practicing physicians are inaccurate in assessing their own performance. These data suggest that systems to provide practicing physicians with regular and routine feedback may be appropriate if we are to ensure physicians are able to accurately assess themselves in a profession in which self-regulation is predicated upon the assumption that physicians know their capabilities and limitations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Accreditation Council for Graduate Medical Education (2006). ACGME Outcome Project. General competencies, http://www.acgme.org/outcome/comp/compFull.asp#3. Accessed January 5

  • CanMEDs 2000 Project (1996). Skills for the new millennium: report of the societal needs working group. Royal College of Physicians and Surgeons of Canada: http://rcpsc.medical.org/canmeds/index.php. Accessed November 24, 2004

  • College of Physicians and Surgeons of Alberta (2004). Physician Achievement Review Program http://www.par-program.org/ Accessed November 23

  • L.J. Cronbach (1990) Essentials of Psychological Measurement EditionNumber2 Macmillan New York

    Google Scholar 

  • K.W. Eva J.P.W. Cunnington H.I. Reiter D.R. Keane G.R. Norman (2004) ArticleTitleHow can I know what I don’t know? Poor self assessment in a well-defined domain Advances in Health Sciences Education 9 211–224 Occurrence Handle10.1023/B:AHSE.0000038209.65714.d4

    Article  Google Scholar 

  • R. Evans G. Elwyn A. Edwards (2004) ArticleTitleReview of instruments for peer assessment of physicians British Medical Journal 328 IssueID7450 1243

    Google Scholar 

  • L. Festinger (1954) ArticleTitleA theory of social comparison processes Human Relations 7 117–140 Occurrence Handle10.1177/001872675400700202

    Article  Google Scholar 

  • J.T. Fitzgerald L.D. Gruppen C.B. White (2000) ArticleTitleThe influence of task formats on the accuracy of medical students’ self-assessments Academic Medicine 75 737–741 Occurrence Handle10.1097/00001888-200007000-00019

    Article  Google Scholar 

  • C.P. Friedman G.G. Gatti T.M. Franz G.C. Murphy F.M. Wolf P.S Heckerling P.L. Fine T.M. Miller A.S. Elstein (2005) ArticleTitleDo physicians know when their diagnoses are correct? Implications for decision support and error reduction Journal of General Internal Medicine 20 334–339 Occurrence Handle10.1111/j.1525-1497.2005.30145.x

    Article  Google Scholar 

  • R.D. Fox P.E. Mazmanian R.W. Putnam (1989) Changing and Learning in the Lives of Physicians Prager Publishers New York, NY

    Google Scholar 

  • W. Hall C. Violato R. Lewkonia J. Lockyer H. Fidler J. Toews P. Jennett M. Donoff D. Moores (1999) ArticleTitleAssessment of physician performance in Alberta: The physician achievement review Canadian Medical Association Journal 161 52–57

    Google Scholar 

  • B.J. Harvey A.I. Rothman R.C. Frecker (2003) ArticleTitleEffect of an undergraduate medical curriculum on students’ self-directed learning Academic Medicine 78 1259–1265 Occurrence Handle10.1097/00001888-200312000-00015

    Article  Google Scholar 

  • B. Hodges G. Regehr D. Martin (2001) ArticleTitleDifficulties in recognizing one’s own incompetence: Novice physicians who are unskilled and unaware of it Academic Medicine 76 S87–S89 Occurrence Handle10.1097/00001888-200110001-00029

    Article  Google Scholar 

  • J. Kruger D. Dunning (1999) ArticleTitleUnskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments Journal of Personality and Social Psychology 77 1121–1134 Occurrence Handle10.1037/0022-3514.77.6.1121

    Article  Google Scholar 

  • D. Leach (2000) ArticleTitleEvaluation of Competence: An ACGME perspective American Journal of Physical Medicine and Rehabilitation 79 487–489 Occurrence Handle10.1097/00002060-200009000-00020

    Article  Google Scholar 

  • J.M. Lockyer C. Violato (2004) ArticleTitleAn examination of the appropriateness of using a common peer assessment instrument to assess physician skills across specialties Academic Medicine 10 IssueIDsupplement S5–S8 Occurrence Handle10.1097/00001888-200410001-00002

    Article  Google Scholar 

  • K.V. Mann M.H. Gelula (2003) How to facilitate self-directed learning D. Davis B.E. Barnes R. Fox (Eds) The Continuing Development of Physicians AMA Press Chicago 121–143

    Google Scholar 

  • J.T. Parboosingh M.C. Badet D.L. Wooster (2003) Individualized learning strategies D. Davis B.E. Barnes R. Fox (Eds) The Continuing Development of Physicians AMA Press Chicago 145–167

    Google Scholar 

  • H.I. Reiter K.W. Eva R.M. Hatala G.R. Norman (2002) ArticleTitleSelf and peer assessment in tutorials: Application of a relative-ranking model Academic Medicine 77 1134–1139 Occurrence Handle10.1097/00001888-200211000-00016

    Article  Google Scholar 

  • L. Ross D. Greene P. House (1977) ArticleTitleThe false consensus effect: An egocentric bias in social perception and attributional processes Journal of Experimental Social Psychology 13 279–301 Occurrence Handle10.1016/0022-1031(77)90049-X

    Article  Google Scholar 

  • J. Sargeant K. Mann S. Ferrier (2005) ArticleTitleUnderstanding family physicians reactions to MSF performance assessment: Perceptions of credibility and usefulness Medical Education 39 497–504 Occurrence Handle10.1111/j.1365-2929.2005.02124.x

    Article  Google Scholar 

  • J.M. Sargeant K.V. Mann S.N. Ferrier D.B. Langille P.D. Muirhead D.E. Sinclair (2003) ArticleTitleResponses of rural family physicians and their colleagues and coworker raters to a multi-source feedback process: A pilot study Academic Medicine 78 IssueID10 suppl S42–S44 Occurrence Handle10.1097/00001888-200310001-00014

    Article  Google Scholar 

  • J.C. Sibley D.L. Sackett V. Neufeld B. Gerrard R.V. Rudnick W. Fraser (1982) ArticleTitleA randomized trial of continuing medical education New England Journal of Medicine 306 511–515 Occurrence Handle10.1056/NEJM198203043060904

    Article  Google Scholar 

  • C. Violato J. Lockyer H. Fidler (2003) ArticleTitleMulti source feedback: A method of assessing surgical practice British Medical Journal 326 IssueID7388 546–548

    Google Scholar 

  • Violato, C., Lockyer, J., Fidler, H., Toews, J., (2006). Testing a theoretical model of multi source feedback physician performance using structural equation modeling. Paper presented at the 5th Hawaii International Conference on Statistics, Mathematics and Related Fields, January 16–18

  • M. Ward L. Gruppen G. Regehr (2002) ArticleTitleMeasuring self-assessment: Current state of the art Advances in Health Sciences Education 7 63–80 Occurrence Handle10.1023/A:1014585522084

    Article  Google Scholar 

  • M. Ward H. MacRae C. Schlachta J. Mamazza E. Puolin R. Reznick G. Regher (2003) ArticleTitleResident self-assessment of operative performance American Journal of Surgery 185 IssueID6 521–524 Occurrence Handle10.1016/S0002-9610(03)00069-2

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Claudio Violato.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Violato, C., Lockyer, J. Self and Peer Assessment of Pediatricians, Psychiatrists and Medicine Specialists: Implications for Self-Directed Learning. Adv Health Sci Educ Theory Pract 11, 235–244 (2006). https://doi.org/10.1007/s10459-005-5639-0

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10459-005-5639-0

Keywords

Navigation