Advances in Health Sciences Education

, Volume 11, Issue 3, pp 235–244 | Cite as

Self and Peer Assessment of Pediatricians, Psychiatrists and Medicine Specialists: Implications for Self-Directed Learning

Article

Abstract

Self-regulation in medicine depends on accurate self-assessment. The purpose of the present study was to examine the discrepancy between self and peer assessments for a group of specialist physicians from internal medicine (IM), pediatrics, and psychiatry clinical domains (i.e., patient management, clinical assessment, professional development, and communication). Data from 304 psychiatrists, pediatricians and internal medicine specialists were used. Each physician had data from an identical self and 8 peer (38 item/4 clinical domains assessment). A total of 2306 peer assessments were available. Physicians were classified into quartiles based on mean assessment peer data and compared with self-assessment data. The analyses showed that self and peer assessment profiles were consistent across specialties and domains. Physicians assessed in the lowest and highest quartiles (i.e., <25th and >75th) by colleagues tended to rate themselves 30–40 percentile ranks higher and lower than peers, respectively. This study suggests that practicing physicians are inaccurate in assessing their own performance. These data suggest that systems to provide practicing physicians with regular and routine feedback may be appropriate if we are to ensure physicians are able to accurately assess themselves in a profession in which self-regulation is predicated upon the assumption that physicians know their capabilities and limitations.

Keywords

continuing medical education continuing professional development internal medicine specialists pediatricians psychiatrists peer assessment self assessment self directed learning 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Accreditation Council for Graduate Medical Education (2006). ACGME Outcome Project. General competencies, http://www.acgme.org/outcome/comp/compFull.asp#3. Accessed January 5Google Scholar
  2. CanMEDs 2000 Project (1996). Skills for the new millennium: report of the societal needs working group. Royal College of Physicians and Surgeons of Canada: http://rcpsc.medical.org/canmeds/index.php. Accessed November 24, 2004Google Scholar
  3. College of Physicians and Surgeons of Alberta (2004). Physician Achievement Review Program http://www.par-program.org/ Accessed November 23Google Scholar
  4. Cronbach, L.J. 1990Essentials of Psychological Measurement2MacmillanNew YorkGoogle Scholar
  5. Eva, K.W., Cunnington, J.P.W., Reiter, H.I., Keane, D.R., Norman, G.R. 2004How can I know what I don’t know? Poor self assessment in a well-defined domainAdvances in Health Sciences Education9211224CrossRefGoogle Scholar
  6. Evans, R., Elwyn, G., Edwards, A. 2004Review of instruments for peer assessment of physiciansBritish Medical Journal3281243Google Scholar
  7. Festinger, L. 1954A theory of social comparison processesHuman Relations7117140CrossRefGoogle Scholar
  8. Fitzgerald, J.T., Gruppen, L.D., White, C.B. 2000The influence of task formats on the accuracy of medical students’ self-assessmentsAcademic Medicine75737741CrossRefGoogle Scholar
  9. Friedman, C.P., Gatti, G.G., Franz, T.M., Murphy, G.C., Wolf, F.M., Heckerling, P.S, Fine, P.L., Miller, T.M., Elstein, A.S. 2005Do physicians know when their diagnoses are correct? Implications for decision support and error reductionJournal of General Internal Medicine20334339CrossRefGoogle Scholar
  10. Fox, R.D., Mazmanian, P.E., Putnam, R.W. 1989Changing and Learning in the Lives of PhysiciansPrager PublishersNew York, NYGoogle Scholar
  11. Hall, W., Violato, C., Lewkonia, R., Lockyer, J., Fidler, H., Toews, J., Jennett, P., Donoff, M., Moores, D. 1999Assessment of physician performance in Alberta: The physician achievement reviewCanadian Medical Association Journal1615257Google Scholar
  12. Harvey, B.J., Rothman, A.I., Frecker, R.C. 2003Effect of an undergraduate medical curriculum on students’ self-directed learningAcademic Medicine7812591265CrossRefGoogle Scholar
  13. Hodges, B., Regehr, G., Martin, D. 2001Difficulties in recognizing one’s own incompetence: Novice physicians who are unskilled and unaware of itAcademic Medicine76S87S89CrossRefGoogle Scholar
  14. Kruger, J., Dunning, D. 1999Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessmentsJournal of Personality and Social Psychology7711211134CrossRefGoogle Scholar
  15. Leach, D. 2000Evaluation of Competence: An ACGME perspectiveAmerican Journal of Physical Medicine and Rehabilitation79487489CrossRefGoogle Scholar
  16. Lockyer, J.M., Violato, C. 2004An examination of the appropriateness of using a common peer assessment instrument to assess physician skills across specialtiesAcademic Medicine10S5S8CrossRefGoogle Scholar
  17. Mann, K.V., Gelula, M.H. 2003

    How to facilitate self-directed learning

    Davis, D.Barnes, B.E.Fox, R. eds. The Continuing Development of PhysiciansAMA PressChicago121143
    Google Scholar
  18. Parboosingh, J.T., Badet, M.C., Wooster, D.L. 2003

    Individualized learning strategies

    Davis, D.Barnes, B.E.Fox, R. eds. The Continuing Development of PhysiciansAMA PressChicago145167
    Google Scholar
  19. Reiter, H.I., Eva, K.W., Hatala, R.M., Norman, G.R. 2002Self and peer assessment in tutorials: Application of a relative-ranking modelAcademic Medicine7711341139CrossRefGoogle Scholar
  20. Ross, L., Greene, D., House, P. 1977The false consensus effect: An egocentric bias in social perception and attributional processesJournal of Experimental Social Psychology13279301CrossRefGoogle Scholar
  21. Sargeant, J., Mann, K., Ferrier, S. 2005Understanding family physicians reactions to MSF performance assessment: Perceptions of credibility and usefulnessMedical Education39497504CrossRefGoogle Scholar
  22. Sargeant, J.M., Mann, K.V., Ferrier, S.N., Langille, D.B., Muirhead, P.D., Sinclair, D.E. 2003Responses of rural family physicians and their colleagues and coworker raters to a multi-source feedback process: A pilot studyAcademic Medicine78S42S44CrossRefGoogle Scholar
  23. Sibley, J.C., Sackett, D.L., Neufeld, V., Gerrard, B., Rudnick, R.V., Fraser, W. 1982A randomized trial of continuing medical educationNew England Journal of Medicine306511515CrossRefGoogle Scholar
  24. Violato, C., Lockyer, J., Fidler, H. 2003Multi source feedback: A method of assessing surgical practiceBritish Medical Journal326546548Google Scholar
  25. Violato, C., Lockyer, J., Fidler, H., Toews, J., (2006). Testing a theoretical model of multi source feedback physician performance using structural equation modeling. Paper presented at the 5th Hawaii International Conference on Statistics, Mathematics and Related Fields, January 16–18Google Scholar
  26. Ward, M., Gruppen, L., Regehr, G. 2002Measuring self-assessment: Current state of the artAdvances in Health Sciences Education76380CrossRefGoogle Scholar
  27. Ward, M., MacRae, H., Schlachta, C., Mamazza, J., Puolin, E., Reznick, R., Regher, G. 2003Resident self-assessment of operative performanceAmerican Journal of Surgery185521524CrossRefGoogle Scholar

Copyright information

© Springer 2006

Authors and Affiliations

  1. 1.Medical Education Research UnitUniversity of CalgaryCalgaryCanada

Personalised recommendations