Advertisement

Advances in Health Sciences Education

, Volume 11, Issue 1, pp 51–60 | Cite as

Relationships Between Self-Assessment Skills, Test Performance, and Demographic Variables in Psychiatry Residents

  • David J. LynnEmail author
  • Charles Holzer
  • Patrick O’Neill
Article

Abstract

Some researchers have seen the capacity for self-assessment in trainees as a special skill, and some reports have concluded that this skill is positively and crucially correlated with academic competence. Thus, it is believed that those trainees who are most deficient in knowledge are least likely to be aware of their limitations. Other researchers have emphasized the impact of statistical regression and other technical considerations in the studies, which have led to these conclusions. Our study used a relative-ranking design to measure the accuracy of self-assessments of both strengths and weaknesses in psychiatry residents. We analyzed the relationships between indices of self-assessment accuracy and other resident characteristics, particularly current academic strength as measured by a standard test of psychiatric knowledge. A total of 56 residents in two general psychiatry programs evaluated their performance on the Psychiatry Resident in Training Examination by estimating the rank order of their scores in the 11 psychiatry subject areas. For each resident, actual examination results were then used to generate measures of the accuracy of the identification of strengths and weaknesses. Residents’ identifications of their strengths and weaknesses were significantly more accurate than chance levels. Strengths and weaknesses were identified with roughly equal proficiency, and accuracy in these assessments was not correlated to any of the following variables: academic competence as measured by examination raw scores, postgraduate year, gender, international vs. American medical education, program membership, or age. Our results do not support the hypothesis that trainees who show the least academic mastery also make the most inaccurate self-assessments. In addition, we found no resident characteristics that accounted for variation in self-assessment accuracy.

Keywords

self-assessment medical education residency training psychiatry competence 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Baliga, S., Gruppen, L.D., Fitzgerald, J.T., White, C., Grum, C.M., Woolliscroft, J.O. & Davis, W.K. (1998). Do personal characteristics influence self-assessment accuracy? Paper presented at the 8th International Ottawa Conference on Medical Education, Philadelphia.Google Scholar
  2. Fitzgerald, J.T., Gruppen, L.D., White, C.B. 2000The influence of task formats on the accuracy of medical students’ self-assessmentsAcademic Medicine75737741Google Scholar
  3. Gordon, M.J. 1991A review of the validity and accuracy of self-assessments in health professions trainingAcademic Medicine66762769CrossRefGoogle Scholar
  4. Gruppen, L.D., Garcia, J., Grum, C.M., Fitzgerald, J.T., White, C.A., Dicken, L., Sisson, J.C., Zweifler, A. 1997Medical students’ self-assessment accuracy in communication skillsAcademic Medicine72S57S59Google Scholar
  5. Gruppen, L.D., White, C., Fitzgerald, J.T., Grum, C.M., Woolliscroft, J.O. 2000Medical students’ self-assessments and their allocations of learning timeAcademic Medicine75374379Google Scholar
  6. Harrington, J.P., Murnaghan, J.J., Regehr, G. 1997Applying a relative ranking model to the self-assessment of extended performancesAdvances in Health Sciences Education21725Google Scholar
  7. Hodges, G., Regehr, G., Martin, M. 2001Difficulties in recognizing one’s own incompetence: Novice physicians who are unskilled and unaware of itAcademic Medicine76S87S89Google Scholar
  8. Kruger, J., Dunning, D. 1999Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessmentsJournal of Personality and Social Psychology7711211134Google Scholar
  9. Krueger, J., Mueller, R.A. 2002Unskilled, unaware, or both? The better-than-average heuristic and statistical regression predict errors in estimates of own performanceJournal of Personality and Social Psychology82180188CrossRefGoogle Scholar
  10. Regehr, G., Hodges, B., Tiberius, R., Lofchy, J. 1996Measuring self-assessment skills: An innovative relative ranking modelAcademic Medicine71S52S54Google Scholar
  11. Reiter, H.I., Eva, K.W., Hatala, R.M., Norman, G.R. 2002Self and peer assessment in tutorials: Application of a relative-ranking modelAcademic Medicine7711341139Google Scholar
  12. Ward, M., Gruppen, L., Regehr, G. 2002Measuring self-assessment: Current state of the artAdvances in Health Science Education76380Google Scholar

Copyright information

© Springer 2006

Authors and Affiliations

  • David J. Lynn
    • 1
    Email author
  • Charles Holzer
    • 2
  • Patrick O’Neill
    • 3
  1. 1.Department of PsychiatryThomas Jefferson UniversityPhiladelphiaUSA
  2. 2.Department of PsychiatryUniversity of Texas Medical Branch at GalvestonGalvestonUSA
  3. 3.Department of Psychiatry and NeurologyTulane University School of MedicineNew OrleansUSA

Personalised recommendations