Advances in Health Sciences Education

, Volume 11, Issue 3, pp 267–278 | Cite as

Distorted Perceptions of Competence and Incompetence Are More Than Regression Effects

  • M. Albanese
  • S. Dottl
  • G. Mejicano
  • L. Zakowski
  • C.  Seibert
  • S. Van Eyck
  • C. Prucha
Article

Abstract

Students inaccurately assess their own skills, especially high- or low-performers on exams. This study assessed whether regression effects account for this observation. After completing the Infection and Immunity course final exam (IIF), second year medical students (N = 143) estimated their performance on the IIF in terms of percent correct and percentile rank. Second year grade point averages (M2GPAs) were combined with the IIF results to form five subgroups: 1 = true-low (lowest third on both IIF and M2GPA, 2 = false-low (lowest third on IIF only), 3 = middle (neither lowest nor highest third on IIF), 4 = false-high (highest third on IIF only), 5 = true-high (highest third on IIF and M2GPA). The false-low and false-high groups were considered more susceptible to regression effects due to likely group misclassification. Differences between self-assessment and actual performance within each group and between the five groups were used to estimate what portion of observed differences is due to general tendencies versus regression effects. Results found that students accurately assessed their percent correct, but inaccurately assessed their percentile rank. No statistically significant differences existed between the true and false-low subgroups nor the true- and false-high subgroups. Percentages of mean differences suggest that while regression effects resulted in 50–75% over/under-estimates of scores by students who were misclassified, when they were merged with the true-low/high groups, they do not account for more than 14% of low performer over-estimates of their performance and high performer under-estimates of their performance. Accurate percent correct assessments and distorted percentile rank assessments are challenges in using instructional methods dependent on student self-assessments of their learning needs. Identifying and helping students with distorted perceptions of their test performances may be a key issue in such instructional approaches.

Keywords

distorted perceptions of competence life-long learning regression effects self-assessment 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Albanese, M., Zakowski, L., Seibert, C., VanEyck, S., Prucha, C. & Mejicano, G. (2002). Delusions of competence and incompetence may depend on how it’s measured. In Proceedings of the 10th International Ottawa Conference on Medical Education, Ottawa, CAGoogle Scholar
  2. Arnold, L., Willoughby, T.L., Calkins, E.V 1985Self-evaluation in undergraduate medical education: A longitudinal perspectiveJournal of Medical Education602128Google Scholar
  3. Cohen, J. 1988 Statistical Power Analysis for the Behavioral Sciences2Lawrence Erlbaum Associates, PublishersHillsdale, NJGoogle Scholar
  4. Eva, K.W., Cunnington, J.P.W., Reiter, H.I., Keane, D.R., Norman, G.R 2004How can I know what I don’t know? Poor self assessment in a well-defined domainAdvances in Health Sciences Education9211224CrossRefGoogle Scholar
  5. Falchikov, N., Boud, D 1989Student self-assessment in higher education: A meta analysisReview of Educational Research59395430CrossRefGoogle Scholar
  6. Hodges, B., Regehr, G., Martin, D 2002Difficulties in recognizing one’s own incompetence: Novice physicians who are unskilled and unaware of itAcademic Medicine76S879Google Scholar
  7. Kruger, J., Dunning, D. 1999Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessmentsJournal of Personality and Social Psychology77112134CrossRefGoogle Scholar
  8. Ward, M., Gruppen, L., Regehr, G. 2002Measuring self-assessment: Current state of the artAdvances in Health Sciences Education76380CrossRefGoogle Scholar

Copyright information

© Springer 2006

Authors and Affiliations

  • M. Albanese
    • 1
  • S. Dottl
    • 1
  • G. Mejicano
    • 1
  • L. Zakowski
    • 1
  • C.  Seibert
    • 1
  • S. Van Eyck
    • 1
  • C. Prucha
    • 1
  1. 1.University of Wisconsin Medical SchoolMadisonUSA

Personalised recommendations