Abstract.
In the popularly used ranking method of peer rating, the exclusion of the evaluations/marks given to oneselves is intuitively appealing and has been actually practiced, since a person/university/country typically is biased in favor of itself. This short paper shows that this apparently reasonable principle of self-exclusion may give unacceptable rankings. In particular, it may rank B over A despite the fact that everyone including B ranks A over B. An impossibility theorem (in two versions) is proved, showing that, if the self-awarded marks are excluded, no method of ranking can satisfy some compelling conditions like monotonicity, neutrality, and weak unanimity. Some proposals to overcome the difficulty are discussed. While no ideal proposal has been discovered, some may be practically acceptable in most cases.
Similar content being viewed by others
Author information
Authors and Affiliations
Additional information
Received: 5 November 2000/Accepted: 15 May 2002
The authors would like to thank Maurice Salles and two anonymous referees for helpful comments. Sun's research was partially done when he worked at Max Planck Institute for Research into Economic Systems at Jena, Germany. The usual disclaimer applies.
Rights and permissions
About this article
Cite this article
Ng, YK., Sun, GZ. & Sun, GZ. Exclusion of self evaluations in peer ratings: An impossibility and some proposals. Soc Choice Welfare 20, 443–456 (2003). https://doi.org/10.1007/s003550200191
Issue Date:
DOI: https://doi.org/10.1007/s003550200191