Crowd-Ranking: a Markov-based method for ranking alternatives
- 263 Downloads
Many ranking algorithms rank a set of alternatives based on their performance in a set of pairwise comparisons. In this study, a special scenario is observed in which the objective is to rate and rank a set of groups in a traditional recruiting situation, in which the groups extend offers to the set of individuals, and the individuals will select one of their available offers. The new ranking method, Crowd-Ranking, uses collective wisdom and decision-making in conjunction with Markov chains to create competitive matches between alternatives and ultimately provide a ranking of the alternatives. First, the method is evaluated by its performance in a perfect season scenario. Next, it is applied to the case of NCAA football recruiting in the power conferences (ACC, Big Ten, Big 12, Pac 12 and SEC) in the Football Bowl Subdivision. For the Big Ten conference, the method performs significantly better than popular existing services at predicting future team performance based on past recruiting rankings. For a comprehensive national ranking of the power conferences, there is no statistically significant difference between Crowd-Ranking and the other methods.
KeywordsDecision making Markov chains Ranking Crowds
The authors would like to thank Thomas Hagebols for his contribution in gathering the data for the national ranking. The authors would also like to thank anonymous referees for helping to improve the quality of the manuscript.
- Colley WN (2002) Colley’s bias free college football ranking method: the Colley matrix explained. www.colleyrankings.com/matrate.pdf
- Elo AE (1961) The new U.S.C.F rating system. Chess Life 16:160–161Google Scholar
- Govan AY (2008) Ranking theory with application to popular sports. Dissertation, North Carolina State UniversityGoogle Scholar
- Massey K (1997) Statistical models applied to the rating of sports teams. Bachelor’s Thesis, Bluefield CollegeGoogle Scholar
- Rivals. Retrieved Jan 2017, http://www.rivals.com
- Scout. Retrieved Jan 2017, http://www.scout.com
- Sports. Retrieved Jan 2017, http://www.247sports.com
- Saaty TL (1980) The analytic hierarchy process. McGraw-Hill, New YorkGoogle Scholar
- Saaty TL (1986) Axiomatic foundation of the analytic hierarchy process. INFORMS 32(7):841–855Google Scholar