Abstract
We extend the Bayesian skill rating system of TrueSkill to accommodate score-based match outcomes. TrueSkill has proven to be a very effective algorithm for matchmaking — the process of pairing competitors based on similar skill-level — in competitive online gaming. However, for the case of two teams/players, TrueSkill only learns from win, lose, or draw outcomes and cannot use additional match outcome information such as scores. To address this deficiency, we propose novel Bayesian graphical models as extensions of TrueSkill that (1) model player’s offence and defence skills separately and (2) model how these offence and defence skills interact to generate score-based match outcomes. We derive efficient (approximate) Bayesian inference methods for inferring latent skills in these new models and evaluate them on three real data sets including Halo 2 XBox Live matches. Empirical evaluations demonstrate that the new score-based models (a) provide more accurate win/loss probability estimates than TrueSkill when training data is limited, (b) provide competitive and often better win/loss classification performance than TrueSkill, and (c) provide reasonable score outcome predictions with an appropriate choice of likelihood — prediction for which TrueSkill was not designed, but which can be useful in many applications.
Keywords
- variational inference
- matchmaking
- graphical models
Download conference paper PDF
References
Abramowitz, M., Stegun, I.A.: Handbook of Mathematical Functions, With Formulas, Graphs, and Mathematical Tables. Dover Publications, New York (1974)
Birlutiu, A., Heskes, T.: Expectation Propagation for Rating Players in Sports Competitions. In: Kok, J.N., Koronacki, J., Lopez de Mantaras, R., Matwin, S., Mladenič, D., Skowron, A. (eds.) PKDD 2007. LNCS (LNAI), vol. 4702, pp. 374–381. Springer, Heidelberg (2007)
Dangauthier, P., Herbrich, R., Minka, T., Graepel, T.: Trueskill through time: Revisiting the history of chess. In: NIPS, pp. 337–344. MIT Press, Cambridge (2008)
Elo, A.E.: The rating of chess players: past and present. Arco Publishing, New York (1978)
Herbrich, R., Minka, T., Graepel, T.: TrueskillTM: A Bayesian skill rating system. In: NIPS, pp. 569–576 (2006)
Karlis, D., Ntzoufras, I.: Bayesian modelling of football outcomes: using the skellam’s distribution for the goal difference. IMA Journal of Management Mathematics 20(2), 133–145 (2009)
Kschischang, F.R., Frey, B.J., Loeliger, H.-A.: Factor graphs and the sum-product algorithm. IEEE Transactions on Information Theory 47(2), 498–519 (2001)
Minka, T.: Expectation propagation for approximate bayesian inference. In: UAI, pp. 362–369. Morgan Kaufmann (2001)
Moroney, M.J.: Facts from figures, 3rd edn. Penguin Press Science (1956)
Skellam, J.G.: The frequency distribution of the difference between two Poisson variates belonging to different populations. Journal of the Royal Statistical Society: Series A 109(3), 296 (1946)
Glickman, M.E., Stern, H.S.: A state-space model for football league scores. Journal of the American Statistical Association 93(441), 25–35 (1998)
Beal, M.J., Ghahramani, Z.: The Variational Bayesian EM Algorithm for Incomplete Data: with Application to Scoring Graphical Model Structures. In: Proceedings of the Seventh Valencia International Meeting, pp. 453–464 (2002)
Karlis, D., Ntzoufras, I.: Bayesian modelling of football outcomes: using the Skellam’s distribution for the goal difference. IMA Journal of Management Mathematics 20(2), 133–145 (2009)
Karlis, D., Ntzoufras, I.: Analysis of Sports Data by Using Bivariate Poisson Models. Journal of the Royal Statistical Society: Series D 52(3), 381–393 (2003)
Moroney, M.J.: Facts from figures, 3rd edn. Penguin Press Science (1956)
Dixon, M.J., Coles, S.G.: Modelling Association Football Scores and Inefficiencies in the Football Betting Market. Journal of the Royal Statistical Society: Series C 46(2), 265–280 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Guo, S., Sanner, S., Graepel, T., Buntine, W. (2012). Score-Based Bayesian Skill Learning. In: Flach, P.A., De Bie, T., Cristianini, N. (eds) Machine Learning and Knowledge Discovery in Databases. ECML PKDD 2012. Lecture Notes in Computer Science(), vol 7523. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33460-3_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-33460-3_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33459-7
Online ISBN: 978-3-642-33460-3
eBook Packages: Computer ScienceComputer Science (R0)
