The organizers of the EvalRS recommender systems competition argue that accuracy should not be the only goal and explain how they took robustness and fairness into account.
Change history
11 March 2024
A Correction to this paper has been published: https://doi.org/10.1038/s42256-024-00819-5
References
Tagliabue, J. et al. Preprint at https://arxiv.org/abs/2104.09423 (2021).
Baigorria Alonso, M. Preprint at https://arxiv.org/abs/2108.09858 (2021).
Ribeiro, M. T., Wu, T., Guestrin, C. & Singh, S. in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics 4902–4912 https://doi.org/10.18653/v1/2020.acl-main.442 (2020).
Chia, P. J., Tagliabue, J., Bianchi, F., He, C. & Ko, B. In Companion Proc. Web Conference 2022 99–104 https://doi.org/10.1145/3487553.3524215 (2022).
Tagliabue, J. et al. Proceedings of the CIKM 2022 Workshops co-located with 31st ACM International Conference on Information and Knowledge Management Vol. 3318 CEUR-WS (2022).
Schedl, M. In Proc. 2016 ACM on International Conference on Multimedia Retrieval 103–110 https://doi.org/10.1145/2911996.2912004 (2016).
Ke Yang, J. S. In Proc. 29th International Conference on Scientific and Statistical Database Management 1–6 https://doi.org/10.1145/3085504.3085526 (2017).
Dixon, L., Li, J., Sorensen, J., Thain, N. & Vasserman, L. In Proc. 2018 AAAI/ACM Conference on AI, Ethics, and Society 67–73 https://doi.org/10.1145/3278721.3278729 (2018).
Acknowledgements
EvalRS is based on RecList, an open source library whose development is supported by Comet, Neptune and Gantry.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare they have no conflicting interests.
Rights and permissions
About this article
Cite this article
Tagliabue, J., Bianchi, F., Schnabel, T. et al. A challenge for rounded evaluation of recommender systems. Nat Mach Intell 5, 181–182 (2023). https://doi.org/10.1038/s42256-022-00606-0
Published:
Issue Date:
DOI: https://doi.org/10.1038/s42256-022-00606-0
- Springer Nature Limited
This article is cited by
-
Human–AI adaptive dynamics drives the emergence of information cocoons
Nature Machine Intelligence (2023)