Abstract
Most existing approaches of learning to rank treat the effectiveness of each query equally which results in a relatively lower ratio of queries with high effectiveness (i.e. rich queries) in the produced ranking model. Such ranking models need to be further optimized to increase the number of rich queries. In this paper, queries with different effectiveness are distinguished, and the queries with higher effectiveness are given higher weights. We modify the gradient in the LambdaMART algorithm based on a new perspective of Matthew effect to highlight the optimization of the rich queries and to produce the rich ranking model, and we present a consistency theorem for the modified optimization objective. Based on the effectiveness evaluation criteria for information retrieval, we introduce the Gini coefficient, mean-variance and quantity statistics to measure the performances of the ranking models. Experimental results show that the ranking models produced by the gradient-modified LambdaMART algorithm based on Matthew effect exhibit a stronger Matthew effect compared to the original LambdaMART algorithm.
Supported by the National Natural Science Foundation of China under Grant Nos. 61762052 and 61572360, the Natural Science Foundation of JiangXi Province of China under Grant No. 20171BAB202010, the Opening Foundation of Network and Data Security Key Laboratory of Sichuan Province under Grant No. NDSMS201602, the Science and Technology Project of the Education Department of Jiangxi Province of China under Grant No. GJJ160746, and the Doctoral Scientific Research Startup Foundation of Jinggangshan University under Grant No. JZB1804.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Page, L., Brin, S., Motwani, R., Winograd, T.: The pagerank citation ranking: bringing order to the web. Technical report, Stanford Digital Library Technologies Project (1999)
Merton, R.K., et al.: The matthew effect in science. Science 159(3810), 56–63 (1968)
Wu, Q., Burges, C.J., Svore, K.M., Gao, J.: Adapting boosting for information retrieval measures. Inf. Retr. 13(3), 254–270 (2010)
Burges, C.J.: From ranknet to lambdarank to lambdaMART: an overview. Microsoft Research Technical report MSR-TR-2010-82 (2010)
Wang, S., Wu, Y., Gao, B.J., Wang, K., Lauw, H.W., Ma, J.: A cooperative coevolution framework for parallel learning to rank. IEEE Trans. Knowl. Data Eng. 27(12), 3152–3165 (2015)
Ibrahim, O.A.S., Landasilva, D.: An evolutionary strategy with machine learning for learning to rank in information retrieval. Soft Comput. 22(10), 3171–3185 (2018)
Xu, J., Zeng, W., Lan, Y., Guo, J., Cheng, X.: Modeling the parameter interactions in ranking SVM with low-rank approximation. IEEE Trans. Knowl. Data Eng. (2018, in Press)
Järvelin, K., Kekäläinen, J.: Cumulated gain-based evaluation of IR techniques. ACM Trans. Inf. Syst. (TOIS) 20(4), 422–446 (2002)
Chapelle, O., Metlzer, D., Zhang, Y., Grinspan, P.: Expected reciprocal rank for graded relevance. In: Proceedings of the 18th ACM Conference on Information and Knowledge Management, pp. 621–630. ACM (2009)
Dixon, P.M., Weiner, J., Mitchell-Olds, T., Woodley, R.: Bootstrapping the gini coefficient of inequality. Ecology 68, 1548–1551 (1987)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Li, J., Liu, G. (2018). A Rich Ranking Model Based on the Matthew Effect Optimization. In: Chen, X., Sen, A., Li, W., Thai, M. (eds) Computational Data and Social Networks. CSoNet 2018. Lecture Notes in Computer Science(), vol 11280. Springer, Cham. https://doi.org/10.1007/978-3-030-04648-4_38
Download citation
DOI: https://doi.org/10.1007/978-3-030-04648-4_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-04647-7
Online ISBN: 978-3-030-04648-4
eBook Packages: Computer ScienceComputer Science (R0)