Skip to main content

Multi-sourced Integrated Ranking with Exposure Fairness

  • Conference paper
  • First Online:
Advances in Knowledge Discovery and Data Mining (PAKDD 2024)


Integrated ranking system is one of the critical components of industrial recommendation platforms. An integrated ranking system is expected to generate a mix of heterogeneous items from multiple upstream sources. Two main challenges need to be solved in this process, namely, (i) Utility-fairness tradeoff: an integrated ranking system is required to balance the overall platform’s utility and exposure fairness among different sources; (ii) Information utilization from upstream sources: each source sequence has been carefully arranged by its provider, so how to efficiently utilize the source sequential information is important and should be carefully considered by the integrated ranking system. Existing methods generally cannot address these two challenges well. In this paper, we propose an integrated ranking model called Multi-sourced Constrained Ranking (MSCRank). It is a dual RNN-based model managing the utility-fairness tradeoff with multi-task learning, and capturing information in source sequences with a novel MA-GRU cell. We compare MSCRank with various baselines on public and industrial datasets, and MSCRank achieves the state-of-the-art performance on both utility and fairness. Online A/B test further validates the effectiveness of MSCRank.

Y. Liu, W. Liu and W. Xia—Authors contributed equally to this research.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 74.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions


  1. 1.

    Code is available in


  1. Mindspore (2020).

  2. Carbonell, J., Goldstein, J.: The use of MMR, diversity-based reranking for reordering documents and producing summaries. In: Proceedings of SIGIR (1998)

    Google Scholar 

  3. Cho, K., Van Merriënboer, B., Bahdanau, D., Bengio, Y.: On the properties of neural machine translation: encoder-decoder approaches. arXiv preprint arXiv:1409.1259 (2014)

  4. Chung, J., Gulcehre, C., Cho, K., Bengio, Y.: Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555 (2014)

  5. Clarke, C.L., et al.: Novelty and diversity in information retrieval evaluation. In: Proceedings of SIGIR (2008)

    Google Scholar 

  6. Fu, M., Agrawal, A., Irissappane, A.A., Zhang, J., Huang, L., Qu, H.: Deep reinforcement learning framework for category-based item recommendation. IEEE Trans. Cybern. 52(11), 12028–12041 (2021)

    Google Scholar 

  7. Geyik, S.C., Ambler, S., Kenthapadi, K.: Fairness-aware ranking in search & recommendation systems with application to linkedin talent search. In: Proceedings of of KDD (2019)

    Google Scholar 

  8. Kullback, S.: Information theory and statistics. Courier Corporation (1997)

    Google Scholar 

  9. Morik, M., Singh, A., Hong, J., Joachims, T.: Controlling fairness and bias in dynamic learning-to-rank. In: Proceedings of SIGIR (2020)

    Google Scholar 

  10. Okura, S., Tagami, Y., Ono, S., Tajima, A.: Embedding-based news recommendation for millions of users. In: Proceedings of KDD (2017)

    Google Scholar 

  11. Pei, C., et al.: Personalized re-ranking for recommendation (2019)

    Google Scholar 

  12. Richardson, M., Dominowska, E., Ragno, R.: Predicting clicks: estimating the click-through rate for new ads. In: Proceedings of WWW (2007)

    Google Scholar 

  13. Sener, O., Koltun, V.: Multi-task learning as multi-objective optimization. In: Proceedings of NeurIPS (2018)

    Google Scholar 

  14. Sonboli, N., et al.: Librec-auto: a tool for recommender systems experimentation. In: Proceedings of CIKM (2021)

    Google Scholar 

  15. Wan, M., Ni, J., Misra, R., McAuley, J.: Addressing marketing bias in product recommendations. In: Proceedings of WSDM (2020)

    Google Scholar 

  16. Xi, Y., et al.: On-device integrated re-ranking with heterogeneous behavior modeling. In: Proceedings of KDD, pp. 5225–5236 (2023)

    Google Scholar 

  17. Xia, W., Liu, W., Liu, Y., Tang, R.: Balancing utility and exposure fairness for integrated ranking with reinforcement learning. In: Proceedings of CIKM (2022)

    Google Scholar 

  18. Xie, R., Zhang, S., Wang, R., Xia, F., Lin, L.: Hierarchical reinforcement learning for integrated recommendation. In: Proceedings of AAAI (2021)

    Google Scholar 

  19. Yan, J., Xu, Z., Tiwana, B., Chatterjee, S.: Ads allocation in feed via constrained optimization. In: Proceedings of KDD (2020)

    Google Scholar 

  20. Zehlike, M., et al.: Fa* IR: a fair top-k ranking algorithm. In: Proceedings of CIKM (2017)

    Google Scholar 

Download references


The Shanghai Jiao Tong University team is partially supported by National Natural Science Foundation of China (62177033). The work is also sponsored by Huawei Innovation Research Program. We thank MindSpore [1] for the partial support of this work.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Yong Yu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Liu, Y. et al. (2024). Multi-sourced Integrated Ranking with Exposure Fairness. In: Yang, DN., Xie, X., Tseng, V.S., Pei, J., Huang, JW., Lin, J.CW. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2024. Lecture Notes in Computer Science(), vol 14649. Springer, Singapore.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-97-2264-8

  • Online ISBN: 978-981-97-2262-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics