Advertisement

Fair Reviewer Assignment Considering Academic Social Network

  • Kaixia Li
  • Zhao Cao
  • Dacheng Qu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10366)

Abstract

An important task in peer review is assigning papers to appropriate reviewers, which is known as Reviewer Assignment (RA) problem. Most of existing works mainly focus on the similarity between paper topics and reviewer expertise, few works consider multiple relationships between authors and reviewers on academic social network. However, these relationships could influence reviewer assessments on fairness. In this paper, we address RA problem considering academic social network to find a confident, fair and balanced assignment. We model papers and reviewers based on matching degree by combining collaboration distance and topic similarity, and propose Maximum Sum of Matching degree RA (MSMRA) problem. Two algorithms are designed for MSMRA problem: Simulated Annealing-based Stochastic Approximation, and Maximum Matching and Minimum Deviation. Experiments show that our methods achieved good performance both on overall effectiveness and fairness distribution within reasonable running time.

Keywords

Reviewer assignment Academic social network Fair 

Notes

Acknowledgments

The study has been supported by the National Natural Science Foundation of China under Grant No. 61370136.

References

  1. 1.
    Dumais, S.T., Nielsen, J.: Automating the assignment of submitted manuscripts to reviewers. In: International ACM SIGIR Conference on Research and Development in Information Retrieval, Copenhagen, Denmark, p. 233, June 1992Google Scholar
  2. 2.
    Long, C., Wong, C.W., Peng, Y., Ye, L.: On good and fair paper-reviewer assignment. In: IEEE International Conference on Data Mining, p. 1145 (2013)Google Scholar
  3. 3.
    Walker, S.K.: Connected: the surprising power of our social networks and how they shape our lives. J. Fam. Theory Rev. 3, 220 (2012)CrossRefGoogle Scholar
  4. 4.
    Geller, J.: Challenge: how IJCAI 1999 can prove the value of AI by using AI. In: International Joint Conference on Artifical Intelligence, p. 55 (1997)Google Scholar
  5. 5.
    Basu, C., Hirsh, H., Cohen, W.W., Nevill-Manning, C.: Recommending papers by mining the web. In: Proceedings of the IJCAI99 Workshop on Learning About Users, p. 1 (2000)Google Scholar
  6. 6.
    Hettich, S., Pazzani, M.J.: Mining for proposal reviewers: lessons learned at the national science foundation. In: Twelfth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Philadelphia, PA, USA, p. 862, August 2006Google Scholar
  7. 7.
    Rodriguez, M.A., Bollen, J.: An algorithm to determine peer-reviewers, p. 319 (2006)Google Scholar
  8. 8.
    Mimno, D., Mccallum, A.: Expertise modeling for matching papers with reviewers. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Jose, California, USA, p. 500, August 2007Google Scholar
  9. 9.
    Ferilli, S., Di Mauro, N., Basile, T.M.A., Esposito, F., Biba, M.: Automatic topics identification for reviewer assignment. In: Ali, M., Dapoigny, R. (eds.) IEA/AIE 2006. LNCS, vol. 4031, pp. 721–730. Springer, Heidelberg (2006). doi: 10.1007/11779568_78 CrossRefGoogle Scholar
  10. 10.
    Xue, N., Hao, J.X., Jia, S.L., Wang, Q.: An interval fuzzy ontology based peer review assignment method (2012)Google Scholar
  11. 11.
    Hartvigsen, D., Wei, J.C., Czuchlewski, R.: The conference paper-reviewer assignment problem. Decis. Sci. 30, 865 (1999)CrossRefGoogle Scholar
  12. 12.
    Kou N.M., Hou, U.L., Mamoulis N., Gong Z.: Weighted coverage based reviewer assignment. In: ACM SIGMOD International Conference, p. 2031 (2015)Google Scholar
  13. 13.
    Li, X., Watanabe, T.: Automatic paper-to-reviewer assignment, based on the matching degree of the reviewers. Procedia Comput. Sci. 22, 633 (2013)CrossRefGoogle Scholar
  14. 14.
    Kolasa, T., Krol, D.: A survey of algorithms for paper-reviewer assignment problem. IETE Tech. Rev. 28, 123 (2014)CrossRefGoogle Scholar
  15. 15.
    Karimzadehgan, M., Zhai, C.X., Belford, G.: Multi-aspect expertise matching for review assignment. In: ACM Conference on Information and Knowledge Management, p. 1113 (2008)Google Scholar
  16. 16.
    Kou, N.M., Hou, U.L., Mamoulis, N., Li, Y., Li, Y., Gong, Z.: A topic-based reviewer assignment system. Proc. VLDB Endow. 8, 1852 (2015)CrossRefGoogle Scholar
  17. 17.
    Charlin, L., Zemel, R.S., Boutilier, C.: A framework for optimizing paper matching. In: Proceedings of the Twenty-Seventh Conference on Uncertainty in Artificial Intelligence, UAI 2011, Barcelona, Spain, p. 86, July 2012Google Scholar
  18. 18.
    Karimzadehgan, M., Zhai, C.X.: Constrained multi-aspect expertise matching for committee review assignment. In: ACM Conference on Information and Knowledge Management, CIKM 2009, Hong Kong, China, p. 1697, November 2009Google Scholar
  19. 19.
    Kolasa, T., Król, D.: ACO-GA approach to paper-reviewer assignment problem in CMS. In: Jędrzejowicz, P., Nguyen, N.T., Howlet, R.J., Jain, L.C. (eds.) KES-AMSTA 2010. LNCS, vol. 6071, pp. 360–369. Springer, Heidelberg (2010). doi: 10.1007/978-3-642-13541-5_37 CrossRefGoogle Scholar
  20. 20.
    Benferhat, S., Lang, J.: Conference paper assignment. Int. J. Intell. Syst. 16, 1183 (2001)CrossRefzbMATHGoogle Scholar
  21. 21.
    Wang, F., Zhou, S., Shi, N.: Group-to-group reviewer assignment problem. Comput. Oper. Res. 40, 1351 (2013)MathSciNetCrossRefzbMATHGoogle Scholar
  22. 22.
    Conry, D., Koren, Y., Ramakrishnan, N.: Recommender systems for the conference paper assignment problem. In: ACM Conference on Recommender Systems, p. 357 (2009)Google Scholar
  23. 23.
    Tang, W., Tang, J., Tan, C.: Expertise matching via constraint-based optimization. In: Main Conference Proceedings on IEEE/WIC/ACM International Conference on Web Intelligence, WI 2010, Toronto, Canada, August 31–September 3 2010, p. 34 (2010)Google Scholar
  24. 24.
    Garg, N., Kavitha, T., Kumar, A., Mehlhorn, K., Mestre, J.: Assigning papers to referees. Algorithmica 58, 119 (2010)MathSciNetCrossRefzbMATHGoogle Scholar
  25. 25.
    O’Dell, R., Wattenhofer, M., Wattenhofer, R.: The paper assignment problem (2005)Google Scholar
  26. 26.
    Taylor, C.J.: On the optimal assignment of conference papers to reviewers (2012)Google Scholar
  27. 27.
    Kirkpatrick S., Gelatt Jr. C., Vecchi M.P.: Optimization by simulated annealing. In: Readings in Computer Vision, vol. 220, p. 606 (1987)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Beijing Institute of TechnologyBeijingChina

Personalised recommendations