Abstract
The method used to assign referees to the manuscripts submitted to the 10th online World Conference on Soft Computing (WSC10) is described. Each of the 94 manuscripts received was associated with three unique reviewers from a program committee of 78 persons. A fairly advanced, hand-tuned fitness function based on inverse keyword-frequencies, keyword coverage, and penalties for refereeoveruse was used to evolve a satisfactory assignment, via a standard evolutionary algorithm. The resulting referee-to-manuscript matches were hand-adjusted in a small number of cases. In total, only seven assignments (out of more than 280) were declined by referees, and the return-rate for completed reviews was 81%.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
K. Antonina, B. Barbro, V. Hannu, T. Jarmo, and V. Ari. Prototypematching system for allocating conference papers. In Proceedings of the 36th International Conference on System Sciences (HICSS’03). IEEE Press, 2003.
C. Basu, H. Hirsh, W. W. Cohen, and C. Nevill-Manning. Technical paper recommendation: A study in combining multiple information sources. Journal of Artificial Intelligence Research, 1:231–252, 2001.
C. Buckley. Term weighting approaches in automatic text retrieval. Technical Report TR87-881, Cornell University, Ithaca, NY, 1987.
D.G. Cattrysse and L.N. van Wassenhove. A survey of algorithms for the generalized assignment problem. European Journal of Operational Research, 60:260–272, 1992.
R. J. Collins and D. R. Jefferson. Selection in massively parallel genetic algorithms. In Proceedings of the Fourth International Conference on Genetic Algorithms, pages 249–256. Morgan Kaufmann, 1991.
S. T. Dumais and J. Nielsen. Automating the assignment of submitted manuscripts to reviewers. In Proceedings of the 15th Annual International SIGIR, pages 233–244. ACM, 1992.
GR Raidl H Felt. An improved hybrid genetic algorithm for the generalized assignment problem. In Proceedings of the 2004 ACM Symposium on Applied Computing, pages 990–995, 2004.
[8] David Hartvigsen, Jerry C. Wei, and Richard Czuchlewski. The conference paper-reviewer assignment problem. Decision Sciences, 30:865–876, 1999.
J.J. Merelo-Cuervos and P. Castillo-Valdivieso. Conference paper assignment using a combined greedy/evolutionary algorithm. In Parallel Problem Solving from Nature (PPSN VIII), number 3242 in LNCS, pages 602–611. Springer, 2004.
D. Yarowsky and R. Florian. Taking the load off the conference chairs: towards a digital paper-routing assistant. In Proceedings of the 1999 Joint SIGDAT Emprical Methods in NLP and Very-Large Corpora, 1999.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Knowles, J. (2006). The Assignment of Referees to WSC10 Submissions: An Evolutionary Approach. In: Tiwari, A., Roy, R., Knowles, J., Avineri, E., Dahal, K. (eds) Applications of Soft Computing. Advances in Intelligent and Soft Computing, vol 36. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-36266-1_33
Download citation
DOI: https://doi.org/10.1007/978-3-540-36266-1_33
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29123-7
Online ISBN: 978-3-540-36266-1
eBook Packages: EngineeringEngineering (R0)