Double-blind peer reviewing has been proved to be pretty effective and fair way of academic work selection. However, to the best of our knowledge, nobody has yet analysed the effects caused by its introduction at the Russian NLP conferences. We investigate how the double-blind peer reviewing influences gender and location (according to authors’ affiliations) biases and whether it makes two of the conferences under analysis more inclusive. The results show that gender distribution has become more equal for the Dialogue conference, but did not change for the AIST conference. The authors’ location distribution (roughly divided into ‘central’ and ‘not central’) has become more equal for AIST, but, interestingly, less equal for Dialogue.
This is a preview of subscription content, access via your institution.
Tax calculation will be finalised at checkout
Purchases are for personal use onlyLearn about institutional subscriptions
Budden, A.E., Tregenza, T., Aarssen, L.W., Koricheva, J., Leimu, R., Lortie, C.J.: Double-blind review favours increased representation of female authors. Trends Ecol. Evol. 23(1), 4–6 (2008)
Nikishina, I., Bakarov, A., Kutuzov, A.: RusNLP: semantic search engine for Russian NLP conference papers. In: van der Aalst, W.M.P., et al. (eds.) AIST 2018. LNCS, vol. 11179, pp. 111–120. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-11027-7_11
Spier, R.: The history of the peer-review process. Trends Biotechnol. 20(8), 357–358 (2002)
Surwillo, W.W.: Anonymous reviewing and the peer-review process. Am. Psychol. 41(2), 218 (1986)
Tomkins, A., Zhang, M., Heavlin, W.D.: Single versus double blind reviewing at WSDM 2017. arXiv preprint arXiv:1702.00502 (2017)
The article was prepared within the framework of the HSE University Basic Research Program and funded by the Russian Academic Excellence Project ‘5-100’.
Editors and Affiliations
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Kutuzov, A., Nikishina, I. (2019). Double-Blind Peer-Reviewing and Inclusiveness in Russian NLP Conferences. In: van der Aalst, W., et al. Analysis of Images, Social Networks and Texts. AIST 2019. Lecture Notes in Computer Science(), vol 11832. Springer, Cham. https://doi.org/10.1007/978-3-030-37334-4_1
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-37333-7
Online ISBN: 978-3-030-37334-4