Enhancing Russian Wordnets Using the Force of the Crowd

  • Dmitry UstalovEmail author
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 436)


The YARN (Yet Another RussNet) project aims at creating a large open machine-readable thesaurus for Russian using crowdsourcing. This paper describes the project itself along with its objectives and results of the pilot user study conducted at the end of 2013.


WordNet Crowdsourcing Ontologies Thesauri 



This work is supported by the Russian Foundation for the Humanities, project 13-04-12020 “New Open Electronic Thesaurus for Russian”, and by the Ural Branch of RAS grant 12-S-1-1001/3. The author would like to thank the anonymous reviewers for their criticisms and suggestions.


  1. 1.
    Azarova, I., Mitrofanova, O., Sinopalnikova, A., Yavorskaya, M., Oparin, I.: RussNet: building a lexical database for the Russian language. In: Proceedings of Workshop on WordNet Structures and Standardisation, and How These Affect WordNet Applications and Evaluation, Gran Canaria, Spain, pp. 60–64 (2002)Google Scholar
  2. 2.
    Loukachevitch, N.V., Dobrov, B.V.: Development and Use of Thesaurus of Russian Language RuThes. In: Proceedings of Workshop on WordNet Structures and Standardisation, and How These Affect WordNet Applications and Evaluation, Gran Canaria, Spain, pp. 65–70 (2002)Google Scholar
  3. 3.
    Gelfenbein, I., Goncharuk, A., Lekhelt, V., Lipatov, A., Shilo, V.: Avtomaticheskij perevod semanticheskoj seti WORDNET na russkij yazyk. In: Proceedings of Dialog-2003 (2003) (in Russian)Google Scholar
  4. 4.
    Balkova, V., Sukhonogov, A., Yablonsky, S.: Russian WordNet. In: Proceedings of the Second Global WordNet Conference, pp. 31–38 (2004)Google Scholar
  5. 5.
    Navigli, R., Ponzetto, S.P.: BabelNet: The automatic construction, evaluation and application of a wide-coverage multilingual semantic network. Artif. Intell. 193, 217–250 (2012)CrossRefzbMATHMathSciNetGoogle Scholar
  6. 6.
    Krizhanovsky, A., Smirnov, A.: An approach to automated construction of a general-purpose lexical ontology based on Wiktionary. J. Comput. Syst. Sci. Int. 52(2), 215–225 (2013)CrossRefGoogle Scholar
  7. 7.
    Pala, K., Smrž, P.: Building Czech wordnet. Rom. J. Inf. Sci. Technol. 7(1–2), 79–88 (2004)Google Scholar
  8. 8.
    Maziarz, M., Piasecki, M., Szpakowicz, S.: Approaching plWordNet 2.0. In: Proceedings of the 6th Global Wordnet Conference, Matsue, Japan (2012)Google Scholar
  9. 9.
    Anisimov, A., Marchenko, O., Nikonenko, A., Porkhun, E., Taranukha, V.: Ukrainian WordNet: creation and filling. In: Larsen, H.L., Martin-Bautista, M.J., Vila, M.A., Andreasen, T., Christiansen, H. (eds.) FQAS 2013. LNCS, vol. 8132, pp. 649–660. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  10. 10.
    Horák, A., Pala, K., Rambousek, A., Povolnỳ, M.: DEBVisDic-first version of new client-server WordNet browsing and editing tool. In: Proceedings of the Third International WordNet Conference (GWC-06), pp. 325–328 (2006)Google Scholar
  11. 11.
    Henrich, V., Hinrichs, E.: GernEdiT: a graphical tool for germanet development. In: Proceedings of the ACL 2010 System Demonstrations, pp. 19–24 (2010)Google Scholar
  12. 12.
    Piasecki, M., Marcińczuk, M., Ramocki, R., Maziarz, M.: WordNetLoom: a WordNet development system integrating form-based and graph-based perspectives. Int. J. Data Min. Modell. Manage. 5(3), 210–232 (2013)Google Scholar
  13. 13.
    Lin, H., Davis, J.: Computational and crowdsourcing methods for extracting ontological structure from folksonomy. In: Aroyo, L., Antoniou, G., Hyvönen, E., ten Teije, A., Stuckenschmidt, H., Cabral, L., Tudorache, T. (eds.) ESWC 2010, Part II. LNCS, vol. 6089, pp. 472–477. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  14. 14.
    Rumshisky, A.: Crowdsourcing word sense definition. In: Proceedings of the 5th Linguistic Annotation Workshop, pp. 74–81 (2011)Google Scholar
  15. 15.
    Biemann, C.: Creating a system for lexical substitutions from scratch using crowdsourcing. Lang. Resour. Eval. 47(1), 97–122 (2013)CrossRefGoogle Scholar
  16. 16.
    Ross, J., Irani, L., Silberman, M., Zaldivar, A., Tomlinson, B.: Who are the crowdworkers?: shifting demographics in mechanical turk. In: CHI’10 Extended Abstracts on Human Factors in Computing Systems, pp. 2863–2872 (2010)Google Scholar
  17. 17.
    Tudorache, T., Falconer, S., Noy, N.F., Nyulas, C., Üstün, T.B., Storey, M.-A., Musen, M.A.: Ontology development for the masses: creating ICD-11 in WebProtégé. In: Cimiano, P., Pinto, H.S. (eds.) EKAW 2010. LNCS, vol. 6317, pp. 74–89. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  18. 18.
    Noy, N.F., Sarasua, C., Simperl, E.: CrowdMap: crowdsourcing ontology alignment with microtasks. In: Cudré-Mauroux, P., et al. (eds.) ISWC 2012, Part I. LNCS, vol. 7649, pp. 525–541. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  19. 19.
    Kontokostas, D., Zaveri, A., Auer, S., Lehmann, J.: TripleCheckMate: a tool for crowdsourcing the quality assessment of linked data. In: Klinov, P., Mouromtsev, D. (eds.) KESW 2013. CCIS, vol. 394, pp. 265–272. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  20. 20.
    Doan, A., Ramakrishnan, R., Halevy, A.Y.: Crowdsourcing systems on the World-Wide Web. Commun. ACM 54(4), 86–96 (2011)CrossRefGoogle Scholar
  21. 21.
    Braslavski, P., et al.: YARN Begins. In: Proceedings of Dialog-2013 (2013) (in Russian)Google Scholar
  22. 22.
    Lyashevskaya, O., Sharov, S.: The Frequency Dictionary of Modern Russian Language. Azbukovnik, Moscow (2009)Google Scholar
  23. 23.
    Braslavski, P., Ustalov, D., Mukhin, M.: A spinning wheel for YARN: user interface for a crowdsourced thesaurus. In: Proceedings of the Demonstrations at the 14th Conference of the European Chapter of the Association for Computational Linguistics, Gothenburg, Sweden, pp. 101–104 (2014)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  1. 1.Krasovsky Institute of Mathematics and MechanicsEkaterinburgRussia
  2. 2.Ural Federal UniversityEkaterinburgRussia
  3. 3.NLPubEkaterinburgRussia

Personalised recommendations