Skip to main content

Word Sense Disambiguation Using Swarm Intelligence: A Bee Colony Optimization Approach

  • Conference paper
  • First Online:
Computational Linguistics and Intelligent Text Processing (CICLing 2016)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9623))

  • 1364 Accesses

Abstract

Word Sense Disambiguation (WSD) is a problem of figuring out the correct sense of a word in a given context. We introduce an unsupervised knowledge-source approach for word sense disambiguation using a bee colony optimization algorithm that is constructive in nature. Our algorithm, using WordNet, optimizes the search space by globally disambiguating a document by constructively determining the sense of a word using the previously disambiguated words. Heuristic methods for unsupervised word sense disambiguation mostly give less importance to the context words while determining the sense of the target word. In this paper, we put more emphasis on the context and the part of speech of a word while determining its correct sense. We make use of a modified simplified Lesk algorithm as a relatedness measure. Our approach is then compared with recent unsupervised heuristics such as ant colony optimization, genetic algorithms, and simulated annealing, and shows promising results. We finally introduce a voting strategy to our algorithm that ends up further improving our results.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Nguyen, K.-H., Ock, C.-Y.: Word sense disambiguation as a traveling salesman problem. Artif. Intell. Rev. 40, 405–427 (2011)

    Article  Google Scholar 

  2. Navigli, R.: Word sense disambiguation: a survey. ACM Comput. Surv. 41, 10:1–10:69 (2009)

    Article  Google Scholar 

  3. PrincetonUniversity: WordNet. http://wordnet.princeton.edu/

  4. Navigli, R., Litkowski, K.C., Hargraves, O.: SemEval-2007 Task 07: coarse-grained english all-words task. In: Proceedings of 4th International Workshop in Semantic Evaluations, pp. 30–35 (2007)

    Google Scholar 

  5. Lesk, M.: Automatic sense disambiguation using machine readable dictionaries. In: Proceedings of the 5th Annual International Conference on Systems Documentation - SIGDOC 1986, pp. 24–26 (1986)

    Google Scholar 

  6. Mihalcea, R.: Knowledge-based methods for WSD. In: Word Sense Disambiguation Algorithms and Applications, pp. 107–131 (2007)

    Google Scholar 

  7. Jurafsky, D., Martin, J.H.: Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition. Speech Language Process. An Introduction to Natural Language Processing Computational Linguistic Speech Recognition, 21, pp, 0–934 (2009)

    Google Scholar 

  8. Chan, Y.S., Ng, H.T.: Domain Adaptation with Active Learning for Word Sense Disambiguation, pp. 49–56, Computational Linguistics, Prague (2007) (in Press)

    Google Scholar 

  9. Zhu, J., Hovy, E., Rey, M.: Active Learning for Word Sense Disambiguation with Methods for Addressing the Class Imbalance Problem. Computational Linguistics, pp. 783–790 (2007)

    Google Scholar 

  10. Cowie, J., Guthrie, J., Guthrie, L.: Lexical disambiguation using simulated annealing. In: Proceedings of the 14th Conference Computational Linguistics COLING 1992, vol. 1, pp. 359–365 (1992)

    Google Scholar 

  11. Gelbukh, A., Sidorov, G., Han, S.-Y.: Evolutionary Approach to Natural Language Word Sense Disambiguation through Global Coherence Optimization. WSEAS Trans. Comput. 2(1), 257–265 (2003)

    Google Scholar 

  12. Schwab, D., Guillaume, N.: A global ant colony algorithm for word sense disambiguation based on semantic relatedness. Highlights in Practical Applications of Agents and Multiagent Systems, pp. 257–264. Springer, Heidelberg (2011)

    Google Scholar 

  13. Schwab, D., Goulian, J., Tchechmedjiev, A., Blanchon, H.: Ant colony algorithm for the unsupervised word sense disambiguation of texts: comparison and evaluation. In: Proceedings of COLING 2012, pp. 2389–2404 (2012)

    Google Scholar 

  14. Teodorović, D.: Bee Colony. Innov. Swarm Intell. 248, 39–60 (2009)

    Article  Google Scholar 

  15. Bonabeau, E., Dorigo, M., Theraulaz, G.: Swarm Intelligence: From Natural to Artificial Systems. Oxford University Press, New York (1999)

    MATH  Google Scholar 

  16. Patwardhan, S., Pedersen, T.: Using WordNet-based context vectors to estimate the semantic relatedness of concepts. In: 11th Conference on European Chapter Association Computational Linguistics, Vol. 1501, pp. 1–8 (2006)

    Google Scholar 

  17. Schwab, D., Tchechmedjiev, A., Goulian, J., Nasiruddin, M., Sérasset, G., Blanchon, H.: GETALP system: propagation of a Lesk measure through an ant colony algorithm. In: Second Joint Conference on Lexical and Computational Semantics (*SEM), Proceedings of the Seventh International Workshop on Semantic Evaluation (SemEval 2013), Vol. 2, pp. 232–240 (2013)

    Google Scholar 

  18. Teodorović, D., Lucic, P., Markovic, G., Dell’Orco, M.: Bee colony optimization: principles and applications. In: 8th Seminar on Neural Network Applications in Electrical Engineering, pp. 151–156 (2006)

    Google Scholar 

  19. Markovi, G.Z., Teodorović_ca, D.B., Aćimović-Raspopović, V.S.: Routing and wavelength assignment in all-optical networks based on the bee colony optimization. AI Commun. - Netw. Anal. Nat. Sci. Eng. 20(4), 273–285 (2007)

    Google Scholar 

  20. Charniak, E., Blaheta, D., Ge, N., Hall, K., Hale, J., Johnson, M.: Bllip 1987–89 WSJ Corpus Release 1 (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Omar El Ariss .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kumar, S., El Ariss, O. (2018). Word Sense Disambiguation Using Swarm Intelligence: A Bee Colony Optimization Approach. In: Gelbukh, A. (eds) Computational Linguistics and Intelligent Text Processing. CICLing 2016. Lecture Notes in Computer Science(), vol 9623. Springer, Cham. https://doi.org/10.1007/978-3-319-75477-2_34

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-75477-2_34

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-75476-5

  • Online ISBN: 978-3-319-75477-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics