A Lexicographic Encoding for Word Sense Disambiguation with Evolutionary Neural Networks

  • A. Azzini
  • C. da Costa Pereira
  • M. Dragoni
  • A. G. B. Tettamanzi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5883)


We propose a supervised approach to word sense disambiguation based on neural networks combined with evolutionary algorithms. Large tagged datasets for every sense of a polysemous word are considered, and used to evolve an optimized neural network that correctly disambiguates the sense of the given word considering the context in which it occurs.

A new distributed scheme based on a lexicographic encoding to represent the context in which a particular word occurs is proposed.

The viability of the approach has been demonstrated through experiments carried out on a representative set of polysemous words.


Target Word Word Sense Confusion Matrice Word Sense Disambiguation Supervise Approach 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Azzini, A., Dragoni, M., da Costa Pereira, C., Tettamanzi, A.: Evolving neural networks for word sense disambiguation. In: Proc. of HIS 2008, Barcelona, Spain, September 10-12, pp. 332–337 (2008)Google Scholar
  2. 2.
    Azzini, A., Tettamanzi, A.: Evolving neural networks for static single-position automated trading. Journal of Artificial Evolution and Applications 2008(Article ID 184286), 1–17 (2008)CrossRefGoogle Scholar
  3. 3.
    Cottrell, G.: A Connectionist Approach to Word Sense Disambiguation. Pitman, London (1989)Google Scholar
  4. 4.
    Escudero, G., Màrquez, L., Rigau, G.: An empirical study of the domain dependence of supervised word sense disambiguation systems. In: Proc. of the Joint SIGDAT conference on Empirical methods in natural language processing and very large corpora, Morristown, NJ, USA, pp. 172–180. ACL (2000)Google Scholar
  5. 5.
    Escudero, D.M., Màrquez, G.L., Rigau, G.: Supervised Corpus-Based Methods for WSD, pp. 167–207. Springer Netherlands, Heidelberg (2006)Google Scholar
  6. 6.
    Hinton, G., McClelland, J., Rumelhart, D.: Distributed representations. In: Parellel Distributed Processing: explorations in the microstructure of cognition. MIT Press, Cambridge (1986)Google Scholar
  7. 7.
    Hovy, E., Mitchell, M., Palmer, M., Ramshaw, L., Weischedel, R.: Ontonotes: The 90% solution. In: Proc. of the Human Language Technology Conf., New York, pp. 57–60 (2006)Google Scholar
  8. 8.
    Navigli, R.: Word sense disambiguation: A survey. ACM Comput. Surv. 41(2), 1–69 (2009)CrossRefGoogle Scholar
  9. 9.
    Ng, H.: Exemplar-based word sense disambiguation: some recent improvements. In: Proc. of EMNLP 1997, pp. 208–213 (1997)Google Scholar
  10. 10.
    Schapire, R., Singer, Y.: Improved boosting algorithms using confidence-rated predictions. Machine Learning 37(3), 297–336 (1999)zbMATHCrossRefGoogle Scholar
  11. 11.
    Tratz, S., Sanfilippo, A., Gregory, M., Chappell, A., Posse, C., Whitney, P.: Pnnl: A supervised maximum entropy approach to word sense disambiguation. In: Proc. of Int. Workshop on Semantic Evaluations SemEval 2007, Prague, June 2007, pp. 264–267. Association of Computational Linguistics (2007)Google Scholar
  12. 12.
    Vapnik, V.: Statistical Learning Theory. John Wiley & Sons, Chichester (1998)zbMATHGoogle Scholar
  13. 13.
    Yao, X., Liu, Y.: A new evolutionary system for evolving artificial neural networks. IEEE Transactions on Neural Networks 8(3), 694–713 (1997)CrossRefMathSciNetGoogle Scholar
  14. 14.
    Yarowsky, D.: Hierarchical decision lists for word sense disambiguation. Computational Humanities 34(2), 179–186 (2000)CrossRefGoogle Scholar
  15. 15.
    Zhou, X., Han, H.: Survey of word sense disambiguation approaches. In: Proc. of the Int. Artificial Intelligence Research Society Conference, Clearwater Beach, Florida, USA, pp. 307–313. AAAI Press, Menlo Park (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • A. Azzini
    • 1
  • C. da Costa Pereira
    • 1
  • M. Dragoni
    • 1
  • A. G. B. Tettamanzi
    • 1
  1. 1.Dipartimento di Tecnologie dell’InformazioneUniversità degli Studi di MilanoCremaItaly

Personalised recommendations