Distribution-Based Semantic Similarity of Nouns
In our previous work we have proposed two methods for evaluating semantic similarity / dissimilarity of nouns based on their modifier sets registered in Oxford Collocation Dictionary for Student of English. In this paper we provide further details on the experimental support and discussion of these methods. Given two nouns, in the first method the similarity is measured by the relative size of the intersection of the sets of modifiers applicable to both of them. In the second method, the dissimilarity is measured by the difference between the mean values of cohesion between a noun and the two sets of modifiers: its own ones and those of the other noun in question. Here, the cohesion between words is measured via Web statistics for co-occurrences of words. The two proposed measures prove to be in approximately inverse dependency. Our experiments show that Web-based weighting (the second method) gives better results.
KeywordsSemantic relatedness word space model lexical resources Web as corpus natural language processing
- 2.Bolshakov, I.A., Gelbukh, A.: Two Methods of Evaluation of Semantic Similarity of Nouns Based on Their Modifier Sets. In: LNCS, vol. 4592, Springer, Heidelberg (2007)Google Scholar
- 7.Lin, D.: Automatic retrieval and clustering of similar words. In: COLING-ACL 1998, Canada (1998)Google Scholar
- 9.McCarthy, D., Koeling, R., Weeds, J., Carroll, J.: Finding Predominant Word Senses in Untagged Text. In: Proc. 42nd Annual Meeting of the ACL, Barcelona, Spain (2004)Google Scholar
- 10.Oxford Collocations Dictionary for Students of English. Oxford University Press (2003)Google Scholar
- 11.Patwardhan, S., Banerjee, S., Pedersen, T.: Using Measures of Semantic Relatedness for Word Sense Disambiguation. In: Gelbukh, A. (ed.) CICLing 2003. LNCS, vol. 2588, Springer, Heidelberg (2003)Google Scholar