An overview of textual semantic similarity measures based on web intelligence
- 400 Downloads
Computing the semantic similarity between terms (or short text expressions) that have the same meaning but which are not lexicographically similar is a key challenge in many computer related fields. The problem is that traditional approaches to semantic similarity measurement are not suitable for all situations, for example, many of them often fail to deal with terms not covered by synonym dictionaries or are not able to cope with acronyms, abbreviations, buzzwords, brand names, proper nouns, and so on. In this paper, we present and evaluate a collection of emerging techniques developed to avoid this problem. These techniques use some kinds of web intelligence to determine the degree of similarity between text expressions. These techniques implement a variety of paradigms including the study of co-occurrence, text snippet comparison, frequent pattern finding, or search log analysis. The goal is to substitute the traditional techniques where necessary.
KeywordsSimilarity measures Web intelligence Web search engines Information integration
Unable to display preview. Download preview PDF.
- Banerjee S, Pedersen T (2003) Extended gloss overlaps as a measure of semantic relatedness. In: International joint conference on artificial intelligence (IJCAI), pp 805–810Google Scholar
- Bollegala D, Matsuo Y, Ishizuka M (2007) Measuring semantic similarity between words using web search engines. In: Proceedings of WWW, pp 757–766Google Scholar
- Leacock C, Chodorow M, Miller GA (1998) Using corpus statistics and WordNet relations for sense identification. Comput Linguistics 24(1): 147–165Google Scholar
- Pedersen T, Patwardhan S, Michelizzi J (2004) WordNet::Similarity—measuring the relatedness of concepts. In: Proceedings of AAAI, pp 1024–1025Google Scholar
- Resnik P (1995) Using information content to evaluate semantic similarity in a taxonomy. In: International joint conference on artificial intelligence (IJCAI), pp 448–453Google Scholar
- Rousseeuw PJ, Leroy AM (2005) Robust regression and outlier detection. Wiley, New YorkGoogle Scholar