Lexical Analysis of Textual Data
Lexical processing; Term processing
Lexical analysis refers to the association of meaning with explicitly specified textual strings, referred to here as lexical terms. These lexical terms are typically obtained from texts (whether natural or artificial) by a process called term extraction. The association of meaning with lexical terms involves a data structure known generically as a lexicon. The characteristic operation in using a lexicon is a lookup, where the input is a lexical term, and the output is a representation of one or more associated meanings. A lexicon consists of a collection of entries, each of which comprises an entry term and a meaning structure. Lookup entails finding any entries whose entry term matches the lexical term in question.
Here, the term lexical analysis is used to refer only to operations performed on complete words or word groups. Operations on the characters within words is the concern of morphology.
The use of text corporafor...
- 2.Chodorow M, Byrd R, Heidorn, G. Extracting semantic hierarchies from a large on-line dictionary. In: Proceedings of the 23rd Annual Meeting of the Association for Computation Linguistics; 1985. p. 299–304.Google Scholar
- 3.Church K, Hanks P. Word association norms: mutual information and lexicography. Comput Linguist. 1990;16(1):22–9.Google Scholar
- 6.Frakes WB, Baeza-Yates R. Information retrieval: data structures & algorithms, Chapters III, VII, and IX. Englewood Cliffs: Prentice-Hall; 1992.Google Scholar
- 11.Mitkov R. The Oxford handbook of computational linguistics. Chapters III, XXI, XXIV, XXV, and XXXIII. Oxford: Oxford University Press; 2003.Google Scholar
- 13.Voorhees EM. Using WordNet to disambiguate word senses for text retrieval. In: Proceedings of the 16th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval; 1993. p. 171–80.Google Scholar