Local weighting scheme for word pairs

Abstract

Term weighting schemes are the integral part of an Information retrieval system which play an important role in the performance of the information retrieval system. Manning et al (2002) and Sandor Dominich (2008) have provided a detail of information retrieval techniques and weighting schemes in their books. Weight of a term can be seen in two different aspects, local and global. Local weights are functions of frequency of a word in a document and global weights are functions of the frequency of a term in the entire collection. A detail discussion on different types of local weighting schemes can be found in Chisholm & Kolda (1999). Suitability of some global weighting schemes for local weights can be seen in Bisht et al (2008). A comparative study on term weighting schemes for text categorization has been made by Lan et al (2005). There are several weighting schemes, following are some of the commonly used local weighting schemes.