Balancing Manual and Automatic Indexing for Retrieval of Paper Abstracts
MEDLINE is a widely used very large database of abstracts of research papers in medical domain. Abstracts in it are manually supplied with keywords from a controlled vocabulary called MeSH. The MeSH keywords assigned to a specific document are subdivided into MeSH major headings, which express the main topic of the document, and MeSH minor headings, which express additional information about the document’s topic. The search engine supplied with MEDLINE uses Boolean retrieval model with only MeSH keywords used for indexing. We show that (1) vector space retrieval model with the full text of the abstracts indexed gives much better results; (2) assigning greater weights to the MeSH keywords than to the terms appearing in the text of the abstracts gives slightly better results, and (3) assigning slightly greater weight to major MeSH terms than to minor MeSH terms further improves the results.
KeywordsSearch Engine Full Text MeSH Term Vector Space Model Boolean Model
Unable to display preview. Download preview PDF.
- 1.Dhillon, I.S., Modha, D.S.: Concept Decomposition for Large Sparse Text Data using Clustering. Technical Report RJ 10147(9502), IBM Almaden Research Center (1999)Google Scholar
- 2.Dhillon, I.S., Fan, J., Guan, Y.: Efficient Clustering of Very Large Document Collections. In: Data Mining for Scientific and Engineering Applications, Kluwer, Dordrecht (2001)Google Scholar
- 3.Baeza-Yates, R., Ribeiro-Neto, B.: Modern Information Retrieval. Addison-Wesley, Reading (1999)Google Scholar
- 4.Frakes, W.B., Baeza-Yates, R.: Information Retrieval: Data Structures and Algorithms. Prentince Hall, Englewood Cliffs (1992)Google Scholar
- 5.Ide, E.: New experiments in relevance feedback. In: Salton, G. (ed.) The SMART Retrieval System, pp. 337–354. Prentice Hall, Englewood Cliffs (1971)Google Scholar
- 8.MEDLINE Fact Sheet, http://www.nlm.nih.gov/pubs/factsheets/medline.html
- 9.Porter, M.: An algorithm for suffix stripping. Program 14, 130–137 (1980)Google Scholar