Advertisement

A Fingerprinting Technique for Evaluating Semantics Based Indexing

  • Eduard Hoenkamp
  • Sander van Dijk
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3936)

Abstract

The quality of search engines depends usually on the content of the returned documents rather than on the text used to express this content. So ideally, search techniques should be directed more toward the semantic dependencies underlying documents than toward the texts themselves. The most visible examples in this direction are Latent Semantic Analysis (LSA), and the Hyperspace Analog to Language (HAL). If these techniques are really based on semantic dependencies, as they contend, then they should be applicable across languages.

To investigate this contention we used electronic versions of two kinds of material with their translations: a novel, and a popular treatise about cosmology. We used the analogy of fingerprinting as employed in forensics to establish whether individuals are related. Genetic fingerprinting uses enzymes to split the DNA and then compare the resulting band patterns. Likewise, in our research we used queries to split a document into fragments. If a search technique really isolates fragments semantically related to the query, then a document and its translation should have similar band patterns.

In this paper we (1) present the fingerprinting technique, (2) introduce the material used, and (3) report results of an evaluation for two semantic indexing techniques.

Keywords

Search Technique Latent Semantic Analysis Vector Space Model Relevance Ranking Document Space 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Hull, D.A., Grefenstette, G.: Querying across languages: A dictionary-based approach to multilingual information retrieval. In: 19th Annual ACM Conference on Research and Development in Information Retrieval, pp. 49–57 (1996)Google Scholar
  2. 2.
    Yang, Y., Carbonell, J.G., Brown, R.D., Frederking, R.E.: Translingual information retrieval: Learning from bilingual corpora. Artificial Intelligence 103, 323–345 (1998)CrossRefMATHGoogle Scholar
  3. 3.
    Hoenkamp, E.: Unitary operators on the document space. Journal of the American Society for Information Science and Technology 54, 314–320 (2003)CrossRefGoogle Scholar
  4. 4.
    Deerwester, S.C., Dumais, S.T., Landauer, T.K., Furnas, G.W., Harshman, R.A.: Indexing by latent semantic analysis. Journal of the American Society of Information Science 41, 391–407 (1990)CrossRefGoogle Scholar
  5. 5.
    Osgood, C.E., Suci, G.J., Tannenbaum, P.H.: The measurement of meaning. University of Illinois Press, Urbana (1957)Google Scholar
  6. 6.
    Burgess, C., Livesay, K., Lund, K.: Explorations in context space: Words, sentences, discourse. Discourse Processes 25, 211–257 (1998)CrossRefGoogle Scholar
  7. 7.
    Hoenkamp, E., Song, D.: The document as an ergodic markov chain. In: Proceedings of the 27th Conference on Research and Development in Information Retrieval, pp. 496–497 (2004)Google Scholar
  8. 8.
    Lafferty, J., Zhai, C.: Document language models, query models, and risk minimization for IR. In: Proceedings of the 24th Conference on Research and Development in Information Retrieval, pp. 111–119 (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Eduard Hoenkamp
    • 1
  • Sander van Dijk
    • 1
  1. 1.Nijmegen Institute for Cognition and InformationThe Netherlands

Personalised recommendations