Effective Web and Desktop Retrieval with Enhanced Semantic Spaces

  • Amjad M. Daoud
Part of the Communications in Computer and Information Science book series (CCIS, volume 117)

Abstract

We describe the design and implementation of the NETBOOK prototype system for collecting, structuring and efficiently creating semantic vectors for concepts, noun phrases, and documents from a corpus of free full text ebooks available on the World Wide Web. Automatic generation of concept maps from correlated index terms and extracted noun phrases are used to build a powerful conceptual index of individual pages. To ensure scalabilty of our system, dimension reduction is performed using Random Projection [13]. Furthermore, we present a complete evaluation of the relative effectiveness of the NETBOOK system versus the Google Desktop [8].

Keywords

Semantic Vectors NETBOOK Dimension Reduction Retrieval Effectiveness 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Belkin, N.J., Croft, W.B.: Retrieval techniques. Annual Review of Information Science and Technology 22, 109–145 (1987)Google Scholar
  2. 2.
    Briggs, G., Shamma, D., Caas, A.J., Carff, R., Scargle, J., Novak, J.D.: Concept Maps Applied to Mars Exploration Public Outreach. In: Caas, A.J., Novak, J.D., Gonzlez, F. (eds.) Concept Maps: Theory, Methodology, Technology, Proceedings of the First International Conference on Concept Mapping. Universidad Pblica de Navarra, Pamplona (2004)Google Scholar
  3. 3.
    Caas, A.J., Hill, G., Carff, R., Suri, N., Lott, J., Eskridge, T., Gmez, G., Arroyo, M., Carvajal, R.: CmapTools: A Knowledge Modeling and Sharing Environment. In: Caas, A.J., Novak, J.D., Gonzlez, F.M. (eds.) Concept Maps: Theory, Methodology, Technology, Proceedings of the First International Conference on Concept Mapping. Universidad Pblica de Navarra, Pamplona (2004)Google Scholar
  4. 4.
    Brand, M.: Incremental singular value decomposition of uncertain data with missing values. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2350, pp. 707–720. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  5. 5.
    Broder, A.Z.: On the resemblance and containment of documents. Compression and Complexity of Sequences (1997)Google Scholar
  6. 6.
    Deerwester, S., Dumais, S., Furnas, G., Landauer, T., Harshman, R.: Indexing by latent semantic analysis. Journal of the American Society for Information Science 41(6), 391–407 (1990)CrossRefGoogle Scholar
  7. 7.
    Edward, A.F.: Lexical relations: Enhancing effectiveness of IR systems. ACM SIGIR Forum 15(3), 5–36 (Winter 1980)CrossRefGoogle Scholar
  8. 8.
  9. 9.
    Leake, D., Maguitman, A., Reichherzer, T., Caas, A., Carvalho, M., Arguedas, M., Brenes, S., Eskridge, T.: Aiding knowledge capture by searching for extensions of knowledge models. In: Proceedings of KCAP-2003. ACM Press, St. Augustine (2003)Google Scholar
  10. 10.
    Sahlgren, M.: The Word-Space Model: Using distributional analysis to represent syntagmatic and paradigmatic relations between words in high-dimensional vector spaces. PhD thesis, Department of Linguistics, Stockholm University (2006)Google Scholar
  11. 11.
    Salton, G.: The SMART system 1961-1976: Experiments in dynamic document processing. In: Encyclopedia of Library and Information Science, pp. 1–36 (1980)Google Scholar
  12. 12.
    Van Rijsbergen, C.J.: The Geometry of Information Retrieval. Cambridge University Press, Cambridge (2004)CrossRefMATHGoogle Scholar
  13. 13.
    Widdows, D., Ferraro, K.: Semantic Vectors: A Scalable Open Source Package and Online Technology Management Application, Google Code (2009)Google Scholar
  14. 14.
    Hinrich Schutze, H.: Automatic word sense discrimination. Computational Linguistics 24(1), 97–124 (1998)Google Scholar
  15. 15.
    Spink, A., Wolfram, D., Jansen, B.J., Saracevic, T.: Searching the Web: The Public and their Queries. Journal of the American Society for Information Sciences and Technology 52(3), 226–234Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Amjad M. Daoud
    • 1
  1. 1.American University of the Middle EastKuwait

Personalised recommendations