A Text Retrieval System Based on Distributed Representations

  • Zhe Zhao
  • Tao Liu
  • Jun Chen
  • Bofang Li
  • Xiaoyong Du
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9932)

Abstract

Most text retrieval systems are essentially based on bag-of-words (BOW) text representations. Despite popularity of BOW, it ignores the internal semantic meanings of words since each word is treated as an atomic unit. Recently, distributed word and text representations become increasingly popular in NLP literatures. They embed syntactic and semantic information of words and texts into low-dimensional vectors, thus overcome the weaknesses of traditional BOW representations to some extent. In this paper, we implement a text retrieval system that are totally supported by distributed representations. Our new system no longer relies on the matchings of words in queries and texts, but uses semantic similarity to judge if a text is relevant to a query and to what extent, which provides better user experience compared with traditional text retrieval systems.

Keywords

Text retrieval Distributed text representation Hierarchical paragraph vector 

References

  1. 1.
    Le, Q.V., Mikolov, T.: Distributed representations of sentences and documents. In: ICML 2014, Beijing, China, 21–26 June 2014, pp. 1188–1196 (2014)Google Scholar
  2. 2.
    Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality, pp. 3111–3119 (2013)Google Scholar
  3. 3.
    Mogotsi, I.C., Christopher, D.M., Prabhakar, R., Hinrich, S.: Introduction to Information Retrieval, 482 p. Cambridge University Press, Cambridge, (2008). Inf. Retr. 13(2), 192–195 (2010). ISBN: 978-0-521-86571-5Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Zhe Zhao
    • 1
  • Tao Liu
    • 1
  • Jun Chen
    • 1
  • Bofang Li
    • 1
  • Xiaoyong Du
    • 1
  1. 1.School of InformationRenmin University of ChinaBeijingChina

Personalised recommendations