A Text Retrieval System Based on Distributed Representations
Most text retrieval systems are essentially based on bag-of-words (BOW) text representations. Despite popularity of BOW, it ignores the internal semantic meanings of words since each word is treated as an atomic unit. Recently, distributed word and text representations become increasingly popular in NLP literatures. They embed syntactic and semantic information of words and texts into low-dimensional vectors, thus overcome the weaknesses of traditional BOW representations to some extent. In this paper, we implement a text retrieval system that are totally supported by distributed representations. Our new system no longer relies on the matchings of words in queries and texts, but uses semantic similarity to judge if a text is relevant to a query and to what extent, which provides better user experience compared with traditional text retrieval systems.
KeywordsText retrieval Distributed text representation Hierarchical paragraph vector
This work is supported by the Fundamental Research Funds for the Central Universities, the Research Funds of Renmin University of China No. 14XNLQ06.
- 1.Le, Q.V., Mikolov, T.: Distributed representations of sentences and documents. In: ICML 2014, Beijing, China, 21–26 June 2014, pp. 1188–1196 (2014)Google Scholar
- 2.Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality, pp. 3111–3119 (2013)Google Scholar
- 3.Mogotsi, I.C., Christopher, D.M., Prabhakar, R., Hinrich, S.: Introduction to Information Retrieval, 482 p. Cambridge University Press, Cambridge, (2008). Inf. Retr. 13(2), 192–195 (2010). ISBN: 978-0-521-86571-5Google Scholar