A Bilingual Linking Service for the Web
The aim of Cross-Language Information Retrieval (CLIR) area is to address situations where a query is made in one language and the application is able to return documents in another. Many CLIR techniques attempt to translate the user’s query to the language of the target documents using translation dictionaries. However, these techniques have limitations in terms of lexical coverage of the dictionary adopted. For some applications, the dictionaries are manually edited towards improving the results — but this may require much effort to represent a large collection of information.
In this article we propose an infrastructure for defining automatically relationships between Web documents written in different languages. Our approach is based on the Latent Semantic Indexing Technique, which tries to overcome the problems common to the lexical approach due to words with multiple meanings and multiple words with the same meaning. LSI automatically organizes text objects into a semantic structure appropriate for matching . To support the identification of relationships among documents in different languages, the proposed infrastructure manipulates the stem portion of each word in order to index the corresponding Web documents when building the information space manipulated by LSI. To experiment this proposal, we studied the creation of links among news documents in English and Spanish in three different categories: entertainment, technology and world. The results were positive.
Unable to display preview. Download preview PDF.
- 1.Bulcão Neto, R.F., Izeki, C.A., Pimentel, M.G.C., Pontin, R.P.M., Truong, K.N.: An open linking service supporting the authoring of web documents. In: Proc. of the ACM DocEng, pp. 66–73 (2002)Google Scholar
- 3.Furnas, G.W., Deerwester, S., Dumais, S.T., Landauer, T.K., Harshman, R.A., Streeter, L.A., Lochbaum, K.E.: Information retrieval using a singular value decomposition model of latent semantic structure. In: Proc. of the ACM SIGIR, pp. 465–480 (1988)Google Scholar
- 4.Group, S.: Spanish stemming algorithm. Internet: snowball.tartarus.org (2002)Google Scholar
- 5.Macedo, A.A., Pimentel, M.G.C., Camacho-Guerrero, J.A.: An infrastructure for open latent semantic linking. In: Proc. of ACM Hypertext, pp. 107–116 (2002)Google Scholar
- 6.Macedo, A.A., Pimentel, M.G.C., Guerrero, J.A.C.: Latent semantic linking over homogeneous repositories. In: Proc. of the ACM DocEng, pp. 144–151 (2001)Google Scholar
- 7.Porter, M.: An algorithm for suffix stripping. Program 14(3), 130–137 (1980)Google Scholar