A Novel Implementation of the FITE-TRT Translation Method
Cross-language Information Retrieval requires good methods for translating cross-lingual spelling variants which are not covered by the available dictionary resources. FITE-TRT is an established method employing frequency-based identification of translation equivalents received from transformation rule based translation. This study further develops and evaluates the FITE-TRT method. The paper contributes on four areas. First, an efficient implementation for the FITE-TRT method is discussed. Secondly, a novel iterative FITE-TRT translation approach is developed in order to further improve the effectiveness of the method. Thirdly, the effectiveness of FITE-TRT is assessed in three classes of source-target word similarity. FITE-TRT was found to be very strong in the class of the most similar source and target words and only becomes unsuccessful when the words were dissimilar. Fourthly, in comparison to n-gram and s-gram matching methods, FITE-TRT is shown consistently stronger. All in all, FITE-TRT clearly outperforms the fuzzy string matching methods under comparable conditions. Therefore it is the method of choice for the identification of translation equivalents of cross-lingual spelling variants when the requirements for the result quality are high.
KeywordsApproximate string matching cross-language information retrieval cross-lingual spelling variants fuzzy matching out-of-vocabulary words transformation rules
Unable to display preview. Download preview PDF.
- 1.Keskustalo, H., Pirkola, A., Visala, K., Leppänen, E., Järvelin, K.: Non-adjacent digrams improve matching of cross-lingual spelling variants. In: SPIRE 2003 Conf. Manaus, pp. 252–265 (2003)Google Scholar
- 2.Multilingual Glossary for Art Librarians, http://www.ifla.org/II/s30/pub/mg1.htm
- 3.Multilingual Glossary of Medical Terms by Heymans Institute of Pharmacology, University of Gent, http://users.ugent.be/~rvdstich/eugloss/welcome.html
- 5.Pirkola, A., Toivonen, J., Keskustalo, H., Järvelin, K.: FITE-TRT: A high quality translation technique for OOV words. In: Proceedings of the 21st Annual ACM Symposium on Applied Computing, Dijon France, April 23-27, 2006, pp. 1043–1049 (2006)Google Scholar
- 6.Pirkola, A., Toivonen, J., Keskustalo, H., Visala, K., Järvelin, K.: Fuzzy translation of cross-lingual spelling variants. In: Proc. 26th ACM SIGIR Conf. Toronto, pp. 345–352 (2003)Google Scholar
- 7.Zobel, J., Dart, P.: Phonetic string matching: lessons from information retrieval. In: Proc. 19th ACM SIGIR Conf. Zurich, pp. 166–172 (1996)Google Scholar