Abstract
This paper reports on the construction and testing of a new Question Answering (QA) system, implemented as an workflow which builds on several web services developed at the Research Institute for Artificial Intelligence (RACAI).The evaluation of the system has been independently done by the organizers of the Romanian-Romanian task of the ResPubliQA 2009 exercise and has been rated the best performing system with the highest improvement due to the NLP technology over a baseline state-of-the-art IR system. We describe a principled way of combining different relevance measures for obtaining a general relevance (to the user’s question) score that will serve as the sort key for the returned paragraphs. The system was trained on a specific corpus, but its functionality is independent on the linguistic register of the training data. The trained QA system that participated in the ResPubliQA shared task is available as a web application at http://www2.racai.ro/sir-resdec/ .
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Heie, M.H., Whittaker, E.W.D., Novak, J.R., Mrozinski, J., Furu, S.: TAC2008 Question Answering Experiments at Tokyo Institute of Technology. In: Proceedings of the Text Analysis Conference (TAC 2008), November 17-19. National Institute of Standards and Technology, Gaithersburg, (2008)
Ion, R., Ştefănescu, D., Ceauşu, A., Tufiş, D.: RACAI’s QA System at the Romanian-Romanian Multiple Language Question Answering (QA@CLEF2008) Main Task. In: Nardi, A., Peters, C. (eds.) CLEF 2008. LNCS, vol. 5706, p. 10. Springer, Heidelberg (2009)
Ion, R., Ştefănescu, D., Ceauşu, A., Tufiş, D., Irimia, E., Barbu Mititelu, V.: A Trainable Multi-factored QA System. In: Peters, C., et al. (eds.) Working Notes for the CLEF 2009 Workshop, Corfu, Greece, p. 14 (October 2009)
Ittycheriah, A., Franz, M., Zhu, W.J., Ratnaparkhi, A., Mammone, R.J.: IBM’s Statistical Question Answering System. In: Proceedings of the 9th Text Retrieval Conference (TREC-9), Gaithersburg, Maryland, November 13-16, pp. 229–235 (2000)
Och, F.J.: Minimum Error Rate Training in statistical machine translation. In: Proceedings of the 41st Annual Meeting on Association for Computational Linguistics, Sapporo, Japan, July 07-12, pp. 160–167 (2003)
Papineni, K., Roukos, S., Ward, T., Zhu, W.J.: BLEU: a method for automatic evaluation of machine translation. In: Proceedings of the ACL 2002, 40th Annual Meeting of the Association for Computational Linguistics, Philadelphia, pp. 311–318 (July 2002)
Peñas, A., Forner, P., Sutcliffe, R., Rodrigo, Á., Forăscu, C., Alegria, I., Giampiccolo, D., Moreau, N., Osenova, P.: Overview of ResPubliQA 2009: Question Answering Evaluation over European Legislation. In: Peters, C., et al. (eds.) Working Notes for the CLEF 2009 Workshop, Corfu, Greece, October 2009, p. 14 (October 2009)
Tufiş, D., Ion, R., Ceauşu, A., Ştefănescu, D.: RACAI’s Linguistic Web Services. In: Proceedings of the 6th Language Resources and Evaluation Conference - LREC 2008. ELRA - European Language Ressources Association, Marrakech, Morocco (May 2008)
Wiegand, M., Momtazi, S., Kazalski, S., Xu, F., Chrupała, G., Klakow, D.: The Alyssa System at TAC QA 2008. In: Proceedings of the Text Analysis Conference (TAC 2008), November 17-19. National Institute of Standards and Technology, Gaithersburg (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ion, R., Ştefănescu, D., Ceauşu, A., Tufiş, D., Irimia, E., Barbu Mititelu, V. (2010). A Trainable Multi-factored QA System. In: Peters, C., et al. Multilingual Information Access Evaluation I. Text Retrieval Experiments. CLEF 2009. Lecture Notes in Computer Science, vol 6241. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15754-7_29
Download citation
DOI: https://doi.org/10.1007/978-3-642-15754-7_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15753-0
Online ISBN: 978-3-642-15754-7
eBook Packages: Computer ScienceComputer Science (R0)