Question Answering Experiments for Finnish and French
This paper presents a question answering (QA) system called Tikka. Tikka’s approach to QA is based on question classification, semantic annotation and answer extraction pattern matching. Tikka’s performance is evaluated by conducting experiments in the following tasks: monolingual Finnish and French and bilingual Finnish-English QA. Tikka is the first system ever reported to perform monolingual textual QA in the Finnish language. This is also the task in which its performance is best: 23 % of all questions are answered correctly. Tikka’s performance in the monolingual French task is a little inferior to its performance in the monolingual Finnish task, and when compared to the other systems evaluated with the same data in the same task, its performance is near the average. In the bilingual Finnish-English task, Tikka was the only participating system, and – as is expected – its performance was inferior to those attained in the monolingual tasks.
KeywordsTarget Word Query Term Semantic Annotation Question Answering Name Entity Recognition
Unable to display preview. Download preview PDF.
- 2.Lin, J., Katz, B.: Building a Reusable Test Collection for Question Answering. Journal of the American Society for Information Science and Technology (in press, 2005)Google Scholar
- 3.Magnini, B., Vallin, A., Aunimo, L.: Overview of the CLEF 2005 Multilingual Question Answering Track. In: Peters, C., Gey, F.C., Gonzalo, J., Müller, H., Jones, G.J.F., Kluck, M., Magnini, B., de Rijke, M., Giampiccolo, D. (eds.) CLEF 2005. LNCS, vol. 4022, pp. 307–331. Springer, Heidelberg (2006)CrossRefGoogle Scholar
- 5.Aunimo, L., Makkonen, J., Kuuskoski, R.: Cross-language Question Answering for Finnish. In: Hyvönen, E., Kauppinen, T., Salminen, M., Viljanen, K., Ala-Siuru, P. (eds.) Proceedings of the 11th Finnish Artificial Intelligence Conference STeP 2004, Vantaa, Finland, September 1-3. Conference Series – No 20, vol. 2, pp. 35–49. Finnish Artificial Intelligence Society (2004)Google Scholar
- 6.Quirk, R., Greenbaum, S., Leech, G., Svartvik, J.: A Comprehensive Grammar of the English Language. Longman, New York (1985)Google Scholar
- 7.Salton, G.: The SMART Retrieval System: Experiments in Automatic Document Processing. Prentice-Hall, Englewood Cliffs (1971)Google Scholar
- 8.Porter, M.F.: An Algorithm for Suffix Stripping. Program 14, 130–137 (1980)Google Scholar
- 9.Porter, M.: Snowball: A Language for Stemming Algorithms (2001) [22.8.2005], Available at http://snowball.tartarus.org/texts/introduction.html
- 10.Hatcher, E., Gospodnetić, O.: Lucene in Action. Manning Publications Co. (2004)Google Scholar
- 12.Volk, M., Clematide, S.: Learn - Filter - Apply - Forget. Mixed Approaches to Named Entity Recognition. In: Proceedings of the 6th International Workshop of Natural Language for Information Systems, Madrid, Spain (2001)Google Scholar