Multilingual Question-Answering System in Biomedical Domain on the Web: An Evaluation
- Cite this paper as:
- Olvera-Lobo MD., Gutiérrez-Artacho J. (2011) Multilingual Question-Answering System in Biomedical Domain on the Web: An Evaluation. In: Forner P., Gonzalo J., Kekäläinen J., Lalmas M., de Rijke M. (eds) Multilingual and Multimodal Information Access Evaluation. CLEF 2011. Lecture Notes in Computer Science, vol 6941. Springer, Berlin, Heidelberg
Question-answering systems (QAS) are presented as an alternative to traditional systems of information retrieval, intended to offer precise responses to factual questions. An analysis has been made of the results offered by the QA multilingual biomedical system HONqa, available on the Web. The study has used a set of 120 biomedical definitional questions (What is...?), taken from the medical website WebMD, which were formulated in English, French, and Italian. The answers have been analysed using a serie of specific measures (MRR, TRR, FHS, precision, MAP).
The study confirms that for all the languages analysed the functioning effectiveness needs to be improved, although in the multilingual context analysed the questions in the English language achieve better results for retrieving definitional information than in French and Italian.
KeywordsMultilingual information Multilingual Question Answering Systems Restricted-domain Question Answering Systems HONqa Biomedical information Evaluation measures
Unable to display preview. Download preview PDF.