Skip to main content

Multilingual Question-Answering System in Biomedical Domain on the Web: An Evaluation

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNISA,volume 6941)

Abstract

Question-answering systems (QAS) are presented as an alternative to traditional systems of information retrieval, intended to offer precise responses to factual questions. An analysis has been made of the results offered by the QA multilingual biomedical system HONqa, available on the Web. The study has used a set of 120 biomedical definitional questions (What is...?), taken from the medical website WebMD, which were formulated in English, French, and Italian. The answers have been analysed using a serie of specific measures (MRR, TRR, FHS, precision, MAP).

The study confirms that for all the languages analysed the functioning effectiveness needs to be improved, although in the multilingual context analysed the questions in the English language achieve better results for retrieving definitional information than in French and Italian.

Keywords

  • Multilingual information
  • Multilingual Question Answering Systems
  • Restricted-domain Question Answering Systems
  • HONqa
  • Biomedical information
  • Evaluation measures

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-642-23708-9_10
  • Chapter length: 6 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   54.99
Price excludes VAT (USA)
  • ISBN: 978-3-642-23708-9
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   69.99
Price excludes VAT (USA)

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ely, J.W., Osheroff, P.N., Ebell, M., Bergus, G., Barcey, L., Chambliss, M., Evans, E.: Analysis of questions asked by family doctors regarding patient care. British Medical Journal 319, 358–361 (1999)

    CrossRef  Google Scholar 

  2. Lee, M., Cimino, J., Zhu, H.R., Sable, C., Shanker, V., Ely, J., Yu, H.: Beyond Information Retrieval –Medical Question Answering. AMIA, Washington DC (2006)

    Google Scholar 

  3. Yu, H., Kaufman, D.: A cognitive evaluation of four online search engines for answering definitional questions posed by physicians. In: Pacific Symposium on Biocomputing, vol. 12, pp. 328–339 (2007)

    Google Scholar 

  4. Zweigenbaum, P.: Question answering in biomedicine. In: Rijke, Webber (eds.) Proceedings Workshop on Natural Language Processing for Question Answering, EACL 2003, pp. 1–4. ACL, Budapest (2005)

    Google Scholar 

  5. Costa L.F., Santos, D.: Question Answering Systems: a partial answer (SINTEF, Oslo) (2007)

    Google Scholar 

  6. Blair-Goldensohn, S., McKeown, K., Schlaikjer, A.H.: Answering Definitional Questions: A Hybrid Approach. New Directions in Question Answering 4, 47–58 (2004)

    Google Scholar 

  7. Olvera-Lobo, M.D., Gutiérrez-Artacho, J.: Language resources used in Multi-lingual Question Answering Systems. Online Information Review 35(4) (forthcoming, 2011)

    Google Scholar 

  8. Cui, H., Kan, M.Y., Chua, T.S., Xiao, J.: A Comparative Study on Sentence Retrieval for Definitional Question Answering. In: SIGIR Workshop on Information retrieval for Question Answering (IR4QA), Sheffield (2004)

    Google Scholar 

  9. Tsur, O.: Definitional Question-Answering Using Trainable Text Classifiers. PhD Thesis. University of Amsterdam (2003)

    Google Scholar 

  10. Olvera-Lobo, M.D., Gutiérrez-Artacho, J.: Question-Answering Systems as Efficient Sources of Terminological Information: Evaluation. Health Information and Library Journal 27(4), 268–274 (2010)

    CrossRef  Google Scholar 

  11. Diekema, A. R.: Translation Events in Cross-Language Information Retrieval: Lexical ambiguity, lexical holes, vocabulary mismatch, and correct translations. PhD Thesis. University of Syracuse (2003)

    Google Scholar 

  12. Cruchet, S., Gaudinat, A., Rindflesch, T., Boyer, C.: What about trust in the Question Answering world? In: AMIA 2009 Annual Symposium, San Francisco (2009)

    Google Scholar 

  13. Blair, D.C.: Searching biases in large interactive document retrieval systems. Journal of the American Society for Information Science 31(4), 271–277 (1980)

    CrossRef  Google Scholar 

  14. Peters, C.: What Happened in CLEF 2009: Introduction to the Working Notes. In: Peters, C., Di Nunzio, G.M., Kurimo, M., Mostefa, D., Penas, A., Roda, G. (eds.) CLEF 2009. LNCS, vol. 6241, pp. 1–12. Springer, Heidelberg (2010), http://www.clefcampaign.org/2009/working_notes/CLEF2009-intro.pdf

    CrossRef  Google Scholar 

  15. Raved, D.R., Qi, H., Wu, H. Fan, W.: Evaluating Web-based Question Answering Systems. Technical Report, University of Michigan (2001)

    Google Scholar 

  16. Salton, G., Mc Gill, M.J.: Introduction to Modern Information Retrieval. Mc Graw-Hill, New York (1983)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Olvera-Lobo, MD., Gutiérrez-Artacho, J. (2011). Multilingual Question-Answering System in Biomedical Domain on the Web: An Evaluation. In: Forner, P., Gonzalo, J., Kekäläinen, J., Lalmas, M., de Rijke, M. (eds) Multilingual and Multimodal Information Access Evaluation. CLEF 2011. Lecture Notes in Computer Science, vol 6941. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23708-9_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-23708-9_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-23707-2

  • Online ISBN: 978-3-642-23708-9

  • eBook Packages: Computer ScienceComputer Science (R0)