Abstract
In automatic question answering, the identification of the correct target term (i.e. the term to define) in a definition question is critical since if the target term is not correctly identified, then all subsequent modules have no chance of providing relevant nuggets. In this paper, we present a method to tag a question sentence experimenting with two learning approaches: QTag and Hidden Markov Model. We tested the methods in five collections of questions, PILOT, TREC 2003, TREC 2004, CLEF 2004 and CLEF 2005. We performed ten-fold cross validation for each collection and we also tested with all questions together. The best accuracy rates for each collection were obtained using QTag, but with all questions together the best accuracy rate is obtained using HMM.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Dan Modolvan, Marius Pasca, Sanda Harabagiu, and Mihai Surdeanu. Performance Issues and Error Analysis in an Open-Domain Question Answering System. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL), pages 33–40, Philadelphia, July 2002.
Ellen M. Voorhees. Evaluating Answers to Definition Questions. NIST, pages 1–3, 2003.
Wesley Hildebrandt, Boris Katz, and Jimmy Lin. Answering Definition Question Using Multiple Knowledge Sources. In Proceedings of HLT/NAACL, pages 49–56, Boston, 2004.
Oren Tsur. Definitional Question-Anwering Using Trainable Text Classifiers. Master’s thesis, Institute of Logic Language and Computation, University of Amsterdam, 2003.
S. Harabagiu and F. Lacatusu. Strategies for Advanced Question Answering. In Proceedings of the Workshop on Pragmatics of Question Answering at HLT-NAACL, pages 1–9, 2004.
Jinxi Xu, Ana Licuanan, and Ralph Weischedel. TREC 2003 QA at BBN: Answering Definitional Questions. In The Twelfth Text Retrieval Conference (TREC 2003), pages 28–35, 2003.
Lawrence Rabiner. A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition. In Proc. IEEE, volume 77, pages 257–286, 1989.
Christopher D. Manning and Hinrich Schutze. Foundations of Statistical Natural Languaje Processing. The MIT Press Cambridge, Massachusetts, London, England, 1999.
Oliver Manson. Qtag-A portable probabilistic tagger. Corpus Research, The University of Birmingham, U.K., 1997.
http://www.alias-i.com/lingpipe/index.html.
Walter Daelemans, Jakub Zavrel, Peter Berck, and Steven Gillis. MBT: A Memory-Based Part of Speech Tagger-Generator. In Proceedings of the Fourth Workshop on Very Large Corpora, Copenhagen, Denmark,, pages 14–27, 1996.
http://trec.nist.gov/.
http://www.clef-campaign.org/.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 International Federation for Information Processing
About this paper
Cite this paper
Martínez, C., López, A.L. (2006). Analysing Definition Questions by Two Machine Learning Approaches. In: Bramer, M. (eds) Artificial Intelligence in Theory and Practice. IFIP AI 2006. IFIP International Federation for Information Processing, vol 217. Springer, Boston, MA . https://doi.org/10.1007/978-0-387-34747-9_29
Download citation
DOI: https://doi.org/10.1007/978-0-387-34747-9_29
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-34654-0
Online ISBN: 978-0-387-34747-9
eBook Packages: Computer ScienceComputer Science (R0)