Skip to main content
SpringerLink
Log in

Answer Validation for Question Answering Systems by Using External Resources

  • Conference paper
  • First Online:
Integrated Uncertainty in Knowledge Modelling and Decision Making (IUKM 2016)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9978))

Abstract

This paper focuses on extracting question-answer pairs on the Internet which is an useful resource for building Automated Question Answering systems. Question-answer pairs from public resources usually contain noisy information, mostly in the answers. Therefore to obtain reliable question-answer pairs, the answers need to be validated. Previous studies usually handled this problem based on the relationship between a question and its corresponding answers. Differently, this paper proposes a new approach that uses external resources to validate the reliability of answers from question-answer pairs crawled from the Web. We will combine both kinds of information, one is the matching between question and its answers while the other is based on the supporting of external resources to the answers. The experiment conducted on the question-answer pairs extracted from Yahoo!Answer and StackOverflow shows the effectiveness of our proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    http://trec.nist.gov/.

  2. 2.

    http://clef.isti.cnr.it/.

  3. 3.

    https://code.google.com/p/word2vec.

  4. 4.

    http://stackoverflow.com/.

  5. 5.

    http://nlp.stanford.edu/software/.

References

  1. Belinkov, Y., Mohtarami, M., Cyphers, S., Glass, J.: A continuous word vector approach to answer selection in community question answering systems. In: Proceedings of SemEval, pp. 282–287 (2015)

    Google Scholar 

  2. Bian, J., Liu, Y., Agichtein, E., Zha, H.: Factoid question answering over social media. In: Proceedings of WWW (2008)

    Google Scholar 

  3. Gunawardana, A., Shani, G.: A survey of accuracy evaluation metrics of recommendation tasks. J. Mach. Learn. Res. 10, 2935–2962 (2009)

    MathSciNet  MATH  Google Scholar 

  4. Higashinaka, R., Isozaki, H.: Corpus-based question answering for why-questions. In: Proceedings of the Third International Joint Conference on Natural Language Processing (IJCNLP), pp. 418–425 (2008)

    Google Scholar 

  5. Hildebrandt, W., Katz, B., Lin, J.: Answering definition questions using multiple knowledge sources. In: proceedings of HLT/NAANC (2004)

    Google Scholar 

  6. Hu, H., Liu, B., Wang, B., Liu, M., Wang, X.: Multimodal DBN for predicting high-quality answers in cQA portals. In: Proceedings of ACL, pp. 843–847 (2013)

    Google Scholar 

  7. Lou, J., Fang, Y., Lim, K.H., Peng, J.Z.: Contributing high quantity and quality knowledge to online Q&A communities. J. Am. Soc. Inf. Sci. Technol. 64(2), 356–371 (2013)

    Article  Google Scholar 

  8. Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. CoRR, abs/1301.3781 (2013a)

    Google Scholar 

  9. Shah, C., Pomerantz, J.: Evaluating, predicting answer quality in community QA. In: Proceedings of SIGIR (2010)

    Google Scholar 

  10. Soricut, R., Brill, E.: Automatic question answering using the web: beyond the factoid. J. Inf. Retr. Web IR 9(2), 191–206 (2006)

    Article  Google Scholar 

  11. Tran, Q.H., Tran, V.D., Vu, T.T., Nguyen, M.L., Pham, S.B.: Combining multiple features for answer selection in community question answering. In: Proceedings of SemEval, pp. 215–219 (2015)

    Google Scholar 

  12. Wang, B., Wang, X., Sun, C., Liu, B., Sun, L.: Modeling semantic relevance for question-answer pairs in web social communities. In: Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pp. 1230–1238 (2010)

    Google Scholar 

  13. Toba, H., Ming, Z.Y., Adriani, M., Chua, T.: Discovering high quality answers in community question answering archives using a hierarchy of classifiers. Inf. Sci. 261, 101–115 (2014)

    Article  MathSciNet  Google Scholar 

  14. Yu, L., Hermann, K.M., Blunsom, P., Pulman, S.: Deep learning for answer sentence selection. In: Proceeding of Neural Information Processing Systems (NIPS): Deep Learning and Representation Learning Workshop, Montreal, Quebec, Canada (2014)

    Google Scholar 

  15. Zamanov, I., Hateva, N., Kraeva, M., Yovcheva, I., Nikolova, I., Angelova, G.: A hybrid system for answer validation based on lexical and distance features. In: Proceedings of SemEval, pp. 242–246 (2015)

    Google Scholar 

  16. Zhang, Z., Zhou, Y., Huang, X., Wu, L.: Answering definition questions using web knowledge bases. In: Dale, R., Wong, K.-F., Su, J., Kwong, O.Y. (eds.) IJCNLP 2005. LNCS (LNAI), vol. 3651, pp. 498–506. Springer, Heidelberg (2005). doi:10.1007/11562214_44

    Chapter  Google Scholar 

  17. Zhou, X., Hu, B., Lin, J., Xiang, Y., Wang, X.: A deep learning based comment sequence labeling system for answer selection challenge. In: Proceedings of SemEval, pp. 210–214 (2015)

    Google Scholar 

Download references

Acknowledgement

This paper is supported by The Vietnam National Foundation for Science and Technology Development (NAFOSTED) under grant number 102.01-2014.22.

Author information

Authors and Affiliations

  1. VNU University of Engineering and Technology, Ha Noi City, Vietnam

    Van-Tu Nguyen

  2. Faculty of Information Technology, Ton Duc Thang University, Ho Chi Minh City, Vietnam

    Anh-Cuong Le

Authors
  1. Van-Tu Nguyen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anh-Cuong Le
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anh-Cuong Le .

Editor information

Editors and Affiliations

  1. Japan Advanced Institute of Science and Technology, Nomi, Ishikawa, Japan

    Van-Nam Huynh

  2. Graduate School of Engineering Science, Osaka University, Toyonaka, Osaka, Japan

    Masahiro Inuiguchi

  3. University of Science, Ho Chi Minh City, Vietnam

    Bac Le

  4. Duy Tan University, Da Nang, Vietnam

    Bao Nguyen Le

  5. Université de Technologie de Compiègne , Compiègne, France

    Thierry Denoeux

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Nguyen, VT., Le, AC. (2016). Answer Validation for Question Answering Systems by Using External Resources. In: Huynh, VN., Inuiguchi, M., Le, B., Le, B., Denoeux, T. (eds) Integrated Uncertainty in Knowledge Modelling and Decision Making. IUKM 2016. Lecture Notes in Computer Science(), vol 9978. Springer, Cham. https://doi.org/10.1007/978-3-319-49046-5_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-49046-5_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-49045-8

  • Online ISBN: 978-3-319-49046-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation