Skip to main content

A Support Vector Machine Based System for Technical Question Classification

  • Conference paper
  • First Online:
Mining Intelligence and Knowledge Exploration (MIKE 2015)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9468))

Abstract

This paper presents our attempt on developing a question classification system for technical domain. Question classification system classifies a question into the type of answer it requires and therefore plays an important role in question answering. Although the task is quite popular in general domain, we were unable to find any question classification system that classifies the questions of a technical subject. We defined a technical domain question taxonomy containing six classes. We manually created a dataset containing 1086 questions. Then we identified a set of features suitable for the technical domain. We observed that the parse structure similarity plays an important role in this classification. To capture the parse tree similarity we employed the tree kernel and we proposed a level-wise matching approach. We have used these features and dataset in a support vector machine classifier to achieve 93.22 % accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Breck, E., Burger, J., Ferro, L., House, D., Light, M., Mani, I.: Publications manual. In: Proceedings of The Eighth Text Retrieval Conference (TREC8) (1999)

    Google Scholar 

  • Chang, C.C., Lin, C.J.: LIBSVM 2011. ACM Trans. Intell. Syst. Technol. 2(27), 1–27 (2011)

    Article  Google Scholar 

  • Cortes, C., Vapnik, V.N.: Support vector networks. Mach. Learn. 20, 273–297 (1995). 1981

    MATH  Google Scholar 

  • Hovy, E., Hermjakob, U., Ravichandran, D.: A question/answer typology with surface text patterns. In: Proceedings of the Human Language Technology (HLT) Conference (2002)

    Google Scholar 

  • Huang, Z., Thint, M., Qin, Z.: Question classification using head words and their hypernyms. In: Proceedings of the Conference on EMNLP, pp. 927–936 (2008)

    Google Scholar 

  • Hacioglu, K., Ward, W.: Question classification with support vector machines and error correcting codes. In: Proceedings of HLT-NACCL 2003 (2003)

    Google Scholar 

  • Hermjakob, U.: Parsing and question classification for question answering. In: ACL 2001 Workshop on Open-Domain Question Answering (2001)

    Google Scholar 

  • Suzuki, J., Taira, H., Sasaki, Y., Maeda, E.: Question classification using HDAG kernel. In: ACL 2003 Workshop on Multilingual Summarization and Question Answering (2003)

    Google Scholar 

  • Ittycheriah, A., Franz, M., Zhu, W.-J., Ratnaparkhi, A.: IBM’s statistical question answering system. In: The Ninth Text REtrieval Conference (TREC9) (2000)

    Google Scholar 

  • Li, X., Roth, D.: Question classification using head words and their hypernyms. In: Proceedings of the Conference on EMNLP, pp. 927–936 (2002)

    Google Scholar 

  • Socher, R., Bauer, J., Manning, C.D., Ng, A.Y.: Parsing with compositional vector grammars. In: Proceedings of ACL 2013 (2013)

    Google Scholar 

  • Singhal, A., Abney, S., Bacchiani, M., Collins, M., Hindle, D., Pereira, F.: QAT & T at TREC-8. In: The Eighth Text REtrieval Conference (TREC8) (1999)

    Google Scholar 

  • Zhang, D., Lee, W.S.: Question classification using support vector machines. In: Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 26–32 (2003). 1999

    Google Scholar 

  • Oh, H.J., Lee, C.H., Kim, H.J., Jang, M.G.: 2005 Descriptive question answering in encyclopedia. In: Association for Computational Machinery (2005)

    Google Scholar 

  • Lally, A., Prager, J.M., McCord, M.C., Boguraev, B.K., Patwardhan, S., Fan, J., Fodor, P., Chu-Carroll, J.: Question analysis: how watson reads a clue (2005)

    Google Scholar 

  • Moschitti, A.: State-of-the-art tree kernels in natural language processing. In: ACL (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shlok Kumar Mishra .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Mishra, S.K., Kumar, P., Saha, S.K. (2015). A Support Vector Machine Based System for Technical Question Classification. In: Prasath, R., Vuppala, A., Kathirvalavakumar, T. (eds) Mining Intelligence and Knowledge Exploration. MIKE 2015. Lecture Notes in Computer Science(), vol 9468. Springer, Cham. https://doi.org/10.1007/978-3-319-26832-3_60

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-26832-3_60

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-26831-6

  • Online ISBN: 978-3-319-26832-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics