Advertisement

Agricultural Question Classification Based on CNN of Cascade Word Vectors

  • Lei ChenEmail author
  • Jin Gao
  • Yuan Yuan
  • Li Wan
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11257)

Abstract

Compared with traditional search engines, the query method of QA system is more intelligent and applicable in non-professional scenes, e.g., agricultural information retrieval. Question classification is an important issue in QA system. Since the particularities of agricultural questions, such as words sparsity, many technical terms, and so on, some existing methods are difficult to achieve the desired result in the agricultural question classification task. Hence, it is necessary to investigate how to extract as many useful information as possible from short agricultural questions to improve the efficiency of agricultural question classification. In order to solve this problem, the paper explores effective semantic representation of agricultural question sentences and proposes a method for agricultural question classification based on CNN of cascade word vectors. Different combinations of questions, answers, and synonym information are used to learn different cascade word vectors, which are taken as the input of CNN to construct the model of question classification. The experimental results show that our method can achieve better result in the agricultural question classification task.

Keywords

Agricultural question classification Cascade word vector Semantic representation CNN Question and answering system 

Notes

Acknowledgments

The authors would like to thank the anonymous reviewers for their helpful reviews. The work is supported by National Natural Science Foundation of China (Grant No. 31771677) and National Natural Science Foundation of Anhui (Grant No. 1608085QF127).

References

  1. 1.
    Chinese word segmentation component of Python: Jieba. http://www.oss.io/os/fxsjy/jieba
  2. 2.
    Das, R., Zaheer, M., Reddy, S., McCallum, A.: Question answering on knowledge bases and text using universal schema and memory networks. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017, Short Papers, vol. 2, pp. 358–365 (2017)Google Scholar
  3. 3.
    HIT-SCIR: HIT IR-lab Tongyici Cilin (Extended). https://www.ltp-cloud.com/
  4. 4.
    Hu, D.: The research of question analysis based on ontology and architecture design for question answering system in agriculture. Ph.D. thesis. Chinese Academy of Agricultural Sciences (2013). (in Chinese)Google Scholar
  5. 5.
    Kalchbrenner, N., Grefenstette, E., Blunsom, P.: A convolutional neural network for modelling sentences. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, ACL 2014, Long Papers, vol. 1, pp. 655–665 (2014)Google Scholar
  6. 6.
    Kim, Y.: Convolutional neural networks for sentence classification. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, EMNLP 2014, A Meeting of SIGDAT, a Special Interest Group of the ACL, pp. 1746–1751 (2014)Google Scholar
  7. 7.
    Komninos, A., Manandhar, S.: Dependency based embeddings for sentence classification tasks. In: The 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016, pp. 1490–1500 (2016)Google Scholar
  8. 8.
    Lai, S., Xu, L., Liu, K., Zhao, J.: Recurrent convolutional neural networks for text classification. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, pp. 2267–2273 (2015)Google Scholar
  9. 9.
    Le-Hong, P., Phan, X.-H., Nguyen, T.-D.: Using dependency analysis to improve question classification. In: Nguyen, V.-H., Le, A.-C., Huynh, V.-N. (eds.) Knowledge and Systems Engineering. AISC, vol. 326, pp. 653–665. Springer, Cham (2015).  https://doi.org/10.1007/978-3-319-11680-8_52CrossRefGoogle Scholar
  10. 10.
    Liu, L., Yu, Z., Guo, J., Mao, C., Hong, X.: Chinese question classification based on question property kernel. Int. J. Mach. Learn. Cybern. 5(5), 713–720 (2014)CrossRefGoogle Scholar
  11. 11.
    Ma, M., Huang, L., Xiang, B., Zhou, B.: Group sparse CNNs for question classification with answer sets. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017, Short Papers, vol. 2, pp. 335–340 (2017)Google Scholar
  12. 12.
    Mao, X., Li, X.: A survey on question and answering system. J. Front. Comput. Sci. Technol. 6(3), 193–207 (2012). (in Chinese)Google Scholar
  13. 13.
    Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. CoRR abs/1301.3781 (2013)Google Scholar
  14. 14.
    Moldovan, D.I., Pasca, M., Harabagiu, S.M., Surdeanu, M.: Performance issues and error analysis in an open-domain question answering system. ACM Trans. Inf. Syst. 21(2), 133–154 (2003)CrossRefGoogle Scholar
  15. 15.
    Song, H., Ren, Z., Liang, S., Li, P., Ma, J., de Rijke, M.: Summarizing answers in non-factoid community question-answering. In: Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, WSDM 2017, pp. 405–414 (2017)Google Scholar
  16. 16.
    Srivastava, N., Hinton, G.E., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)MathSciNetzbMATHGoogle Scholar
  17. 17.
    Wei, Z., Meng, F., Guo, J.: Design and implementation of agricultural information search engine classifier. J. Agric. Mech. Res. 2014(3), 186–189 (2014). (in Chinese)Google Scholar
  18. 18.
    Zhang, D., Li, S., Wang, J.: Semi-supervised question classification with jointly learning question and answer representation. J. Chin. Inf. Process. 31(1), 1–7 (2017). (in Chinese)Google Scholar
  19. 19.
    Zhang, X.: Research on agricultural information classification method based on deep learning. Master’s thesis. Northwest A & F University (2017). (in Chinese)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Institute of Intelligent Machines, Chinese Academy of SciencesHefeiChina
  2. 2.University of Science and Technology of ChinaHefeiChina

Personalised recommendations