Abstract
Recent work on opinion mining typically focuses on subtasks such as aspect mining or polarity classification, ignoring the detailed explanatory evidences that account for one certain user opinion. In this paper, we study the extraction of explanatory expressions, by modeling the problem based on conditional random field (CRF). We compare the effectiveness of both discrete and neural features, and further integrate them. We evaluate the models on two datasets from two different domains which have been annotated with ground-truth explanatory expression. Results show that the neural CRF model performs better than the discrete CRF. After a combination of the discrete and neural features, our final CRF mode achieves the top-performing results.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
References
Che, W., Li, Z., Liu, T.: LTP: a Chinese language technology platform. In: Coling 2010: Demonstrations, pp. 13–16 (2010)
Choi, Y., Cardie, C., Riloff, E., Patwardhan, S.: Identifying sources of opinions with conditional random fields and extraction patterns. In: Proceedings of the HLT-EMNLP, pp. 355–362. Association for Computational Linguistics (2005)
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., Kuksa, P.: Natural language processing (almost) from scratch. JMLR 12, 2493–2537 (2011)
Ding, X., Liu, B., Yu, P.S.: A holistic lexicon-based approach to opinion mining. In: Proceedings of the WSDM, pp. 231–240. ACM (2008)
Do, T., Artieres, T., et al.: Neural conditional random fields. In: International Conference on Artificial Intelligence and Statistics, pp. 177–184 (2010)
Duchi, J., Hazan, E., Singer, Y.: Adaptive subgradient methods for online learning and stochastic optimization. JMLR 12, 2121–2159 (2011)
Durrett, G., Klein, D.: Neural CRF parsing. In: Proceedings of the 53rd ACL-IJCNLP (Volume 1: Long Papers), pp. 302–312, Beijing, China, July 2015
Graves, A., Schmidhuber, J.: Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Netw. 18(5), 602–610 (2005)
He, Y., Pan, D., Fu, G.: Chinese explanatory segment recognition as sequence labeling. In: Wang, H., Qi, H., Che, W., Qiu, Z., Kong, L., Han, Z., Lin, J., Lu, Z. (eds.) ICYCSEE 2015. CCIS, vol. 503, pp. 159–168. Springer, Heidelberg (2015). doi:10.1007/978-3-662-46248-5_20
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Irsoy, O., Cardie, C.: Bidirectional recursive neural networks for token-level labeling with structure. CoRR abs/1312.0493 (2013)
Jakob, N., Gurevych, I.: Extracting opinion targets in a single-and cross-domain setting with conditional random fields. In: EMNLP, pp. 1035–1045 (2010)
Jin, W., Ho, H.H., Srihari, R.K.: A novel lexicalized HMM-based learning framework for web opinion mining. In: Proceedings of the 26th ICML, pp. 465–472 (2009)
Johansson, R., Moschitti, A.: Syntactic and semantic structure for opinion expression detection. In: CoNLL, pp. 67–76 (2010)
Kim, H.D., Castellanos, M., Hsu, M., Zhai, C., Dayal, U., Ghosh, R.: Compact explanatory opinion summarization. In: CIKM, pp. 1697–1702. ACM (2013)
Kim, H.D., Castellanos, M.G., Hsu, M., Zhai, C., Dayal, U., Ghosh, R.: Ranking explanatory sentences for opinion summarization. In: SIGIR, pp. 1069–1072 (2013)
Kobayashi, N., Inui, K., Matsumoto, Y.: Extracting aspect-evaluation and aspect-of relations in opinion mining. In: EMNLP-CoNLL, vol. 7, pp. 1065–1074 (2007)
Lafferty, J., McCallum, A., Pereira, F.: Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of the Eighteenth ICML, vol. 1, pp. 282–289 (2001)
Liu, B.: Sentiment analysis and opinion mining. Synth. Lect. Hum. Lang. Technol. 5(1), 1–167 (2012)
Liu, P., Joty, S., Meng, H.: Fine-grained opinion mining with recurrent neural networks and word embeddings. In: Proceedings of the EMNLP, pp. 1433–1443, Lisbon, Portugal, September 2015
Pang, B., Lee, L.: Opinion mining and sentiment analysis. Found. Trends Inf. Retr. 2(1–2), 1–135 (2008)
Peng, F., Feng, F., McCallum, A.: Chinese segmentation and new word detection using conditional random fields. In: Proceedings of Coling 2004, pp. 562–568 (2004)
Popescu, A.M., Etzioni, O.: Extracting product features and opinions from reviews. In: Kao, A., Poteet, S.R. (eds.) Natural Language Processing and Text Mining, pp. 9–28. Springer, Heidelberg (2007). doi:10.1007/978-1-84628-754-1_2
Rao, D., Ravichandran, D.: Semi-supervised polarity lexicon induction. In: Proceedings of EACL, pp. 675–682. Association for Computational Linguistics (2009)
Ren, Y., Zhang, Y., Zhang, M., Ji, D.: Context-sensitive twitter sentiment classification using neural network. In: AAAI (2016)
Tseng, H., Chang, P., Andrew, G., Jurafsky, D., Manning, C.: A conditional random field word segmenter for sighan bakeoff 2005. In: Proceedings of the Fourth SIGHAN Workshop, pp. 168–171 (2005)
Turian, J., Ratinov, L.A., Bengio, Y.: Word representations: a simple and general method for semi-supervised learning. In: Proceedings of the ACL, pp. 384–394 (2010)
Wang, D., Nyberg, E.: A long short-term memory model for answer sentence selection in question answering. In: Proceedings of the 53rd ACL and the 7th IJCNLP (Volume 2: Short Papers), pp. 707–712, Beijing, China, July 2015
Wang, M., Manning, C.D.: Effect of non-linear deep architecture in sequence labeling. In: Proceedings of the Sixth International Joint Conference on Natural Language Processing, pp. 1285–1291 (2013)
Wang, P., Qian, Y., Soong, F.K., He, L., Zhao, H.: Learning distributed word representations for bidirectional LSTM recurrent neural network. In: Proceedings of ICASSP (2016)
Wiebe, J., Wilson, T., Cardie, C.: Annotating expressions of opinions and emotions in language. Lang. Resour. Eval. 39(2–3), 165–210 (2005)
Yang, B., Cardie, C.: Joint inference for fine-grained opinion extraction. In: ACL (1), pp. 1640–1649 (2013)
Zhang, M., Zhang, Y.: Combining discrete and continuous features for deterministic transition-based dependency parsing. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp. 1316–1321 (2015)
Zhang, M., Zhang, Y., Fu, G.: Transition-based neural word segmentation. In: Proceedings of the 54th ACL (2016)
Zhang, M., Zhang, Y., Vo, D.T.: Neural networks for open domain targeted sentiment. In: Proceedings of the 2015 Conference on EMNLP, pp. 612–621 (2015)
Zhou, J., Xu, W.: End-to-end learning of semantic role labeling using recurrent neural networks. In: Proceedings of the 53rd ACL and the 7th IJCNLP (Volume 1: Long Papers), pp. 1127–1137, Beijing, China, July 2015
Acknowledgments
We thank the anonymous reviewers for their constructive comments, which helped to improve the paper. This work was partially funded by National Natural Science Foundation of China (Nos. 61672211, 61602160 and 61170148), Natural Science Foundation of Heilongjiang Province (No. F2016036), and the Returned Scholar Foundation of Heilongjiang Province.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Pan, D., Wang, M., Zhang, M., Fu, G. (2017). Extracting Chinese Explanatory Expressions with Discrete and Neural CRFs. In: Zou, B., Han, Q., Sun, G., Jing, W., Peng, X., Lu, Z. (eds) Data Science. ICPCSEE 2017. Communications in Computer and Information Science, vol 728. Springer, Singapore. https://doi.org/10.1007/978-981-10-6388-6_1
Download citation
DOI: https://doi.org/10.1007/978-981-10-6388-6_1
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-6387-9
Online ISBN: 978-981-10-6388-6
eBook Packages: Computer ScienceComputer Science (R0)