Abstract
Previous approaches to Chinese zero pronoun resolution mainly use syntactic information and probabilistic methods, but the context information is ignored. To make full use of the context and semantic information, we build a context-aware model. We propose a key words extraction strategy and design a classification model by using distributed representations as context feature. To our best knowledge, this is the first work using distributed representations in Chinese zero pronoun resolution. Experimental results show that our approach achieves a better performance than previous supervised methods.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Zhao, S., Ng, H.T.: Identification and resolution of Chinese zero pronouns: a machine learning approach. In: EMNLP-CoNLL, vol. 2007, pp. 541–550 (2007)
Weischedel, R., Palmer, M., Marcus, M., Hovy, E., Pradhan, S., Ramshaw, L., Xue, N., Taylor, A., Kaufman, J., El-Bachouti, M.: Ontonotes release 5.0 LDC2013T19. Linguistic Data Consortium, Philadelphia (2013)
Kong, F., Zhou, G.: A tree kernel-based unified framework for Chinese zero anaphora resolution. In: Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, pp. 882–891 (2010)
Mikolov, T., Yih, W.T., Zweig, G.: Linguistic regularities in continuous space word representations. In: HLT-NAACL, pp. 746–751 (2013)
Converse, S. P.: Pronominal anaphora resolution in Chinese. Doctoral Dissertation, University of Pennsylvania (2006)
Hobbs, J.R.: Resolving pronoun references. Lingua 44(4), 311–338 (1978)
Yeh, C.L., Chen, Y.C.: Zero anaphora resolution in Chinese with shallow parsing. J. Chin. Lang. Comput. 17(1), 41–56 (2007)
Grosz, B.J., Weinstein, S., Joshi, A.K.: Centering: a framework for modeling the local coherence of discourse. Comput. Linguist. 21(2), 203–225 (1995)
Chen, C., Ng, V.: Chinese zero pronoun resolution: some recent advances. In: EMNLP, pp. 1360–1365 (2013)
Chen, C., Ng, V.: Chinese zero pronoun resolution: an unsupervised approach combining ranking and integer linear programming. In: AAAI, pp. 1622–1628 (2014)
Rao, S., Ettinger, A., Hal Daumé, I.I.I., Resnik, P.: Dialogue focus tracking for zero pronoun resolution. In: Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), pp. 494–502 (2015)
Chen, C., Ng, V.: Chinese zero pronoun resolution: a joint unsupervised discourse-aware model rivaling state-of-the-art resolvers, vol. 2, Short Papers, p. 320 (2015)
Miller, S., Guinness, J., Zamanian, A.: Name tagging with word clusters and discriminative training. In: HLT-NAACL, vol. 4, pp. 337–342 (2004)
Huang, F., Yates, A.: Distributional representations for handling sparsity in supervised sequence-labeling. In: Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, pp. 495–503 (2009)
Bengio, Y., Schwenk, H., Senécal, J.S., Morin, F., Gauvain, J.L.: Neural probabilistic language models. In: Innovations in Machine Learning, pp. 137–186 (2006)
Mnih, A., Hinton, G.: Three new graphical models for statistical language modeling. In: Proceedings of the 24th International Conference on Machine Learning, pp. 641–648 (2007)
Collobert, R., Weston, J.: A unified architecture for natural language processing: deep neural networks with multitask learning. In: Proceedings of the 25th International Conference on Machine Learning, pp. 160–167 (2008)
Mikolov, T., Yih, W.T., Zweig, G.: Linguistic regularities in continuous space word representations. In: HLT-NAACL, pp. 746–751 (2013)
Mikolov, T., Chen, K., Corrado, G., Dean, J.: word2vec (2014)
Pennington, J., Socher, R., Manning, C.D.: Glove: global vectors for word representation. In: EMNLP, vol. 14, pp. 1532–1543 (2014)
Pradhan, S., Moschitti, A., Xue, N., et al.: CoNLL-2012 shared task: modeling multilingual unrestricted coreference in OntoNotes. In: Joint Conference on EMNLP and CoNLL-Shared Task, pp. 1–40. Association for Computational Linguistics (2012)
Soon, W.M., Ng, H.T., Lim, D.C.Y.: A machine learning approach to coreference resolution of noun phrases. In: Computational Linguistics, pp. 521–544 (2001)
Mikolov, T., Chen, K., Corrado, G., et al.: Efficient estimation of word representations in vector space (2013). arXiv preprint arXiv:1301.3781
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer Science+Business Media Singapore
About this paper
Cite this paper
Wu, B., Zhao, T. (2016). A Context-Aware Model Using Distributed Representations for Chinese Zero Pronoun Resolution. In: Che, W., et al. Social Computing. ICYCSEE 2016. Communications in Computer and Information Science, vol 623. Springer, Singapore. https://doi.org/10.1007/978-981-10-2053-7_1
Download citation
DOI: https://doi.org/10.1007/978-981-10-2053-7_1
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-2052-0
Online ISBN: 978-981-10-2053-7
eBook Packages: Computer ScienceComputer Science (R0)