Skip to main content

A Context-Aware Model Using Distributed Representations for Chinese Zero Pronoun Resolution

  • Conference paper
  • First Online:
Social Computing (ICYCSEE 2016)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 623))

  • 1325 Accesses

Abstract

Previous approaches to Chinese zero pronoun resolution mainly use syntactic information and probabilistic methods, but the context information is ignored. To make full use of the context and semantic information, we build a context-aware model. We propose a key words extraction strategy and design a classification model by using distributed representations as context feature. To our best knowledge, this is the first work using distributed representations in Chinese zero pronoun resolution. Experimental results show that our approach achieves a better performance than previous supervised methods.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Zhao, S., Ng, H.T.: Identification and resolution of Chinese zero pronouns: a machine learning approach. In: EMNLP-CoNLL, vol. 2007, pp. 541–550 (2007)

    Google Scholar 

  2. Weischedel, R., Palmer, M., Marcus, M., Hovy, E., Pradhan, S., Ramshaw, L., Xue, N., Taylor, A., Kaufman, J., El-Bachouti, M.: Ontonotes release 5.0 LDC2013T19. Linguistic Data Consortium, Philadelphia (2013)

    Google Scholar 

  3. Kong, F., Zhou, G.: A tree kernel-based unified framework for Chinese zero anaphora resolution. In: Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, pp. 882–891 (2010)

    Google Scholar 

  4. Mikolov, T., Yih, W.T., Zweig, G.: Linguistic regularities in continuous space word representations. In: HLT-NAACL, pp. 746–751 (2013)

    Google Scholar 

  5. Converse, S. P.: Pronominal anaphora resolution in Chinese. Doctoral Dissertation, University of Pennsylvania (2006)

    Google Scholar 

  6. Hobbs, J.R.: Resolving pronoun references. Lingua 44(4), 311–338 (1978)

    Article  Google Scholar 

  7. Yeh, C.L., Chen, Y.C.: Zero anaphora resolution in Chinese with shallow parsing. J. Chin. Lang. Comput. 17(1), 41–56 (2007)

    MathSciNet  Google Scholar 

  8. Grosz, B.J., Weinstein, S., Joshi, A.K.: Centering: a framework for modeling the local coherence of discourse. Comput. Linguist. 21(2), 203–225 (1995)

    Google Scholar 

  9. Chen, C., Ng, V.: Chinese zero pronoun resolution: some recent advances. In: EMNLP, pp. 1360–1365 (2013)

    Google Scholar 

  10. Chen, C., Ng, V.: Chinese zero pronoun resolution: an unsupervised approach combining ranking and integer linear programming. In: AAAI, pp. 1622–1628 (2014)

    Google Scholar 

  11. Rao, S., Ettinger, A., Hal Daumé, I.I.I., Resnik, P.: Dialogue focus tracking for zero pronoun resolution. In: Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), pp. 494–502 (2015)

    Google Scholar 

  12. Chen, C., Ng, V.: Chinese zero pronoun resolution: a joint unsupervised discourse-aware model rivaling state-of-the-art resolvers, vol. 2, Short Papers, p. 320 (2015)

    Google Scholar 

  13. Miller, S., Guinness, J., Zamanian, A.: Name tagging with word clusters and discriminative training. In: HLT-NAACL, vol. 4, pp. 337–342 (2004)

    Google Scholar 

  14. Huang, F., Yates, A.: Distributional representations for handling sparsity in supervised sequence-labeling. In: Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, pp. 495–503 (2009)

    Google Scholar 

  15. Bengio, Y., Schwenk, H., Senécal, J.S., Morin, F., Gauvain, J.L.: Neural probabilistic language models. In: Innovations in Machine Learning, pp. 137–186 (2006)

    Google Scholar 

  16. Mnih, A., Hinton, G.: Three new graphical models for statistical language modeling. In: Proceedings of the 24th International Conference on Machine Learning, pp. 641–648 (2007)

    Google Scholar 

  17. Collobert, R., Weston, J.: A unified architecture for natural language processing: deep neural networks with multitask learning. In: Proceedings of the 25th International Conference on Machine Learning, pp. 160–167 (2008)

    Google Scholar 

  18. Mikolov, T., Yih, W.T., Zweig, G.: Linguistic regularities in continuous space word representations. In: HLT-NAACL, pp. 746–751 (2013)

    Google Scholar 

  19. Mikolov, T., Chen, K., Corrado, G., Dean, J.: word2vec (2014)

    Google Scholar 

  20. Pennington, J., Socher, R., Manning, C.D.: Glove: global vectors for word representation. In: EMNLP, vol. 14, pp. 1532–1543 (2014)

    Google Scholar 

  21. Pradhan, S., Moschitti, A., Xue, N., et al.: CoNLL-2012 shared task: modeling multilingual unrestricted coreference in OntoNotes. In: Joint Conference on EMNLP and CoNLL-Shared Task, pp. 1–40. Association for Computational Linguistics (2012)

    Google Scholar 

  22. Soon, W.M., Ng, H.T., Lim, D.C.Y.: A machine learning approach to coreference resolution of noun phrases. In: Computational Linguistics, pp. 521–544 (2001)

    Google Scholar 

  23. Mikolov, T., Chen, K., Corrado, G., et al.: Efficient estimation of word representations in vector space (2013). arXiv preprint arXiv:1301.3781

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bingbing Wu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer Science+Business Media Singapore

About this paper

Cite this paper

Wu, B., Zhao, T. (2016). A Context-Aware Model Using Distributed Representations for Chinese Zero Pronoun Resolution. In: Che, W., et al. Social Computing. ICYCSEE 2016. Communications in Computer and Information Science, vol 623. Springer, Singapore. https://doi.org/10.1007/978-981-10-2053-7_1

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-2053-7_1

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-2052-0

  • Online ISBN: 978-981-10-2053-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics