Skip to main content
SpringerLink
Log in

Singleton Detection for Coreference Resolution via Multi-window and Multi-filter CNN

  • Conference paper
  • First Online:
Machine Translation (CWMT 2017)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 787))

Included in the following conference series:

Abstract

Mention detection is the first and a key stage in most of coreference resolution systems. Singleton mentions are the ones which appear only once and are not mentioned in the following texts. Singleton mentions always affect the performance of coreference resolution systems. To remove the singleton ones from the automatically predicted mentions, we propose a novel singleton detection method based on multi-window and multi-filter convolutional neural network (MMCNN). The MMCNN model can detect singleton mentions with less use of hand-designed features and more sentence information. Experiments show that our system outperforms all the existing singleton detection systems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Hardmeier, C., Fondazione, M.F., Kessler B.: Modelling pronominal anaphora in statistical machine translation. In: Proceedings of the seventh International Workshop on Spoken Language Translation, pp. 283–289 (2010)

    Google Scholar 

  2. Luong, N.Q., Werlen, L.M., Popescu-Belis, A.: Pronoun translation and prediction with or without coreference links. In: The Workshop on Discourse in Machine Translation, pp. 94–100 (2015)

    Google Scholar 

  3. Luong, N.Q., Popescu-Belis, A.: Improving pronoun translation by modeling coreference uncertainty. In: Conference on Machine Translation, vol. 1, Research Papers (2016)

    Google Scholar 

  4. Werlen, L.M., Popescu-Belis, A.: Using Coreference Links to Improve Spanish-to-English Machine Translation. Idiap (2017)

    Google Scholar 

  5. Peng, H., Chang, K.W., Dan, R.: A joint framework for coreference resolution and mention head detection. In: Nineteenth Conference on Computational Natural Language Learning (2015)

    Google Scholar 

  6. Chang, K.W., Samdani, R., Rozovskaya, A., Sammons, M., Roth, D.: Illinois-Coref: the UI system in the CoNLL-2012 shared task. In: Joint Conference on EMNLP and CoNLL - Shared Task. Association for Computational Linguistics, pp. 113–117 (2012)

    Google Scholar 

  7. Chen, C., Ng, V.: Combining the best of two worlds: a hybrid approach to multilingual coreference resolution. In: Joint Conference on EMNLP and CoNLL - Shared Task. Association for Computational Linguistics, pp. 56–63 (2012)

    Google Scholar 

  8. Durrett, G., Klein, D.: Easy victories and uphill battles in coreference resolution. In: Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pp. 1971–1982. ACL (2013)

    Google Scholar 

  9. Ma, C., Doppa, J.R., Orr, J.W., Mannem, P., Fern, X.Z., Dietterich, T.G., Tadepalli, P.: Prune-and-score: learning for greedy coreference resolution. In: Conference on Empirical Methods in Natural Language Processing, pp. 2115–2126 (2014)

    Google Scholar 

  10. Raghunathan, K., Lee, H., Rangarajan, S., Chambers, N., Surdeanu, M., Jurafsky, D., Manning, C.: A multi-pass sieve for coreference resolution. In: Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, pp. 492–501. Association for Computational Linguistics (2010)

    Google Scholar 

  11. De Marneffe, M.C., Recasens, M., Potts, C.: Modeling the lifespan of discourse entities with application to coreference resolution. J. Artif. Intell. Res. 52, 445–475 (2015)

    MATH  MathSciNet  Google Scholar 

  12. Haagsma, H.: Singleton detection using word embeddings and neural networks. In: ACL 2016 (2016)

    Google Scholar 

  13. Yuan, B., Chen, Q., Xiang, Y., Wang, X., Ge, L., Liu, Z., Si, X.: A mixed deterministic model for coreference resolution. In: Joint Conference on EMNLP and CoNLL - Shared Task. Association for Computational Linguistics (2012)

    Google Scholar 

  14. Björkelund, A., Farkas, R.: Data-driven multilingual coreference resolution using resolver stacking. In: Joint Conference on EMNLP and CoNLL - Shared Task (2012)

    Google Scholar 

  15. Zeng, D., Liu, K., Lai, S., Zhou, G., Zhao, J.: Relation classification via convolutional deep neural network. In: COLING (2014)

    Google Scholar 

  16. dos Santos, C.N., Xiang, B., Zhou, B.: Classifying relations by ranking with convolutional neural networks. Computer Science (2015)

    Google Scholar 

  17. Wang, L., Cao, Z., de Melo, G., Liu, Z.: Relation classification via multi-level attention CNNs. In: Meeting of the Association for Computational Linguistics (2016)

    Google Scholar 

  18. Kim, Y.: Convolutional neural networks for sentence classification. Eprint Arxiv (2014)

    Google Scholar 

  19. Iida, R., Torisawa, K., Oh, J.H., Kruengkrai, C., Kloetzer, J. Intra-sentential subject zero anaphora resolution using multi-column convolutional neural network. In: Proceedings of EMNLP (2016)

    Google Scholar 

  20. Clark, K., Manning, C.D.: Improving coreference resolution by learning entity-level distributed representations. In: Meeting of the Association for Computational Linguistics (2016)

    Google Scholar 

  21. Pradhan, S., Moschitti, A., Xue, N., Uryupina, O., Zhang, Y.: CoNLL-2012 shared task: modeling multilingual unrestricted coreference in OntoNotes. In: Joint Conference on EMNLP and CoNLL - Shared Task (2012)

    Google Scholar 

  22. Hovy, E., Marcus, M., Palmer, M., Ramshaw, L., Weischedel, R.: OntoNotes: the 90% solution. In: Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers, pp. 57–60. Association for Computational Linguistics (2006)

    Google Scholar 

  23. Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, pp. 3111–3119 (2013)

    Google Scholar 

  24. Koehn, P.: Statistical significance tests for machine translation evaluation. In: Conference on Empirical Methods in Natural Language Processing, EMNLP, pp. 388–395 (2004)

    Google Scholar 

  25. Pradhan, S., Luo, X., Recasens, M., Hovy, E.H., Ng, V., Strube, M.: Scoring coreference partitions of predicted mentions: a reference implementation. In: Meeting of the Association for Computational Linguistics (2014)

    Google Scholar 

Download references

Acknowledgment

This research is supported by the National Basic Research Program of China (973 Program, No. 2013CB329303), National Natural Science Foundation of China (NSFC, No. 61502035) and Beijing Advanced Innovation Center for Imaging Technology (BAICIT, No. 2016007).

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Beijing Institute of Technology, Beijing, China

    Kenan Li, Heyan Huang, Yuhang Guo & Ping Jian

  2. Beijing Engineering Research Center of High Volume Language Information Processing and Cloud Computing Application, 5 South Zhongguancun Street, Beijing, 100081, China

    Heyan Huang, Yuhang Guo & Ping Jian

  3. Beijing Advanced Innovation Center for Imaging Technology, Capital Normal University, Beijing, 100048, People’s Republic of China

    Kenan Li

Authors
  1. Kenan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Heyan Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yuhang Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ping Jian
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Heyan Huang .

Editor information

Editors and Affiliations

  1. University of Macau, Macau SAR, China

    Derek F. Wong

  2. Soochow University, Suzhou, China

    Deyi Xiong

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, K., Huang, H., Guo, Y., Jian, P. (2017). Singleton Detection for Coreference Resolution via Multi-window and Multi-filter CNN. In: Wong, D., Xiong, D. (eds) Machine Translation. CWMT 2017. Communications in Computer and Information Science, vol 787. Springer, Singapore. https://doi.org/10.1007/978-981-10-7134-8_2

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-7134-8_2

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-7133-1

  • Online ISBN: 978-981-10-7134-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation