Skip to main content

Knowledge-Enhanced Hierarchical Transformers forĀ Emotion-Cause Pair Extraction

  • Conference paper
  • First Online:
Advances in Knowledge Discovery and Data Mining (PAKDD 2023)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13938))

Included in the following conference series:

  • 797 Accesses

Abstract

Emotion-cause pair extraction (ECPE) aims to extract all potential pairs of emotions and corresponding cause(s) from a given document. Current methods have focused on extracting possible emotion-cause pairs by directly analyzing the given documents on the basis of a large training set. However, there are many hard-matching emotion-cause pairs that require commonsense knowledge to understand. Exploiting only the given documents is insufficient to capture the latent semantics behind these hard-matching emotion-cause pairs, which may downgrade the performance of existing ECPE methods. To fill this gap, we propose a Knowledge-Enhanced Hierarchical Transformers framework for the ECPE task. Specifically, we first inject commonsense knowledge into the given documents to construct the knowledge-enhanced clauses. To incorporate the injected knowledge into the clause representations, we then develop a hierarchical Transformers module that leverages two different types of transformer blocks to encode knowledge-enriched clause representations at both global and local stages. Experimental results show that our method achieves state-of-the-art performance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 49.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Bao, Y., Ma, Q., Wei, L., Zhou, W., Hu, S.: Multi-granularity semantic aware graph model for reducing position bias in emotion cause pair extraction. In: Findings of ACL, pp. 1203ā€“1213 (2022)

    Google ScholarĀ 

  2. Cheng, Z., Jiang, Z., Yin, Y., Li, N., Gu, Q.: A unified target-oriented sequence-to-sequence model for emotion-cause pair extraction. IEEE/ACM Trans. Audio Speech Lang. Process. 29, 2779ā€“2791 (2021)

    Google ScholarĀ 

  3. Ding, Z., Xia, R., Yu, J.: ECPE-2D: emotion-cause pair extraction based on joint two-dimensional representation, interaction and prediction. In: ACL, pp. 3161ā€“3170 (2020)

    Google ScholarĀ 

  4. Ding, Z., Xia, R., Yu, J.: End-to-end emotion-cause pair extraction based on sliding window multi-label learning. In: EMNLP, pp. 3574ā€“3583 (2020)

    Google ScholarĀ 

  5. DongZ, D., HAO, C.: Hownet and the computation of meaning (2006)

    Google ScholarĀ 

  6. Fan, C., et al.: A knowledge regularized hierarchical approach for emotion cause analysis. In: EMNLP-IJCNLP, pp. 5614ā€“5624 (2019)

    Google ScholarĀ 

  7. Fan, C., Yuan, C., Du, J., Gui, L., Yang, M., Xu, R.: Transition-based directed graph construction for emotion-cause pair extraction. In: ACL, pp. 3707ā€“3717 (2020)

    Google ScholarĀ 

  8. Gui, L., Xu, R., Wu, D., Lu, Q., Zhou, Y.: Event-driven emotion cause extraction with corpus construction. In: EMNLP, pp. 145ā€“160. World Scientific (2018)

    Google ScholarĀ 

  9. Huang, W., Yang, Y., Peng, Z., Xiong, L., Huang, X.: Deep neural networks based on span association prediction for emotion-cause pair extraction. Sensors 22(10), 3637 (2022)

    ArticleĀ  Google ScholarĀ 

  10. Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

  11. Mittal, A., Vaishnav, J.T., Kaliki, A., Johns, N., Pease, W.: Emotion-cause pair extraction in customer reviews. arXiv preprint arXiv:2112.03984 (2021)

  12. Turcan, E., Wang, S., Anubhai, R., Bhattacharjee, K., Al-Onaizan, Y., Muresan, S.: Multi-task learning and adapted knowledge models for emotion-cause extraction. arXiv preprint arXiv:2106.09790 (2021)

  13. Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, vol. 30 (2017)

    Google ScholarĀ 

  14. Wang, F., Ding, Z., Xia, R., Li, Z., Yu, J.: Multimodal emotion-cause pair extraction in conversations. arXiv preprint arXiv:2110.08020 (2021)

  15. Wei, P., Zhao, J., Mao, W.: Effective inter-clause modeling for end-to-end emotion-cause pair extraction. In: ACL, pp. 3171ā€“3181 (2020)

    Google ScholarĀ 

  16. Wu, Z., Dai, X., Xia, R.: Pairwise tagging framework for end-to-end emotion-cause pair extraction. Front. Comp. Sci. 17(2), 1ā€“10 (2023)

    Google ScholarĀ 

  17. Xia, R., Ding, Z.: Emotion-cause pair extraction: a new task to emotion analysis in texts. In: ACL, pp. 1003ā€“1012 (2019)

    Google ScholarĀ 

  18. Yan, H., Gui, L., Pergola, G., He, Y.: Position bias mitigation: a knowledge-aware graph model for emotion cause extraction. arXiv preprint arXiv:2106.03518 (2021)

  19. Yang, C., Zhang, Z., Ding, J., Zheng, W., Jing, Z., Li, Y.: A multi-granularity network for emotion-cause pair extraction via matrix capsule. In: CIKM, pp. 4625ā€“4629 (2022)

    Google ScholarĀ 

  20. Yuan, C., Fan, C., Bao, J., Xu, R.: Emotion-cause pair extraction as sequence labeling based on a novel tagging scheme. In: EMNLP, pp. 3568ā€“3573 (2020)

    Google ScholarĀ 

Download references

Acknowledgements

This work is supported by the National Key Research and Development Program of China (under grant 2020AAA0106100).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kui Yu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

Ā© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wang, Y., Li, Y., Yu, K., Hu, Y. (2023). Knowledge-Enhanced Hierarchical Transformers forĀ Emotion-Cause Pair Extraction. In: Kashima, H., Ide, T., Peng, WC. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2023. Lecture Notes in Computer Science(), vol 13938. Springer, Cham. https://doi.org/10.1007/978-3-031-33383-5_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-33383-5_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-33382-8

  • Online ISBN: 978-3-031-33383-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics