Abstract
In this paper, we propose a BERT-based framework for Emotion-Cause Pair Extraction (ECPE) task. Given a passage, the ECPE task aims to jointly extract (1) emotion-related clauses and (2) cause clauses (the clause caused the emotion). Our framework is featured by the following two novel designs. First, we formulate the emotion and cause extraction task as a machine reading comprehension (MRC) task. The MRC task is to read a given text passage, and then answer questions by comprehending the article. In our formulation, we treat the ECPE passage as MRC input and pose questions like (Which clauses cause the emotions?). The idea is to leverage the power of MRC model based on recent pre-trained language model. Second, we formulate the emotion-cause pair detection as contextual relatedness detection problem, which can be also effectively addressed by pre-trained language model. The experiment results based on benchmarking datasets demonstrate the effectiveness of the proposed approach; we advance the state-of-the-art results from 61% to 65% in terms of F1 scores.
Similar content being viewed by others
References
Asghar MZ, Subhan F, Ahmad H, Khan WZ, Hakak S, Gadekallu TR, Alazab M (2021) Senti-esystem: A sentiment-based eSystem-using hybridized fuzzy and deep neural network for measuring customer satisfaction. Software: Practice and Experience 51(3):571–594
Chen Y, Hou W, Cheng X, Li S (2018b) Joint learning for emotion classification and emotion cause detection. In: Proceedings of the 2018 conference on empirical methods in natural language processing, pp 646–651
Devlin J, Chang M-W, Lee K, Toutanova K (2019) BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding. In: Proceedings of NAACL-HLT, vol 2019, pp 4171–4186
Ding Z, Xia R, Jianfei YU (2020) “ECPE-2D: Emotion-cause pair extraction based on joint two-dimensional representation, interaction and prediction.” Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
Fan C, Yan H, Jiachen DU, Gui L, Bing L, Yang M, Ruifeng XU, Mao Ruibin (2019) A knowledge regularized hierarchical approach for emotion cause analysis. In: Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing, pp 5618–5628
Gui L, Jianna HU, He Y, Ruifeng XU, Qin LU, Jiachen DU (2017) A question answering approach to emotion cause extraction. In: Proceeding of the 2017 conference on empirical methods in natural language processing, pp 1639–1649
Gao Q, Hu J, Xu R, et al. (2017) Overview of NTCIR-13 ECA Task. In: Proceedings of the 13th NTCIR conference
Ghazi D, Inkpen D, Szpakowicz S (2015) Detecting emotion stimuli in emotion-bearing sentences. In: Computational linguistics and intelligent text processing, pp 152–165
Gui L, Dongyin WU, Ruifeng XU, Qin LU, Zhou YU (2016a) Event-driven Emotion Cause Extraction with Corpus Construction. In: Proceeding of the 2016 Conference on empirical methods in natural language processing, pp 1639–1649
Gui L, Ruifeng XU, Qin LU, Dongyin WU, Zhou YU (2016b) Emotion cause extraction, a challenging task with corpus construction. In: Proceeding of the 2016 Chinese national conference on social media processing, pp 98–109
Gui L, Li Y, Ruifeng XU, Liu B, Qin LU, Zhou YU (2014) Emotion cause detection with linguistic construction in chinese weibo text. In: Natural language processing and chinese computing, pp 457–464
Hakak S, Alazab M, Khan S, Gadekallu TR, Maddikunta PKR, Khan W. Z. (2021) An ensemble machine learning approach through effective feature extraction to classify fake news. Futur Gener Comput Syst 117:47–58
Jiaxing HU, Shi S, Huang H (2019) Combining external sentiment knowledge for emotion cause detection. In: Natural language processing and chinese computing, pp 711–722
Lee SYM, Chen Y, Huang C-R (2010) A Text-driven Rule-based System for Emotion Cause Detection. In: Proceedings of the NAACL HLT 2010 workshop on computational approaches to analysis and generation of emotion in text, pp 45–53
Li X, Feng S, Wang D, Zhang Y (2019) Context-aware emotion cause analysis with multi-attention-based neural network. In: Knowledge-Based Systems, pp 205–218
Li X, Song K, Feng S, Wang D, Zhang Y (2018) A Co-attention Neural Network Model for Emotion Cause Analysis with Emotional Context Awareness. In: Proceedings of the 2018 conference on empirical methods in natural language processing, pp 4752–4757
Li W, Hua XU (2014) Text-based Emotion Classification Using Emotion Cause Extraction. Expert Syst Appl 41(4):1742–1749
Russo I, Caselli T, Rubino F, Boldrini E, Martinez-Barco Patricio (2011) EMOC Ause: An Easy-agaptable Approach to Emotion Cause Contexts. In: Proceedings of the 2nd workshop on computational approaches to subjectivity and sentiment analysis ACL-HLT 2011, 153–160
Song S, Meng Y (2015) Detecting Concept-level Emotion Cause in Microblogging. In: Proceedings of the 24th international conference on world wide web, pp 119–120
Vanwani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I (2017) attention is all you need. In: Proceedings of the 31st international conference on neural information processing systems, pp 6000–6010
Xia R, Ding Z (2019) Emotion-Cause Pair extraction: a new task to emotion analysis in texts. In: Proceedings of the 57th annual meeting of the association for computational linguistics, pp 1003–1012
Xia R, Zhang M, Ding Z (2019) RTHN: A RNN-Transformer Hierarchical Network for Emotion Cause Extraction. In: Proceedings of the twenty-eighth international joint conference on artificial intelligence, pp 5285–5291
Yada S, Ikeda K, Hoashi K, Kageura K (2017) A bootstrap method for automatic rule acquisition on emotion cause extraction. In: In IEEE International conference on data mining workshops, pp 414–421
Zhang H, Jolfaei A, Alazab M (2019) A face emotion recognition method using convolutional neural network and image edge computing. IEEE Access 7:159081–159089
Zhao X, Jiang J, He J, Song Y, Achanauparp P, Lim E-P, Li X (2011) Topical keyphrase extraction from twitter. In: Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies, pp 379–388
Acknowledgements
This work is partially supported by Ministry of Science and Technology, Taiwan under the grant no. 109-2221-E-468-014-MY3 and 109-2221-E-005-058-MY3.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interests
The authors have no competing interests to declare that are relevant to the content of this article. The authors have no relevant financial or non-financial interests to disclose.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Chang, T.W., Fan, YC. & Chen, A.L. Emotion-cause pair extraction based on machine reading comprehension model. Multimed Tools Appl 81, 40653–40673 (2022). https://doi.org/10.1007/s11042-022-13110-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-022-13110-9