Skip to main content
SpringerLink
Log in

Aspect sentiment triplet extraction based on data augmentation and task feedback

  • Research
  • Published:
Journal of Intelligent Information Systems Aims and scope Submit manuscript

Abstract

Aspect sentiment triplet extraction (ASTE), which focuses on mining the triplets (aspect, opinion, sentiment), is a complex and integrated subtask in aspect-based sentiment analysis. It is widely used in market research, product design and promotion, online comment analysis, and so on. Although significant progress has been achieved in existing methods, several challenges remain, such as data scarcity and the separation of span extraction and sentiment classification. Therefore, this paper adds data augmentation and task feedback based on the bidirectional machine reading comprehension model. Before training the model, the data augmentation module applies mask prediction and mark replacement to enrich the data. Span extraction and sentiment classification are two tasks during ASTE. We adopt the direct span extraction method with one classifier to avoid the error accumulation caused by multiple classifiers and to improve the adaptive ability between different datasets. In addition, we fuse the text features derived from the above two tasks for sentiment classification. Based on the feature fusion, the task feedback module is established to alleviate the task separation. Extensive experiments verify the effectiveness of our method. The code is available at https://github.com/zhenzhen313/BMRC-with-DA-and-TF.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data availability

No datasets were generated or analysed during the current study.

Code availability

The code is available at https://github.com/zhenzhen313/BMRC-with-DA-and-TF.

References

  • AlBadani, B., Dong, J., Shi, R., et al. (2023). Smgnn: span-to-span multi-channel graph neural network for aspect-sentiment triplet extraction. Journal of Intelligent Information Systems, 61(3), 695–715. https://doi.org/10.1007/s10844-023-00794-0

    Article  Google Scholar 

  • Cahuantzi, R., Chen, X., & Güttel, S. (2023). A comparison of LSTM and GRU networks for learning symbolic sequences. In K. Arai (Ed.), Intelligent Computing (Vol. 739, pp. 771–785). Cham: Springer Nature Switzerland. https://doi.org/10.1007/978-3-031-37963-5_53

    Chapter  Google Scholar 

  • Chen, H., Zhai, Z., Feng, F., et al. (2022a). Enhanced multi-channel graph convolutional network for aspect sentiment triplet extraction. In: S. Muresan, P. Nakov, & A. Villavicencio (Eds.), Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers, pp. 2974–2985). Association for Computational Linguistics, Dublin, Ireland. https://doi.org/10.18653/v1/2022.acl-long.212

  • Chen, S., Wang, Y., Liu, J., et al. (2021). Bidirectional machine reading comprehension for aspect sentiment triplet extraction. Proceedings of the AAAI Conference on Artificial Intelligence, 35(14), 12666–12674. https://doi.org/10.1609/aaai.v35i14.17500

    Article  Google Scholar 

  • Chen, Y., Keming, C., Sun, X., et al. (2022b). A span-level bidirectional network for aspect sentiment triplet extraction. In: Y., Goldberg, Z., Kozareva, & Y., Zhang (Eds.), Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (pp. 4300–4309). Association for Computational Linguistics, Abu Dhabi, United Arab Emirates. https://doi.org/10.18653/v1/2022.emnlp-main.289

  • Chen, Z., & Qian, T. (2020). Relation-aware collaborative learning for unified aspect-based sentiment analysis. In D. Jurafsky, J. Chai, N. Schluter, et al. (Eds.), Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (pp. 3685–3694). Association for Computational Linguistics, Online. https://doi.org/10.18653/v1/2020.acl-main.340

  • Dave, K., Lawrence, S., & Pennock, D. M. (2003). Mining the peanut gallery: opinion extraction and semantic classification of product reviews. Proceedings of the 12th International Conference on World Wide Web (pp. 519–528). Association for Computing Machinery, New York, NY, USA, WWW ’03. https://doi.org/10.1145/775152.775226

    Chapter  Google Scholar 

  • Devlin, J., Chang, M. W., Lee, K., et al. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. In J. Burstein, C. Doran, & T. Solorio (Eds.), Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1, Long and Short Papers (pp. 4171–4186). Minneapolis, Minnesota: Association for Computational Linguistics. https://doi.org/10.18653/v1/N19-1423

    Chapter  Google Scholar 

  • Di Caro, L., & Grella, M. (2013). Sentiment analysis via dependency parsing. Computer Standards & Interfaces, 35(5), 442–453. https://doi.org/10.1016/j.csi.2012.10.005

    Article  Google Scholar 

  • Fei, H., Ren, Y., Zhang, Y., et al. (2023). Nonautoregressive encoder-decoder neural framework for end-to-end aspect-based sentiment triplet extraction. IEEE Transactions on Neural Networks and Learning Systems, 34(9), 5544–5556. https://doi.org/10.1109/TNNLS.2021.3129483

    Article  Google Scholar 

  • Hu, M., & Liu, B. (2004). Mining and summarizing customer reviews. Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 168–177). Association for Computing Machinery, New York, NY, USA, KDD ’04. https://doi.org/10.1145/1014052.1014073

    Chapter  Google Scholar 

  • Karimi, A., Rossi, L., & Prati, A. (2021). AEDA: An easier data augmentation technique for text classification. In M. F. Moens, X. Huang, L. Specia et al. (Eds.), Findings of the Association for Computational Linguistics: EMNLP 2021 (pp. 2748–2754). Association for Computational Linguistics, Punta Cana, Dominican Republic. https://doi.org/10.18653/v1/2021.findings-emnlp.234

  • Li, X., Bing, L., Li, P., et al. (2019). A unified model for opinion target extraction and target sentiment prediction. Proceedings of the AAAI Conference on Artificial Intelligence, 33(01), 6714–6721. https://doi.org/10.1609/aaai.v33i01.33016714

    Article  Google Scholar 

  • Li, Y., Cohn, T., & Baldwin, T. (2017). Robust training under linguistic adversity. In M. Lapata, P. Blunsom, & A. Koller (Eds.), Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers (pp. 21–27). Valencia, Spain: Association for Computational Linguistics. https://doi.org/10.18653/v1/e17-2004

    Chapter  Google Scholar 

  • Liang, B., Luo, W., Li, X., et al. (2021). Enhancing aspect-based sentiment analysis with supervised contrastive learning. Proceedings of the 30th ACM International Conference on Information & Knowledge Management (pp. 3242–3247). Association for Computing Machinery, New York, NY, USA, CIKM ’21. https://doi.org/10.1145/3459637.3482096

    Chapter  Google Scholar 

  • Lin, C., & He, Y. (2009). Joint sentiment/topic model for sentiment analysis. Proceedings of the 18th ACM Conference on Information and Knowledge Management (pp. 375–384). Association for Computing Machinery, New York, NY, USA, CIKM ’09. https://doi.org/10.1145/1645953.1646003

    Chapter  Google Scholar 

  • Liu, S., Li, K., & Li, Z. (2022). A robustly optimized BMRC for aspect sentiment triplet extraction. In M. Carpuat, M. C. de Marneffe, & I. V. Meza Ruiz (Eds.), Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (pp. 272–278). Association for Computational Linguistics, Seattle, United States. https://doi.org/10.18653/v1/2022.naacl-main.20

    Chapter  Google Scholar 

  • Loshchilov, I., & Hutter, F. (2017). Decoupled weight decay regularization. Preprint retrieved from http://arxiv.org/abs/1711.05101. https://doi.org/10.48550/arXiv.1711.05101

  • Mao, Y., Shen, Y., Yu, C., et al. (2021). A joint training dual-MRC framework for aspect based sentiment analysis. Proceedings of the AAAI Conference on Artificial Intelligence, 35(15), 13543–13551. https://doi.org/10.1609/aaai.v35i15.17597

    Article  Google Scholar 

  • Peng, H., Xu, L., Bing, L., et al. (2020). Knowing what, how and why: A near complete solution for aspect-based sentiment analysis. Proceedings of the AAAI Conference on Artificial Intelligence, 34(05), 8600–8607. https://doi.org/10.1609/aaai.v34i05.6383

    Article  Google Scholar 

  • Pontiki, M., Galanis, D., Pavlopoulos, J., et al. (2014). SemEval-2014 task 4: Aspect based sentiment analysis. In P. Nakov & T. Zesch (Eds.), Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014) (pp. 27–35). Dublin, Ireland: Association for Computational Linguistics. https://doi.org/10.3115/v1/S14-2004

    Chapter  Google Scholar 

  • Pontiki, M., Galanis, D., Papageorgiou, H., et al. (2015). SemEval-2015 task 12: Aspect based sentiment analysis. In P. Nakov, T. Zesch, D. Cer, et al. (Eds.), Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015) (pp. 486–495). Association for Computational Linguistics, Denver, Colorado. https://doi.org/10.18653/v1/S15-2082

  • Pontiki, M., Galanis, D., Papageorgiou, H., et al. (2016). SemEval-2016 task 5: Aspect based sentiment analysis. In S. Bethard, M. Carpuat, D. Cer et al. (Eds.), Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016) (pp. 19–30). Association for Computational Linguistics, San Diego, California. https://doi.org/10.18653/v1/S16-1002

  • Ravi, K., & Ravi, V. (2015). A survey on opinion mining and sentiment analysis: Tasks, approaches and applications. Knowledge-Based Systems, 89, 14–46. https://doi.org/10.1016/j.knosys.2015.06.015

    Article  Google Scholar 

  • Ren, S., Zhang, J., Li, L., et al. (2021). Text AutoAugment: Learning compositional augmentation policy for text classification. In M. F. Moens, X. Huang, L. Specia, et al. (Eds.), Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (pp. 9029–9043). Association for Computational Linguistics, Online and Punta Cana, Dominican Republic. https://doi.org/10.18653/v1/2021.emnlp-main.711

  • Singh, L. G., & Singh, S. R. (2021). Empirical study of sentiment analysis tools and techniques on societal topics. Journal of Intelligent Information Systems, 56(2), 379–407. https://doi.org/10.1007/s10844-020-00616-7

    Article  Google Scholar 

  • Sun, L., Xia, C., Yin, W., et al. (2020). Mixup-transformer: Dynamic data augmentation for NLP tasks. In D. Scott, N. Bel, & C. Zong (Eds.), Proceedings of the 28th International Conference on Computational Linguistics (pp. 3436–3440). International Committee on Computational Linguistics, Barcelona, Spain (Online). https://doi.org/10.18653/v1/2020.coling-main.305

    Chapter  Google Scholar 

  • Toh, Z. (2014). DLIREC: Aspect term extraction and term polarity classification system. In P. Nakov & T. Zesch (Eds.), Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014) (pp. 235–240). Dublin, Ireland: Association for Computational Linguistics.

    Chapter  Google Scholar 

  • Wang, B., Ding, L., Zhong, Q., et al. (2022). A contrastive cross-channel data augmentation framework for aspect-based sentiment analysis. In N. Calzolari, C. R. Huang, H. Kim et al. (Eds.), Proceedings of the 29th International Conference on Computational Linguistics (p. 6691–6704). International Committee on Computational Linguistics, Gyeongju, Republic of Korea. https://aclanthology.org/2022.coling-1.581

  • Wang, Q., Wen, Z., Zhao, Q., et al. (2021). Progressive self-training with discriminator for aspect term extraction. In M. F., Moens, X. Huang, L. Specia et al. (Eds.), Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (p. 257–268). Association for Computational Linguistics, Online and Punta Cana, Dominican Republic. https://doi.org/10.18653/v1/2021.emnlp-main.23

  • Wang, Y., Chen, Z., & Chen, S. (2023). Es-aste: enhanced span-level framework for aspect sentiment triplet extraction. Journal of Intelligent Information Systems, 60(3), 593–612. https://doi.org/10.1007/s10844-023-00783-3

    Article  Google Scholar 

  • Wei, J., & Zou, K. (2019). EDA: Easy data augmentation techniques for boosting performance on text classification tasks. In K. Inui, J. Jiang, V. Ng et al. (Eds.), Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) (pp. 6382–6388). Association for Computational Linguistics, Hong Kong, China. https://doi.org/10.18653/v1/D19-1670

  • Wu, Z., Ying, C., Zhao, F., et al. (2020). Grid tagging scheme for aspect-oriented fine-grained opinion extraction. In T. Cohn, Y. He, & Y. Liu (Eds.), Findings of the Association for Computational Linguistics: EMNLP 2020 (pp. 2576–2585). Association for Computational Linguistics, Online. https://doi.org/10.18653/v1/2020.findings-emnlp.234

  • Xu, L., Li, H., Lu, W., et al. (2020). Position-aware tagging for aspect sentiment triplet extraction. In B. Webber, T. Cohn, Y. He et al. (Eds.), Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) (pp. 2339–2349). Association for Computational Linguistics, Online. https://doi.org/10.18653/v1/2020.emnlp-main.183

  • Xu, L., Chia, Y. K., & Bing, L. (2021). Learning span-level interactions for aspect sentiment triplet extraction. In C. Zong, F. Xia, W. Li et al. (Eds.), Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) (pp. 4755–4766). Association for Computational Linguistics, Online. https://doi.org/10.18653/v1/2021.acl-long.367

  • Yan, H., Dai, J., Ji, T., et al. (2021). A unified generative framework for aspect-based sentiment analysis. In C. Zong, F. Xia, W. Li et al. (Eds.), Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) (pp. 2416–2429). Association for Computational Linguistics, Online. https://doi.org/10.18653/v1/2021.acl-long.188

  • Yu, G., Liu, L., Jiang, H., et al. (2023). Making better use of training corpus: Retrieval-based aspect sentiment triplet extraction via label interpolation. In A. Rogers, J. Boyd-Graber, & N. Okazaki (Eds.), Findings of the Association for Computational Linguistics: ACL 2023 (pp. 4914–4927). Association for Computational Linguistics, Toronto, Canada. https://doi.org/10.18653/v1/2023.findings-acl.303

    Chapter  Google Scholar 

  • Zhang, C., Li, Q., Song, D., et al. (2020). A multi-task learning framework for opinion triplet extraction. In T. Cohn, Y. He, & Y. Liu (Eds.), Findings of the Association for Computational Linguistics: EMNLP 2020 (pp. 819–828). Association for Computational Linguistics, Online. https://doi.org/10.18653/v1/2020.findings-emnlp.72

    Chapter  Google Scholar 

  • Zhang, L., & Liu, B. (2014). Aspect and entity extraction for opinion mining (pp. 1–40). Berlin, Heidelberg: Springer Berlin Heidelberg. https://doi.org/10.1007/978-3-642-40837-3_1

    Book  Google Scholar 

  • Zhang, W., Li, X., Deng, Y., et al. (2021). Towards generative aspect-based sentiment analysis. In C. Zong, F. Xia, W. Li et al. (Eds.), Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) (pp. 504–510). Association for Computational Linguistics, Online. https://doi.org/10.18653/v1/2021.acl-short.64

  • Zhang, Y., Ding, Q., Zhu, Z., et al. (2022). Enhancing aspect and opinion terms semantic relation for aspect sentiment triplet extraction. Journal of Intelligent Information Systems, 59(2), 523–542. https://doi.org/10.1007/s10844-022-00710-y

    Article  Google Scholar 

  • Zhou, S., & Qian, T. (2023). On the strength of sequence labeling and generative models for aspect sentiment triplet extraction. In A. Rogers, J. Boyd-Graber, & N. Okazaki (Eds.), Findings of the Association for Computational Linguistics: ACL 2023 (pp. 12038–12050). Toronto, Canada: Association for Computational Linguistics. https://doi.org/10.18653/v1/2023.findings-acl.762

    Chapter  Google Scholar 

  • Zhu, L., Zhu, X., Guo, J., et al. (2023). Exploring rich structure information for aspect-based sentiment classification. Journal of Intelligent Information Systems, 60(1), 97–117. https://doi.org/10.1007/s10844-022-00729-1

    Article  Google Scholar 

Download references

Funding

This work was supported in part by Hunan Provincial Natural Science Foundation of China under Grant 2023JJ30700, and in part by the Fundamental Research Funds for the Central Universities of Central South University. We are grateful for resources from the High Performance Computing Center of Central South University.

Author information

Authors and Affiliations

  1. School of Computer Science and Engineering, Central South University, Changsha, China

    Shu Liu, Tingting Lu & Kaiwen Li

  2. China Mobile Research Institute, Beijing, China

    Weihua Liu

Authors
  1. Shu Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tingting Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kaiwen Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Weihua Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Conceptualization: Shu Liu; Methodology: Shu Liu, Tingting Lu, Kaiwen Li; Formal analysis and investigation: Tingting Lu, Kaiwen Li; Writing - original draft preparation: Tingting Lu; Writing - review and editing: Shu Liu; Funding acquisition: Shu Liu, Kaiwen Li; Resources: Weihua Liu; Supervision: Weihua Liu.

Corresponding author

Correspondence to Weihua Liu.

Ethics declarations

Ethics approval

Not applicable.

Consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, S., Lu, T., Li, K. et al. Aspect sentiment triplet extraction based on data augmentation and task feedback. J Intell Inf Syst (2024). https://doi.org/10.1007/s10844-024-00855-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10844-024-00855-y

Keywords

Search

Navigation