Abstract
This work present CCD-ASQP, a cross-domain Aspect Sentiment Quadruple prediction(ASQP) dataset in chinese. Based on e-commerce scenario, this dataset lables 15,878 sentiment quadruples out of 3,700 reviews across 6 life domain and 10 product entities. Multiple baselines have been test on CCD-ASQP in terms of ASQP task, and performances have been compared with ChatGPT. Deep learning models’ dramatic decline of accuracy of when shifting to out-of-distribution data shows the lack of domain adaptiveness. ChatGPT achieves relatively consistent cross-domain performance in few-shot setup. Error analysis suggests effect of Chinese language forms on ASQP task. CCD-ASQP leaves great space for sentiment analysis tasks in Chinese language and perspectives from other disciplines are helpful.
The dataset can be obtained from https://github.com/blcunlp/CCD-ASQP.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The “aspect category” and “sentient polarity” items were accurately matched, while the “aspect term” and “opinion” items were fuzzily matched, that is, they are correct as long as they contain key information.
References
Bao, X., Zhongqing, W., Jiang, X., Xiao, R., Li, S.: Aspect-based sentiment analysis with opinion tree generation. In: Raedt, L.D. (ed.) Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI-22, pp. 4044–4050. International Joint Conferences on Artificial Intelligence Organization (2022). https://doi.org/10.24963/ijcai.2022/561. Main Track
Bu, J., et al.: ASAP: a Chinese review dataset towards aspect category sentiment analysis and rating prediction. In: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 2069–2079. Association for Computational Linguistics, Online, June 2021. https://doi.org/10.18653/v1/2021.naacl-main.167. https://aclanthology.org/2021.naacl-main.167
Cai, H., Xia, R., Yu, J.: Aspect-category-opinion-sentiment quadruple extraction with implicit aspects and opinions. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 340–350. Association for Computational Linguistics, Online, August 2021. https://doi.org/10.18653/v1/2021.acl-long.29. https://aclanthology.org/2021.acl-long.29
Chen, X., et al.: Aspect sentiment classification with document-level sentiment preference modeling. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 3667–3677 (2020)
Fan, Z., Wu, Z., Dai, X., Huang, S., Chen, J.: Target-oriented opinion words extraction with target-fused neural sequence labeling. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pp. 2509–2518 (2019)
Hu, M., Liu, B.: Mining and summarizing customer reviews. In: Proceedings of the tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 168–177 (2004)
Jiang, Y.Z., et al.: Genomic and transcriptomic landscape of triple-negative breast cancers: subtypes and treatment strategies. Cancer Cell 35(3), 428–440 (2019)
Liu, B.: Sentiment Analysis and Opinion Mining. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-02145-9
Liu, P., Joty, S., Meng, H.: Fine-grained opinion mining with recurrent neural networks and word embeddings. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp. 1433–1443. Association for Computational Linguistics, Lisbon, Portugal, September 2015. https://doi.org/10.18653/v1/D15-1168. https://aclanthology.org/D15-1168
Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up? Sentiment classification using machine learning techniques. In: Proceedings of the 2002 Conference on Empirical Methods in Natural Language Processing (EMNLP 2002), pp. 79–86. Association for Computational Linguistics, July 2002. https://doi.org/10.3115/1118693.1118704. https://aclanthology.org/W02-1011
Peng, H., Xu, L., Bing, L., Huang, F., Lu, W., Si, L.: Knowing what, how and why: a near complete solution for aspect-based sentiment analysis. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 8600–8607 (2020)
Pontiki, M., et al.: SemEval-2016 task 5: aspect based sentiment analysis. In: Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016), pp. 19–30. Association for Computational Linguistics, San Diego, California, June 2016. https://doi.org/10.18653/v1/S16-1002. https://aclanthology.org/S16-1002
Pontiki, M., Galanis, D., Papageorgiou, H., Manandhar, S., Androutsopoulos, I.: SemEval-2015 task 12: aspect based sentiment analysis. In: Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015), pp. 486–495. Association for Computational Linguistics, Denver, Colorado, June 2015. https://doi.org/10.18653/v1/S15-2082. https://aclanthology.org/S15-2082
Pontiki, M., Galanis, D., Pavlopoulos, J., Papageorgiou, H., Androutsopoulos, I., Manandhar, S.: SemEval-2014 task 4: aspect based sentiment analysis. In: Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), pp. 27–35. Association for Computational Linguistics, Dublin, Ireland, August 2014. https://doi.org/10.3115/v1/S14-2004. https://aclanthology.org/S14-2004
Qiu, G., Liu, B., Bu, J., Chen, C.: Opinion word expansion and target extraction through double propagation. Comput. Linguist. 37(1), 9–27 (2011)
Tuveri, F., Angioni, M.: Sentiment analysis and opinion mining (2012)
Wan, H., Yang, Y., Du, J., Liu, Y., Qi, K., Pan, J.Z.: Target-aspect-sentiment joint detection for aspect-based sentiment analysis. In: AAAI Conference on Artificial Intelligence (2020)
Wang, J., et al.: Aspect sentiment classification towards question-answering with reinforced bidirectional attention network. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 3548–3557. Association for Computational Linguistics, Florence, Italy, July 2019. https://doi.org/10.18653/v1/P19-1345. https://aclanthology.org/P19-1345
Wang, W., Pan, S.J., Dahlmeier, D., Xiao, X.: Recursive neural conditional random fields for aspect-based sentiment analysis. arXiv preprint arXiv:1603.06679 (2016)
Wang, W., Pan, S.J., Dahlmeier, D., Xiao, X.: Coupled multi-layer attentions for co-extraction of aspect and opinion terms. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 31 (2017)
Zhang, W., Deng, Y., Li, X., Yuan, Y., Bing, L., Lam, W.: Aspect sentiment quad prediction as paraphrase generation. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pp. 9209–9219. Association for Computational Linguistics, Online and Punta Cana, Dominican Republic, November 2021. https://doi.org/10.18653/v1/2021.emnlp-main.726. https://aclanthology.org/2021.emnlp-main.726
Zhang, W., Li, X., Deng, Y., Bing, L., Lam, W.: Towards generative aspect-based sentiment analysis. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), pp. 504–510. Association for Computational Linguistics, Online, August 2021. https://doi.org/10.18653/v1/2021.acl-short.64. https://aclanthology.org/2021.acl-short.64
Acknowledgement
This research project is supported by Science Foundation of Beijing Language and Culture University (supported by “the Fundamental Research Funds for the Central Universities”) (23YJ080009).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wang, Y., Zhong, Y., Zhang, X., Niu, C., Yu, D., Liu, P. (2023). CCD-ASQP: A Chinese Cross-Domain Aspect Sentiment Quadruple Prediction Dataset. In: Wang, H., Han, X., Liu, M., Cheng, G., Liu, Y., Zhang, N. (eds) Knowledge Graph and Semantic Computing: Knowledge Graph Empowers Artificial General Intelligence. CCKS 2023. Communications in Computer and Information Science, vol 1923. Springer, Singapore. https://doi.org/10.1007/978-981-99-7224-1_18
Download citation
DOI: https://doi.org/10.1007/978-981-99-7224-1_18
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-7223-4
Online ISBN: 978-981-99-7224-1
eBook Packages: Computer ScienceComputer Science (R0)