Abstract
The substantial volume of user feedback contained in application reviews significantly contributes to the development of human-centred software requirement engineering. The abundance of unstructured text data necessitates an automated analytical framework for decision-making. Language models can automatically extract fine-grained aspect-based sentiment information from application reviews. Existing approaches are constructed based on the general domain corpus, and are challenging to elucidate the internal technique of the recognition process, along with the factors contributing to the analysis results. To fully utilize software engineering domain-specific knowledge and accurately identify aspect-sentiment pairs from application reviews, we design a dependency-enhanced heterogeneous graph neural networks architecture based on the dual-level attention mechanism. The heterogeneous information network with knowledge resources from the software engineering field is embedded into graph convolutional networks to consider the attribute characteristics of different node types. The relationship between aspect terms and sentiment terms in application reviews is determined by adjusting the dual-level attention mechanism. Semantic dependency enhancement is introduced to comprehensively model contextual relationships and analyze sentence structure, thereby distinguishing important contextual information. To our knowledge, this marks initial efforts to leverage software engineering domain knowledge resources to deep neural networks to address fine-grained sentiment analysis issues. The experimental results on multiple public benchmark datasets indicate the effectiveness of the proposed automated framework in aspect-based sentiment analysis tasks for application reviews.
Similar content being viewed by others
Data availability
No datasets were generated or analysed during the current study. https://www.kaggle.com/datasets.
Code availability
Notes
References
Abdou, T., Kamthan, P., Shahmir, N.: Developing a glossary for software projects. In: Advanced Methodologies and Technologies in Network Architecture, Mobile Computing, and Data Analytics, pp. 1358–1372. IGI Global (2019)
Acheampong, F.A., Nunoo-Mensah, H., Chen, W.: Transformer models for text-based emotion detection: a review of BERT-based approaches. Artif. Intell. Rev. 54, 5789–5829 (2021)
Ahmed, T., Bosu, A., Iqbal, A., Rahimi, S.: Senticr: a customized sentiment analysis tool for code review interactions. In: 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE), pp. 106–111 (2017). IEEE
Alami, A., Krancher, O.: How scrum adds value to achieving software quality? Empir. Softw. Eng. 27(7), 165 (2022)
Aldave, A., Vara, J.M., Granada, D., Marcos, E.: Leveraging creativity in requirements elicitation within agile software development: a systematic literature review. J. Syst. Softw. 157, 110396 (2019)
Alturayeif, N., Aljamaan, H., Hassine, J.: An automated approach to aspect-based sentiment analysis of apps reviews using machine and deep learning. Autom. Softw. Eng. 30(2), 30 (2023)
Alzubaidi, L., Zhang, J., Humaidi, A.J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M.A., Al-Amidie, M., Farhan, L.: Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. J. Big Data 8, 1–74 (2021)
Amplayo, R.K., Song, M.: An adaptable fine-grained sentiment analysis for summarization of multiple short online reviews. Data Knowl. Eng. 110, 54–67 (2017)
Arora, D., Gupta, S., Anpalagan, A.: Evolution and adoption of next generation IoT-driven health care 4.0 systems. Wirel. Pers. Commun. 127(4), 3533–3613 (2022)
Birjali, M., Kasri, M., Beni-Hssane, A.: A comprehensive survey on sentiment analysis: approaches, challenges and trends. Knowl. Based Syst. 226, 107134 (2021)
Brauwers, G., Frasincar, F.: A survey on aspect-based sentiment classification. ACM Comput. Surv. 55(4), 1–37 (2022)
Calefato, F., Lanubile, F., Novielli, N.: Emotxt: a toolkit for emotion recognition from text. In: 2017 Seventh International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), pp. 79–80 (2017). IEEE
Calefato, F., Lanubile, F., Maiorano, F., Novielli, N.: Sentiment polarity detection for software development. In: Proceedings of the 40th International Conference on Software Engineering, pp. 128–128 (2018)
Camacho-Otero, J., Boks, C., Pettersen, I.N.: User acceptance and adoption of circular offerings in the fashion sector: insights from user-generated online reviews. J. Clean. Prod. 231, 928–939 (2019)
Carrera-Rivera, A., Larrinaga, F., Lasa, G.: Context-awareness for the design of smart-product service systems: literature review. Comput. Ind. 142, 103730 (2022)
Chazette, L., Schneider, K.: Explainability as a non-functional requirement: challenges and recommendations. Requir. Eng. 25(4), 493–514 (2020)
Chen, X., Xie, H., Li, Z., Cheng, G.: Topic analysis and development in knowledge graph research: a bibliometric review on three decades. Neurocomputing 461, 497–515 (2021)
Chen, O.Y., Bodelet, J.S., Saraiva, R.G., Phan, H., Di, J., Nagels, G., Schwantje, T., Cao, H., Gou, J., Reinen, J.M., et al.: The roles, challenges, and merits of the p value. Patterns 4(12) (a
Chen, Z., Ji, W., Ding, L., Song, B.: Document-level multi-task learning approach based on coreference-aware dynamic heterogeneous graph network for event extraction. Neural Comput. Appl. 36, 303–321 (2023b)
Cortiñas-Lorenzo, K., Lacey, G.: Toward explainable affective computing: a review. IEEE Trans. Neural Netw. Learn. Syst. (2023). https://doi.org/10.1109/TNNLS.2023.3270027
Do, H.H., Prasad, P.W., Maag, A., Alsadoon, A.: Deep learning for aspect-based sentiment analysis: a comparative review. Expert Syst. Appl. 118, 272–299 (2019)
Dridi, A., Atzeni, M., Reforgiato Recupero, D.: Finenews: fine-grained semantic sentiment analysis on financial microblogs and news. Int. J. Mach. Learn. Cybern. 10, 2199–2207 (2019)
Gao, C., Zheng, Y., Li, N., Li, Y., Qin, Y., Piao, J., Quan, Y., Chang, J., Jin, D., He, X., et al.: A survey of graph neural networks for recommender systems: challenges, methods, and directions. ACM Trans. Recomm. Syst. 1(1), 1–51 (2023)
Gong, J., Wang, S., Wang, J., Feng, W., Peng, H., Tang, J., Yu, P.S.: Attentional graph convolutional networks for knowledge concept recommendation in moocs in a heterogeneous view. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 79–88 (2020)
Gunathilaka, S., De Silva, N.: Aspect-based sentiment analysis on mobile application reviews. In: 2022 22nd International Conference on Advances in ICT for Emerging Regions (ICTer), pp. 183–188 (2022). IEEE
Hadi, M.A., Fard, F.H.: Evaluating pre-trained models for user feedback analysis in software engineering: a study on classification of app-reviews. Empir. Softw. Eng. 28(4), 88 (2023)
Hossain, A., Bishal, M., Hossain, E., Sharif, O., Hoque, M.M.: Combatant@ tamilnlp-acl2022: fine-grained categorization of abusive comments using logistic regression. In: Proceedings of the Second Workshop on Speech and Language Technologies for Dravidian Languages, pp. 221–228 (2022)
Hu, L., Liu, Z., Zhao, Z., Hou, L., Nie, L., Li, J.: A survey of knowledge enhanced pre-trained language models. IEEE Trans. Knowl. Data Eng. 36, 1413–1430 (2023)
Imran, M., Yin, H., Chen, T., Huang, Z., Zheng, K.: Dehin: a decentralized framework for embedding large-scale heterogeneous information networks. IEEE Trans. Knowl. Data Eng. 35(4), 3645–3657 (2022)
Iqbal, S., Qureshi, A.N., Li, J., Mahmood, T.: On the analyses of medical images using traditional machine learning techniques and convolutional neural networks. Arch. Comput. Methods Eng. 30(5), 3173–3233 (2023)
Islam, M.R., Zibran, M.F.: Deva: sensing emotions in the valence arousal space in software engineering text. In: Proceedings of the 33rd Annual ACM Symposium on Applied Computing, pp. 1536–1543 (2018a)
Islam, M.R., Zibran, M.F.: Sentistrength-se: exploiting domain specificity for improved sentiment analysis in software engineering text. J. Syst. Softw. 145, 125–146 (2018b)
Jeong, J., Kim, N.: Does sentiment help requirement engineering: exploring sentiments in user comments to discover informative comments. Autom. Softw. Eng. 28(2), 18 (2021)
Klotins, E., Gorschek, T., Sundelin, K., Falk, E.: Towards cost-benefit evaluation for continuous software engineering activities. Empir. Softw. Eng. 27(6), 157 (2022)
Kolthoff, K., Bartelt, C., Ponzetto, S.P.: Data-driven prototyping via natural-language-based GUI retrieval. Autom. Softw. Eng. 30(1), 13 (2023)
Laplante, P.A., Kassab, M.: What Every Engineer Should Know About Software Engineering. CRC Press, Boca Raton (2022)
Lenoir, W.F., Morgado, M., DeWeirdt, P.C., McLaughlin, M., Griffith, A.L., Sangree, A.K., Feeley, M.N., Esmaeili Anvar, N., Kim, E., Bertolet, L.L., et al.: Discovery of putative tumor suppressors from CRISPR screens reveals rewired lipid metabolism in acute myeloid leukemia cells. Nat. Commun. 12(1), 6506 (2021)
Li, B., Pi, D.: Network representation learning: a systematic literature review. Neural Comput. Appl. 32(21), 16647–16679 (2020)
Li, B., Li, Z., Yang, Y.: Residual attention graph convolutional network for web services classification. Neurocomputing 440, 45–57 (2021)
Li, J., Zhao, Y., Jin, Z., Li, G., Shen, T., Tao, Z., Tao, C.: Sk2: integrating implicit sentiment knowledge and explicit syntax knowledge for aspect-based sentiment analysis. In: Proceedings of the 31st ACM International Conference on Information & Knowledge Management, pp. 1114–1123 (2022)
Li, N., Ma, L., Yu, G., Xue, B., Zhang, M., Jin, Y.: Survey on evolutionary deep learning: principles, algorithms, applications, and open issues. ACM Comput. Surv. 56(2), 1–34 (2023)
Ligthart, A., Catal, C., Tekinerdogan, B.: Systematic reviews in sentiment analysis: a tertiary study. Artif. Intell. Rev. 54, 4997–5053 (2021)
Liu, H., Chatterjee, I., Zhou, M., Lu, X.S., Abusorrah, A.: Aspect-based sentiment analysis: a survey of deep learning methods. IEEE Trans. Comput. Soc. Syst. 7(6), 1358–1375 (2020)
Manning, C.D., Surdeanu, M., Bauer, J., Finkel, J.R., Bethard, S., McClosky, D.: The Stanford Corenlp natural language processing toolkit. In: Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pp. 55–60 (2014)
Martínez-Plumed, F., Contreras-Ochando, L., Ferri, C., Hernández-Orallo, J., Kull, M., Lachiche, N., Ramírez-Quintana, M.J., Flach, P.: Crisp-dm twenty years later: from data mining processes to data science trajectories. IEEE Trans. Knowl. Data Eng. 33(8), 3048–3061 (2019)
Mewada, A., Dewang, R.K.: SA-ASBA: a hybrid model for aspect-based sentiment analysis using synthetic attention in pre-trained language BERT model with extreme gradient boosting. J. Supercomput. 79(5), 5516–5551 (2023)
Min, B., Ross, H., Sulem, E., Veyseh, A.P.B., Nguyen, T.H., Sainz, O., Agirre, E., Heintz, I., Roth, D.: Recent advances in natural language processing via large pre-trained language models: a survey. ACM Comput. Surv. 56(2), 1–40 (2023)
Mökander, J., Morley, J., Taddeo, M., Floridi, L.: Ethics-based auditing of automated decision-making systems: nature, scope, and limitations. Sci. Eng. Ethics 27(4), 44 (2021)
Motger, Q., Franch, X., Marco, J.: Software-based dialogue systems: survey, taxonomy, and challenges. ACM Comput. Surv. 55(5), 1–42 (2022)
Obaidi, M., Nagel, L., Specht, A., Klünder, J.: Sentiment analysis tools in software engineering: a systematic mapping study. Inf. Softw. Technol. 151, 107018 (2022)
Obie, H.O., Du, H., Madampe, K., Shahin, M., Ilekura, I., Grundy, J., Li, L., Whittle, J., Turhan, B., Khalajzadeh, H.: Automated detection, categorisation and developers’ experience with the violations of honesty in mobile apps. Empir. Softw. Eng. 28(6), 1–52 (2023)
Peeters, M.M., Diggelen, J., Van Den Bosch, K., Bronkhorst, A., Neerincx, M.A., Schraagen, J.M., Raaijmakers, S.: Hybrid collective intelligence in a human–AI society. AI Soc. 36, 217–238 (2021)
Pinto, C., Syrivelis, D., Gazzetti, M., Koutsovasilis, P., Reale, A., Katrinis, K., Hofstee, H.P.: Thymesisflow: a software-defined, hw/sw co-designed interconnect stack for rack-scale memory disaggregation. In: 2020 53rd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO), pp. 868–880. IEEE (2020)
Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., Sutskever, I.: Language models are unsupervised multitask learners (2019)
Reinhartz-Berger, I., Kemelman, M.: Extracting core requirements for software product lines. Requir. Eng. 25, 47–65 (2020)
Ren, F., Feng, L., Xiao, D., Cai, M., Cheng, S.: Dnet: a lightweight and efficient model for aspect based sentiment analysis. Expert Syst. Appl. 151, 113393 (2020a)
Ren, K., Zheng, T., Qin, Z., Liu, X.: Adversarial attacks and defenses in deep learning. Engineering 6(3), 346–360 (2020b)
Roy, S., Sridharan, S., Jain, S., Raghunathan, A.: Txsim: modeling training of deep neural networks on resistive crossbar systems. IEEE Trans. Very Large Scale Integr. VLSI Syst. 29(4), 730–738 (2021)
Saidani, I., Ouni, A., Mkaouer, M.W.: Improving the prediction of continuous integration build failures using deep learning. Autom. Softw. Eng. 29(1), 21 (2022)
Sapoval, N., Aghazadeh, A., Nute, M.G., Antunes, D.A., Balaji, A., Baraniuk, R., Barberan, C., Dannenfelser, R., Dun, C., Edrisi, M., et al.: Current progress and open challenges for applying deep learning across the biosciences. Nat. Commun. 13(1), 1728 (2022)
Sarker, I.H., Furhad, M.H., Nowrozy, R.: AI-driven cybersecurity: an overview, security intelligence modeling and research directions. SN Comput. Sci. 2, 1–18 (2021)
Shuang, K., Yang, Q., Loo, J., Li, R., Gu, M.: Feature distillation network for aspect-based sentiment analysis. Inf. Fusion 61, 13–23 (2020)
Sivakumar, M., Reddy, U.S.: Aspect based sentiment analysis of students opinion using machine learning techniques. In: 2017 International Conference on Inventive Computing and Informatics (ICICI), pp. 726–731 (2017). IEEE
Snoeck, M., Wautelet, Y.: Agile MERODE: a model-driven software engineering method for user-centric and value-based development. Softw. Syst. Model. 21(4), 1469–1494 (2022)
Suyuti, I., et al.: Fine-grained sentiment analysis on pedulilindungi application users with multinomial Naive Bayes-smote. In: 2022 9th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI), pp. 374–378 (2022). IEEE
Tang, F., Fu, L., Yao, B., Xu, W.: Aspect based fine-grained sentiment analysis for online reviews. Inf. Sci. 488, 190–204 (2019)
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al.: Llama: open and efficient foundation language models (2023). arXiv preprint arXiv:2302.13971
Truşcǎ, M.M., Frasincar, F.: Survey on aspect detection for aspect-based sentiment analysis. Artif. Intell. Rev. 56(5), 3797–3846 (2023)
Usuga-Cadavid, J.P., Lamouri, S., Grabot, B., Fortin, A.: Using deep learning to value free-form text data for predictive maintenance. Int. J. Prod. Res. 60(14), 4548–4575 (2022)
Veling, L., McGinn, C.: Qualitative research in HRI: a review and taxonomy. Int. J. Soc. Robot. 13, 1689–1709 (2021)
Voelter, M., Ratiu, D., Kolb, B., Schaetz, B.: mbeddr: instantiating a language workbench in the embedded software domain. Autom. Softw. Eng. 20, 339–390 (2013)
Wahyudi, D., Sibaroni, Y.: Deep learning for multi-aspect sentiment analysis of tiktok app using the RNN-LSTM method. Build. Inform. Technol. Sci. 4(1), 169–177 (2022)
Wan, Z., Xia, X., Lo, D., Murphy, G.C.: How does machine learning change software development practices? IEEE Trans. Softw. Eng. 47(9), 1857–1871 (2019)
Wan, H., Yang, Y., Du, J., Liu, Y., Qi, K., Pan, J.Z.: Target-aspect-sentiment joint detection for aspect-based sentiment analysis. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 9122–9129 (2020)
Wang, S., Zhang, G., Cao, J.: Aspect-based sentiment analysis with multi-aspects heterogeneous graph convolutional networks. In: Proceedings of the 2021 5th International Conference on Electronic Information Technology and Computer Engineering, pp. 915–920 (2021a)
Wang, X., Chai, Y., Li, H., Wu, D.: Link prediction in heterogeneous information networks: an improved deep graph convolution approach. Decis. Support Syst. 141, 113448 (2021b)
Wang, H., Li, J., Wu, H., Hovy, E., Sun, Y.: Pre-trained language models and their applications. Engineering 25, 51–65 (2022a)
Wang, J., Lan, C., Liu, C., Ouyang, Y., Qin, T., Lu, W., Chen, Y., Zeng, W., Yu, P.: Generalizing to unseen domains: a survey on domain generalization. IEEE Trans. Knowl. Data Eng. 35, 8052–8072 (2022b)
Wankhade, M., Rao, A.C.S., Kulkarni, C.: A survey on sentiment analysis methods, applications, and challenges. Artif. Intell. Rev. 55(7), 5731–5780 (2022)
Wu, Z., Gao, J., Li, Q., Guan, Z., Chen, Z.: Make aspect-based sentiment classification go further: step into the long-document-level. App. Intell. (2021). https://doi.org/10.1007/s10489-021-02836-y
Yadav, A., Vishwakarma, D.K.: Sentiment analysis using deep learning architectures: a review. Artif. Intell. Rev. 53(6), 4335–4385 (2020)
Yang, T., Gao, C., Zang, J., Lo, D., Lyu, M.: Tour: dynamic topic and sentiment analysis of user reviews for assisting app release. In: Companion Proceedings of the Web Conference 2021, pp. 708–712 (2021a)
Yang, G., Zhou, Y., Yu, C., Chen, X.: Deepscc: source code classification based on fine-tuned Roberta (2021b). arXiv preprint arXiv:2110.00914
Yang, H., Zeng, B., Yang, J., Song, Y., Xu, R.: A multi-task learning model for Chinese-oriented aspect polarity classification and aspect term extraction. Neurocomputing 419, 344–356 (2021c)
Yang, Y., Guan, Z., Li, J., Zhao, W., Cui, J., Wang, Q.: Interpretable and efficient heterogeneous graph convolutional network. IEEE Trans. Knowl. Data Eng. 35, 1637–1650 (2021d)
Yang, C., Xu, B., Khan, J.Y., Uddin, G., Han, D., Yang, Z., Lo, D.: Aspect-based API review classification: How far can pre-trained transformer model go? In: 2022 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER), pp. 385–395. IEEE (2022)
Yang, H., Zhang, C., Li, K.: Pyabsa: A modularized framework for reproducible aspect-based sentiment analysis. In: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, pp. 5117–5122 (2023)
Zeng, Y., Li, Z., Tang, Z., Chen, Z., Ma, H.: Heterogeneous graph convolution based on in-domain self-supervision for multimodal sentiment analysis. Expert Syst. Appl. 213, 119240 (2023)
Zhang, Z., Hu, C., Pan, H., Wang, Y., Xu, Y.: Aspect-dependent heterogeneous graph convolutional network for aspect-level sentiment analysis. In: 2022 International Joint Conference on Neural Networks (IJCNN), pp. 1–8 (2022). IEEE
Zhang, T., Xu, B., Thung, F., Haryono, S.A., Lo, D., Jiang, L.: Sentiment analysis for software engineering: How far can pre-trained transformer models go? In: 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME), pp. 70–80. IEEE (2020)
Zhang, Y., Du, J., Ma, X., Wen, H., Fortino, G.: Aspect-based sentiment analysis for user reviews. Cogn. Comput. 13(5), 1114–1127 (2021)
Zhao, G., Luo, Y., Chen, Q., Qian, X.: Aspect-based sentiment analysis via multitask learning for online reviews. Knowl. Based Syst. 264, 110326 (2023a)
Zhao, Y., Zhang, L., Zeng, C., Lu, W., Chen, Y., Fan, T.: Construction of an aspect-level sentiment analysis model for online medical reviews. Inf. Process. Manag. 60(6), 103513 (2023b)
Zheng, L., Chiang, W.-L., Sheng, Y., Zhuang, S., Wu, Z., Zhuang, Y., Lin, Z., Li, Z., Li, D., Xing, E., et al.: Judging llm-as-a-judge with mt-bench and chatbot arena (2023). arXiv preprint arXiv:2306.05685
Zorzetti, M., Signoretti, I., Salerno, L., Marczak, S., Bastos, R.: Improving agile software development using user-centered design and lean startup. Inf. Softw. Technol. 141, 106718 (2022)
Zou, W., Lo, D., Kochhar, P.S., Le, X.-B.D., Xia, X., Feng, Y., Chen, Z., Xu, B.: Smart contract development: challenges and opportunities. IEEE Trans. Softw. Eng. 47(10), 2084–2106 (2019)
Acknowledgements
The authors would like to thank the anonymous reviewers for their valuable comments. This article has been supported by the National Natural Science Foundation of China (61941113), Science and Technology on Information System Engineering Laboratory (No. 05202104). Jiangsu Province Key R&D Program (Modern Agriculture) Key Project (BE2023352), Key Medical Research Projects of Jiangsu Provincial Health Commission (ZD2022068).
Funding
This article has been supported by the National Natural Science Foundation of China (61941113), Science and Technology on Information System Engineering Laboratory (No: 05202104).
Author information
Authors and Affiliations
Contributions
Conceptualization, HZ and YW; methodology, YW; software, HZ; validation, YW; formal analysis, HZ; investigation, HZ; resources, YW; data curation, HZ; writing-original draft preparation, HZ; writing-review and editing, HZ; visualization, HZ; project administration, YW. All authors have read and agreed to the published version of the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no Conflict of interest.
Ethical approval
Not applicable.
Consent to participate
Not applicable.
Consent for publication
We would like to confirm that this work is original and has not been published elsewhere, nor is it currently under consideration for publication elsewhere. All the authors give their consent to publish the manuscript.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Zou, H., Wang, Y. A novel automated framework for fine-grained sentiment analysis of application reviews using deep neural networks. Autom Softw Eng 31, 43 (2024). https://doi.org/10.1007/s10515-024-00444-x
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10515-024-00444-x