Skip to main content
Log in

Enhanced V-Net approach for the emotion recognition and sentiment analysis in the healthcare data

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Emotion plays a vital part in the life of humankind. Emotion Recognition (ER) is the necessary task to find one's inner Emotion through speech, text or face. ER process has inevitable places in applications such as education, healthcare, defence, forensics, automation and scientific-based purposes. However, the recognition models face various issues during the process. Due to the large feature sets, the model's computational time and complexity have been increased; it also produced high errors in recognition, which degrades the efficiency of the system. So, a novel Monkey-based V-Net Framework (MbVF) was developed for this research work to classify the Emotion and sentiment patterns using healthcare data. Initially, the healthcare Artificial Intelligence (AI) conversation data from the Coronavirus Tweets NLP-Text Classification dataset was collected and trained for the system. Next, stemming, stop-words removal, tokenization, and noise feature elimination process were performed in the preprocessing step. Then, the Term Frequency based-Inverse Document Frequency (TF-IDF) features were used to choose the best features depending on the fitness features of the proposed MbVF approach. Finally, the ER process was performed to recognize the emotions, such as positive, neutral and negative, using sentiment analysis with the emotion state transition and emotion pattern. The model attained 99.98% accuracy in predicting emotions, and is higher than the other model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Algorithm 1
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

Data sharing not applicable to this article as no datasets were generated or analyzed during the current study.

References

  1. Goyal R, Kumar P, Singh VP (2023) A Systematic survey on automated text generation tools and techniques: application, evaluation, and challenges. Multimed Tools Appl. https://doi.org/10.1007/s11042-023-15224-0

  2. Ajagbe SA, Adigun MO (2023) Deep learning techniques for detection and prediction of pandemic diseases: a systematic literature review. Multimed Tools Appl. https://doi.org/10.1007/s11042-023-15805-z

  3. Radanliev P, De Roure D (2023) New and emerging forms of data and technologies: literature and bibliometric review. Multimed Tools Appl 82:2887–2911. https://doi.org/10.1007/s11042-022-13451-5

    Article  Google Scholar 

  4. Javaid M, Haleem A, Singh RP (2023) ChatGPT for healthcare services: an emerging stage for an innovative perspective. Bench council transactions on Benchmarks, standards and evaluations 3(1):100105. https://doi.org/10.1016/j.tbench.2023.100105

  5. Dowlagar S, Mamidi R (2023) A code-mixed task-oriented dialog dataset for medical domain. Comput Speech Lang 78:101449. https://doi.org/10.1016/j.csl.2022.101449

    Article  Google Scholar 

  6. Saka AB, Oyedele LO, Akanbi LA, Ganiyu SA, Chan DW, Bello SA (2023) Conversational artificial intelligence in the AEC industry: a review of present status, challenges and opportunities. Adv Eng Inform 55:101869. https://doi.org/10.1016/j.aei.2022.101869

  7. Ivanovic M, Badica C, Badica A (2022) Role of intelligent virtual agents in medical and health domains. In: 2022 International Conference on INnovations in Intelligent SysTems and Applications (INISTA). IEEE, pp 1–6. https://doi.org/10.1109/INISTA55318.2022.9894253

    Chapter  Google Scholar 

  8. Huq SM, Maskeliūnas R, Damaševičius R (2022) Dialogue agents for artificial intelligence-based conversational systems for cognitively disabled: a systematic review. Disabil Rehabil Assist Technol 1-20. https://doi.org/10.1080/17483107.2022.2146768

  9. Imran AS, Daudpota SM, Kastrati Z, Batra R (2020) Cross-cultural polarity and Emotion detection using sentiment analysis and deep learning on COVID-19 related tweets. IEEE Access 8:181074–181090. https://doi.org/10.1109/ACCESS.2020.3027350

    Article  Google Scholar 

  10. Woo WL, Gao B, Al-Nima RRO, Ling WK (2020) Development of conversational artificial intelligence for pandemic healthcare query support. Int J Auto AI Mach Learn 1(1):54–79

    Article  Google Scholar 

  11. Denecke K, Abd-Alrazaq A, Househ M (2021) Artificial intelligence for chatbots in mental health: Opportunities and challenges. In: Multiple perspectives on artificial intelligence in healthcare: Opportunities and challenges, pp 115–128. https://doi.org/10.1007/978-3-030-67303-1_10

    Chapter  Google Scholar 

  12. Meshram S, Naik N, Megha VR, More T, Kharche S (2021) Conversational AI: Chatbots. In: 2021 international conference on intelligent technologies (CONIT). IEEE, pp 1–6. https://doi.org/10.1109/CONIT51480.2021.9498508

    Chapter  Google Scholar 

  13. Rozenes S, Cohen Y (2022) Artificial intelligence synergetic opportunities in services: conversational systems perspective. Appl Sci 12(16):8363. https://doi.org/10.3390/app12168363

    Article  Google Scholar 

  14. Allouch M, Azaria A, Azoulay R (2021) Conversational agents: goals, technologies, vision and challenges. Sensors 21(24):8448. https://doi.org/10.3390/s21248448

    Article  Google Scholar 

  15. Callejas Z, Griol D (2021) Conversational agents for mental health and wellbeing. Dialog systems: a perspective from language, logic and computation. 219–244. https://doi.org/10.1007/978-3-030-61438-6_11

  16. Abdullah M, Madain A, Jararweh Y (2022) ChatGPT: fundamentals, applications and social impacts. In: 2022 Ninth International Conference on Social Networks Analysis, Management and Security (SNAMS). IEEE, pp 1–8. https://doi.org/10.1109/SNAMS58071.2022.10062688

  17. Sachdev JS, Kamath A, Bhatnagar N, Bhatnagar R, Rawal A, Darwish A, Hassenian AE (2021) SAKHA: an artificial intelligence enabled VisualBOT for health and mental wellbeing during COVID'19 pandemic. In: Digital transformation and emerging technologies for fighting COVID-19 pandemic: innovative approaches, pp 95–110. https://doi.org/10.1007/978-3-030-63307-3_6

    Chapter  Google Scholar 

  18. Dinan E, Abercrombie G, Bergman AS, Spruit S, Hovy D, Boureau YL, Rieser V (2021) Anticipating safety issues in E2E conversational AI: framework and tooling. arXiv preprint arXiv:2107.03451. https://doi.org/10.48550/arXiv.2107.03451

  19. Zygadło A, Kozłowski M, Janicki A (2021) Text-based emotion recognition in English and polish for therapeutic chatbot. Appl Sci 11(21):10146. https://doi.org/10.3390/app112110146

    Article  Google Scholar 

  20. Saravanan A, Tsfasman M, Neerincx MA, Oertel C (2022) Giving social robots a conversational memory for motivational experience sharing. In: 2022 31st IEEE international conference on robot and human interactive communication (RO-MAN). IEEE, pp 985–992. https://doi.org/10.1109/RO-MAN53752.2022.9900677

    Chapter  Google Scholar 

  21. Bharti U, Bajaj D, Batra H, Lalit S, Lalit S, Gangwani A (2020) Medbot: Conversational artificial intelligence-powered chatbot for telehealth after covid-19. In: 2020 5th international conference on communication and electronics systems (ICCES). IEEE, pp 870–875. https://doi.org/10.1109/ICCES48766.2020.9137944

    Chapter  Google Scholar 

  22. Jovanović M, Baez M, Casati F (2020) Chatbots as conversational healthcare services. IEEE Internet Comput 25(3):44–51. https://doi.org/10.1109/MIC.2020.3037151

    Article  Google Scholar 

  23. Horn M, Li X, Chen L, Kafle S (2021) A multi-talent healthcare AI bot platform. In: Explainable AI in healthcare and medicine: building a culture of transparency and accountability, pp 171–177. https://doi.org/10.1007/978-3-030-53352-6_15

    Chapter  Google Scholar 

  24. Kandpal P, Jasnani K, Raut R, Bhorge S (2020) Contextual Chatbot for healthcare purposes (using deep learning). In: 2020 fourth world conference on smart trends in systems, security and sustainability (WorldS4). IEEE, pp 625–634. https://doi.org/10.1109/WorldS450073.2020.9210351

    Chapter  Google Scholar 

  25. Ali O, Abdelbaki W, Shrestha A, Elbasi E, Alryalat MA, Dwivedi YK (2023) A systematic literature review of artificial intelligence in the healthcare sector: benefits, challenges, methodologies, and functionalities. J Innov Knowl 8(1):100333. https://doi.org/10.1016/j.jik.2023.100333

  26. Chowdary MK, Nguyen TN, Hemanth DJ (2021) Deep learning-based facial emotion recognition for human–computer interaction applications. Neural Comput Appl 1–8. https://doi.org/10.1007/s00521-021-06012-8

  27. Sajjad M, Kwon S (2020) Clustering-based speech emotion recognition by incorporating learned features and deep BiLSTM. IEEE Access 8:79861–79875. https://doi.org/10.1109/ACCESS.2020.2990405

    Article  Google Scholar 

  28. Tuncer T, Dogan S, Acharya UR (2021) Automated accurate speech emotion recognition system using twine shuffle pattern and iterative neighborhood component analysis techniques. Knowl Based Syst 211:106547. https://doi.org/10.1016/j.knosys.2020.106547

    Article  Google Scholar 

  29. Kumaran U, Radha Rammohan S, Nagarajan SM, Prathik A (2021) Fusion of mel and gammatone frequency cepstral coefficients for speech emotion recognition using deep C-RNN. Int J Speech Technol 24:303–314. https://doi.org/10.1007/s10772-020-09792-x

    Article  Google Scholar 

  30. Sharma H, Hazrati G, Bansal JC (2019) Spider monkey optimization algorithm. Evol Swarm Intell Algorithm 43–59. https://doi.org/10.1007/978-3-319-91341-4_4

  31. Devaram S (2020) Empathic chatbot: emotional intelligence for empathic chatbot: emotional intelligence for mental health wellbeing. arXiv preprint arXiv:2012.09130. https://doi.org/10.48550/arXiv.2012.09130

  32. Dhanasekar V, Preethi Y, Vishali S, IR PJ (2021) A chatbot to promote students mental health through emotion recognition. In: 2021 Third International Conference on Inventive Research in Computing Applications (ICIRCA). IEEE, pp 1412–1416. https://doi.org/10.1109/ICIRCA51532.2021.9544838

  33. Movahedi Z, Bastanfard A (2021) Toward competitive multi-agents in Polo game based on reinforcement learning. Multimed Tools Appl 80:26773–26793. https://doi.org/10.1007/s11042-021-10968-z

    Article  Google Scholar 

  34. Savargiv M, Bastanfard A (2013) Text material design for fuzzy emotional speech corpus based on Persian semantic and structure. In: 2013 International conference on fuzzy theory and its applications (iFUZZY). IEEE, pp 380–384. https://doi.org/10.1109/iFuzzy.2013.6825469

    Chapter  Google Scholar 

Download references

Funding

This research received no specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mily Lal.

Ethics declarations

Ethical approval

All applicable institutional and/or national guidelines for the care and use of animals were followed.

Informed consent

For this type of analysis formal consent is not needed.

Conflict of interest

The authors declare that they have no potential conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 19 KB)

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lal, M., Neduncheliyan, S. Enhanced V-Net approach for the emotion recognition and sentiment analysis in the healthcare data. Multimed Tools Appl 83, 72765–72787 (2024). https://doi.org/10.1007/s11042-024-18364-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-024-18364-z

Keywords

Navigation