Skip to main content
SpringerLink
Log in

Personality-driven experience storage and retrieval for sentiment classification

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

The existing methods for sentiment classification normally ignore that the past experiences retrieved by users under particular situations would affect their sentiment expressions. Furthermore, related research may underutilize user personality to personalize the analysis of storage and retrieval of past experiences. Inspired by the cognition process of human memory, we propose a Personality-Driven Experience Storage and Retrieval (PDESR) model for sentiment classification. Concretely, we first selectively store the user’s past experiences in her/his experience bank via personalized input and forget gates. We then adopt personalized output gate to retrieve past experiences from the experience bank. Finally, we integrate the current experience with the retrieved past experiences to classify user sentiment. Specifically, personality is used to personalize the control of which past experiences should be stored in experience bank and which past experiences should be retrieved from experience bank. The experimental results show that PDESR model outperforms the related models in accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Algorithm 1
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Data availability

The datasets generated and/or analyzed during the current study are available from the corresponding author upon reasonable request.

Notes

  1. https://github.com/jiyu0201/PDESR.

  2. www.yelp.com/dataset.

References

  1. Pang B, Lee L et al (2008) Opinion mining and sentiment analysis. Found Trends Inf Retr 2(1–2):1–135

    Article  Google Scholar 

  2. Choudhary C, Singh I, Kumar M (2023) SARWAS: Deep ensemble learning techniques for sentiment based recommendation system. Expert Syst Appl 216:119420

    Article  Google Scholar 

  3. Vedavathi N, Kum AK (2023) E-learning course recommendation based on sentiment analysis using hybrid Elman similarity. Knowl Based Syst 259:110086

    Article  Google Scholar 

  4. Zhan Z, Xu B (2023) Analyzing review sentiments and product images by parallel deep nets for personalized recommendation. Inf Process Manage 60(1):103166

    Article  Google Scholar 

  5. Fu Y, Li X, Li Y, Wang S, Li D, Liao J, Zheng J (2022) Incorporate opinion-towards for stance detection. Knowl. Based Syst. 246:108657

    Article  Google Scholar 

  6. Pang B, Lee L (2005) Seeing stars: exploiting class relationships for sentiment categorization with respect to rating scales. In: ACL, pp 115–124

  7. Pang B, Lee L, Vaithyanathan S (2002) Thumbs up? sentiment classification using machine learning techniques. In: EMNLP, vol 10. pp 79–86

  8. Sadr H (2022) ACNN-TL: attention-based convolutional neural network coupling with transfer learning and contextualized word representation for enhancing the performance of sentiment classification. Supercomputing 78(7):10149–10175

    Article  Google Scholar 

  9. Kong J, Wang J, Zhang X (2022) Hierarchical BERT with an adaptive fine-tuning strategy for document classification. Knowl Based Syst 238:107872

    Article  Google Scholar 

  10. Zhu X, Peng Z, Guo J, Dietze S (2023) Generating effective label description for label-aware sentiment classification. Expert Syst Appl 213:119194

    Article  Google Scholar 

  11. Qorich M, El-Ouazzani R (2023) Text sentiment classification of amazon reviews using word embeddings and convolutional neural networks. J Supercomput 79:11029–11054

    Article  Google Scholar 

  12. Chen H, Sun M, Tu C, Lin Y, Liu Z (2016) Neural sentiment classification with user and product attention. In: EMNLP, pp 1650–1659

  13. Ji Y, Wu W, Chen S, Chen Q, Hu W, He L (2020) Two-stage sentiment classification based on user-product interactive information. Knowl Based Syst 203:106091

    Article  Google Scholar 

  14. Jia X, Wu Q, Gao X, Chen G (2020) Sentimem: attentive memory networks for sentiment classification in user review. In: DASFAA, pp 736–751

  15. Speer ME, Bhanji JP, Delgado MR (2014) Savoring the past: positive memories evoke value representations in the striatum. Neuron 84(4):847–856

    Article  Google Scholar 

  16. Chen C, Takahashi T, Yang S (2015) Remembrance of happy things past: positive autobiographical memories are intrinsically rewarding and valuable, but not in depression. Front Psychol 6:222–222

    Article  Google Scholar 

  17. Haas BW, Canli T (2008) Emotional memory function, personality structure and psychopathology: a neural system approach to the identification of vulnerability markers. Brain Res Rev 58(1):71–84

    Article  Google Scholar 

  18. Mayo PR (1983) Personality traits and the retrieval of positive and negative memories. Pers. Individ. Differ. 4(5):465–471

    Article  Google Scholar 

  19. Goldstein EB (2014) Cognitive psychology: connecting mind, research and everyday experience

  20. Wiebe J, Riloff E (2005) Creating subjective and objective sentence classifiers from unannotated texts. In: CICLing, pp 486–497

  21. Qu L, Ifrim G, Weikum G (2010) The bag-of-opinions method for review rating prediction from sparse text patterns. In: COLING, pp 913–921

  22. Kiritchenko S, Zhu X, Mohammad SM (2014) Sentiment analysis of short informal texts. J Artif Intell Res 50:723–762

    Article  Google Scholar 

  23. Ding X, Liu B, Yu PS (2008) A holistic lexicon-based approach to opinion mining. In: WSDM, pp 231–240

  24. Nawangsari RP, Kusumaningrum R, Wibowo A (2019) Word2vec for Indonesian sentiment analysis towards hotel reviews: an evaluation study. Proc Comput Sci 157:360–366

    Article  Google Scholar 

  25. Elman JL (1990) Finding structure in time. Cognit Sci 14(2):179–211

    Article  Google Scholar 

  26. Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780

    Article  Google Scholar 

  27. Arbane M, Benlamri R, Brik Y, Alahmar AD (2023) Social media-based COVID-19 sentiment classification model using Bi-LSTM. Expert Syst Appl 212:118710

    Article  Google Scholar 

  28. Tai KS, Socher R, Manning CD (2015) Improved semantic representations from tree-structured long short-term memory networks. In: ACL/IJCNLP, vol 1, pp 1556–1566

  29. Xu J, Chen D, Qiu X, Huang X (2016) Cached long short-term memory neural networks for document-level sentiment classification. In: EMNLP, pp 1660–1669

  30. Bahdanau D, Cho KH, Bengio Y (2015) Neural machine translation by jointly learning to align and translate. In: ICLR

  31. Hu Q, Zhou J, Chen Q, He L (2018) SNNN: Promoting word sentiment and negation in neural sentiment classification. In: AAAI, pp 3255–3262

  32. Zhang Y, Wang J, Zhang X (2021) Learning sentiment sentence representation with multiview attention model. Inf Sci 571:459–474

    Article  MathSciNet  Google Scholar 

  33. Liu Y, Ott M, Goyal N, Du J, Joshi M, Chen D, Levy O, Lewis M, Zettlemoyer L, Stoyanov V (2019) Roberta: a robustly optimized BERT pretraining approach. arXiv:1907.11692

  34. Brown T, Mann B, Ryder N, Subbiah M, Kaplan JD, Dhariwal P, Neelakantan A, Shyam P, Sastry G, Askell A et al (2020) Language models are few-shot learners. Adv Neural Inf Process Syst 33:1877–1901

    Google Scholar 

  35. Munikar M, Shakya S, Shrestha A (2019) Fine-grained sentiment classification using BERT. In: AITB, vol 1, pp 1–5

  36. Wu Z, Dai X-Y, Yin C, Huang S, Chen J (2018) Improving review representations with user attention and product attention for sentiment classification. In: AAAI, vol 32

  37. Tang D, Qin B, Liu T (2015) Learning semantic representations of users and products for document level sentiment classification. In: ACL/IJCNLP, vol 1, pp 1014–1023

  38. Gao W, Yoshinaga N, Kaji N, Kitsuregawa M (2013) Modeling user leniency and product popularity for sentiment classification. In: IJCNLP, pp 1107–1111

  39. Lin J, Mao W, Zeng DD (2017) Personality-based refinement for sentiment classification in microblog. Knowl Based Syst 132:204–214

    Article  Google Scholar 

  40. Lyu C, Foster J, Graham Y (2020) Improving document-level sentiment analysis with user and product context. In: COLING, pp 6724–6729

  41. Zhang Y, Wang J, Zhang X (2021) Personalized sentiment classification of customer reviews via an interactive attributes attention model. Knowl Based Syst 226:107135

    Article  Google Scholar 

  42. Mireshghallah F, Shrivastava V, Shokouhi M, Berg-Kirkpatrick T, Sim R, Dimitriadis D (2022) Useridentifier: implicit user representations for simple and effective personalized sentiment analysis. In: FL4NLP

  43. Wen J, Huang A, Zhong M, Ma J (2023) Hybrid sentiment analysis with textual and interactive information. Expert Syst Appl 213:118960

    Article  Google Scholar 

  44. Kihlstrom JF (2017) On personality and memory

  45. Digman JM (1990) Personality structure: emergence of the five-factor model. Annu Rev Psychol 41(1):417–440

    Article  Google Scholar 

  46. Pennebaker JW, Boyd RL, Jordan K, Blackburn K (2015) The development and psychometric properties of LIWC2015. Technical report

  47. Tausczik YR, Pennebaker JW (2010) The psychological meaning of words: LIWC and computerized text analysis methods. J Lang Soc Psychol 29(1):24–54

    Article  Google Scholar 

  48. Eichstaedt JC, Kern ML, Yaden DB, Schwartz H, Giorgi S, Park G, Hagan CA, Tobolsky VA, Smith LK, Buffone A et al (2021) Closed-and open-vocabulary approaches to text analysis: a review, quantitative comparison, and recommendations. Psychol Methods 26(4):398

    Article  Google Scholar 

  49. Jayaratne M, Jayatilleke B (2020) Predicting personality using answers to open-ended interview questions. IEEE Access 8:115345–115355

    Article  Google Scholar 

  50. Zhu Y, Hu L, Ge X, Peng W, Wu B (2022) Contrastive graph transformer network for personality detection. In: IJCAI, pp 4559–4565

  51. Pennebaker JW, King LA (1999) Linguistic styles: language use as an individual difference. J Pers Soc Psychol 77(6):1296

    Article  Google Scholar 

  52. Wang X, Zhang H, Cao L, Feng L (2020) Leverage social media for personalized stress detection. In: MM, pp 2710–2718

  53. Aizawa A (2003) An information-theoretic perspective of TF–IDF measures. Inf Process Manage 39(1):45–65

    Article  Google Scholar 

  54. Halamish V, Stern P (2022) Motivation-based selective encoding and retrieval. Mem Cogn 50(4):736–750

    Article  Google Scholar 

  55. Becattini F, Uricchio T (2022) Memory networks. In: MM, pp 7380–7382

  56. Kalat J, Shiota M (2011) Emotion

  57. Tang D, Qin B, Liu T (2015) Document modeling with gated recurrent neural network for sentiment classification. In: EMNLP, pp 1422–1432

  58. Yang Z, Yang D, Dyer C, He X, Smola A, Hovy E (2016) Hierarchical attention networks for document classification. In: NAACL-HLT, pp 1480–1489

  59. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez A.N, Kaiser Ł, Polosukhin I (2017) Attention is all you need. Adv Neural Inf Process Syst 30

  60. Loshchilov I, Hutter F (2018) Decoupled weight decay regularization. In: ICLR

  61. Hossin M, Sulaiman MN (2015) A review on evaluation metrics for data classification evaluations. Int J Data Min Knowl Manage Process 5(2):1

    Article  Google Scholar 

  62. Gaudette L, Japkowicz N (2009) Evaluation methods for ordinal classification. In: CCAI, pp 207–210

  63. Pitman EJ (1937) Significance tests which may be applied to samples from any populations. J R Stat Soc 4(1):119–130

    Article  Google Scholar 

  64. Adalı S, Golbeck J (2014) Predicting personality with social behavior: a comparative study. Soc Netw Anal Min 4:1–20

    Article  Google Scholar 

  65. Aljundi R, Babiloni F, Elhoseiny M, Rohrbach M, Tuytelaars T (2018) Memory aware synapses: learning what (not) to forget. In: ECCV, pp 139–154

  66. Tyng CM, Amin HU, Saad MN, Malik AS (2017) The influences of emotion on learning and memory. Front Psychol 8:1454

    Article  Google Scholar 

  67. Dubey S, Singh IL, Srivastava S (2014) Effect of personality on working memory capacity. Indian J Posit Psychol 5(2):150

    Google Scholar 

Download references

Funding

This work is funded by National Natural Science Foundation of China (under Project No. 62377013), Science and Technology Commission of Shanghai Municipality, China (under Project No. 21511100302), and the Fundamental Research Funds for the Central Universities. It is also supported by Natural Science Foundation of Shanghai (under Project No. 22ZR1419000) and the Research Project of Shanghai Science and Technology Commission (20dz2260300).

Author information

Authors and Affiliations

  1. Institute of AI for Education, East China Normal University, Shanghai, China

    Yu Ji & Liang He

  2. School of Computer Science and Technology, East China Normal University, Shanghai, China

    Yu Ji, Wen Wu & Liang He

  3. Shanghai Key Laboratory of Mental Health and Psychological Crisis Intervention, School of Psychology and Cognitive Science, East China Normal University, Shanghai, China

    Wen Wu, Yi Hu & Xi Chen

  4. School of Data Science and Engineering, East China Normal University, Shanghai, China

    Wenxin Hu

Authors
  1. Yu Ji
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wen Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yi Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xi Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Wenxin Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Liang He
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Yu Ji contributed to conceptualization, methodology, software, validation, formal analysis, investigation, data curation, writing—original draft, and writing—review and editing. Wen Wu contributed to conceptualization, methodology, formal analysis, investigation, writing—original draft, writing—review and editing, and supervision. Yi Hu and Liang He contributed to supervision and writing—review and editing. Xi Chen and Wenxin Hu contributed to writing—review and editing.

Corresponding author

Correspondence to Wen Wu.

Ethics declarations

Conflict of interest

The authors have no relevant financial or non-financial interests to disclose.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ji, Y., Wu, W., Hu, Y. et al. Personality-driven experience storage and retrieval for sentiment classification. J Supercomput (2024). https://doi.org/10.1007/s11227-024-06170-1

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11227-024-06170-1

Keywords

Search

Navigation