Abstract
Text-based depression detection has long been investigated by exploring useful handcrafted linguistic features and word embeddings. This paper focuses on utilizing emoji as an emotional modality to detect whether a subject is depressed or not based on text. In particular, we propose to extract sentence-level emotional information with model pretrained to predict emoji of text on social media and semantic information with widely used embedding model. The embeddings are then input to the classification model to predict one’s mental state. Experiments are conducted on user-generated posts from three datasets and clinical conversational data from DAIC-WOZ. Results on social media data indicate emojis’ superior performance in general, with further enhancement derived from modality fusion. Furthermore, emoji outperforms contextual text embeddings in sparse scenarios like clinical interview dialogues. We also provide a detailed analysis showing that the emojis extracted from healthy and depressed subjects are significantly different, suggesting that emoji can be a reliable emotion representation in such implicit yet complex sentiment analysis settings.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Al Hanai, T., Ghassemi, M., Glass, J.: Detecting depression with audio/text sequence modeling of interviews. In: Proceedings of Interspeech 2018, pp. 1716–1720 (2018). 10.21437/Interspeech. 2018–2522
Aragón, M.E., López-Monroy, A.P., González-Gurrola, L.C., Montes, M.: Detecting depression in social media using fine-grained emotions. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol. 1 (Long and Short Papers), pp. 1481–1486 (2019)
Bojanowski, P., Grave, E., Joulin, A., Mikolov, T.: Enriching word vectors with subword information. Trans. Assoc. Comput. Linguist. 5, 135–146 (2017)
Chen, X., Sykora, M.D., Jackson, T.W., Elayan, S.: What about mood swings: Identifying depression on twitter with temporal measures of emotions. In: Companion Proceedings of the The Web Conference 2018, pp. 1653–1660 (2018)
DeVault, D., et al.: Simsensei kiosk: A virtual human interviewer for healthcare decision support. In: Proceedings of the 2014 International Conference on Autonomous Agents and Multi-agent Systems, AAMAS 2014, pp. 1061–1068. International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC (2014). http://dl.acm.org/citation.cfm?id=2615731.2617415
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)
Felbo, B., Mislove, A., Søgaard, A., Rahwan, I., Lehmann, S.: Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasm. arXiv preprint arXiv:1708.00524 (2017)
Harrigian, K., Aguirre, C., Dredze, M.: Do models of mental health based on social media data generalize? In: Proceedings of the 2020 Conference On Empirical Methods In Natural Language Processing: Findings, pp. 3774–3788 (2020)
Hayati, S.A., Muis, A.O.: Analyzing incorporation of emotion in emoji prediction. In: Proceedings of the Tenth Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, pp. 91–99 (2019)
J. Joormann, M.Q.: Cognitive processes and emotion regulation in depression. Depression Anxiety 31 (2014). https://doi.org/10.1002/da.22264
Joulin, A., Grave, E., Bojanowski, P., Mikolov, T.: Bag of tricks for efficient text classification. arXiv preprint arXiv:1607.01759 (2016)
Losada, D.E., Crestani, F., Parapar, J.: eRISK 2017: CLEF Lab on early risk prediction on the internet: experimental foundations. In: Jones, G.J.F., et al. (eds.) CLEF 2017. LNCS, vol. 10456, pp. 346–360. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-65813-1_30
Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. In: Bengio, Y., LeCun, Y. (eds.) 1st International Conference on Learning Representations, ICLR 2013, Scottsdale, Arizona, USA, 2–4 May 2013, Workshop Track Proceedings (2013). http://arxiv.org/abs/1301.3781
Pennington, J., Socher, R., Manning, C.: Glove: Global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp. 1532–1543 (2014)
Sadeque, F., Xu, D., Bethard, S.: Measuring the latency of depression detection in social media. In: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, pp. 495–503 (2018)
Trotzek, M., Koitka, S., Friedrich, C.M.: Linguistic metadata augmented classifiers at the clef 2017 task for early detection of depression. In: CLEF (Working Notes) (2017)
Trotzek, M., Koitka, S., Friedrich, C.M.: Word embeddings and linguistic metadata at the CLEF 2018 tasks for early detection of depression and anorexia. In: CEUR Workshop Proceedings, vol. 2125 (2018). http://www.reddit.com/r/depression
Wolohan, J., Hiraga, M., Mukherjee, A., Sayyed, Z.A., Millard, M.: Detecting linguistic traces of depression in topic-restricted text: Attending to self-stigmatized depression with nlp. In: Proceedings of the First International Workshop on Language Cognition and Computational Models, pp. 11–21 (2018)
Zanzotto, F.M., Santilli, A.: Syntnn at semeval-2018 task 2: is syntax useful for emoji prediction? embedding syntactic trees in multi layer perceptrons. In: Proceedings of The 12th International Workshop on Semantic Evaluation, pp. 477–481 (2018)
Acknowledgements
This work has been supported by National Natural Science Foundation of China (No. 61901265, 92048205), Major Program of National Social Science Foundation of China (No. 18ZDA293), and Shanghai Municipal Science and Technology Major Project (2021SHZDZX0102). Experiments have been carried out on the PI supercomputer at Shanghai Jiao Tong University.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Zhang, P., Wu, M., Yu, K. (2023). Using Emoji as an Emotion Modality in Text-Based Depression Detection. In: Zhenhua, L., Jianqing, G., Kai, Y., Jia, J. (eds) Man-Machine Speech Communication. NCMMSC 2022. Communications in Computer and Information Science, vol 1765. Springer, Singapore. https://doi.org/10.1007/978-981-99-2401-1_5
Download citation
DOI: https://doi.org/10.1007/978-981-99-2401-1_5
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-2400-4
Online ISBN: 978-981-99-2401-1
eBook Packages: Computer ScienceComputer Science (R0)