Skip to main content

Evaluation and Comparison of Text Classifiers to Develop a Depression Detection Service

  • Conference paper
  • First Online:
XV Mediterranean Conference on Medical and Biological Engineering and Computing – MEDICON 2019 (MEDICON 2019)

Abstract

Depression is a mental disorder which can become a serious health problem. This research line is focused on creating a depression detection service from text analysis. Sentiment Analysis and Natural Language Processing methods will be used to develop this service. The service will classify text in positive or negative depending on the emotions inferred from user’s input texts. In this study, five classifiers have been evaluated to determine which one fits better for this purpose. Naïve Bayes, Decision Tree, Naïve Bayes based on Bernoulli model and Maximum Entropy are the classifiers analyzed. A specific corpus which includes sentences that fit research needs was designed for testing purposes, whereas Sentiment140’s corpus was used with training purposes. An evaluation methodology formed by three tests was designed. Results show a promising starting point, but further analysis will be needed. Future related works will focus on expanding classification to get user’s mood and not only a binary classification. It will allow to include this service as input for developing personalized intervention and education mHealth systems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. World Health Organization. https://www.who.int/en/news-room/fact-sheets/detail/depression. Accessed 21 Apr 2019

  2. Liu, B.: Sentiment analysis and opinion mining. Synth. Lect. Hum. Lang. Technol. 5(1), 1–167 (2012)

    Article  Google Scholar 

  3. Carrillo-de-Albornoz, J., Rodríguez Vidal, J., Plaza, L.: Feature engineering for sentiment analysis in e-health forums. PLoS ONE 13(11), e0207996 (2018)

    Article  Google Scholar 

  4. Mullen, T., Collier, N.: Sentiment analysis using support vector machines with diverse information sources. In: Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing, EMNLP 2004, pp. 412–418 (2004)

    Google Scholar 

  5. Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up?: Sentiment classification using machine learning techniques. In: Proceedings of the ACL 2002 Conference on Empirical Methods in Natural Language Processing, EMNLP 2002, vol. 10, pp. 79–86 (2002)

    Google Scholar 

  6. Kennedy, A., Inkpen, D.: Sentiment classification of movie reviews using contextual valence shifters. Comput. Intell. 22(2), 110–125 (2006)

    Article  MathSciNet  Google Scholar 

  7. Boiy, E., Hens, P., Deschacht, K., Francine Moens, M.: Automatic sentiment analysis in on-line text. In: Proceedings of the 11th International Conference on Electronic Publishing, pp. 349–360 (2007)

    Google Scholar 

  8. Salvetti, F., Reichenbach, C., Lewis, S.: Opinion polarity identification of movie reviews. In: Wiebe, J. (ed.) Computing Attitude and Affect in Text: Theory and Applications, pp. 303–316. Springer, Dordrecht (2006)

    Google Scholar 

  9. Carrillo-de-Albornoz, J., Plaza, L., Gervás, P.: A hybrid approach to emotional sentence polarity and intensity classification. In: Proceedings of the Fourteenth Conference on Computational Natural Language Learning, CoNLL 2010, pp. 153–161 (2010)

    Google Scholar 

  10. Read, J., Carroll, J.: Weakly supervised techniques for domain-independent sentiment classification. In: Proceedings of the 1st International CIKM Workshop on Topic-sentiment Analysis for Mass Opinion, TSA 2009, pp. 45–52 (2009)

    Google Scholar 

  11. Turney, P.D.: Thumbs up or thumbs down?: Semantic orientation applied to unsupervised classification of reviews. In: Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, pp. 417–424 (2002)

    Google Scholar 

  12. An easy introduction to Natural Language Processing. https://towardsdatascience.com/an-easy-introduction-to-natural-language-processing-b1e2801291c1. Accessed 26 Apr 2019

  13. Search Business Analytics. https://searchbusinessanalytics.techtarget.com/definition/natural-language-processing-NLP. Accessed 25 Apr 2019

  14. Natural Language Toolkit. https://www.nltk.org. Accessed 26 Apr 2019

  15. Sentiment140 - A Twitter Sentiment Analysis Tool. http://www.sentiment140.com. Accessed 26 Apr 2019

  16. Lovins, J.B.: Development of a stemming algorithm. Mech. Transl. Comput. Linguist. 11(1–2), 22–31 (1968)

    Google Scholar 

  17. Plisson, J., Lavrac, N., Mladenic, D.: A rule based approach to word lemmatization. In: Proceedings of IS-2004, pp. 83–86 (2004)

    Google Scholar 

Download references

Acknowledgements

This work has been partially funded by the Spanish Ministry of Science (project DPI2017-86088-C3-1-R, iBC).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Diego Moreno-Blanco .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Moreno-Blanco, D., Ochoa-Ferreras, B., Gárate, F.J., Solana-Sánchez, J., Sánchez-González, P., Gómez, E.J. (2020). Evaluation and Comparison of Text Classifiers to Develop a Depression Detection Service. In: Henriques, J., Neves, N., de Carvalho, P. (eds) XV Mediterranean Conference on Medical and Biological Engineering and Computing – MEDICON 2019. MEDICON 2019. IFMBE Proceedings, vol 76. Springer, Cham. https://doi.org/10.1007/978-3-030-31635-8_146

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-31635-8_146

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-31634-1

  • Online ISBN: 978-3-030-31635-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics