Skip to main content

Machine Learning for Depression Screening in Online Communities

  • Conference paper
  • First Online:
  • 341 Accesses

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1240))

Abstract

Social media writings have been explored over the last years, in the context of mental health, as a potential source of information for extending the so-called digital phenotyping of a person. In this paper we present a computational approach for the classification of depressed social media users. We conducted a cross evaluation study based on two public datasets, collected from the same social network, in order to understand the impact of transfer learning when the data source is virtually the same. We hope that the results presented here challenge the research community to address more often the issues of reproducibility and interoperability, two key concepts in the era of computational Big Data.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    https://www.twitter.com/.

  2. 2.

    https://www.reddit.com/.

  3. 3.

    https://gist.github.com/sebleier/554280.

  4. 4.

    www.python.org.

References

  1. Mental Health Atlas 2017 (Geneva: World Health Organization) (2018)

    Google Scholar 

  2. Al-Mosaiwi, M., Johnstone, T.: In an absolute state: elevated use of absolutist words is a marker specific to anxiety, depression, and suicidal ideation. Clin. Psychol. Sci. 6, 2167702617747074 (2018)

    Article  Google Scholar 

  3. Benton, A., Coppersmith, G., Dredze, M.: Ethical research protocols for social media health research. In: Proceedings of the First ACL Workshop on Ethics in Natural Language Processing, pp. 94–102 (2017)

    Google Scholar 

  4. Bravo-Marquez, F., Frank, E., Mohammad, S.M., Pfahringer, B.: Determining word-emotion associations from tweets by multi-label classification. In: 2016 IEEE/WIC/ACM International Conference on Web Intelligence (WI), pp. 536–539. IEEE (2016)

    Google Scholar 

  5. Chen, L., Hossain, K.T., Butler, P., Ramakrishnan, N., Prakash, B.A.: Syndromic surveillance of flu on twitter using weakly supervised temporal topic models. Data Min. Knowl. Disc. 30(3), 681–710 (2016)

    Article  MathSciNet  Google Scholar 

  6. Chung, C., Pennebaker, J.W.: The psychological functions of function words. Soc. Commun. 1, 343–359 (2007)

    Google Scholar 

  7. Conway, M., O’Connor, D.: Social media, big data, and mental health: current advances and ethical implications. Curr. Opin. Psychol. 9, 77–82 (2016)

    Article  Google Scholar 

  8. Coppersmith, G., Dredze, M., Harman, C.: Quantifying mental health signals in Twitter. In: Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality, pp. 51–60 (2014)

    Google Scholar 

  9. Coppersmith, G., Leary, R., Whyne, E., Wood, T.: Quantifying suicidal ideation via language usage on social media. In: Joint Statistics Meetings Proceedings, Statistical Computing Section, JSM (2015)

    Google Scholar 

  10. Coppersmith, G., Ngo, K., Leary, R., Wood, A.: Exploratory analysis of social media prior to a suicide attempt. In: Proceedings of the Third Workshop on Computational Lingusitics and Clinical Psychology, pp. 106–117 (2016)

    Google Scholar 

  11. Ernala, S.K., Birnbaum, M.L., Candan, K.A., Rizvi, A.F., Sterling, W.A., Kane, J.M., De Choudhury, M.: Methodological gaps in predicting mental health states from social media: triangulating diagnostic signals. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, p. 134. ACM (2019)

    Google Scholar 

  12. Kim, Y., Huang, J., Emery, S.: Garbage in, garbage out: data collection, quality assessment and reporting standards for social media data use in health research, infodemiology and digital disease detection. J. Med. Internet Res. 18(2), 41 (2016)

    Google Scholar 

  13. Klein, A.Z., Sarker, A., Cai, H., Weissenbacher, D., Gonzalez-Hernandez, G.: Social media mining for birth defects research: a rule-based, bootstrapping approach to collecting data for rare health-related events on twitter. J. Biomed. Inform. 87, 68–78 (2018)

    Article  Google Scholar 

  14. Lampos, V.: Flu detector: estimating influenza-like illness rates from online user-generated content. arXiv preprint arXiv:1612.03494 (2016)

  15. Losada, D.E., Crestani, F.: A test collection for research on depression and language use. In: International Conference of the Cross-Language Evaluation Forum for European Languages, pp. 28–39. Springer (2016)

    Google Scholar 

  16. Loveys, K., Crutchley, P., Wyatt, E., Coppersmith, G.: Small but mighty: affective micropatterns for quantifying mental health from social media language. In: Proceedings of the Fourth Workshop on Computational Linguistics and Clinical Psychology—From Linguistic Signal to Clinical Reality. pp. 85–95 (2017)

    Google Scholar 

  17. Mohammad, S.M., Bravo-Marquez, F.: Emotion intensities in tweets. arXiv preprint arXiv:1708.03696 (2017)

  18. Mohammad, S.M., Kiritchenko, S.: Using hashtags to capture fine emotion categories from tweets. Computat. Intell. 31(2), 301–326 (2015)

    Article  MathSciNet  Google Scholar 

  19. Nadeem, M.: Identifying depression on twitter. CoRR abs/1607.07384 (2016)

    Google Scholar 

  20. Paul, M.J., Sarker, A., Brownstein, J.S., Nikfarjam, A., Scotch, M., Smith, K.L., Gonzalez, G.: Social media mining for public health monitoring and surveillance. In: Biocomputing 2016: Proceedings of the Pacific Symposium, pp. 468–479. World Scientific (2016)

    Google Scholar 

  21. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., Duchesnay, E.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)

    MathSciNet  MATH  Google Scholar 

  22. Rude, S., Gortner, E.M., Pennebaker, J.: Language use of depressed and depression-vulnerable college students. Cogn. Emot. 18(8), 1121–1133 (2004)

    Article  Google Scholar 

  23. Smith, M., Broniatowski, D.A., Paul, M.J., Dredze, M.: Towards real-time measurement of public epidemic awareness: Monitoring influenza awareness through twitter. In: AAAI Spring Symposium on Observational Studies through Social Media and Other Human-Generated Content (2016)

    Google Scholar 

  24. Torous, J., Staples, P., Onnela, J.P.: Realizing the potential of mobile mental health: new methods for new data in psychiatry. Curr. Psychiatry Rep. 17(8), 61 (2015)

    Article  Google Scholar 

  25. VanDam, C., Kanthawala, S., Pratt, W., Chai, J., Huh, J.: Detecting clinically related content in online patient posts. J. Biomed. Inform. 75, 96–106 (2017)

    Article  Google Scholar 

  26. Vilar, S., Friedman, C., Hripcsak, G.: Detection of drug-drug interactions through data mining studies using clinical sources, scientific literature and social media. Brief. Bioinform. 19(5), 863–877 (2017)

    Article  Google Scholar 

  27. Vioulès, M.J., Moulahi, B., Azé, J., Bringay, S.: Detection of suicide-related posts in twitter data streams. IBM J. Res. Dev. 62(1), 1–7 (2018)

    Article  Google Scholar 

  28. Yang, C.C., Yang, H., Jiang, L., Zhang, M.: Social media mining for drug safety signal detection. In: Proceedings of the 2012 International Workshop on Smart Health and Wellbeing, pp. 33–40. ACM (2012)

    Google Scholar 

  29. Yates, A., Cohan, A., Goharian, N.: Depression and self-harm risk assessment in online forums. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, p. 2968–2978. Association for Computational Linguistics (2017)

    Google Scholar 

  30. Yun, G.W., Morin, D., Park, S., Joa, C.Y., Labbe, B., Lim, J., Lee, S., Hyun, D.: Social media and flu: media twitter accounts as agenda setters. Int. J. Med. Inform. 91, 67–73 (2016)

    Article  Google Scholar 

  31. Zhang, J., Brackbill, D., Yang, S., Centola, D.: Identifying the effects of social media on health behavior: data from a large-scale online experiment. Data Brief 5, 453–457 (2015)

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the Integrated Programme of SR&TD SOCA (Ref. CENTRO-01-0145-FEDER-000010), co-funded by Centro 2020 program, Portugal 2020, European Union, through the European Regional Development Fund. Rui Antunes is supported by the Fundação para a Ciência e a Tecnologia (PhD Grant SFRH/BD/137000/2018).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alina Trifan .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Trifan, A., Antunes, R., Oliveira, J.L. (2021). Machine Learning for Depression Screening in Online Communities. In: Panuccio, G., Rocha, M., Fdez-Riverola, F., Mohamad, M., Casado-Vara, R. (eds) Practical Applications of Computational Biology & Bioinformatics, 14th International Conference (PACBB 2020). PACBB 2020. Advances in Intelligent Systems and Computing, vol 1240. Springer, Cham. https://doi.org/10.1007/978-3-030-54568-0_11

Download citation

Publish with us

Policies and ethics