Abstract
Detection of suicide risk is a highly prioritized, yet complicated task. Five decades of research have produced predictions slightly better than chance (AUCs = 0.56–0.58). In this study, Artificial Neural Network (ANN) models were constructed to predict suicide risk from everyday language of social media users. The dataset included 83,292 postings authored by 1002 authenticated Facebook users, alongside valid psychosocial information about the users. Using Deep Contextualized Word Embeddings for text representation, two models were constructed: A Single Task Model (STM), to predict suicide risk from Facebook postings directly (Facebook texts → suicide) and a Multi-Task Model (MTM), which included hierarchical, multilayered sets of theory-driven risk factors (Facebook texts → personality traits → psychosocial risks → psychiatric disorders → suicide). Compared with the STM predictions (0.621 ≤ AUC ≤ 0.629), the MTM produced significantly improved prediction accuracy (0.697 ≤ AUC ≤ 0.746), with substantially larger effect sizes (0.729 ≤ d ≤ 0.936). Subsequent content analyses suggested that predictions did not rely on explicit suicide-related themes, but on a range of text features. The findings suggest that machine learning based analyses of everyday social media activity can improve suicide risk predictions and contribute to the development of practical detection tools.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Introduction
Suicide is a leading cause of death worldwide and considerable scientific efforts are directed at early detection and prevention of suicide risk1,2. However, detecting suicide risk is a complex classification problem3,4. Findings from a recent meta-analysis of five decades of suicide research using traditional statistical methods showed that our ability to detect suicide risk from demographic, psychological, or medical factors is extremely limited. In fact, the prediction performances of suicide risk were “only slightly better than chance” (AUCs = 0.56–0.58)5. In the present work, we report on research showing that the combination of psychological knowledge, advanced machine learning techniques, and natural language processing (NLP) methods can considerably improve suicide risk predictions.
Machine learning techniques are becoming increasingly common in mental health research6,7. In a recent review of 300 mental health studies that employed machine learning/data driven algorithms, Shatte et al. concluded that such tools may improve our ability to detect and diagnose mental health conditions. However, the applicability of machine-learning models may still be limited because their predictions are often based on medical sources, such as neuroimaging data, counselling transcripts, and clinical reports. A recent study, for example, managed to develop a highly accurate suicide prediction model (0.769 ≤ AUC ≤ 0.792), based on the health records of patients who visited one of the Berkshire Health System hospitals8. Although valuable, these sources do not capture first-hand the patients’ natural behavior, nor do they include data from non-treated or non-diagnosed individuals.
Recent studies have therefore focused on ‘in the moment’, everyday exchanges collected from social media platforms9,10. The popularity of social media platforms, such as Facebook or Twitter, has created unprecedented opportunities to mine large data sets of everyday, user-generated content for patterns of communication that could be indicative of various mental health conditions. Research in this field has been particularly bountiful in the case of depressive disorders11,12,13.
In comparison, studies exploring suicide risk detection from user-generated social media posts are significantly fewer in number14. Together with earlier works on non-digital communication formats (e.g., written poetry or interviews)15,16, they show that natural language contains valuable signals that are indicative of suicide risk. However, we flag three general limitations of the existing research on suicide detection from social media activity:
First, offline, external validations of suicide risk are rarely included in the datasets. Instead, the ‘ground truth’ criterion for suicide risk is determined by proxy diagnostic measures, that is, judgements of suicidal thoughts or behaviors made by experts or non-experts based on the textual content posted by the users14,17. However, these judgments may not properly measure actual suicide risk (construct validity) due to self-presentation biases and language ambiguities on social media18. Moreover, text-based judgments will fail to identify users who do not choose to explicitly share suicidal or depressive feelings online19. Finally, in many cases, the data collection and judgment process has been conducted on postings from designated, suicide-related forums, such as “suicide watch” on Reddit14,20, thus limiting their applicability to more natural, everyday settings.
Second, existing research has mainly used text mining methods that are based on occurrence statistics of words that belong to pre-defined lexicons. However, the meaning of words (even the word ‘kill’) depend on their context. Moreover, natural language, especially in informal environments such as Facebook, may include non-words and emoji that are not listed in registered lexicons (e.g., Lolll, OMG,
). Machine learning algorithms should therefore account for these unique language characteristics of social media.
Third, mental health conditions in general21 and suicide risk in particular5 are complex and heterogeneous phenomena with multiple genetic and environmental risk factors. Yet, the existing research on suicide and on other mental health manifestations in social media activities rarely considers the broader clinical picture of the condition. Predictions of suicide risk are expected to benefit from simultaneous computational analyses of multiple risk factors3.
The present study
In this study, we leverage recent advancements in machine learning and construct deep neural network models to predict suicide risk from user-generated social media texts. A total of 1002 Facebook users completed a well-established, clinically valid screening tool of suicide risk22 and volunteered to disclose a year of their Facebook activity, resulting in a dataset of 83,292 postings.
Clinically validated data was collected on three sets of risk factors for suicide and for depressive episodes, which often precede suicidal behavior23. The first set comprised psychiatric disorders (internalizing psychopathology), the most severe risk factors for suicide behaviors5,24, including depression as well as generalized anxiety, which often appears in comorbidity with depression23,25. The second set included psychosocial risks for depression26,27, namely: depressive rumination, excessive worries27,28, feelings of loneliness, and lack of satisfaction with life29,30. The third and most distal set of factors included the Big Five personality traits31, since neuroticism and, to a lesser extent, extroversion have been associated with suicide behaviors32 and depression23.
Based on this dataset, we extracted representations of Facebook texts, using a deep Contextualized Word Embeddings (CWE) algorithm (see “Method” section). These text representations served as the input for two principal Artificial Neural Network (ANN) models, which were constructed for the purpose of the current study. The first model was a straightforward Single Task Model (STM) that aimed to predict suicide risk from users’ Facebook activity (Facebook texts → suicide). The second model was a Multi Task Model (MTM) that considered three additional, theory-driven layers of contributing factors (Facebook texts → personality traits → psychosocial risks → psychiatric disorders → suicide). We hypothesized that the MTM, which combines knowledge from both the psychological and the computational sciences, would significantly improve suicide risk prediction accuracy, compared to the STM and to the current state of suicide research. Finally, we provide interpretational analyses of the MTM predictions to identify textual features that may have contributed to the distinction between individuals with and without suicide risk.
Method
Tools and measurements
Suicide risk
Suicide risk was measured using the Columbia Suicide Severity Rating Scale (CSSRS)22. The CSSRS is considered a diagnostic tool of choice in clinical settings and empirical research, with high specificity and sensitivity33,34. The first part of the scale addresses passive suicide ideation35 (a wish to be dead and suicidal thoughts) and the second part addresses active suicide ideation and behaviors (suicidal thoughts with method, intent, or a specific plan and preparation to commit suicide). This second part was only presented to participants who reported suicidal ideation in the first part. This modular structure enables the extraction of two binary (yes/no) variables: a general risk of suicide (all the participants who had at least passive ideation) and a high risk of suicide (a sub-group of the 'general risk' participants who reported a specific method, intention, or plan to act on their suicidal thoughts). The scale does not address completed acts of suicide. In this study, the sum score of the CSSRS correlated with the sum scores of all other risk factors (see next) and especially with depression (r = 0.44), thus indicating a high convergent validity of the scale (Table 1).
Risk factors for suicide and depression
Major depressive disorder was measured using the Patient Health Questionnaire-9 (PHQ-9)36. Generalized anxiety disorder was measured using the GAD-7 scale37. Depressive rumination (brooding) was measured using five items from the Ruminative Responses Scale (RSS)38. Excessive worrying was measured using the Penn State Worry Questionnaire (PSWQ)39. Loneliness was measured using the 10-item version of the UCLA-Loneliness Scale40. Low satisfaction with life was measured using the Satisfaction With Life Scale (SWLS)41. Personality traits were assessed using the short version of the Big Five Inventory (BFI-10)42. Descriptive statistics and zero-order correlations of all psycho-diagnostic measures are provided in Table 1. Detailed descriptions of measures are provided in the Supplementary Material.
Sample and dataset
The procedures of the study comply with the ethical standards of the Helsinki Declaration of 1975, as revised in 2008. All procedures were approved by the Ethics for Research on Human Subjects Committees of the Technion, Israel Institute of Technology and the Hebrew University of Jerusalem. Informed consent was obtained from all participants. Participant recruitment was conducted through Amazon’s Mechanical Turk (MTurk). A strict data quality assurance protocol for online data collection was applied43. This included a method to screen out bogus participants and eight attention checks (see Supplementary Material).
After reading and signing the consent form, participants completed eight psycho-diagnostic measures, and gave us a one-off authorization to download their Facebook posts up to 12 months prior to the research date. The Facebook data was extracted to an encrypted data storage through a designated application, which was developed for the purpose of the current study. Upon completion, participants who met the criterion for suicide risk received a letter that included a list of mental health services and an encouragement to seek help (see Supplementary Material).
The initial sample included 2,685 English speaking adult US residents. From this sample, we excluded 236 users with suspicious IP addresses, 464 users who did not pass the attention checks, and 335 users who did not publish any Facebook postings. We then extracted a total of 85,643 textual postings that were generated and posted by the remaining 1650 users. However, since valuable ANN-based predictions require sufficient amount of text, we further excluded users who did not reach the median number of Facebook posts, which was calculated to be 10 postings per profile. The final dataset included 83,292 posts generated by 1002 Facebook users (23.25% male) who published at least 10 posts. The average number of postings per user was 82.35 (SD = 106.79) and the average number of words in each post was 31.14 (SD = 66.56). Table 2 presents the socio-demographic characteristics (age, gender, and income) of the current sample.
The collected Facebook posts were then matched with the psycho-diagnostic information and the suicide risk scores of the 1002 users who generated these posts. Based on previous studies that investigated the unique characteristics of MTurk samples, we note that the prevalence of mental health issues, and especially of major depression, is significantly higher in MTurk, compared with the general population43,44,45. Correspondingly, relatively high rates of suicide risk were found in the current sample: 361 users (36.03%) met the criterion for ‘general risk of suicide,’ of which 132 (13.17%) met the criterion for high risk of suicide. Users at general risk differed from users who did not report of any suicidal ideation on several socio-demographic parameters (Table 2). They were younger (M = 34.6, SD = 10.6, t = − 5.09, p < 0.001) and relatively poorer (M = 48,389$, SD = 35,526 t = − 4.26, p < 0.001) compared with non-suicidal users (mean age = 38.3, SD = 11, mean annual income = 58,563$, SD = 36,627). At risk users also had more Facebook postings (M = 97, SD = 119.9) than non-suicidal users (M = 74.1, SD = 97.9), t = 3.27, p < 0.01. The magnitude of all socio-demographic differences was small (0.21 ≤ Cohen's d ≤ 0.32). Gender differences between suicidal and non-suicidal users were not significant (χ2 = 0.005, p = 0.945).
ANN-based models
In order to predict suicide risk from Facebook texts, two ANN-based models were constructed (see Figs. 1, 2). The construction process included four steps: First, we extracted representations of the Facebook texts, using ELMo, a deep Contextualized Word Embeddings (CWE) algorithm. Second, we created the two types of ANN models (STM and MTM), in which the ELMo based representations served as inputs. Third, we trained and optimized the models to predict suicide risk from (represented) Facebook texts. Finally, we tested the quality of the predictions made by both models. Following is a detailed description of the process.
Both models consisted of identical input and output layers. The input consisted of representations of Facebook texts, which are 1024-dimensional vectors extracted by ELMo, a state-of-the-art method for Embeddings from Language Models46. ELMo comprises a deep language model through multiple bi-directional Long-short-Term-Memory (LSTM) layers. The use of ELMo has two advantages over other text representation techniques, such as word count or N-grams: It is character-based (rather than word-based) and therefore it generates representations also to non-words (i.e. words that do not appear in formal dictionaries), which are popular in social media language (e.g., Lolll or OMG) and it generates representations of words within their context (i.e., a given word receives different representations depending on its surrounding text).
Using a pre-trained ELMo model (available at https://tfhub.dev/google/elmo/2), we extracted a 1024-dimensional embedding vector for each Facebook post in our data through mean-pooling over the contextualized word embeddings generated for the post. The overall textual-activity of the user was represented as the average of its post vectors and served as input to the ANN models.
The output of the two models consisted of a single binary (yes/no) variable of suicide risk. Following the modular structure of the suicide scale, we considered two variants of each model, one for predicting general risk of suicide and one for predicting high risk of suicide. The two variants of the Single Task Model (STM) were constructed to predict suicide risk directly from textual contents of Facebook posts, using a set of fully-connected layers (textual content → suicide). The two Multi Task Model (MTM) variants were constructed to predict a hierarchical combination of multiple factors. We integrated three sets of auxiliary risk factors that could mediate the link between Facebook postings and suicide risk (textual content → personality traits → psychosocial risks → psychiatric disorders → suicide). An illustration of these risk factors is provided in the Supplementary Material, Fig. A.
Each auxiliary layer is accompanied by a set of fully-connected layers, thus forming several “subnetworks.” The subnetwork located at the bottom of the model (i.e., the Personality traits) is activated directly by the input layer (Facebook content), while the subnetworks at the middle (Psychiatric disorders and Psychosocial risks) are activated by the previous subnetwork’s output, which is concatenated with outputs from a shared set of fully-connected layers. The shared set of layers is activated directly from the input layer (i.e., the textual representations), which allows the subnetworks to get direct information from the input layer (and not just from the previous subnetwork). This architecture introduces inductive bias to the suicide prediction model through the auxiliary tasks, while learning a shared set of parameters for the multiple tasks in order to reduce the risk for overfitting. Finally, the Suicide layer at the top of the model is activated by the output generated by the Psychiatric disorders layer and by the output of the shared set of hidden layers (Fig. 2). The loss functions of both models are provide in the Supplementary Material.
The dataset was randomly divided into three portions, such that the percentage of users at general suicide risk is identical in all portions. In the learning phase, each ANN-based model was trained on the Facebook texts of 70% of the users in the sample (701 users), to classify users as being suicidal or not. Each learning example was comprised of the Facebook posts of one participant together with the suicide label of that participant (positive/negative for general/high suicide risk). For the MTM model, each learning example also included the auxiliary variable scores of the participant (i.e., their scores on the three sets of psychodiagnostics scales).
In the model development phase, a hyper-parameter tuning process was conducted on another 15% of the data (150 users). In this phase, we also considered several alternative models that were more complicated than the STM but less complicated than the MTM. These partial models included one of the MTM three auxiliary layers (e.g., psychiatric disorders) but their detection performance did not reach the quality of the complete MTM. Finally, in the test phase, the algorithm was used to provide suicide risk predictions to the remaining 15% of the dataset (151 users) based on their Facebook postings only (that is, the MTM did not have access to the personality, psychosocial, or psychiatric external labels).
This learning process was conducted five times, each time with a different random division of the dataset to three parts, to prevent from overfitting and selection bias. In each division, we maintained the same composite of users and postings. The results from this fivefold cross-validation process are presented in the following section. The full details of the models, including their objective function, training algorithm, hyper-parameters, and tuning procedure are provided in the Supplementary Material.
Results
Detection performance of suicide risk
A receiver operating characteristic curve (ROC curve), which plots the True Positive prediction rates of each model against its False Positive prediction rates was generated and the Area Under the ROC Curve (AUC) was calculated. AUC provides a reliable estimation of the quality of the predictions across all possible classification thresholds. It specifically suits class imbalanced tasks in which the positive class (suicidal users) is significantly smaller than the negative class (non-suicidal users)47. AUC scores can also be easily transformed to Cohen’s d, the most common effect-size measure in experimental psychology48.
Table 3 presents the prediction performance of the two models. The average prediction performances of the STM was significantly higher than chance level (AUC of 0.5), both for general risk [AUC = 0.621, 95% CI: 0.576, 0.657] and for high suicide risk [AUC = 0.629, 95% CI 0.606, 0.660]. A transformation of the AUC scores to effect sizes48 indicated a medium effect size for general risk (Cohen’s d = 0.436) and high risk (Cohen’s d = 0.466) of suicide. The results from the STM therefore suggest that single task models may produce higher than chance predictions that are comparable, and perhaps even superior, to previously documented non-machine learning suicide detection efforts5.
Importantly, the inclusion of all risk factors in the MTM produced substantial improvements in prediction accuracy for general [AUC = 0.746, 95% CI 0.727, 0.765] and high suicide risk [AUC = 0.697, 95% CI 0.690, 0.707]. These predictions showed a medium-to-large effect size for high suicide risk (Cohen’s d = 0.729) and a large-to-very large effect size for general suicide risk (Cohen’s d = 0.936). The absence of an overlap between the Confidence Intervals of the STM and the MTM, indicates that the observed improvements in the prediction quality of the MTM is significant. On average, the MTM produced higher AUC scores than the STM, both in the general risk case (mean difference = 0.124, 95% CI 0.074, 0.162) and the high risk case (mean difference = 0.064, 95% CI 0.034, 0.090).
A similar pattern of results was found when the Facebook texts were represented with the recent attention-based BERT model (Bidirectional Encoder Representations from Transformers)49. The comparison between the prediction performances with BERT and ELMo (see Supplementary Material, Table A) indicated that the observed patterns and predictions extend beyond the specific CWE method (ELMo) that was employed in this study. The results support our hypothesis that a multilayered prediction model consisting of all three layers of contributing factors (Facebook content → personality traits → psychosocial risks → psychiatric disorders → suicide) would demonstrate improved predictions, in comparison with a single task model and with the previous efforts in the literature to predict suicide risk without machine learning and natural language processing (NLP) methods.
Interpretation of the observed predictions
In order to gain a deeper insight into what could be the specific textual indications that allowed the machine to make predictions, we applied the following procedure to the fold in which the MTM achieved its best general risk AUC score. We first transformed the continuous general risk score that each participant received from the MTM to a binary general suicide risk label (positive/negative). The threshold from the ROC curve that was chosen for this transformation was the one that returned the maximum ratio between the True Positive and the False Positive rates. Based on this threshold, users were classified into four groups: True Positive, False Positive, True Negative, and False Negative (a plain language description of these classes is available in the Supplementary Material).
We then conducted a word search for explicit suicide-related content among users at general risk who were classified correctly by the MTM (N = 33 True Positive users, 22% of the test data). Specifically, we searched for morphological variations of three words: Suicide, Kill, and Die. This search produced eight mentions of suicide, 20 mentions of kill, and 44 appearances of die. Notably, only in a single instance did these words appear in messages directly related to suicide. Two typical examples are “my back is killing me” and “It’s gonna be a good Halloween, probably going to die, but it’ll be fun.” Even in the case of the most explicit phrase “I want to die,” the full context was: “Cramps so bad, I want to die”.
Finally, we applied Term Frequency Inverse Document Frequency (TF-IDF) analysis50 to detect specific words that distinguish between True Positive and True Negative users. For each one of the above four classes, we extracted the 100 most characteristic words that best distinguished the given class from the rest (see Supplementary Material, Table B. The results indicated that the most distinctive words of the True Positive class (i.e., users at general suicide risk who were identified correctly) consisted of negatively charged words (bad, worst), including swear words (bitch, fucking), words referring to feelings of distress (mad, cry, hurt, sad), and to physical complaints (sick, pain, surgery, hospital). Similar to the previous analysis, explicit suicide-related words, such as kill, die, or suicide did not appear in this list.
In contrast, the most distinctive words of the True Negative class (i.e., non-suicidal users who were identified correctly) consisted of positive words (great, happy, perfect), including positive emotions (loving, love, peace) and events (wedding, thanksgiving), positive experiences of belonging and friendships (together, friends, mother, wife), and positive attitude towards life (blessed, gift, wishes). Interestingly, a dominant theme in the postings of these True Negative users was religion and spirituality (Christ, church, God, faith). Taken together, these findings suggest that the ANN model did not rely on explicit suicide manifestations, but on a wide range of textual features, including emotionally charged topics.
Discussion
Suicide is a leading cause of death worldwide1 and early detection and prevention of suicide risk is a cross-national mission. However, five decades of suicide research have yielded prediction performances that are only marginally better than chance5. In the present study, we leveraged recent advancements in NLP methods to predict suicide risk from textual features of everyday, user-generated social media posts.
The results from the STM indicate that textual features of Facebook postings predict both general and high suicide risk (0.621 ≤ AUC ≤ 0.629). The observed medium effect size of the STM-based results is comparable, and perhaps even superior to earlier suicide prediction attempts that did not use machine learning5. This is a noteworthy proof of concept, given that the predictors of suicide risk in this study were not extracted from medical sources or demographic information, but from everyday user-generated behavior in a naturalistic environment (social media).
More importantly, the results confirmed our expectation that the MTM, which integrated multiple theory-driven risk factors, would produce improved prediction accuracy of suicide risk from textual social media postings (0.697 ≤ AUC ≤ 0.746), compared with the STM and with the existing literature on suicide risk prediction5. In this research, the MTM produced medium-to-large and large effect sizes for high and general suicide risk, respectively. These high-quality predictions were significantly better than the STM-based predictions. Altogether, these results demonstrate the potential of machine learning and NLP methods for the detection of externally validated suicide risk from everyday social media behavior, as well as the importance of integrating theory-driven factors when using such methods.
Theoretical contributions to research on suicide risk prediction from social media
The present work builds on earlier attempts to predict suicide risk from social media by incorporating several improvements. First, the incorporation of theory-driven measures strengthened the construct and external validity of the findings. In contrast to previous works that used proxy diagnostic measures (i.e., judgements made by experts or non-experts based on users' textual content) as the ground truth for suicide risk20,51, the current study relied on external, clinically valid measure of suicide risk. The inclusion of additional psycho-diagnostic tools (i.e., the personality, psychosocial, and psychiatric measures) contributed to the validity of the study as well.
Second, the dataset on which the prediction algorithms were developed was extracted from everyday (inter)actions in a non medical environment, rather than from a medical source or even from a designated online suicide-support forum, thus extending the generalizability of the findings to multiple and ordinary settings. To maintain this high ecological validity without compromising the internal validity of the psychological information, a strict data quality assurance protocol was applied, and only valid responses were included. In addition, post hoc internal reliability and convergence validity checks were conducted on all variables (see Supplementary Material). These procedures, along with the externally obtained psychodiagnostics measures, contributed to the construction of a large and high quality dataset, compared to existing research in this field9.
Third, to our knowledge, this study is the first to apply state-of-the-art artificial neural networks and deep CWEs for text representation in order to predict suicide risk from social media. The use of ELMo has two advantages over other text representation techniques, such as word count or N-grams: It generates representations also for non-words, which are popular in social media language (e.g., Lolll or OMG), and for words within their context (i.e., a given word receives different representations depending on its surrounding text). Complementing the advantages of CWE methods, the application of ANN-based models provided an effective platform for learning multiple variables jointly52, thus enabling the analysis of a multilayered psychosocial profile of suicidal and non-suicidal individuals.
Fourth, the combination of the four main features of the study (i.e., a CWE representation method, ANN modeling, psychodiagnostic measures, and analysis of everyday language) enabled the extraction of valuable language usage patterns that could not be hypothesized a priori. Since many users refrain from sharing explicit depressive content19,53, algorithms that rely solely on explicit distress-related content or established lexicons are arguably more susceptible to False Negative results. In contrast, the current ANN models were capable of detecting subtler cues of mental health difficulties. In fact, our word search for explicit suicide references revealed that the majority of the True Positive (suicidal) users rarely posted content that directly referred to suicide ideation. Correspondingly, the TF-IDF analysis did not reveal explicit suicide-related words either.
Although interpretations remain speculative, the TF-IDF outcomes suggest that correct classifications of suicide risk could be based on the appearance of negatively charged words (swearing, distress, physical complaints). These negative themes are in line with previous work on the digital footprints of depression in social media12. Interestingly, in this study, the high quality performance of the models may also result from the distinct language of the True Negative (non-suicidal) users, which included references to positive emotions and experiences, positive attitudes towards life, as well as religion and spirituality. This interpretation is in line with previous work emphasizing the protective role of meaning in life and religious/community involvement against actual suicide behaviors54. This finding provides another reason to employ ANN models, given that lexicon-based models that aim to discover explicit suicide-related content might miss these subtler signals (e.g., religious expressions in the True Negative group). ANN models may detect suicide risk even when users refrain from sharing explicit, suicide-related content.
Limitations of the current research
The first limitation of the present work concerns the self-report nature of the psycho-diagnostic data collection procedure. Although usage of such screening tools is common in large-scale mental health surveys, it may be less accurate than face-to-face, structured clinical interviews or formal medical assessments of suicide risk (or related psychiatric disorders). This study also did not investigate actual suicide deaths (completed suicide), which can be seen as the ultimate predictive criterion for suicide. Yet, in this study, we chose well-established psycho-diagnostic measures and ensured the quality of the self-reported responses by using multiple validation checks (internal reliability, convergence validity, and a data quality assurance protocol; see Supplementary Material). Nevertheless, we recommend that future research includes additional forms of external criteria for suicide risk assessment.
A second limitation concerns the focus on language-based input to the ANN models. A recent study on depression detection indicated the superiority of textual contents over other types of social network signals, such as length or timestamps of postings12. It is possible however, that the incorporation of non-textual social media activity features (e.g., pictures) could further improve the quality of suicide risk predictions.
A third limitation concerns the socio-demographic makeup of our sample. Compared with a recent US national survey conducted by the Centers for Disease Control and Prevention (CDC)55, the participants in the current sample were more likely to be younger, female, and have a slightly higher average annual income (see Table 2). In addition, although we specifically sought to recruit individuals from the general population, the current sample consisted of relatively high rates of suicide risk and emotional distress. These rates seem to characterize users of crowdsourcing platforms (such as MTurk), even when rigorous data quality measures are implemented43,44,56, and may therefore limit the generalizability of the findings. Finally, as our predictive models were text-based, Facebook users who had published less than 10 posts in 12 months had to be excluded from the analyses. The current findings (and text-based models in general) may therefore be less relevant for users who rarely publish textual content on social media.
Implications of the current research
The integration of machine learning methods in mental health practices seems to be a promising avenue for advancing personalized psychiatry practices6 and improving detection and diagnosis efforts of complex psychiatric phenomena7,57. The knowledge gained from this study and from similar studies9 could lay the foundations for the development of practical monitoring tools capable of tracking and analyzing cues from online communication, automatically and unobtrusively. Ideally, such applications would integrate cues from several information streams (including medical records) and alert individuals, family members, or mental health caregivers, when increased levels of suicide risk are detected.
A second implication of the current study relates to computational mental health research. We join previous recommendations to investigate the prediction performances of machine learning methods ‘in the wild’6, including everyday environments, such as ubiquitous social media platforms. Based on the current findings, we recommend that such endeavors combine state-of-the-art computational techniques along with theory-driven components from clinical and social sciences. While this study did not include every known risk factor, it anchored the predictions of suicide risk within the theoretical framework of the multifaceted nature of suicide2. We evidenced significant improvements in suicide risk predictions from social media postings when the detection algorithms incorporated the wider clinical picture of suicide and its related risk factors. In the present study, this progress was made possible due to a close collaboration between computational, social, and clinical scientists. Genuine, multi-disciplinary collaboration seems to be a prerequisite for the field of computational mental health research to make significant progress.
Data availability
The data of this study are available on request from the corresponding author [YO]. The data are not publicly available due to their containing information that could compromise the privacy of research participants.
References
Abubakar, I. I., Tillmann, T. & Banerjee, A. Global, regional, and national age-sex specific all-cause and cause-specific mortality for 240 causes of death, 1990–2013: A systematic analysis for the global burden of disease study 2013. Lancet 385, 117–171 (2015).
Levi-Belz, Y., Gvion, Y. & Apter, A. The psychology of suicide: From research understandings to intervention and treatment. Front. Psychiatry 10, 214 (2019).
Ribeiro, J. D. et al. Letter to the editor: Suicide as a complex classification problem: Machine learning and related techniques can advance suicide prediction—A reply to Roaldset. Psychol. Med. 46, 2009–2010. https://doi.org/10.1017/S0033291716000611 (2016).
Ribeiro, J. D., Huang, X., Fox, K. R., Walsh, C. G. & Linthicum, K. P. Predicting imminent suicidal thoughts and nonfatal attempts: The role of complexity. Clin. Psychol. Sci. 7, 941–957 (2019).
Franklin, J. C. et al. Risk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research. Psychol. Bull. 143, 187 (2017).
Perna, G., Grassi, M., Caldirola, D. & Nemeroff, C. B. The revolution of personalized psychiatry: Will technology make it happen sooner?. Psychol. Med. 48, 705–713. https://doi.org/10.1017/S0033291717002859 (2018).
Shatte, A. B. R., Hutchinson, D. M. & Teague, S. J. Machine learning in mental health: A scoping review of methods and applications. Psychol. Med. 49, 1426–1448. https://doi.org/10.1017/S0033291719000151 (2019).
Zheng, L. et al. Development of an early-warning system for high-risk patients for suicide attempt using deep learning and electronic health records. Transl. Psychiatry 10, 1–10 (2020).
Guntuku, S. C., Yaden, D. B., Kern, M. L., Ungar, L. H. & Eichstaedt, J. C. Detecting depression and mental illness on social media: An integrative review. Curr. Opin. Behav. Sci. 18, 43–49 (2017).
Gkotsis, G. et al. Characterisation of mental health conditions in social media using informed deep learning. Sci. Rep. 7, 45141 (2017).
De Choudhury, M., Gamon, M., Counts, S. & Horvitz, E. Predicting depression via social media. ICWSM 13, 1–10 (2013).
Eichstaedt, J. C. et al. Facebook language predicts depression in medical records. Proc. Natl. Acad. Sci. 115, 11203–11208 (2018).
Reece, A. G. & Danforth, C. M. Instagram photos reveal predictive markers of depression. arXiv preprint https://arXiv.org/1608.03282 (2016).
Zirikly, A., Resnik, P., Uzuner, O. & Hollingshead, K. CLPsych 2019 shared task: Predicting the degree of suicide risk in Reddit posts. In Proceedings of the Sixth Workshop on Computational Linguistics and Clinical Psychology, 24–33 (2019).
Pestian, J., Nasrallah, H., Matykiewicz, P., Bennett, A. & Leenaars, A. Suicide note classification using natural language processing: A content analysis. Biomed. Inform. Insights 3, 4706 (2010).
Stirman, S. W. & Pennebaker, J. W. Word use in the poetry of suicidal and nonsuicidal poets. Psychosom. Med. 63, 517–522 (2001).
Niederhoffer, K., Hollingshead, K., Resnik, P., Resnik, R. & Loveys, K. Proceedings of the Sixth Workshop on Computational Linguistics and Clinical Psychology (Association for Computational Linguistics, Minneapolis, 2019).
De Choudhury, M. & Kıcıman, E. Integrating Online and Offline Data in Complex, Sensitive Problem Domains: Experiences from Mental Health (Association for the Advancement of Artificial Intelligence, Menlo Park, 2018).
Ophir, Y., Asterhan, C. S. C. & Schwarz, B. B. The digital footprints of adolescent depression, social rejection and victimization of bullying on Facebook. Comput. Hum. Behav. 91, 62–71. https://doi.org/10.1016/j.chb.2018.09.025 (2019).
Sawhney, R., Manchanda, P., Singh, R. & Aggarwal, S. A computational approach to feature extraction for identification of suicidal ideation in tweets. In Proceedings of ACL 2018, Student Research Workshop, 91–98 (2018).
Blaney, P. H., Krueger, R. F. & Millon, T. E. Oxford Textbook of Psychopathology (Oxford University Press, Oxford, 2015).
Posner, K. et al. The Columbia-suicide severity rating scale: Initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am. J. Psychiatry 168, 1266–1277 (2011).
American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (DSM-5®) (American Psychiatric Pub, Washington, 2013).
Hawton, K. & van Heeringen, K. Suicide. The Lancet 373, 1372–1381. https://doi.org/10.1016/S0140-6736(09)60372-X (2009).
Sartorius, N., Üstün, T. B., Lecrubier, Y. & Wittchen, H.-U. Depression comorbid with anxiety: Results from the WHO study on psychological disorders in primary health care. Br. J. Psychiatry 168, 38–43 (1996).
Beck, A. T. Cognitive therapy: A 30-year retrospective. Am. Psychol. 46, 368 (1991).
Nolen-Hoeksema, S. & Watkins, E. R. A heuristic for developing transdiagnostic models of psychopathology: Explaining multifinality and divergent trajectories. Persp. Psychol. Sci. 6, 589–609 (2011).
Ehring, T. & Watkins, E. R. Repetitive negative thinking as a transdiagnostic process. Int. J. Cogn. Therapy 1, 192–205 (2008).
Cacioppo, J. T., Hughes, M. E., Waite, L. J., Hawkley, L. C. & Thisted, R. A. Loneliness as a specific risk factor for depressive symptoms: Cross-sectional and longitudinal analyses. Psychol. Aging 21, 140 (2006).
Green, B. H. et al. Risk factors for depression in elderly people: A prospective study. Acta Psychiatr. Scand. 86, 213–217 (1992).
John, O. P. & Srivastava, S. The Big-Five trait taxonomy: History, measurement, and theoretical perspectives. In Handbook of Personality: Theory and Research 2nd edn (eds Pervin, L. A. & John, O. P.) 102–138 (Guilford Press, New York, 1999).
Brezo, J., Paris, J. & Turecki, G. Personality traits as correlates of suicidal ideation, suicide attempts, and suicide completions: A systematic review. Acta Psychiatr. Scand. 113, 180–206 (2006).
Drapeau, C. W. et al. Screening for suicide risk in adult sleep patients. Sleep Med. Rev. 46, 17–26. https://doi.org/10.1016/j.smrv.2019.03.009 (2019).
Weber, A. N., Michail, M., Thompson, A. & Fiedorowicz, J. G. Psychiatric emergencies: Assessing and managing suicidal ideation. Med. Clin. 101, 553–571 (2017).
Turecki, G. & Brent, D. A. Suicide and suicidal behaviour. The Lancet 387, 1227–1239 (2016).
Kroenke, K., Spitzer, R. L. & Williams, J. B. W. The PHQ-9: Validity of a brief depression severity measure. J. Gen. Intern. Med. 16, 606–613. https://doi.org/10.1046/j.1525-1497.2001.016009606.x (2001).
Spitzer, R. L., Kroenke, K., Williams, J. B. W. & Löwe, B. A brief measure for assessing generalized anxiety disorder: The GAD-7. Arch. Intern. Med. 166, 1092–1097. https://doi.org/10.1001/archinte.166.10.1092 (2006).
Nolen-Hoeksema, S. & Morrow, J. A prospective study of depression and posttraumatic stress symptoms after a natural disaster: The 1989 Loma Prieta earthquake. J. Pers. Soc. Psychol. 61, 115–121. https://doi.org/10.1037/0022-3514.61.1.115 (1991).
Meyer, T. J., Miller, M. L., Metzger, R. L. & Borkovec, T. D. Development and validation of the penn state worry questionnaire. Behav. Res. Ther. 28, 487–495 (1990).
Russell, D. W. UCLA loneliness scale (Version 3): Reliability, validity, and factor structure. J. Pers. Assess. 66, 20–40 (1996).
Diener, E., Emmons, R. A., Larsen, R. J. & Griffin, S. The satisfaction with life scale. J. Pers. Assess. 49, 71–75. https://doi.org/10.1207/s15327752jpa4901_13 (1985).
Rammstedt, B. & John, O. P. Measuring personality in one minute or less: A 10-item short version of the Big Five inventory in English and German. J. Res. Pers. 41, 203–212 (2007).
Ophir, Y., Sisso, I., Asterhan, C. S. C., Tikochinski, R. & Reichart, R. The turker blues: Hidden factors behind increased depression rates among Amazon’s mechanical turkers. Clin. Psychol. Sci. 8, 65–83 (2020).
Arditte, K. A., Çek, D., Shaw, A. M. & Timpano, K. R. The importance of assessing clinical phenomena in Mechanical Turk research. Psychol. Assess. 28, 684 (2016).
McCredie, M. N. & Morey, L. C. Who are the turkers? A characterization of MTurk workers using the personality assessment inventory. Assessment 26, 759 (2018).
Peters, M. E. et al. Deep contextualized word representations. arXiv preprint https://arXiv.org/1802.05365 (2018).
Jeni, L. A., Cohn, J. F. & De La Torre, F. Facing imbalanced data—recommendations for the use of performance metrics. In 2013 Humaine association conference on affective computing and intelligent interaction, 245–251 (IEEE, 2013).
Salgado, J. F. Transforming the area under the normal curve (AUC) into Cohen’sd, Pearson’s rpb, odds-ratio, and natural log odds-ratio: Two conversion tables. Eur. J. Psychol. Appl. Legal Context 10, 35–47 (2018).
Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint https://arXiv.org/1810.04805 (2018).
Mogotsi, I. C. & Christopher, D. Manning, Prabhakar Raghavan, and Hinrich Schütze: Introduction to information retrieval. Inf. Retrieval 13, 192–195. https://doi.org/10.1007/s10791-009-9115-y (2010).
Ernala, S. K. et al. Methodological Gaps in Predicting Mental Health States from Social Media: Triangulating Diagnostic Signals (Association for Computing Machinery, Glasgow, 2019).
Ruder, S. An overview of multi-task learning in deep neural networks. arXiv preprint https://arXiv.org/1706.05098 (2017).
Ophir, Y. SOS on SNS: Adolescent distress on social network sites. Comput. Hum. Behav. 68, 51–55. https://doi.org/10.1016/j.chb.2016.11.025 (2017).
VanderWeele, T. J., Li, S., Tsai, A. C. & Kawachi, I. Association between religious service attendance and lower suicide rates among US women. JAMA Psychiatry 73, 845–851 (2016).
U.S. Centers for Disease Control and Prevention. Health, United States, 2018 (National Center for Health Statistics, Hyattsville, 2018).
Walters, K., Christakis, D. A. & Wright, D. R. Are mechanical Turk worker samples representative of health status and health behaviors in the US?. PLoS ONE 13, e0198835 (2018).
Paul, M. J. & Dredze, M. Social monitoring for public health. Synth. Lect. Inf. Concepts Retrieval Serv. 9, 1–183 (2017).
Acknowledgements
The research presented here was conducted with the financial support of the Israeli Innovation Authority (Kamin Grants #60561 and #60560).
Author information
Authors and Affiliations
Contributions
The reported research is a joint project, which combined researchers from complementary fields of knowledge under the supervision of R.R. and C.S.C.A. All authors contributed to the study design, test battery development, and writing process of the final manuscript. In addition to these joint contributions, Y.O. initiated the study concept, coordinated the research project, drafted and edited the manuscript. R.T. constructed the machine learning models and performed the data analyses. C.S.C.A. provided critical revisions to the manuscript. I.S. led the data collection process. R.R. guided the machine-learning analyses and interpretations of the findings and provided critical revisions.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Ophir, Y., Tikochinski, R., Asterhan, C.S.C. et al. Deep neural networks detect suicide risk from textual facebook posts. Sci Rep 10, 16685 (2020). https://doi.org/10.1038/s41598-020-73917-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-020-73917-0
- Springer Nature Limited
This article is cited by
-
Risk factors and their association network for young adults’ suicidality: a cross-sectional study
BMC Public Health (2024)
-
Unraveling minds in the digital era: a review on mapping mental health disorders through machine learning techniques using online social media
Social Network Analysis and Mining (2024)
-
Suicidal ideation prediction based on social media posts using a GAN-infused deep learning framework with genetic optimization and word embedding fusion
International Journal of Information Technology (2024)
-
AI and mental health: evaluating supervised machine learning models trained on diagnostic classifications
AI & SOCIETY (2024)
-
Emotion mining for early suicidal threat detection on both social media and suicide notes using context dynamic masking-based transformer with deep learning
Multimedia Tools and Applications (2024)