Abstract
Background: With the development of Internet, many people with suicide risk tend to express their thoughts on social media platforms. AI-based model can early identify social media users with suicide risk and analyze their cognitive and interpersonal characteristics. Then we can do early intervention to help them.
Objective: To build an automatic crisis balance analysis model based on artificial intelligence which can perform automatic early suicide identification, suicide risk classification and analyze cognitive distortion and interpersonal relationship of users. Then to validate the predictive efficiency of model.
Method: Firstly, based on the suicide knowledge graph, free annotation data set was generated and then Bert-based model was built. Secondly, the data set was refined by psychology students and experts to build fine-tuning model and Psychology+ model. The Psychology+ model was used as final suicide risk assessment model. We enriched and quantified the variables of cognitive and interpersonal characteristics and built the cognitive distortion and interpersonal relationship analysis model. Using F1 score, precision, recall and accuracy to evaluate the model performance and the consistence of model results with expert judgment and scales results to evaluate the model prediction ability.
Results: For the suicide risk assessment model, the F1 score, precision, recall rate and accuracy rate of the model are 77.98%, 80.75%, 75.41% and 78.68% respectively. For the cognitive distortion and interpersonal relationship analysis model, the F1 score, accuracy and recall rate of the model are 77.26%, 78.22% and 76.33% respectively. Comparing the results with the results of the scale by chi square test, there was no significant difference in cognitive distortion(P = 0.521) and interpersonal relationship(P = 0.189) aspect.
Conclusion: The model showed good performance and can be used as a guideline and evaluation tool for intervention.
This study was supported by the grant from the National College Students Innovation and Entrepreneurship Training Program of Wuhan University (202210486105), National Natural Science Foundation of China General Program (72174152), Project of Humanities and Social Sciences of the Ministry of Education in China (20YJCZH204), the Young Top-notch Talent Cultivation Program of Hubei Province.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
World Health Organization: Suicide worldwide in 2019. https://www.who.int/publications/i/item/9789240026643. Accessed 16 June 2021
Huang, Y.Q., Wang, Y., Wang, H., et al.: Prevalence of mental disorders in China: a cross-sectional epidemiological study. Lancet Psychiatry 6(3), 211–224 (2019). https://doi.org/10.1016/S2215-0366(18)30511-X
World Health Organization: Depression-Fact Sheet. https://www.who.int/news-room/fact-sheets/detail/depression. Accessed 16 Mar 2022
Buckman, J.E.J., Underwood, A., Clarke, K., et al.: Risk factors for relapse and recurrence of depression in adults and how they operate: a four-phase systematic review and meta-synthesis. Clin. Psychol. Rev. 64, 13–38 (2018). https://doi.org/10.1016/j.cpr.2018.07.005
World Health Organization: Depression. https://www.who.int/health-topics/depression#tab=tab_1. Accessed 16 Mar 2022
Roskar, S., Bracic, M.F., Kolar, U., et al.: Attitudes within the general population towards seeking professional help in cases of mental distress. Int. J. Soc. Psychiatry 63(7), 614–621 (2017). https://doi.org/10.1177/0020764017724819
Bifftu, B.B., Takele, W.W., Guracho, Y.D., et al.: Depression and its help seeking behaviors: a systematic review and meta-analysis of community survey in Ethiopia. Depression research and treatment. 1592596 (2018). https://doi.org/10.1155/2018/1592596
Aguilera, D.C.: Crisis intervention: theory and methodology. AORN J. 38(1), 88 (1971)
Huang, Z.S., Hu, Q., Gu, J.G., et al.: Web-based intelligent agents for suicide monitoring and early warning. China Digit. Med. 14(03), 3–6 (2019). https://doi.org/10.3969/j.issn.1673-7571.2019.03.001
Burns, D.: Feeling Good the New Mood Therapy. Scientific and Technical Documentation Press, Beijing (2014)
Frank, E., Levenson, J.C.: Interpersonal Psychotherapy. Chongqing University Press, Chongqing (2015)
Fu, G., Song, C., Li, J., Ma, Y., Chen, P., Wang, R., et al.: Distant supervision for mental health management in social media: suicide risk classification system development study. J. Med. Internet Res. 23(8), e26119 (2021). https://doi.org/10.2196/26119
Hammen, C.L., Krantz, S.: Effect of success and failure on depressive cognitions. J. Abnorm. Psychol. 85(6), 577–586 (1976). https://doi.org/10.1037/0021-843X.85.6.577
Krantz, S., Hammen, C.: Assessment of cognitive bias in depression. J. Abnorm. Psychol. 88(6), 611–619 (1979). https://doi.org/10.1037/0021-843X.88.6.611
Liu, X.J., Wang, M.P.: The association among childhood psychological abuse and neglect, cognitive bias and self-worth of medical freshmen. Chin. J. Health Psychol. 25(03), 446–449 (2017). https://doi.org/10.13342/j.cnki.cjhp.2017.03.035
Zheng, R.C.: Psychological Diagnosis of College Students. Shandong Education Press, Jinan (1999)
Wang, X.L., Xu, N.F., Yang, D.H., et al.: Intercourse vexation among medical students. Chin. Ment. Health J. 04, 247–250 (2005). https://doi.org/10.3321/j.issn:1000-6729.2005.04.008
Chen, Y.J., Huang, S.H., Zhou, Q.A., et al.: Interaction mechanism between boredom proneness, interpersonal disturbance and internet gaming addiction in university freshmen. Med. Soc. 33(07), 90–93 (2020). https://doi.org/10.13723/j.yxysh.2020.07.021
Huang, X.L., Zhang, L., Liu, T.L., et al.: Detecting suicidal ideation in Chinese microblogs with psychological lexicons. In: 2014 IEEE 11th International Conference on Ubiquitous Intelligence and Computing and 2014 IEEE 11th International Conference on Autonomic and Trusted Computing and 2014 IEEE 14th International Conference on Scalable Computing and Communications and Its Associated Workshops, pp. 844–849 (2014). https://doi.org/10.1109/uic-atc-scalcom.2014.48
Guan, L., Hao, B., Cheng, Q., et al.: Identifying Chinese microblog users with high suicide probability using internet-based profile and linguistic features: classification model. JMIR Ment. Health 2(2), e17 (2015). https://doi.org/10.2196/mental.4227
Cheng, Q., Li, T.M., Kwok, C.L., et al.: Assessing suicide risk and emotional distress in chinese social media: a text mining and machine learning study. J. Med. Internet Res. 19(7), e243 (2017). https://doi.org/10.2196/jmir.7276
Guan, L., Hao, B.B., Cheng, J., et al.: Behavioral and linguistic characteristics of microblog users with various suicide ideation level: an explanatory study. Chin. J. Public Health 31(03), 349–352 (2015). https://doi.org/10.11847/zgggws2015-31-03-29
Ryan, T., Xenos, S.: Who uses Facebook? An investigation into the relationship between the big five, shyness, narcissism, loneliness, and Facebook usage. Comput. Hum. Behav. 27(5), 1658–1664 (2011). https://doi.org/10.1016/j.chb.2011.02.004
Gosling, S.D., Augustine, A.A., Vazire, S., et al.: Manifestations of personality in online social networks: self-reported Facebook-related behaviors and observable profile information. Cyberpsychol. Behav. Soc. Netw. 14(9), 483–488 (2011). https://doi.org/10.1089/cyber.2010.0087
Cash, S.J., Thelwall, M., Peck, S.N., et al.: Adolescent suicide statements on My Space. Cyberpsychol. Behav. Soc. Netw. 16(3), 166–174 (2013). https://doi.org/10.1089/cyber.2012.0098
Spates, K., Ye, X., Johnson, A.: “I just might kill myself”: suicide expressions on Twitter. Death Stud. 44(3), 189–194 (2020). https://doi.org/10.1080/07481187.2018.1531085
Liu, X., Liu, X., Sun, J., et al.: Proactive suicide prevention online (PSPO): machine identification and crisis management for Chinese social media users with suicidal thoughts and behaviors. J. Med. Internet Res. 21(5), e11705 (2019). https://doi.org/10.2196/11705
Agrawal, P.K., Alvi, A.S., Bamnote, G.R.: Natural language-based self-learning feedback analysis system. In: Satapathy, S.C., Raju, K.S., Mandal, J.K., Bhateja, V. (eds.) Proceedings of the Second International Conference on Computer and Communication Technologies. AISC, vol. 380, pp. 99–107. Springer, New Delhi (2016). https://doi.org/10.1007/978-81-322-2523-2_9
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Guo, L.Y. et al. (2022). The Construction and Validation of an Automatic Crisis Balance Analysis Model. In: Traina, A., Wang, H., Zhang, Y., Siuly, S., Zhou, R., Chen, L. (eds) Health Information Science. HIS 2022. Lecture Notes in Computer Science, vol 13705. Springer, Cham. https://doi.org/10.1007/978-3-031-20627-6_17
Download citation
DOI: https://doi.org/10.1007/978-3-031-20627-6_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-20626-9
Online ISBN: 978-3-031-20627-6
eBook Packages: Computer ScienceComputer Science (R0)