Skip to main content
View expanded cover

International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems

IEA/AIE 2017: Advances in Artificial Intelligence: From Theory to Practice pp 396–406Cite as

Interweaving Domain Knowledge and Unsupervised Learning for Psychiatric Stressor Extraction from Clinical Notes

Part of the Lecture Notes in Computer Science book series (LNAI,volume 10351)

Abstract

Mental health is an increasingly important problem in healthcare. Psychiatric stressors are one of the major contributors of mental disorders. Very few studies have investigated stressor data in electronic health records, mostly because they are recorded in narrative texts. This study takes the initiative to develop a natural language processing system to automatically extract psychiatric stressors from clinical notes. Our approach integrates domain knowledge from multiple sources and unsupervised word representation features generated from deep learning based algorithms, to address the context dependence and data sparseness challenges caused by idiosyncratic psychosocial backgrounds. Experimental results on psychiatric notes from the CEGS N-GRID 2016 challenge demonstrate that the proposed approach is promising. The best performing configuration achieved a precision of 90.5%, a recall of 65.5%, and a F-measure of 76.0% for inexact matching.

Keywords

  • Domain Knowledge
  • Conditional Random Field
  • Unify Medical Language System
  • Name Entity Recognition
  • False Negative Error

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-60045-1_41
  • Chapter length: 11 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   64.99
Price excludes VAT (USA)
  • ISBN: 978-3-319-60045-1
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   84.99
Price excludes VAT (USA)
Learn about institutional subscriptions
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.

Notes

  1. 1.

    https://www.i2b2.org/NLP/RDoCforPsychiatry.

  2. 2.

    http://www.chokkan.org/software/crfsuite/.

  3. 3.

    http://clamp.uth.edu/.

References

  1. Aronson, A.R., Lang, F.M.: An overview of MetaMap: historical perspective and recent advances. J. Am. Med. Inf. Assoc. 17(3), 229–236 (2010)

    CrossRef  Google Scholar 

  2. Bodenreider, O.: The unified medical language system (UMLS): integrating biomedical terminology. Nucleic Acids Res. 32(suppl 1), D267–D270 (2004)

    CrossRef  Google Scholar 

  3. Cho, H.C., Okazaki, N., Miwa, M., Tsujii, J.: Named entity recognition with multiple segment representations. Inf. Process. Manag. 49(4), 954–965 (2013)

    CrossRef  Google Scholar 

  4. Collobert, R., Weston, J.: A unified architecture for natural language processing: deep neural networks with multitask learning. In: The 25th International Conference on Machine Learning, pp. 160–167. ACM (2008)

    Google Scholar 

  5. Friedman, M.J., Resick, P.A., Bryant, R.A., Strain, J., Horowitz, M., Spiegel, D.: Classification of trauma and stressor-related disorders in DSM-5. Depression and anxiety 28(9), 737–749 (2011). http://onlinelibrary.wiley.com/doi/10.1002/da.20845/full

    CrossRef  Google Scholar 

  6. Gorrell, G., Jackson, R., Roberts, A., Stewart, R.: Finding negative symptoms of schizophrenia in patient records. In: Proceedings of the NLP Med Biol Work (NLPMedBio), Recent Adv Nat Lang Process (RANLP), pp. 9–17 (2013)

    Google Scholar 

  7. Guo, J., Che, W., Wang, H., Liu, T.: Revisiting embedding features for simple semi-supervised learning. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 110–120 (2014)

    Google Scholar 

  8. Insel, T.R.: The NIMH research domain criteria (RDoC) project: precision medicine for psychiatry. Am. J. Psychiatry (2014). http://ajp.psychiatryonline.org/doi/abs/10.1176/appi.ajp.2014.14020138

  9. Kazama, J., Makino, T., Ohta, Y., Tsujii, J.: Tuning support vector machines for biomedical named entity recognition. In: Proceedings of the ACL-02 Workshop on Natural Language Processing in the Biomedical Domain, vol. 3, pp. 1–8. Association for Computational Linguistics (2002)

    Google Scholar 

  10. Lafferty, J., McCallum, A., Pereira, F.C.N.: Conditional random fields: probabilistic models for segmenting and labeling sequence data (2001)

    Google Scholar 

  11. Leaman, R., Doğan, R.I., Lu, Z.: DNorm: disease name normalization with pairwise learning to rank. Bioinformatics, p. btt474 (2013)

    Google Scholar 

  12. Leaman, R., Lu, Z.: TaggerOne: joint named entity recognition and normalization with semi-Markov Models. Bioinformatics 32(18), 2839–2846 (2016)

    CrossRef  Google Scholar 

  13. McCoy, T.H., Castro, V.M., Roberson, A.M., Snapper, L.A., Perlis, R.H.: Improving prediction of suicide and accidental death after discharge from general hospitals with natural language processing. Jama Psychiatry 73(10), 1064–1071 (2016)

    CrossRef  Google Scholar 

  14. Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013)

  15. Miller, G.A.: WordNet: a lexical database for English. Commun. ACM 38(11), 39–41 (1995)

    CrossRef  Google Scholar 

  16. Mnih, A., Hinton, G.E.: A scalable hierarchical distributed language model. In: Advances in Neural Information Processing Systems, pp. 1081–1088 (2009)

    Google Scholar 

  17. Nadeau, D., Turney, P.D., Matwin, S.: Unsupervised named-entity recognition: generating gazetteers and resolving ambiguity. In: Lamontagne, L., Marchand, M. (eds.) AI 2006. LNCS, vol. 4013, pp. 266–277. Springer, Heidelberg (2006). doi:10.1007/11766247_23

    CrossRef  Google Scholar 

  18. Organization, W.H., et al.: Prevention of mental disorders: effective interventions and policy options: Summary report (2004). http://apps.who.int/iris/handle/10665/43027

  19. Patel, R., Wilson, R., Jackson, R., Ball, M., Shetty, H., Broadbent, M., Stewart, R., McGuire, P., Bhattacharyya, S.: Cannabis use and treatment resistance in first episode psychosis: a natural language processing study. Lancet 385, S79 (2015)

    CrossRef  Google Scholar 

  20. Pestian, J.P., Grupp-Phelan, J., Bretonnel Cohen, K., Meyers, G., Richey, L.A., Matykiewicz, P., Sorter, M.T.: A controlled trial using natural language processing to examine the language of suicidal adolescents in the emergency department. Suicide and Life-threatening Behavior (2015)

    Google Scholar 

  21. Proctor, E.K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., Mittman, B.: Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm. Policy Ment. Health Ment. Health Serv. Res. 36(1), 24–34 (2009)

    CrossRef  Google Scholar 

  22. Rumshisky, A., Ghassemi, M., Naumann, T., Szolovits, P., Castro, V.M., McCoy, T.H., Perlis, R.H.: Predicting early psychiatric readmission with natural language processing of narrative discharge summaries. Transl. Psychiatry 6(10), e921 (2016)

    CrossRef  Google Scholar 

  23. Saeed, M., Villarroel, M., Reisner, A.T., Clifford, G., Lehman, L.W., Moody, G., Heldt, T., Kyaw, T.H., Moody, B., Mark, R.G.: Multiparameter Intelligent Monitoring in Intensive Care II (MIMIC-II): a public-access intensive care unit database. Crit. Care Med. 39(5), 952 (2011)

    CrossRef  Google Scholar 

  24. Tang, B., Feng, Y., Wang, X., Wu, Y., Zhang, Y., Jiang, M., Wang, J., Xu, H.: A comparison of conditional random fields and structured support vector machines for chemical entity recognition in biomedical literature. J. Cheminform. 7(supplement 1), S8 (2015)

    CrossRef  Google Scholar 

  25. Wilson, T., Wiebe, J., Hoffmann, P.: Recognizing contextual polarity in phrase-level sentiment analysis. In: Proceedings of the Conference on Human Language Technology and Empirical Methods in Language Processing, pp. 347–354. Association for Computational Linguistics (2005)

    Google Scholar 

  26. Zhang, Y., Wang, J., Tang, B., Wu, Y., Jiang, M., Chen, Y., Xu, H.: UTH_CCB: A Report for SemEval 2014 Task 7 Analysis of Clinical Text. SemEval 2014, pp. 802–806 (2014)

    Google Scholar 

Download references

Acknowledgement

We thank the organizers of the CEGS N-GRID 2016 challenge for providing the corpus.

Author information

Authors and Affiliations

  1. St. John’s School, Houston, TX, 77019, USA

    Olivia R. Zhang

  2. School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX, 77030, USA

    Yaoyun Zhang, Jun Xu, Kirk Roberts & Hua Xu

  3. Department of Psychiatry and Behavioral Sciences, The University of Texas Health Science Center at Houston, Houston, TX, 77030, USA

    Xiang Y. Zhang

Authors
  1. Olivia R. Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yaoyun Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jun Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kirk Roberts
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xiang Y. Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Hua Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hua Xu .

Editor information

Editors and Affiliations

  1. Artois University, Lens, France

    Salem Benferhat

  2. Artois University, Lens, France

    Karim Tabia

  3. Texas State University, San Marcos, Texas, USA

    Moonis Ali

Rights and permissions

Reprints and Permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Zhang, O.R., Zhang, Y., Xu, J., Roberts, K., Zhang, X.Y., Xu, H. (2017). Interweaving Domain Knowledge and Unsupervised Learning for Psychiatric Stressor Extraction from Clinical Notes. In: Benferhat, S., Tabia, K., Ali, M. (eds) Advances in Artificial Intelligence: From Theory to Practice. IEA/AIE 2017. Lecture Notes in Computer Science(), vol 10351. Springer, Cham. https://doi.org/10.1007/978-3-319-60045-1_41

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-60045-1_41

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-60044-4

  • Online ISBN: 978-3-319-60045-1

  • eBook Packages: Computer ScienceComputer Science (R0)