Abstract
Automatic text classification (TC) research can be used for real-world problems such as the classification of in-patient discharge summaries and medical text reports, which is beneficial to make medical documents more understandable to doctors. However, in electronic medical records (EMR), the texts containing sentences are shorter than that in general domain, which leads to the lack of semantic features and the ambiguity of semantic. To tackle this challenge, we propose to add word-cluster embedding to deep neural network for improving short text classification. Concretely, we first use hierarchical agglomerative clustering to cluster the word vectors in the semantic space. Then we calculate the cluster center vector which represents the implicit topic information of words in the cluster. Finally, we expand word vector with cluster center vector, and implement classifiers using CNN and LSTM respectively. To evaluate the performance of our proposed method, we conduct experiments on public data sets TREC and the medical short sentences data sets which is constructed and released by us. The experimental results demonstrate that our proposed method outperforms state-of-the-art baselines in short sentence classification on both medical domain and general domain.
Keywords
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Dos Santos CN, Gatti M (2014) Deep convolutional neural networks for sentiment analysis of short texts COLING, pp 69–78
Buschmeier K, Cimiano P, Klinger R (2014) An impact analysis of features in a classification approach to irony detection in product reviews. WASSA@ ACL
Sriram B, Fuhry D, Demir E et al (2010) Short text classification in twitter to improve information filtering. In: Proceedings of the 33rd international ACM SIGIR conference on research and development in information retrieval. ACM, pp 841–842
Mikolov T, Chen K, Corrado G et al (2013) Efficient estimation of word representations in vector space. arXiv:1301.3781
Pennington J, Socher R, Manning C (2014) Glove: global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp 1532–1543
Joulin A, Grave E, Bojanowski P et al (2016) Bag of tricks for efficient text classification. arXiv:1607.01759
Kim Y (2014) Convolutional neural networks for sentence classification. arXiv:1408.5882
Socher R, Perelygin A, Wu J et al (2013) Recursive deep models for semantic compositionality over a sentiment treebank. In: Proceedings of the 2013 conference on empirical methods in natural language processing, pp 1631–1642
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780
Zhou C, Sun C, Liu Z, Lau F A C-LSTM neural network for text classification. arXiv:1511.08630
Song J, He Y, Fu G (2015) Polarity classification of short product reviews via multiple cluster-based SVM classifiers. PACLIC
Wang P, Xu J, Xu B et al (2015) Semantic clustering and convolutional neural network for short text categorization. In: Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing (volume 2: short papers), vol 2, pp 352–357
Fan RE, Chang KW, Hsieh CJ et al (2008) LIBLINEAR: a library for large linear classification[J]. J Mach Learn Res 9:1871–1874
Lai S, Xu L, Liu K et al (2015) Recurrent convolutional neural networks for text classification. In: AAAI, vol 333, pp 2267–2273
Silva J, Coheur L, Mendes AC et al (2011) From symbolic to sub-symbolic information in question classification. Artif Intell Rev 35(2):137–154
Kalchbrenner N, Grefenstette E, Blunsom P (2014) A convolutional neural network for modelling sentences. arXiv:1404.2188
Ma M, Huang L, Xiang B et al (2015) Dependency-based convolutional neural networks for sentence embedding. arXiv:1507.01839
Komninos A, Manandhar S (2016) Dependency based embeddings for sentence classification tasks. HLT-NAACL, pp 1490–1500
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Shen, Y., Zhang, Q., Zhang, J., Huang, J., Lu, Y., Lei, K. (2019). Improving Medical Short Text Classification with Semantic Expansion Using Word-Cluster Embedding. In: Kim, K., Baek, N. (eds) Information Science and Applications 2018. ICISA 2018. Lecture Notes in Electrical Engineering, vol 514. Springer, Singapore. https://doi.org/10.1007/978-981-13-1056-0_41
Download citation
DOI: https://doi.org/10.1007/978-981-13-1056-0_41
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-1055-3
Online ISBN: 978-981-13-1056-0
eBook Packages: EngineeringEngineering (R0)