Abstract
Text-oriented clinical diagnosis inference is to predict a set of diagnoses for a specific patient given its medical notes. Due to the great potential of automatic diagnosis inference, machine learning methods have began to be applied to this domain. However, existing approaches focus on performing either labor-intensive feature engineering or sequential modeling of each medical note separately, without considering the information sharing among similar patients, which is essential for evidence-based medicine, an emerging new diagnosis process. Motivated by this issue and the recently proposed graph convolutional network (GCN) for text classification, we propose to apply GCN for the text-oriented clinical diagnosis inference task. To encode the comorbidity of diagnoses into the GCN model and allow information sharing between patients, we devise a coupled graph convolutional neural networks (CGCN), where a note-dependent graph and a label-dependent graph are learned collaboratively with hyperplane projection to ensure they are in the same semantic space. The comprehensive results on two real datasets show that our method outperforms the state-of-art methods in text-oriented diagnosis inference.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Bastings, J., Titov, I., Aziz, W., Marcheggiani, D., Sima’an, K.: Graph convolutional encoders for syntax-aware neural machine translation. arXiv (2017)
Baumel, T., Nassour-Kassis, J., Cohen, R., Elhadad, M., Elhadad, N.: Multi-label classification of patient notes: case study on ICD code assignment. In: AAAI (2018)
Baxt, W.G.: Use of an artificial neural network for data analysis in clinical decision-making: the diagnosis of acute coronary occlusion. Neural Comput. 2(4), 480–489 (1990)
Binaghi, E.: A fuzzy logic inference model for a rule-based system in medical diagnosis. Expert Syst. 7(3), 134–141 (1990)
Bruna, J., Zaremba, W., Szlam, A., Lecun, Y.: Spectral networks and locally connected networks on graphs (2014)
Choi, E., Bahadori, M.T., Schuetz, A., Stewart, W.F., Sun, J.: Doctor AI: predicting clinical events via recurrent neural networks. In: MLHC, pp. 301–318 (2016)
Defferrard, M., Bresson, X., Vandergheynst, P.: Convolutional neural networks on graphs with fast localized spectral filtering. In: NIPS, pp. 3844–3852 (2016)
Djulbegovic, B., Guyatt, G.H.: Progress in evidence-based medicine: a quarter century on. Lancet 390(10092), 415–423 (2017)
Ghassemi, M., et al.: Unfolding physiological state: Mortality modelling in intensive care units. In: SIGKDD, pp. 75–84. ACM (2014)
Henaff, M., Bruna, J., Lecun, Y.: Deep convolutional networks on graph-structured data. arXiv (2015)
Iyyer, M., Enns, P., Boyd-Graber, J., Resnik, P.: Political ideology detection using recursive neural networks. In: ACL, vol. 1, pp. 1113–1122 (2014)
Johnson, A.E., et al.: MIMIC-III, a freely accessible critical care database. Sci. Data 3, 160035 (2016)
Keezer, M.R., Sisodiya, S.M., Sander, J.W.: Comorbidities of epilepsy: current concepts and future perspectives. Lancet Neurol. 15(1), 106–115 (2016)
Kim, Y.: Convolutional neural networks for sentence classification. arXiv (2014)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv (2014)
Kipf, T., Welling, M.: Semi-supervised classification with graph convolutional networks (2017)
Lipton, Z.C., Kale, D.C., Elkan, C., Wetzel, R.: Learning to diagnose with LSTM recurrent neural networks. arXiv (2015)
Liu, N., Lu, P., Zhang, W., Wang, J.: Knowledge-aware deep dual networks for text-based mortality prediction. In: ICDE, pp. 1406–1417. IEEE (2019)
Lund, N., Petersen, A., Snoer, A., Jensen, R.H., Barloese, M.: Cluster headache is associated with unhealthy lifestyle and lifestyle-related comorbid diseases: results from the Danish cluster headache survey. Cephalalgia 39(2), 254–263 (2019)
Manevitz, L.M., Yousef, M.: One-class SVMS for document classification. JMLR 2, 139–154 (2001)
Miller, A., Fisch, A., Dodge, J., Karimi, A.H., Bordes, A., Weston, J.: Key-value memory networks for directly reading documents. arXiv (2016)
Nam, J., Kim, J., Loza Mencía, E., Gurevych, I., Fürnkranz, J.: Large-scale Multi-label Text Classification - Revisiting Neural Networks. arXiv (2013)
Peng, H., et al.: Large-scale hierarchical text classification with recursively regularized deep graph-CNN. In: WWW, pp. 1063–1072 (2018)
Prakash, A., et al.: Condensed memory networks for clinical diagnostic inferencing. In: AAAI (2017)
Ramos, A.L., Redeker, I., Hoffmann, F., Callhoff, J., Zink, A., Albrecht, K.: Comorbidities in patients with rheumatoid arthritis and their association with patient-reported outcomes: results of claims data linked to questionnaire survey. J. Rheumatol. 46(6), 564–571 (2019)
Sackett, D.L., Rosenberg, W.M., Gray, J.M., Haynes, R.B., Richardson, W.S.: Evidence based medicine: what it is and what it isn’t (1996)
Schlichtkrull, M., Kipf, T.N., Bloem, P., van den Berg, R., Titov, I., Welling, M.: Modeling relational data with graph convolutional networks. In: Gangemi, A., et al. (eds.) ESWC 2018. LNCS, vol. 10843, pp. 593–607. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-93417-4_38
Sun, M., Zhao, S., Gilvary, C., Elemento, O., Zhou, J., Wang, F.: Graph convolutional networks for computational drug development and discovery. Brief. Bioinform. 21(3), 919–935 (2019)
Wang, G., et al.: Joint embedding of words and labels for text classification. arXiv (2018)
Wang, J., Wang, Z., Zhang, D., Yan, J.: Combining knowledge with deep convolutional neural networks for short text classification. In: IJCAI, pp. 2915–2921. AAAI Press (2017)
Wang, S., Manning, C.D.: Baselines and bigrams: simple, good sentiment and topic classification. In: ACL, pp. 90–94. ACL (2012)
Xue, Q., Zhang, W., Zha, H.: Multi-label classification of patient notes: case study on ICD code assignment. In: AAAI (2020)
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., Hovy, E.: Hierarchical attention networks for document classification. In: NAACL, pp. 1480–1489 (2016)
Yao, L., Mao, C., Luo, Y.: Graph convolutional networks for text classification. In: AAAI, vol. 33, pp. 7370–7377 (2019)
Zhang, H., Xiao, L., Chen, W., Wang, Y., Jin, Y.: Multi-task label embedding for text classification. arXiv (2017)
Zhou, J., Cui, G., Zhang, Z., Yang, C., Liu, Z., Sun, M.: Graph neural networks: a review of methods and applications. arXiv (2018)
Acknowledgement
This work was supported in part by National Natural Science Foundation of China under Grant No. 61532010 and 61521002, and Beijing Academy of Artificial Intelligence (BAAI).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Liu, N., Zhang, W., Li, X., Yuan, H., Wang, J. (2020). Coupled Graph Convolutional Neural Networks for Text-Oriented Clinical Diagnosis Inference. In: Nah, Y., Cui, B., Lee, SW., Yu, J.X., Moon, YS., Whang, S.E. (eds) Database Systems for Advanced Applications. DASFAA 2020. Lecture Notes in Computer Science(), vol 12112. Springer, Cham. https://doi.org/10.1007/978-3-030-59410-7_26
Download citation
DOI: https://doi.org/10.1007/978-3-030-59410-7_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-59409-1
Online ISBN: 978-3-030-59410-7
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)