Skip to main content

Towards User Friendly Medication Mapping Using Entity-Boosted Two-Tower Neural Network

  • Conference paper
  • First Online:
Deep Learning for Human Activity Recognition (DL-HAR 2021)

Abstract

Recent advancements in medical entity linking have been applied in the area of scientific literature and social media data. However, with the adoption of telemedicine and conversational agents such as Alexa in healthcare settings, medical name inference has become an important task. Medication name inference is the task of mapping user friendly medication names from a free-form text to a concept in a normalized medication list. This is challenging due to the differences in the use of medical terminology from health care professionals and user conversations coming from the lay public. We begin with mapping descriptive medication phrases (DMP) to standard medication names (SMN). Given the prescriptions of each patient, we want to provide them with the flexibility of referring to the medication in their preferred ways. We approach this as a ranking problem which maps SMN to DMP by ordering the list of medications in the patient’s prescription list obtained from pharmacies. Furthermore, we leveraged the output of intermediate layers and performed medication clustering. We present the Medication Inference Model (MIM) achieving state-of-the-art results. By incorporating medical entities based attention, we have obtained further improvement for ranking models.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.fdbhealth.com/.

  2. 2.

    CommonNames, Warning, Uses, HowToUse, SideEffects, Precautions, DrugInteractions, Overdose, Notes, MissedDose, Storage, MedicAlert.

  3. 3.

    https://portal.dbmi.hms.harvard.edu/projects/n2c2-nlp/.

References

  1. Zhu, M., Celikkaya, B., Bhatia, P., Reddy, C.K.: LATTE: latent type modeling for biomedical entity linking. arXiv preprint arXiv:1911.09787 (2019)

  2. Miftahutdinov, Z., Tutubalina, E.: Deep neural models for medical concept normalization in user-generated texts. arXiv preprint arXiv:1907.07972 (2019)

  3. Chopra, S., Hadsell, R., LeCun, Y.: Learning a similarity metric discriminatively, with application to face verification. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), vol. 1, pp. 539–546. IEEE (2005)

    Google Scholar 

  4. Luong, M.-T., Pham, H., Manning, C.D.: Effective approaches to attention-based neural machine translation. arXiv preprint arXiv:1508.04025 (2015)

  5. Bhatia, P., Celikkaya, B., Khalilia, M., Senthivel, S.: Comprehend medical: A named entity recognition and relationship extraction web service. In: 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA), pp. 1844–1851 (2019)

    Google Scholar 

  6. Kim, Y.: Convolutional neural networks for sentence classification. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar, October 2014, pp. 1746–1751. Association for Computational Linguistics (2014)

    Google Scholar 

  7. Devlin, J., Chang, M.-W., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)

  8. Guo, J., Fan, Y., Ji, X., Cheng, X.: MatchZoo: a learning, practicing, and developing system for neural text matching. In: Proceedings of the 42Nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2019, pp. 1297–1300. ACM, New York (2019)

    Google Scholar 

  9. Zhang, Y., Chen, Q., Yang, Z., Lin, H., Zhiyong, L.: BioWordVec, improving biomedical word embeddings with subword information and MeSH. Sci. Data 6(1), 52 (2019)

    Article  Google Scholar 

  10. Chen, Q., Peng, Y., Lu, Z.: BiosentVec: creating sentence embeddings for biomedical texts. CoRR, abs/1810.09302 (2018)

    Google Scholar 

  11. Bojanowski, P., Grave, E., Joulin, A., Mikolov, T.: Enriching word vectors with subword information. Trans. Assoc. Comput. Linguist. 5, 135–146 (2017)

    Article  Google Scholar 

  12. Alsentzer, E., et al.: Publicly available clinical BERT embeddings. In: Proceedings of the 2nd Clinical Natural Language Processing Workshop, Minneapolis, Minnesota, USA, pp. 72–78. Association for Computational Linguistics, June 2019

    Google Scholar 

  13. Lee, J., et al.: BioBERT: a pre-trained biomedical language representation model for biomedical text mining. Bioinformatics 36, 1234–1240 (2019)

    Google Scholar 

  14. Hu, B., Lu, Z., Li, H., Chen, Q.: Convolutional neural network architectures for matching natural language sentences. In: Advances in Neural Information Processing Systems, pp. 2042–2050 (2014)

    Google Scholar 

  15. Dai, Z., Xiong, C., Callan, J., Liu, Z.: Convolutional neural networks for soft-matching n-grams in ad-hoc search. In: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, pp. 126–134 (2018)

    Google Scholar 

  16. Wang, S., Jiang, J.: Machine comprehension using match-LSTM and answer pointer. arXiv preprint arXiv:1608.07905 (2016)

  17. Pang, L., Lan, Y., Guo, J., Xu, J., Wan, S., Cheng, X.: Text matching as image recognition. In: Thirtieth AAAI Conference on Artificial Intelligence (2016)

    Google Scholar 

  18. Rousseeuw, P.J.: Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. J. Comput. Appl. Math. 20, 53–65 (1987)

    Article  Google Scholar 

  19. Aronson, A.R.: Effective mapping of biomedical text to the UMLS metathesaurus: the metamap program. In: Proceedings of the AMIA Symposium, p. 17. American Medical Informatics Association (2001)

    Google Scholar 

  20. Brennan, P.F., Aronson, A.R.: Towards linking patients and clinical information: detecting UMLS concepts in e-mail. J. Biomed. Inf. 36(4–5), 334–341 (2003)

    Article  Google Scholar 

  21. Leaman, R., Doğan, R.I., Lu, Z.: DNorm: disease name normalization with pairwise learning to rank. Bioinformatics 29(22), 2909–2917 (2013)

    Article  Google Scholar 

  22. Limsopatham, N., Collier, N.: Normalising medical concepts in social media texts by learning semantic representation. Association for Computational Linguistics (2016)

    Google Scholar 

  23. Lee, K., Hasan, S.A., Farri, O., Choudhary, A., Agrawal, A.: Medical concept normalization for online user-generated texts. In: 2017 IEEE International Conference on Healthcare Informatics (ICHI), pp. 462–469. IEEE (2017)

    Google Scholar 

  24. Belousov, M., Dixon, W., Nenadic, G.: Using an ensemble of generalised linear and deep learning models in the SMM4H 2017 medical concept normalisation task. In: Proceedings of the Second Workshop on Social Media Mining for Health Applications (SMM4H). Health Language Processing Laboratory (2017)

    Google Scholar 

  25. Luo, Y., Song, G., Li, P., Qi, Z.: Multi-task medical concept normalization using multi-view convolutional neural network. In: Thirty-Second AAAI Conference on Artificial Intelligence (2018)

    Google Scholar 

  26. Niu, J., Yang, Y., Zhang, S., Sun, Z., Zhang, W.: Multi-task character-level attentional networks for medical concept normalization. Neural Process. Lett. 49(3), 1239–1256 (2019)

    Article  Google Scholar 

  27. Bhatia, P., Arumae, K., Busra Celikkaya, E.: Dynamic transfer learning for named entity recognition. In: Shaban-Nejad, A., Michalowski, M. (eds.) W3PHAI 2019. SCI, vol. 843, pp. 69–81. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-24409-5_7

    Chapter  Google Scholar 

  28. Singh, G., Bhatia, P.: Relation extraction using explicit context conditioning. arXiv preprint arXiv:1902.09271 (2019)

  29. Jin, M., et al.: Improving hospital mortality prediction with medical named entities and multimodal learning. arXiv preprint arXiv:1811.12276 (2018)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shaoqing Yuan .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yuan, S., Bhatia, P., Celikkaya, B., Liu, H., Choi, K. (2021). Towards User Friendly Medication Mapping Using Entity-Boosted Two-Tower Neural Network. In: Li, X., Wu, M., Chen, Z., Zhang, L. (eds) Deep Learning for Human Activity Recognition. DL-HAR 2021. Communications in Computer and Information Science, vol 1370. Springer, Singapore. https://doi.org/10.1007/978-981-16-0575-8_10

Download citation

  • DOI: https://doi.org/10.1007/978-981-16-0575-8_10

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-16-0574-1

  • Online ISBN: 978-981-16-0575-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics