Skip to main content

Biomedical Text Recognition Using Convolutional Neural Networks: Content Based Deep Learning

  • Conference paper
  • First Online:
Advances in Computational Collective Intelligence (ICCCI 2020)

Abstract

Named Entity Recognition (NER) targets to automatically detect the drug and disease mentions from biomedical texts and is fundamental step in the biomedical text mining. Although deep learning has been successfully implemented, the accuracy and processing time are still major issues preventing it from achieving NMR. This research aims to upgrade the accuracy of classification while decreasing the processing time, by paying more attention to significant areas of NMR. The novel proposed system consists of a Bi-Directional Long Short-Term Memory with Conditional Random Field (BiLSTM-CRF) using dropout strategy to effectively prevent overfitting and enhancing the generalization abilities. The system built includes the attention mechanism and attention fusion for redistributing the weight of samples belonging to each class in order to compensate the problem occurring from data imbalance and to focus only on the critical areas of the observed things and ignoring non-critical areas.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Li, L., Jin, L., Jiang, Z., Song, D., Huang, D.: Biomedical named entity recognition based on extended recurrent neural networks. In: 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 649–652 (2015)

    Google Scholar 

  2. Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., Dyer, C.: Neural architectures for named entity recognition. arXiv preprint arXiv:1603.01360 (2016)

  3. Luo, L.: An attention-based BiLSTM-CRF approach to document-level chemical named entity recognition. Bioinformatics 34, 1381–1388 (2018)

    Article  Google Scholar 

  4. Dandala, B., Joopudi, V., Devarakonda, M.: Adverse drug events detection in clinical notes by jointly modeling entities and relations using neural networks. Drug Saf. 42(1), 135–146 (2019). https://doi.org/10.1007/s40264-018-0764-x

    Article  Google Scholar 

  5. Wei, H.: Named entity recognition from biomedical texts using a fusion attention-based BiLSTM-CRF. IEEE Access 7, 73627–73636 (2019)

    Article  Google Scholar 

  6. Dang, T.H., Le, H.Q., Nguyen, T.M., Vu, S.T., Wren, J.: D3NER: biomedical named entity recognition using CRF-biLSTM improved with fine-tuned embeddings of various linguistic information. Bioinformatics 34(20), 3539–3546 (2018)

    Article  Google Scholar 

  7. Fabregat, H., Araujo, L., Martinez-Romo, J.: Deep neural models for extracting entities and relationships in the new RDD corpus relating disabilities and rare diseases. Comput. Methods Prog. Biomed. 164, 121–129 (2018)

    Article  Google Scholar 

  8. Zhu, Q., Li, X., Consea, A., Pereira, C.: GRAM-CNN: a deep learning approach with local context for named entity recognition in biomedical text. Bioinformatics 34(9), 1547–1554 (2018)

    Article  Google Scholar 

  9. Kim, J., Ko, Y., Seo, J.: A bootstrapping approach with CRF and deep learning models for improving the biomedical named entity recognition in multi-domains. IEEE Access 7(99), 70308–70318 (2019)

    Article  Google Scholar 

  10. Cho, H., Lee, H.: Biomedical named entity recognition using deep neural networks with contextual information. BMC Bioinform. 20 (2019). Article number: 735. https://doi.org/10.1186/s12859-019-3321-4

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to P. W. C. Prasad .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Joshi, S., Alsadoon, A., Senanayake, S.M.N.A., Prasad, P.W.C., Naim, A.G., Elchouemi, A. (2020). Biomedical Text Recognition Using Convolutional Neural Networks: Content Based Deep Learning. In: Hernes, M., Wojtkiewicz, K., Szczerbicki, E. (eds) Advances in Computational Collective Intelligence. ICCCI 2020. Communications in Computer and Information Science, vol 1287. Springer, Cham. https://doi.org/10.1007/978-3-030-63119-2_48

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-63119-2_48

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-63118-5

  • Online ISBN: 978-3-030-63119-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics