Skip to main content

Deep Learning-Based Approach Using Word and Character Embedding for Named Entity Recognition from Hindi-English Tweets

  • Conference paper
  • First Online:
Applications of Networks, Sensors and Autonomous Systems Analytics

Abstract

Named Entity Recognition (NER) is a task that identifies named entities from data written in Natural Language. It accepts sentences or paragraphs as input and identifies the relevant nouns like names of people, places, organizations, etc. that appear within the sentences or paragraph or an article. This model also belongs from the field of Information Extraction of Natural Language Processing (NLP). Lots of research works have been carried out on Named Entities Recognition (NER), but most of the works have been done on resource-rich languages and domains. It is very challenging to work with informal tweets which make the process more complex due to unstructured and incomplete data. In this paper, we use deep learning-based approach using bi-directional LSTM (Bi-LSTM) for recognizing named entities from tweets mixed in Hindi and English languages.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Collins M, Singer Y (1999) Unsupervised models for named entity classification. In 1999 joint SIGDAT conference on empirical methods in natural language processing and very large Corpora.

    Google Scholar 

  2. Etzioni O, Cafarella M, Downey D, Popescu A-M, Shaked T, Soder-land S, Weld DS, Yates A (2005) Unsupervised named-entity extraction from the web: an experimental study. Artif Intell 165(1):91–134

    Article  Google Scholar 

  3. Zhang S, Elhadad N (2013) Unsupervised biomedical named entity recognition: experiments with clinical and biological texts. J Biomed Inform 46(6):1088–1098

    Article  Google Scholar 

  4. Rao PRK, Malarkodi CS, Ram RVS, Devi SL (2015) Esm-il: Entity extraction from social media text for indian languages @ fire 2015 - an overview. In FIRE workshops

    Google Scholar 

  5. Bhargava R, Sharma Y, Sharma S (2016a) Sentiment analysis for mixed script indic sentences. In Advances in Computing, Com-munications and Informatics (ICACCI), 2016 Inter-national Conference on, pages 524–529. IEEE

    Google Scholar 

  6. Ekbal A, Bandyopadhyay S (2008) Bengali named entity recognition using support vector machine. In Proceedings of the IJCNLP- 08 workshop on named entity recognition for south and south east Asian languages

    Google Scholar 

  7. Gupta D, Tripathi S, Ekbal A, Bhattacharyya P (2016) A hybrid approach for entity extraction in code-mixed social media data. Money 25:66

    Google Scholar 

  8. Bhat IA, Shrivastava M, Bhat RA (2016) Code mixed entity extraction in indian languages using neural networks. In FIRE (Working Notes), pp 296–297

    Google Scholar 

  9. Singh V, Vijay D, Akhtar SS, Shrivastava M (2018) Named entity recognition for Hindi- English Code-Mixed Social Media Text. In Proceedings of the Seventh Named Entities Workshop, pp 27–35, Melbourne, Australia, July 20, 2018, Association for Computational Linguistics

    Google Scholar 

  10. Ritter A, Clark S, Mausam, Etzioni O (2011) Named entity recognition in tweets: an experimental study. In Proceedings of the 2011 conference on empirical methods in natural language processing, July, Edinburgh, Scotland, UK

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Amit Majumder .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Majumder, A., Paul, A., Banerjee, A. (2022). Deep Learning-Based Approach Using Word and Character Embedding for Named Entity Recognition from Hindi-English Tweets. In: Mandal, J.K., Hinchey, M., Sen, S., Biswas, P. (eds) Applications of Networks, Sensors and Autonomous Systems Analytics. Studies in Autonomic, Data-driven and Industrial Computing. Springer, Singapore. https://doi.org/10.1007/978-981-16-7305-4_23

Download citation

  • DOI: https://doi.org/10.1007/978-981-16-7305-4_23

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-16-7304-7

  • Online ISBN: 978-981-16-7305-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics