Skip to main content
SpringerLink
Log in

Sentence Boundary Detection for Hindi–English Social Media Text

  • Conference paper
  • First Online:
Recent Findings in Intelligent Computing Techniques

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 709))

Abstract

In this paper, we present an approach of automatic sentence boundary detection for Hindi–English Codemixed social media texts. We develop a corpus of Hindi–English Codemixed posts collected from Facebook and made an in-depth study to explore the limitations of using existing rule-based sentence boundary detection systems on codemixed social media text. Our proposed approach is a rule-based sentence boundary detection approach which is tested on our developed corpus and outperforms over the existing approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.facebook.com/delhimetroconfessions/.

  2. 2.

    https://www.facebook.com/RCC.KOTA/.

  3. 3.

    https://www.facebook.com/aryan12121990/.

  4. 4.

    https://www.facebook.com/bcplconfessions.

  5. 5.

    http://facepager.software.informer.com/3.6/.

  6. 6.

    http://www.cs.cmu.edu/~ark/TweetNLP/.

  7. 7.

    Language tagset is taken from [7].

References

  1. Rudrapal, D., Jamatia, A., Chakma, K., Das, A., Gambäck, B.: Sentence boundary detection for social media text. In: ICON (2015)

    Google Scholar 

  2. Mikheev, A.: Tagging sentence boundaries. In: Proceedings of the NAACL, Seattle, pp. 264–271 (2000)

    Google Scholar 

  3. Reynar, J.C., Ratnaparkhi, A.: A maximum entropy approach to identifying sentence boundaries. In: Proceedings of the 5th Conference on Applied Natural Language Processing, Apr 1997, pp. 803–806, Washington, DC. ACL (1997)

    Google Scholar 

  4. Parakh, M., Rajesha, N., Ramya, M.: Sentence boundary disambiguation in Kannada texts, language in India. In: Special Volume: Problems of Parsing in Indian Languages, pp. 17–19. www.languageinindia.com. Accessed 11:5 May 2011

  5. Deepamala, N., Ramakanth Kumar, P.: Sentence boundary detection in Kannada language. Int. J. Comput. Appl. (0975-8887) (2012)

    Google Scholar 

  6. Wanjaria, N., Dhopavkarb, G.M., Zungrec, N.B.: Sentence boundary detection for Marathi language. In: International Conference on Information Security and Privacy (ICISP2015), 11–12 Dec 2015, Nagpur, India

    Google Scholar 

  7. Jamatia, A., Gambäck, B., Das, A.: Part-of-speech tagging for code-mixed English-Hindi Twitter and Facebook chat messages. In: Proceedings of 10th International Conference on Recent Advances in Natural Language Processing, pp. 239-248, Hissar, Bulgaria, 7–9 Sept 2015

    Google Scholar 

Download references

Acknowledgements

Thanks to Assistant Professor Anupam Jamatia and Assistant Professor Dwijen Rudrapal, Computer Science and Engineering Department, National Institute of Technology, Agartala for their support and guidance throughout our work.

Author information

Authors and Affiliations

  1. National Institute of Technology Agartala, Agartala, Tripura, India

    Ajeet Singh, Bhanu Pratap Singh, Ankit Kumar Poddar & Abhishek Singh

Authors
  1. Ajeet Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bhanu Pratap Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ankit Kumar Poddar
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Abhishek Singh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ajeet Singh .

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, National Institute of Technology, Rourkela, Rourkela, Odisha, India

    Pankaj Kumar Sa

  2. Department of Computer Science and Engineering, National Institute of Technology, Rourkela, Rourkela, Odisha, India

    Sambit Bakshi

  3. Department of Computer Engineering and Informatics, University of Patras, Patras, Greece

    Ioannis K. Hatzilygeroudis

  4. Department of Computer Science and Engineering, National Institute of Technology, Rourkela, Rourkela, Odisha, India

    Manmath Narayan Sahoo

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Singh, A., Singh, B.P., Poddar, A.K., Singh, A. (2018). Sentence Boundary Detection for Hindi–English Social Media Text. In: Sa, P., Bakshi, S., Hatzilygeroudis, I., Sahoo, M. (eds) Recent Findings in Intelligent Computing Techniques . Advances in Intelligent Systems and Computing, vol 709. Springer, Singapore. https://doi.org/10.1007/978-981-10-8633-5_22

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-8633-5_22

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-8632-8

  • Online ISBN: 978-981-10-8633-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation