Using SRX Standard for Sentence Segmentation

  • Marcin Miłkowski
  • Jarosław Lipski
Conference paper

DOI: 10.1007/978-3-642-20095-3_16

Part of the Lecture Notes in Computer Science book series (LNCS, volume 6562)
Cite this paper as:
Miłkowski M., Lipski J. (2011) Using SRX Standard for Sentence Segmentation. In: Vetulani Z. (eds) Human Language Technology. Challenges for Computer Science and Linguistics. LTC 2009. Lecture Notes in Computer Science, vol 6562. Springer, Berlin, Heidelberg

Abstract

In this paper, we evaluate using the SRX (Segmentation Rules eXchange) standard for specifying sentence segmentation rules. The rules were originally created for a proofreading tool called LanguageTool. As proofreading tools are quite sensitive to segmentation errors, the underlying segmentation mechanisms must be sufficiently reliable. Even though SRX allows only regular expressions as a means for specifying sentence breaks and exceptions to those breaks, our evaluation shows that it is sufficient for the task, both in terms of the performance of the algorithm used and correctness of results. Moreover, it offers interoperability with different tools, which in turn allows maintaining consistent segmentation in a whole language-processing pipeline. Our rules are available on an open-source license (LGPL), which also helped in receiving valuable community input from our users.

Keywords

segmentation standards computer-aided translation grammar-checking 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Marcin Miłkowski
    • 1
  • Jarosław Lipski
    • 2
  1. 1.Institute of Philosophy and SociologyPolish Academy of SciencesWarszawaPoland
  2. 2.Institute of Philosophy and SociologyPolish Academy of SciencesLiverpoolUK

Personalised recommendations