Using SRX Standard for Sentence Segmentation
- Cite this paper as:
- Miłkowski M., Lipski J. (2011) Using SRX Standard for Sentence Segmentation. In: Vetulani Z. (eds) Human Language Technology. Challenges for Computer Science and Linguistics. LTC 2009. Lecture Notes in Computer Science, vol 6562. Springer, Berlin, Heidelberg
In this paper, we evaluate using the SRX (Segmentation Rules eXchange) standard for specifying sentence segmentation rules. The rules were originally created for a proofreading tool called LanguageTool. As proofreading tools are quite sensitive to segmentation errors, the underlying segmentation mechanisms must be sufficiently reliable. Even though SRX allows only regular expressions as a means for specifying sentence breaks and exceptions to those breaks, our evaluation shows that it is sufficient for the task, both in terms of the performance of the algorithm used and correctness of results. Moreover, it offers interoperability with different tools, which in turn allows maintaining consistent segmentation in a whole language-processing pipeline. Our rules are available on an open-source license (LGPL), which also helped in receiving valuable community input from our users.
Keywordssegmentation standards computer-aided translation grammar-checking
Unable to display preview. Download preview PDF.