Abstract
In this article, we present a test environment for a word analysis system that is used for reliable and sense-conveying hyphenation of German words. A crucial task is the hyphenation of compound words, a huge set of those can readily be formed from existing words. Due to this fact, testing and checking all existing words for correct hyphenation is infeasible. Therefore we have developed special test methods for large text files which filter the few problematic cases from the complete set of analysed words. These methods include detecting unknown or ambiguous words, comparing the output of different versions of the word analysis system, and choosing dubious words according to other special criteria. The test system is also suited for testing other applications that are based on word analysis, such as full text search.
This project was in part supported by Hochschuljubiläumsstiftung der Stadt Wien under the grant number H-75/99.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Barth, W., Nirschl, H.: Sichere sinnentsprechende Silbentrennung für die deutsche Sprache. Angewandte Informatik 4, 1985, pp. 152–159.
Barth, W.: Volltextsuche mit sinnentsprechender Wortzerlegung. Wirtschaftsinformatik, vol. 32, no. 5, 1990, pp. 467–471.
Kodydek, G.: A Word Analysis System for German Hyphenation, Full Text Search, and Spell Checking, with Regard to the Latest Reform of German Orthography. Proc. of the Third Int. Workshop on Text, Speech and Dialogue, Brno, Czech Republic, 2000.
Lezius, W., Rapp, R., Wettler, M.: A Freely Available Morphological Analyzer, Disambiguator, and Context Sensitive Lemmatizer for German. In: Proceedings of the COLING-ACL 1998, Montreal, Canada, 1998.
Sitta, H., Gallmann, P.: Duden, Informationen zur neuen deutschen Rechtschreibung, ed. Dudenredaktion, Dudenverlag, Mannheim, 1996.
Steiner, H.: Automatische Silbentrennung durch Wortbildungsanalyse. Ph.D. thesis, Institute of Computer Graphics, Vienna University of Technology, 1995.
Steiner, H., Barth, W.: Sichere sinnentsprechende Silbentrennung mit Berucksichtigung der deutschen Wortbildungsgrammatik. Tagungsband Konvens’94, ed. H. Trost, Vienna, 1994, pp. 330–340.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Schönhacker, M., Kodydek, G. (2000). Testing a Word Analysis System for Reliable and Sense-Conveying Hyphenation and Other Applications. In: Sojka, P., Kopeček, I., Pala, K. (eds) Text, Speech and Dialogue. TSD 2000. Lecture Notes in Computer Science(), vol 1902. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45323-7_22
Download citation
DOI: https://doi.org/10.1007/3-540-45323-7_22
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-41042-3
Online ISBN: 978-3-540-45323-9
eBook Packages: Springer Book Archive