A User-Oriented Approach to Evaluation and Documentation of a Morphological Analyzer

  • Gertrud Faaß
Conference paper

DOI: 10.1007/978-3-642-23138-4_4

Part of the Communications in Computer and Information Science book series (CCIS, volume 100)
Cite this paper as:
Faaß G. (2011) A User-Oriented Approach to Evaluation and Documentation of a Morphological Analyzer. In: Mahlow C., Piotrowski M. (eds) Systems and Frameworks for Computational Morphology. SFCM 2011. Communications in Computer and Information Science, vol 100. Springer, Berlin, Heidelberg

Abstract

This article describes a user-oriented approach to evaluate and extensively document a morphological analyzer with a view to normative descriptions of ISO and EAGLES. While current state-of-the-art work in this field often describes task-based evaluation, our users (supposedly rather NLP non-experts, anonymously using the tool as part of a webservice) expect an extensive documentation of the tool itself, the testsuite that was used to validate it and the results of the validation process. ISO and EAGLES offer a good starting point when attempting to find attributes that are to be evaluated. The documentation introduced in this article describes the analyzer in a way comparable to others by defining its features as attribute-value pairs (encoded in DocBook XML). Furthermore, the evaluation itself and its results are described. All documentation and the created testsuites are online and free to use: http://www.ims.uni-stuttgart.de/projekte/dspin.

Keywords

German documentation evaluation validation verification eHumanities ISO 9126 EAGLES morphological analyzer 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Gertrud Faaß
    • 1
  1. 1.Institut für maschinelle SprachverarbeitungUniversität StuttgartStuttgartGermany

Personalised recommendations