The Role of Evaluation in Language Technology



Spelling checkers, natural language interfaces and machine translation systems (MT) have something in common: they belong to the group of natural language processing systems and there is no doubt, that the theoretical basis of these systems is called computational linguistics. This basis has its roots in linguistics, i.e. in formal linguistics, in mathematics and computer science. Furthermore, there are influences from sociology, psychology and the interdisciplinary fields among these five. Computer science with its subfields hardware and software is the only candidate which could contribute to a technology.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Anwender-Arbeitskreis Maschinelle Übersetzung (1991):“Evaluationsliste (list of evaluation criteria)”. Internal report produced by working group 3: Qualitätsvergleich. Bonn, Luxembourg.Google Scholar
  2. [2]
    Bétori, Istvan S.; Lenders, Winfried; Putschke, Wolfgang (Eds.) (1989). “Computational Linguistics. An International Handbook on Computer Oriented Language Research and Applications”. Walter de Gruyter. Berlin, New York.Google Scholar
  3. [3]
    Copeland, Charles; Gerhardt, Tom C.; Havenith, Roger; Joergensen, Lise; Ripplinger, Baerbel; Roniotes, Celia (1991). “Recommendation on Testing and Evaluation”. Internal Eurotra report. Luxembourg.Google Scholar
  4. [4]
    Flickinger, Dan; Nerbonne, John; Sag, Ivan; Wasow, Tom (1987). “Toward Evaluation of NLP Systems”. Forum of the ACL — Evaluating Natural Language Processing Systems. Palo Alto.Google Scholar
  5. [5]
    Guida, Giovanni; Mauri, Giancarlo (1986). “Evaluation of Natural Language Processing Systems: Issues and Approaches”. Proceedings of the IEEE, Vol. 74, No. 7. 1026-1035.Google Scholar
  6. [6]
    King, Margaret; Falkedal, Kirsten (1990). “Using Test Suites in Evaluation of Machine Translation Systems”. Proceedings of Coling 1990, Vol. 2, 211–216. Budapest.Google Scholar
  7. [7]
    Mann, William C. (1981). “Selective Planning of Interface Evaluations”. Proceedings of he 19th Annual Meeting of the Association for Computational Linguistics, Stanford.Google Scholar
  8. [8]
    Rinsche, Adriane (1993). “Evaluationsverfahren fuer Maschinelle Uebersetzungssysteme — Zur Methodik und experimentellen Praxis”. Commission of the European Communities. Report EUR 14766 DE. Luxembourg.Google Scholar
  9. [9]
    Sondheimer, Norman K. (1981). “Evaluation of Natural Interfaces to Database Systems”. Proceedings of the 19th Annual Meeting of the Association for Computational Linguistics, Stanford.Google Scholar

Copyright information

© Friedr. Vieweg & Sohn Verlagsgesellschaft mbH, Braunschweig/Wiesbaden 1995

Authors and Affiliations

  1. 1.CRETA LuxembourgGermany

Personalised recommendations