Machine Translation

, Volume 23, Issue 2–3, pp 117–127

TER-Plus: paraphrase, semantic, and alignment enhancements to Translation Edit Rate

  • Matthew G. Snover
  • Nitin Madnani
  • Bonnie Dorr
  • Richard Schwartz
Article

Abstract

This paper describes a new evaluation metric, TER-Plus (TERp) for automatic evaluation of machine translation (MT). TERp is an extension of Translation Edit Rate (TER). It builds on the success of TER as an evaluation metric and alignment tool and addresses several of its weaknesses through the use of paraphrases, stemming, synonyms, as well as edit costs that can be automatically optimized to correlate better with various types of human judgments. We present a correlation study comparing TERp to BLEU, METEOR and TER, and illustrate that TERp can better evaluate translation adequacy.

Keywords

Machine translation evaluation Paraphrasing Alignment 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer Science+Business Media B.V. 2009

Authors and Affiliations

  • Matthew G. Snover
    • 1
  • Nitin Madnani
    • 1
  • Bonnie Dorr
    • 1
  • Richard Schwartz
    • 2
  1. 1.Laboratory for Computational Linguistics and Information Processing, Institute for Advanced Computer StudiesUniversity of MarylandCollege ParkUSA
  2. 2.BBN TechnologiesCambridgeUSA

Personalised recommendations