Meteor Universal: Language Specific Translation Evaluation for Any Target Language

This paper describes Meteor Universal, released for the 2014 ACL Workshop on Statistical Machine Translation. Meteor Universal brings language specific evaluation to previously unsupported target languages by (1) automatically extracting linguistic resources (paraphrase tables and function word lists) from the bitext used to train MT systems and (2) using a universal parameter set learned from pooling human judgments of translation quality from several language directions. Meteor Universal is shown to significantly outperform baseline BLEU on two new languages, Russian (WMT13) and Hindi (WMT14).

• NS
  National Science Foundation

  Award: 0915327
• QF
  Qatar Foundation
• FN
  Fonds National de la Recherche Luxembourg
• QN
  Qatar National Research Fund