机器翻译评测的新进展

机器翻译评测对机器翻译的研究和开发具有至关重要的作用,对其的研究一直是国内外机器翻译界的重点课题。本文首先全面地介绍了最近出现的而且受到极大关注的机器翻译评测技术,即IBM公司的BLEU机器翻译评测标准和NIST采用的机器翻译评测技术。实验表明,自动翻译评测技术能够接近人工评价,评测结果也是可接受的。因此,采用自动翻译评测技术能够给自然语言处理的研究人员和开发人员带来很大的便利性。本文还展示了一个开放式的可扩展的自动翻译评测的平台,完全实现了BLEU和NIST评测标准,并做出了一定的改进使得该系统具有良好的使用性和可扩展性。

The Improvement of Automatic Machine Translation Evaluation

Evaluation plays a critical role in the machine translation. The research of automatic machine translation evaluation is an urgent need for the natural language processing researchers and developers. This paper briefly describes the background of evaluation of machine translation and two important technology of automatic evaluation: BLEU and NIST metrics. Then, we presents some improvements for these metrics by the ideas from text retrieval, which is called TFIDF weighted metric. This method avoids the shortcoming of BLEU metric and achieves a higher F ratio value. As a result, it can give a remarkable effect on the automatic evaluation of machine translation. We also describe an evaluation platform which can take more convenience to the researches and developers.