带标记音节的双向维汉神经机器翻译方法

近年来,基于神经网络的机器翻译成为机器翻译领域的主流方法,但是在低资源翻译领域中仍存在平行语料不足和数据稀疏的挑战.针对维-汉平行语料不足和维吾尔语形态复杂所导致的数据稀疏问题,从维吾尔语的音节特点出发,将单词切分成音节,同时融入BME(Begin,Middle,End)标记思想,提出一种基于带标记音节的神经网络机器翻...

Bi-directional Uyghur-Chinese Neural Machine Translation with Marked Syllables

In recent years, neural networks have become the mainstream methods used in machine translation, but in the field of low-resource machine translation, parallel corpus shortage and data sparseness remain great challenges. Aiming at the problem of data sparseness caused by insufficient Uyghur-Chinese parallel corpus and complex Uyghur morphology, this paper proposes a neural network method, which is based on the syllable characteristics of Uyghur language, cutting words into syllables, and incorporating the idea of BME（Begin, Middle, End） markup. Compared to the word level and the BPE level, the proposed method improves 7.39 and 3.04 BLEU values respectively in Uyghur-Chinese machine translation tasks, and 5.82 and 3.09 BLEU values respectively in Chinese-Uyghur machine translation. It indicates that under the condition of insufficient parallel corpus, this method can effectively improve the quality of Uyghur-Chinese machine translation.