首页 | 本学科首页   官方微博 | 高级检索  
     

基于长度的扩展方法的汉英句子对齐
引用本文:张艳,柏冈秀纪.基于长度的扩展方法的汉英句子对齐[J].中文信息学报,2005,19(5):33-36,58.
作者姓名:张艳  柏冈秀纪
作者单位:国际电气通信技术研究所音声言语通信研究所日本京都 619 - 0288
基金项目:日本情报通信研究机构的委托研究项目
摘    要:本文提出了一种用于汉英平行语料库对齐的扩展方法。该扩展方法以基于长度的统计对齐方法为主,然后根据双语词典引入了词汇信息,而基于标点的方法作为对齐的后处理部分。这种扩展方法不仅避免了复杂的中文处理,例如,汉语分词和词性标注,而且在统计方法中引入了关键词信息,以提高句子对齐的正确率。本文中所用的双语语料是LDC 的关于香港的双语新闻报道。动态规划算法用于系统的实现。和单纯的基于长度的方法和词汇方法相比,我们的扩展方法提高了句子对齐的正确率,并且结果是比较理想的。

关 键 词:人工智能  机器翻译  句子对齐  中文处理  双语语料库  
文章编号:1003-0077(2005)05-0031-06
收稿时间:2004-09-08
修稿时间:2004-09-082005-05-10

Aligning Sentences in Chinese-English Corpora with Extended Length-based Approach
ZHANG Yan,KASHIOKA Hideki.Aligning Sentences in Chinese-English Corpora with Extended Length-based Approach[J].Journal of Chinese Information Processing,2005,19(5):33-36,58.
Authors:ZHANG Yan  KASHIOKA Hideki
Affiliation:Spoken Language Communication Research Laboratories , Advanced Telecommunications Research Institute International , Kyoto 619 - 0288 , Japan
Abstract:In this paper, we present a new approach to align Chinese-English sentences in the parallel texts. This approach Ks mainly based on statistical approach, here is length-based alignment approach, and simultaneously considers lexical informarion from the bilingual lexicon. Punctoation-based approach is the post-processing for alignment. This extended approach not only avoids complicated Chinese processing further, such as segmentation and part-of-speech tagging, but also uses some Chinese key words in the statistical approach to improve accuracy of sentence alignment. The bilingual corpus in this paper is LDC parallel texts in Hong Kong newspaper. Then dynamic programming algorithm is used to accomplish the alignment processing. Compared with length-based approach and lexical approach, our approach improves the alignment accuracy and the experiment result is desirable.
Keywords:artificial intelligence  machine translation  sentence alignment  Chinese processing  bilingual corpus
本文献已被 CNKI 维普 万方数据 等数据库收录!
点击此处可从《中文信息学报》浏览原始摘要信息
点击此处可从《中文信息学报》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号