首页 | 本学科首页   官方微博 | 高级检索  
     

基于Web的无指导译文消歧词模型与N-gram模型及对比研究
引用本文:刘鹏远,赵铁军.基于Web的无指导译文消歧词模型与N-gram模型及对比研究[J].电子与信息学报,2009,31(12):2969-2974.
作者姓名:刘鹏远  赵铁军
作者单位:1. 北京大学计算语言学研究所,北京,100871
2. 哈尔滨工业大学计算机科学与技术学院,哈尔滨,150001
基金项目:国家重点基础研究发展计划(2004CB318102)资助课题 
摘    要:该文提出了基于Web的无指导译文消歧的词模型及N-gram模型方法,并在尽可能相同的条件下进行了比较。两种方法均利用搜索引擎统计不同搜索片段在Web上的Page Count作为主要消歧信息。词模型定义了汉语词汇与英语词汇之间的双语词汇Web相关度,根据汉语上下文词汇与英语译文之间的相关度进行消歧;N-gram模型首先假设不同语义下的多义词N-gram序列行为模式不同,从而可对多义词不同语义类下词汇在实例中的N-gram序列进行统计与分析以进行消歧。两个模型的性能均超过了在国际语义评测SemEval2007的task#5上可比较的最好无指导系统。对这两个模型进行试验对比可发现N-gram模型性能优于词模型,也表明组合两类模型的结果有进一步提升消歧性能的潜力。

关 键 词:计算语言学    无指导译文消歧    词模型    N-gram模型    Page  Count    双语词汇Web相关度
收稿时间:2008-12-05

Comparison of Web-Based Unsupervised Translation Disambiguation Word Model and N-gram Model
Liu Peng-yuan,Zhao Tie-jun.Comparison of Web-Based Unsupervised Translation Disambiguation Word Model and N-gram Model[J].Journal of Electronics & Information Technology,2009,31(12):2969-2974.
Authors:Liu Peng-yuan  Zhao Tie-jun
Affiliation:Institute of Computational Linguistics, Peking University. Beijing 100871, China;
Department of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China
Abstract:This paper describes and compares web-based unsupervised translation disambiguation word model and N-gram model. For acquiring knowledge of disambiguation, both two models put differents queries to search engine and statistic page counts which it returned. Word model defines Web Bilingual Relatedness(WBR) between Chinese words and English words and disambiguates word sense by maxmizing Web Bilingual Relatedness between contexts and the translations of target word. Based on the hypothesis that the pattern of a polysemant is different while different sense of it is being used, N-gram model makes disambiguation by statisticing and analyzing N-grams of words in different semantic class of that polysemant. Both of the two models are evaluated on the SemEval2007 task#5, achieving the top performance against the state-of-the-art comparable unsupervised systems. Furthmore, N-gram model outperforms word model and the performence has potential for promotion when combine the results of that two class model.
Keywords:Page  Count  Computational linguistics  Unsupervised translation disambiguation  Word model  N-gram model  Page Count  Web Bilingual Relatedness(WBR)
本文献已被 万方数据 等数据库收录!
点击此处可从《电子与信息学报》浏览原始摘要信息
点击此处可从《电子与信息学报》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号