首页 | 本学科首页   官方微博 | 高级检索  
     

基于机器翻译的维吾尔语形态分析研究
引用本文:徐 春,杨 勇,蒋同海.基于机器翻译的维吾尔语形态分析研究[J].计算机工程与应用,2017,53(14):138-142.
作者姓名:徐 春  杨 勇  蒋同海
作者单位:1.中国科学院 新疆理化技术研究所,乌鲁木齐 830011 2.中国科学院大学,北京100049 3.新疆财经大学 计算机科学与工程学院,乌鲁木齐 830012 4.新疆师范大学 计算机科学技术学院,乌鲁木齐 830054
摘    要:针对现有维吾尔语形态分析研究中存在的数据稀疏、模型构建复杂等问题,提出一种基于机器翻译的维吾尔语形态分析模型,即将维吾尔语词干提取(词性标注)任务中词干提取前(词性标注前)的句子看作是机器翻译模型训练过程中的源语言端,词干提取后(词性标注后)的句子看作是目标语言端;为了达到最佳的效果,加入了外部信息模块和联合校验模块以优化模型。实验结果表明,基于机器翻译框架的维吾尔语形态分析模型在词干提取、词性标注两个任务上优于其他模型。对比英语(词干提取、词性标注)、汉语(分词、词性标注)实验结果,提出的方法更适合维吾尔语形态分析。

关 键 词:维吾尔语形态分析  基于机器翻译  词干提取  词性标注  模型优化  

Research on machine translation based Uyghur morphological analysis
XU Chun,YANG Yong,JIANG Tonghai.Research on machine translation based Uyghur morphological analysis[J].Computer Engineering and Applications,2017,53(14):138-142.
Authors:XU Chun  YANG Yong  JIANG Tonghai
Affiliation:1.Xinjiang Technical Institute of Physics & Chemistry, Chinese Academy of Sciences, Urumqi 830011, China 2.University of Chinese Academy of Sciences, Beijing 100049, China 3.College of Computer Science and Engineering, Xinjiang University of Finance and Economics, Urumqi 830012, China 4.College of Computer Science and Technology, Xinjiang Normal University, Urumqi 830054, China
Abstract:To alleviate the data sparseness and reduce the complexity of models construction in Uyghur morphology analysis, it proposes a Statistical Machine Translation (SMT) based morphology analysis model, which considers the pre-stem words (pre-Part-Of-Speech (POS) tagging) in Uyghur word stemming (POS tagging) as the source part of SMT system, and the post-stemming words  (POS tags) as the target part. To optimize the model, it uses dictionaries and joint validation in the model. Experimental results show that, the approach outperforms other systems in Uyghur word stemming and part-of-speech tagging. Compared with segmentation and POS tagging tasks in English and Chinese, the approach is more suitable for Uyghur.
Keywords:Uyghur morphology analysis  machine translation based  word stemming  part-of-speech tagging  model optimization  
点击此处可从《计算机工程与应用》浏览原始摘要信息
点击此处可从《计算机工程与应用》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号