首页 | 本学科首页   官方微博 | 高级检索  
     

跨语言文献相似度的分析方法
引用本文:刘娇,崔荣一,赵亚慧,张振国. 跨语言文献相似度的分析方法[J]. 延边大学学报(自然科学版), 2016, 0(2): 151-155
作者姓名:刘娇  崔荣一  赵亚慧  张振国
作者单位:延边大学工学院 计算机科学与技术学科 智能信息处理研究室, 吉林 延吉 133002
摘    要:对不同语言的句对齐文献资料进行分析,提出了基于多语主题模型的跨语言文献相似度的计算方法.首先,对收集整理的不同语言(中文、英文、韩文)文献构建数据模型,通过分词、分词结果修正及选择、词权重计算等预处理工作构造词项-文档矩阵.其次,建立多语主题语义空间,将译成3种不同语言的文献映射到语义空间,在语义空间中每一主题都由3种语言构成.最后,通过其语义空间中对应的主题计算比较不同语言间的文献相似度.实验结果显示,不同语言之间的文献相似度可以直接在语义空间中计算,且相似度计算的准确性在90%以上,验证了本文方法在跨语言文献相似度计算时的有效性.

关 键 词:多语主题模型  跨语言  语义相似度

An analysis method of cross-lingual literature similarity
LIU Jiao,CUI Rongyi,ZHAO Yahui,ZHANG Zhenguo. An analysis method of cross-lingual literature similarity[J]. Journal of Yanbian University (Natural Science), 2016, 0(2): 151-155
Authors:LIU Jiao  CUI Rongyi  ZHAO Yahui  ZHANG Zhenguo
Affiliation:Intelligent Information Processing Lab., Dept. of Computer Science & Technology, College of Engineering, Yanbian University, Yanji 133002, China
Abstract:We analyse different language literatures with sentence alignment and propose a cross-lingual literatures’ similarity method based on multilingual topic correlation model. In this paper, the data model for the collected different language literatures is firstly gained by term-document matrix, which is obtained by the process of words segmentation, the adjustment and selection of words segmentation results, and the weight calculation of feature words.And then, multilingual topic correlation semantic space is built. The three different language literatures are represented in the semantic space where each topic is made up of the three languages.Similarity calculation of different language literatures is completed by their correlation topic in the semantic space. Experiment results show that the similarity of different language literaturescan be calculated directly in the semantic space, the accuracy can be reached 90%, which verify the effectiveness of our method in calculating the similarity of cross-lingual literatures.
Keywords:multilingual topic correlation model  cross-lingual  semantic similarity
本文献已被 CNKI 等数据库收录!
点击此处可从《延边大学学报(自然科学版)》浏览原始摘要信息
点击此处可从《延边大学学报(自然科学版)》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号