首页 | 本学科首页   官方微博 | 高级检索  
     

融合语言知识与深度学习的文本蕴含识别
引用本文:郑德权,于凤,王贺伟.融合语言知识与深度学习的文本蕴含识别[J].计算机工程与应用,2020,56(24):157-163.
作者姓名:郑德权  于凤  王贺伟
作者单位:1.哈尔滨商业大学 计算机与信息工程学院,哈尔滨 150028 2.哈尔滨工业大学 计算机科学与技术学院,哈尔滨 150001
基金项目:黑龙江省自然科学基金;国家重点研发计划
摘    要:文本蕴含技术在自然语言处理中得到了广泛应用,但存在词对推理能力差的问题(例如,句对中出现反义词对无法判断反义关系等)。重点研究了词对知识向量的获取问题,包括融合多特征及有监督的词对关系向量获取、采用TransR的词对关系表示获取、反义词向量表示获取等三种方法,并将知识向量引入到文本蕴含识别模型中的词对齐和注意力机制部分。有关实验表明,上述方法相比经典模型有了较大的提升。

关 键 词:文本蕴含  知识向量  深度学习  词对齐  注意力机制  

Text Entailment Recognition Based on Integration of Language Knowledge and Deep Learning
ZHENG Dequan,YU Feng,WANG Hewei.Text Entailment Recognition Based on Integration of Language Knowledge and Deep Learning[J].Computer Engineering and Applications,2020,56(24):157-163.
Authors:ZHENG Dequan  YU Feng  WANG Hewei
Affiliation:1.School of Computer and Information Engineering, Harbin University of Commerce, Harbin 150028, China 2.School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China
Abstract:Text entailment technology has been widely used in natural language processing, but there are some problems such as the poor reasoning ability of word pairs (for example, there is the antonym pairs in sentence pairs, but can’t judge the antonym relationship, etc.). This paper focuses on the acquisition of knowledge vector from words, including acquire the word pairs relation vector by integration of multi feature and supervised method, acquire word pairs relation expression using TransR tools, and acquire antonym vector expression. Knowledge vector is introduced into the part of word alignment and attention mechanism in text entailment recognition model. The experimental results show that the proposed method is better than the classical model.
Keywords:text entailment  knowledge representation  deep learning  word alignment  attention mechanism  
本文献已被 万方数据 等数据库收录!
点击此处可从《计算机工程与应用》浏览原始摘要信息
点击此处可从《计算机工程与应用》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号