基于语义关系约束和词语关系信息的句向量研究

针对现有的句向量学习方法不能很好的学习关系知识信息、表示复杂的语义关系，提出了基于PV-DM模型和关系信息模型的关系信息句向量模型（RISV），该模型是将PV-DM模型作为句向量训练基本模型，然后为其添加关系信息知识约束条件，使改进后模型能够学习到文本中词语之间的关系，并将关系约束模型（RCM）模型作为预训练模型，使其进一步整合语义关系约束信息，最后在文档分类和短文本语义相似度两个任务中验证了RISV模型的有效性。实验结果表明，采用RISV模型学习的句向量能够更好地表示文本。

Sentence Vector Based on Semantic Relationship Constraints and Word Relationship Information

In view of the fact that the existing sentence vector learning method can not well learn the relational knowledge information and express the complicated semantic relation, a relational information sentence vector model (RISV) based on the PV-DM model and the relational information model is proposed.This model uses the PV-DM model as the basic model of sentence vector training, and then adds the knowledge constraint of relational information to make the improved model can learn the relationship between the words in the text and uses the RCM model as Pre-training model to further integrate the information of the semantic relationship constraints, and finally validates the validity of the RISV model in two tasks: document classification and short text semantic similarity. The experimental results show that sentence vectors learned by RISV model can better represent the text.