基于信息熵的半监督领域实体关系抽取研究

针对监督机器学习方法抽取实体关系受限于标注语料的规模问题,提出采用信息熵方法来不断扩展小规模训练数据的半监督领域实体关系抽取。结合领域词汇选取小规模训练数据,构建了一定准确率的初始最大熵分类器,用来从未标记数据中预测出候选新实例。采用信息熵方法,通过设定不同熵值,多次循环以选取可信度较高的新实例来扩展训练数据。使用扩展后的训练数据重新迭代训练分类器,分类器性能趋于稳定迭代终止,实现了半监督学习的领域实体关系抽取。实验表明,和已有方法相比,本文提出的半监督领域实体关系抽取通过结合信息熵方法,在小规模标注样本环境中取得了较好的学习效果。

A semi-supervised learning method based on information entropy to extract the domain entity relation

To solve the limitation by the scale of labeled corpus of the supervised learning method,a semi-supervised method based on information entropy was proposed to extract entity relation using small-scale training data.First,combined with field vocabulary to select small-scale training data,an initial maximum entropy classifier of certain accuracy was constructed to predict some new candidate instances from unlabeled data.Second,the method of information entropy was applied by setting different entropy value an...