基于知网的概念特征抽取方法

文本特征抽取是文本过滤的一项重要基础,但通常采取的用字、词作为特征项的显著缺点是无法表达文本的语义信息,所以本文在向量空间模型的基础上提出了一种以知网为语义知识库、基于语义信息的文本特征项抽取方法。该方法比单纯的词汇信息更能体现文本的概念特征,提高过滤系统的性能;同时还能降低文本向量的维数,减少计算量,提高过滤效率。我们在引入了该方法的中文文本过滤系统上进行的实验结果也充分证实了其有效性。

Hownet-based conceptual feature selection method

Feature selection of documents is an important issue in text filtering. However, the lack of semantic information in document representation is a great disadvantage of word feature. This paper presents a novel method of semantic based feature selection on the basis of vector space model which takes Hownet as its semantic repository. This method can better represent the conceptual feature of texts than simple words, improve the system performance, meanwhile decrease the dimension of text vector to reduce the load of computation and improve the filtering efficiency. The experiment results on our Chinese text filtering system which integrated the method has sufficiently proved its effect.