一种基于PCA和RS的文本过滤方法

本文提出一种文本过滤方法,即首先利用PCA(主成分分析)的方法进行文本特征抽取,在此基础上运用RS中决策表上的规则推理方法,发现规则并形成规则库,对于新进来文档将其条件属性与规则库里规则进行相似匹配,进行文本过滤。实验结果表明,此方法用于垃圾邮件过滤能取得很高的正确率和召回率。

A Method for Text Filter Based on PCA and RS

This paper proposed a new method for text filtering based on Rough Sets theory and PCA. First,our algorithm for feature extraction is based on principal components analysis. Then, we generated the rules which are useful to us base on the decision tables of Rough Set theory. When an unknown document was inputted, we just matched approximately the condition property of the document to these rules and remained useful information. Results show that using our method to filter out spam enjoys a very high degree of precision and recall.