基于二叉排序树及中文分词的关键字过滤技术

防止敏感重要的文档资料泄漏是电力行业信息安全中一项重要的工作。采用二叉排序树技术对基础词组库和过滤关键字进行预排序,采用最大后缀匹配方式对需要检测的文本字符串进行中文分词,再通过关键字二叉排序树进行检查过滤,以达到安全高效检测敏感关键字的目的。经性能分析测试,该技术在性能和准确率上都有很好的效果。

Research on Keyword Filtering Technology Based on Binary Sort Tree and Chinese Word Segmentation

To avoid the information leakages of sensitive and important documents is one of important tasks for information security of electricity industry. This paper presents a keyword filtering method based on binary sort tree and Chinese word segmentation. The proposed method first uses binary sort tree to sort basic phrases and filtering keywords, and then implements the Chinese word segmentation by applying the postfix maximum match algorithm to the candidate Chinese texts, further checks sensitive keywords by using keyword binary sort tree. The experimental results show that the proposed method has a very good effect on performance and accuracy.