完全加权关联规则挖掘及其在查询扩展中的应用*

为了将完全加权关联规则挖掘技术应用于查询扩展,提出面向查询扩展的基于多种剪枝策略的完全加权词间关联规则挖掘算法,该算法能够极大地提高挖掘效率;提出了一种新的查询扩展模型和扩展词权重计算方法,使扩展词权值更加合理,在此基础上提出一种新的基于局部反馈的查询扩展算法,该算法利用完全加权关联规则挖掘算法自动从局部反馈的前列初检文档中挖掘与原查询相关的完全加权关联规则,构建规则库,从中提取与原查询相关的扩展词,实现查询扩展。实验结果表明,查询扩展算法的检索性能确实得到了很好的改善和提高,与现有查询扩展算法比较,在相同的查全率水平级下其平均查准率有了明显的提高。     

基于完全加权关联规则的局部反馈查询扩展

针对现有查询扩展存在的缺陷,将完全加权关联规则挖掘技术应用于查询扩展,提出新的查询扩展模型和扩展词权重的计算方法;提出基于完全加权关联规则挖掘的局部反馈查询扩展算法。该算法能自动从初检的前列文档中挖掘与原查询相关的完全加权关联规则,从规则中提取与原查询相关的扩展词,实现查询扩展。实验结果表明,与现有查询扩展算法比较,该查询扩展算法的检索性能得到很好的改善和提高。     

基于矩阵加权关联规则挖掘的伪相关反馈查询扩展

提出一种面向查询扩展的矩阵加权关联规则挖掘算法,给出与其相关的定理及其证明过程.该算法采用4种剪枝策略,挖掘效率得到极大提高.实验结果表明,其挖掘时间比原来的平均时间减少87.84%.针对现有查询扩展的缺陷,将矩阵加权关联规则挖掘技术应用于查询扩展,提出新的查询扩展模型和更合理的扩展词权重计算方法.在此基础上提出一种伪相关反馈查询扩展算法——基于矩阵加权关联规则挖掘的伪相关反馈查询扩展算法,该算法能够自动地从前列n 篇初检文档中挖掘与原查询相关的矩阵加权关联规则,构建规则库,从中提取与原查询相关的扩展词,实现查询扩展.实验结果表明,该算法的检索性能确实得到了很好的改善.与现有查询扩展算法相比,在相同的查全率水平级下,其平均查准率有了明显的提高.     

一种新的基于扩展规则的定理证明算法

基于扩展规则的定理证明方法是一种与归结方法互补的新的定理证明方法,首先通过对扩展规则的深入研究,给出了扩展规则的一个重要性质,设计并实现了该性质的判定算法.此外,从理论上分析及证明了该判定算法的时问和空间复杂性.基于此,提出了一种新的基于扩展规则的定理证明算法NER,将判定子句集可满足性问题转化为一系列文字集合的包含问题,而非计数问题.实验结果表明,算法NER的执行效率较原有扩展规则算法IER和基于归结的有向归结算法DR有明显提高,有些问题可以提高两个数量级.     

基于半扩展规则的定理证明方法

自动定理证明一直是人工智能领域中最重要的问题之一,基于归结的方法是通过推出空子句的方法来判定子句集的可满足性.基于扩展规则的定理证明方法在一定意义上是和归结原理对偶的方法,是通过子句集能否推导出所有极大项组成的子句集来判定可满足性.通过对扩展规则的研究给出了半扩展规则的概念,并提出了基于半扩展规则的定理证明算法SER.然后分析及证明了该算法的正确性、完备性和复杂性.实验结果表明,算法SER的执行效率较基于归结的有向归结算法DR和基于扩展规则算法IER,NER有明显的提高.     

面向查询扩展的词间正负关联规则挖掘算法

查询扩展是改善和提高信息检索性能的核心技术之一,其关键问题是如何获取与原查询相关的扩展词。通过关联规则挖掘技术获取扩展词是一种有效的扩展词来源方法。为了获取高质量的扩展词,提出了一种面向查询扩展的基于文本数据库的词间正负关联规则挖掘算法。该算法采用支持度-置信度-相关度框架衡量关联规则,避免产生自相矛盾的正、负关联规则,并结合查询项,给出新的剪枝策略,挖掘出只含有查询词项的正负规则,提高了挖掘效率。实验结果表明,与传统的挖掘算法比较,提出的算法更有效、合理,能检测和删除相互矛盾的规则。     

基于q→ti和q→-tj挖掘的查询扩展算法

为了区分与原查询正负相关的扩展词,提高查询扩展性能,将正负关联规则挖掘技术应用于查询扩展,提出一种基于关联规则q→ti和q→-tj挖掘的局部反馈查询扩展算法。该算法从初检的前列文档中挖掘只含查询词项的词间正负关联规则q→ti和q→-tj,构造正负规则库;从规则库中提取扩展词,分别构建正负扩展词库,从正扩展词库中删除与负扩展词相同的词后得到所需的扩展词,与原查询组合实现查询扩展。算法还给出一种新的查询扩展模型和扩展词权重计算方法,使扩展词权值更合理。实验结果表明算法不仅能发现虚假扩展词,而且还能改善和提高信息检索性能。     

基于q→ti和q→(┑)tj挖掘的查询扩展算法

为了区分与原查询正负相关的扩展词,提高查询扩展性能,将正负关联规则挖掘技术应用于查询扩展,提出一种基于关联规则q→ti和q→-(┐)tj挖掘的局部反馈查询扩展算法.该算法从初检的前列文档中挖掘只含查询词项的词间正负关联规则q→ti和q→ (┐)tj,构造正负规则库;从规则库中提取扩展词,分别构建正负扩展词库,从正扩展词库中删除与负扩展词相同的词后得到所需的扩展词,与原查询组合实现查询扩展.算法还给出一种新的查询扩展模型和扩展词权重计算方法,使扩展词权值更合理.实验结果表明算法不仅能发现虚假扩展词,而且还能改善和提高信息检索性能.     

一种增量更新算法在数据挖掘中的应用

引入扩展差别矩阵和扩展决策矩阵，提出了新的属性约简算法和增量更新算法，即基于扩展差别矩阵的属性约简算法和基于扩展决策矩阵的增量式规则提取算法，讨论了规则的增量更新算法。由于使用了增量更新算法和并行处理技术，从而提高了数据挖掘的效率，降低了时间复杂度。通过实验说明此算法是有效和可行的。     

基于局部搜索的并行扩展规则推理方法

扩展规则推理方法在经典的可满足性问题求解中已得到广泛应用,若干个基于扩展规则的推理方法已被提出,皆得到国内外的认可,例如完备的NER,IMOMH_IER,PPSER算法以及基于局部搜索的不完备算法ERACC等,都具有良好的求解效果.其中,ERACC算法是当前扩展规则求解器中求解效率最高、能力最强的算法.但是,串行的ERACC算法在启发式和预处理上仍然具有可提升的空间.基于此,设计了相应的并行框架,提出了PERACC算法.该算法基于格局检测的局部搜索方法,从变量赋初始值、化简解空间和启发式这3个阶段出发,将原极大项空间分解成为若干极大项子空间,并对原子句集进行化简后,并行处理各个子空间.通过实验显示：该算法与原算法相比,不仅在求解效率方面有较大提高,而且可以求解规模更大的测试用例,使扩展规则方法再次突破公式规模的限制.     

Redundancy checking algorithms based on parallel novel extension rule

Abstract

Redundancy checking (RC) is a key knowledge reduction technology. Extension rule (ER) is a new reasoning method, first presented in 2003 and well received by experts at home and abroad. Novel extension rule (NER) is an improved ER-based reasoning method, presented in 2009. In this paper, we first analyse the characteristics of the extension rule, and then present a simple algorithm for redundancy checking based on extension rule (RCER). In addition, we introduce MIMF, a type of heuristic strategy. Using the aforementioned rule and strategy, we design and implement RCHER algorithm, which relies on MIMF. Next we design and implement an RCNER (redundancy checking based on NER) algorithm based on NER. Parallel computing greatly accelerates the NER algorithm, which has weak dependence among tasks when executed. Considering this, we present PNER (parallel NER) and apply it to redundancy checking and necessity checking. Furthermore, we design and implement the RCPNER (redundancy checking based on PNER) and NCPPNER (necessary clause partition based on PNER) algorithms as well. The experimental results show that MIMF significantly influences the acceleration of algorithm RCER in formulae on a large scale and high redundancy. Comparing PNER with NER and RCPNER with RCNER, the average speedup can reach up to the number of task decompositions when executed. Comparing NCPNER with the RCNER-based algorithm on separating redundant formulae, speedup increases steadily as the scale of the formulae is incrementing. Finally, we describe the challenges that the extension rule will be faced with and suggest possible solutions.     

半扩展规则下分解的定理证明方法

基于扩展规则的定理证明方法在一定意义上是与归结原理对偶的方法,通过子句集能否推导出所有极大项来判定可满足性.IER(improved extension rule)算法是不完备的算法,在判定子句集子空间不可满足时,并不能判定子句集的满足性,算法还需重新调用ER(extension rule)算法,降低了算法的求解效率.通过对子句集的极大项空间的研究,给出了子句集的极大项空间分解后子空间的求解方法.通过对扩展规则的研究,给出了极大项部分空间可满足性判定方法PSER(partial semi-extension rule).在IER算法判定子空间不可满足时,可以调用PSER算法判定子空间对应的补空间的可满足性,从而得到子句集的可满足性,避免了不能判定极大项子空间可满足性时需重新调用ER算法的缺点,使得IER算法更完备.在此基础上,还提出DPSER(degree partial semi-extension rule)定理证明方法.实验结果表明:所提出的DPSER和IPSER的执行效率较基于归结的有向归结算法DR、IER及NER算法有明显的提高.     

Multiple-attribute decision making under uncertainty: the evidential reasoning approach revisited

In multiple-attribute decision making (MADM) problems, one often needs to deal with decision information with uncertainty. During the last decade, Yang and Singh (1994) have proposed and developed an evidential reasoning (ER) approach to deal with such MADM problems. Essentially, this approach is based on an evaluation analysis model and Dempster's rule of combination in the Dempster-Shafer (D-S) theory of evidence. This paper reanalyzes the ER approach explicitly in terms of D-S theory and then proposes a general scheme of attribute aggregation in MADM under uncertainty. In the spirit of such a reanalysis, previous ER algorithms are reviewed and two other aggregation schemes are discussed. Theoretically, it is shown that new aggregation schemes also satisfy the synthesis axioms, which have been recently proposed by Yang and Xu (2002) for which any rational aggregation process should grant. A numerical example traditionally examined in published sources on the ER approach is used to illustrate the discussed techniques.     

Inference analysis and adaptive training for belief rule based systems

Belief rule base (BRB) systems are an extension of traditional IF-THEN rule based systems and capable of capturing complicated nonlinear causal relationships between antecedent attributes and consequents. In a BRB system, various types of information with uncertainties can be represented using belief structures, and a belief rule is designed with belief degrees embedded in its possible consequents. For a set of inputs to antecedent attributes, inference in BRB is implemented using the evidential reasoning (ER) approach. In this paper, the inference mechanism of the ER algorithm is analyzed first and its patterns of monotonic inference and nonlinear approximation are revealed. For a practical BRB system, it is difficult to determine its parameters accurately by using only experts’ subjective knowledge. Moreover, the appropriate adjustment of the parameters of a BRB system using available historical data can lead to significant improvement on its prediction performance. In this paper, a training data selection scheme and an adaptive training method are developed for updating BRB parameters. Finally, numerical studies on a multi-modal function and a practical pipeline leak detection problem are conducted to illustrate the functionality of BRB systems and validate the performance of the adaptive training technique.     

基于可拓蚁群算法的粗糙集属性约简方法

蚁群算法是一种模拟进化算法,它有很多优点,且成功地解决了许多复杂的组合优化问题,然而它并不完美。受可拓学中关联函数的启发,提出基于关联函数的状态转换规则和局部信息素更新规则,并将其用于粗糙集的属性约简。实验结果证明该算法是有效的。     

基于可拓蚁群算法的粗糙集属性约简方法

蚁群算法是一种模拟进化算法,它有很多优点,且成功地解决了许多复杂的组合优化问题,然而它并不完美。受可拓学中关联函数的启发,提出基于关联函数的状态转换规则和局部信息素更新规则,并将其用于粗糙集的属性约简。实验结果证明该算法是有效的。     

基于证据推理的确定因子规则库推理方法

不确定性推理方法是人工智能领域的一个主要研究内容,If-then规则是人工智能领域最常见的知识表示方法. 文章针对实际问题往往具有不确定性的特点,提出基于证据推理的确定因子规则库推理方法.首先在If-then规则的基础上给出确定因子结构和确定因子规则库知识表示方法,该方法可以有效利用各种类型的不确定性信息,充分考虑了前提、结论以及规则本身的多种不确定性. 然后,提出了基于证据推理的确定因子规则库推理方法. 该方法通过将已知事实与规则前提进行匹配,推断结论并得到已知事实条件下的前提确定因子;进一步,根据证据推理算法得到结论的确定因子. 文章最后,通过基于证据推理的确定因子规则库推理方法在UCI数据集分类问题的应用算例,说明该方法的可行性和高效性.     

基于可拓规则的故障诊断专家系统推理机的研究

针对传统产生式规则在知识表示、匹配冲突等方面存在的局限,提出了一种将可拓规则用于故障诊断专家系统推理机的方法;该方法重点研究了可拓规则的匹配原理和可拓推理机算法思想,提出了匹配度计算方法并用来计算故障条件与规则前件的匹配度;根据研究表明,利用可拓规则进行推理,不仅在知识表示上比传统产生式规则推理有所提高,而且还解决了传统专家系统容易出现匹配冲突等问题;最后以AMU故障推理为例,说明可拓推理机具有推理速度快、效率高等优点,取得了较好的推理效果.     

EPCCL理论的求交知识编译算法

超扩展规则是对扩展规则的扩充,基于超扩展规则能够求得任意两个非互补且不相互蕴含的子句所能扩展出极大项集的交集、差集和并集,并将所得结果以EPCCL（each pair of clauses contains complementary literals）理论的形式保存.基于超扩展规则的性质,本文提出了一种新的EPCCL理论编译算法：求交知识编译算法IKCHER（intersection approach to knowledge compilation based on hyper extension rule）,该算法适合难解类SAT问题的知识编译,同时是一种可并行的知识编译算法.本文还研究了如何实现多个EPCCL理论的求交操作,证明了EPCCL理论的求交过程是可并行执行的,并设计了相应并行求交算法PIAE（parellel intersection of any number of EPCCL）.通过对输入EPCCL理论对应普通子句集的利用,设计了一种高效的并行求交算法imp-PIAE（improvement of PIAE）.基于上述算法本文还设计了两个并行知识编译算法P-IKCHER（IKCHER with PIAE）和impP-IKCHER（IKCHER withimp-PIAE）,分别采用PIAE并行合并算法和imp-PUAE并行合并算法.最后,通过实验验证了大部分情况下IKCHER算法的编译质量是目前为止所有EPCCL理论编译器中最优的,P-IKCHER算法所使用的合并策略并没有起到加速的效果,反而使得编译效率和编译质量有所下降,而impP-IKCHER算法提高了IKCHER算法的编译效率,四核并行下最高可提高两倍.     

A SIMPLE DECISION RULE ON FUZZY EVENTS

Decision making in real problems is done in a fuzzy environment. Thus, Fuzzy-Bayes decision rules have been proposed to cope with a fuzzy state of nature. These decision rules are based on the probability of fuzzy events, or the possibility measure of fuzzy events. Furthermore, a decision rule based on fuzzy utility functions and the possibility distribution of fuzzy events are constructed. However, in these decision rules the fuzziness of the fuzzy expected utility is very big, because these decision rules are based on the extension principle for calculation of the fuzzy expected utility. In this article, avoiding the large fuzziness of the expected utility, we proposed a simple decision rule based on the representation interval of the possibility distributions of fuzzy events and the representation value of the fuzzy utility function. Further, we discuss the application of this simple decision rule to the decision problems, in which the decision maker obtains the one-peak symmetric possibility distribution of a state of nature and the one-peak symmetric membership functions of fuzzy events on a state of nature, by his or her knowledge and his or her belief.