对不连续帕累托前沿的一种改进的MOEA/D

提出了一种改进的基于分解的多目标进化算法,用于解决不连续帕累托前沿的多目标优化问题中出现帕累托近似前沿分布不均匀与不完整的问题.主要的思想是通过基于密度的聚类算法将尽量逼近帕累托前沿的种群划分为若干个子种群,将不连续帕累托前沿问题转化为多个连续子问题,然后协同演化所有子种群,最后获得更为均匀与完整的帕累托解集.实验表明对于处理不连续帕累托问题的优越性.     

基于改进粒子群优化的无标记数据鲁棒聚类算法

已有的聚类算法大多仅考虑单一的目标,导致对某些形状的数据集性能较弱,对此提出一种基于改进粒子群优化的无标记数据鲁棒聚类算法。优化阶段:首先,采用多目标粒子群优化的经典形式生成聚类解集合;然后,使用K-means算法生成随机分布的初始化种群,并为其分配随机初始化的速度;最终,采用MaxiMin策略确定帕累托最优解。决策阶段：测量帕累托解集与理想解的距离,将距离最短的帕累托解作为最终聚类解。对比实验结果表明,本算法对不同形状的数据集均可获得较优的类簇数量,对目标问题的复杂度具有较好的鲁棒性。     

混合分解和强度帕累托多目标进化算法

在多目标进化优化中,使用分解策略的基于分解的多目标进化算法(MOEA/D)时间复杂度低,使用〖BP(〗强度帕累托策略的〖BP)〗强度帕累托进化算法-2(SPEA2)能得到分布均匀的解集。结合这两种策略,提出一种新的多目标进化算法用于求解具有复杂、不连续的帕累托前沿的多目标优化问题(MOP)。首先,利用分解策略快速逼近帕累托前沿;然后,利用强度帕累托策略使解集均匀分布在帕累托前沿,利用解集重置分解策略中的权重向量集,使其适配于特定的帕累托前沿;最后,利用分解策略进一步逼近帕累托前沿。使用的反向世代距离(IGD)作为度量标准,将新算法与MOEA/D、SPEA2和paλ-MOEA/D在12个基准问题上进行性能对比。实验结果表明该算法性能在7个基准问题上最优,在5个基准问题上接近于最优,且无论MOP的帕累托前沿是简单或复杂、连续或不连续的,该算法均能生成分布均匀的解集。     

自适应种群更新策略的多目标粒子群算法

针对粒子种群较差的局部搜索能力,提出了一种自适应种群更新策略的多目标粒子群算法。该算法在每次种群进行迭代时,根据种群的多样性测度以及每个粒子的适应度值,自适应地改变速度权重,以此来提高种群粒子在局部搜索时的活性,使算法具有较强的局部搜索能力同时又保留了足够的全局搜索能力。最后利用多组经典测试样例进行仿真,并与传统的粒子群算法以及速度线性衰减算法做比较,在单目标优化中,自适应粒子群算法能够更快地寻找最优位置;在多目标优化中,自适应粒子群算法能够更快速地收敛于帕累托最优边界。     

基于平行多种群与冗余基因策略的置信规则库优化方法

置信规则库(Belief rule base, BRB)的参数学习和结构学习共同影响着置信规则库的建模精度和复杂度. 为了提高BRB结构学习和参数学习的优化效率, 本文提出了一种基于平行多种群(Parallel multi-population)策略和冗余基因(Redundant genes)策略的置信规则库优化方法. 该方法采用平行多种群策略以实现对具有不同数量规则BRB同时进行优化的目的, 采用冗余基因策略以确保具有不同数量规则的BRB能够顺利进行(交叉, 变异等)相关优化操作. 最终自动生成具有不同数量规则BRB的最优解, 并得出帕累托前沿(Pareto frontier), 决策者可以根据自身偏好和实际问题需求, 综合权衡并在帕累托前沿中筛选最优解. 最后以某输油管道泄漏检测问题作为示例验证本文提出方法的有效性, 示例分析结果表明本文提出的方法可以一次生成具有多条规则BRB的最优解, 并且可以准确绘制出帕累托前沿, 为综合决策提供较强的决策支持.     

可求解多目标优化问题的演化博弈优化算法

借鉴演化博弈的思想和选择机制,提出了一种新的基于演化博弈的优化算法(EGOA)用于多目标问题的求解.算法框架具备对该类问题的通用性.为了对算法性能进行评估,采用了一组多目标优化问题(MOPs)的测试函数进行实验.实验结果表明,使用本算法搜索得到的演化稳定策略集合能够很好地逼近多目标优化问题的帕累托前沿,与一些经典的演化算法相比具有良好的问题求解能力.     

可求解多目标优化问题的演化博弈优化算

借鉴演化博弈的思想和选择机制,提出了一种新的基于演化博弈的优化算法(EGOA)用于多目标问题的求解.算法框架具备对该类问题的通用性.为了对算法性能进行评,采用了一组多目标优化问题(MOPs)测试函数进行实验.实验结果表明,使用本算法搜索得到的演化稳定策略集合能够很好地逼近目标优化问题的帕累托前沿,与一些经典的演化算法相比具有良好的问题求解力.     

基于定期竞争学习的多目标粒子群优化算法

为提高种群的多样性和算法的收敛性，提出一种基于定期竞争学习机制的多目标粒子群算法。该算法将多目标粒子群算法和竞争学习机制相结合，即每隔一定迭代代数便使用一次竞争学习机制，很好地保持了种群的多样性；同时，该算法不需要全局最优粒子的外部存档，而是从当前代种群中选取一部分优秀的粒子，再从这些优秀的粒子中随机选取一个作为全局最优粒子，能够有效提升算法的收敛性。将提出的算法与基于分解的多目标粒子群算法（MPSOD）、基于竞争机制且快速收敛的多目标粒子群（CMOPSO）算法、参考向量引导的多目标进化算法（RVEA）等8个算法在21个标准测试函数上进行了比较，结果表明，所提算法的帕累托（Pareto）前沿更加均匀，在世代距离（IGD）上会更加小。     

基于环境选择和配对选择的多目标粒子群算法

为了使多目标粒子群算法中种群粒子能够快速地收敛于怕累托最优边界,针对标准多目标粒子群算法中缺乏粒子评价标准以及种群个体历史最优值位置和全局最优值位置选择问题,提出了一种基于环境选择和配对选择策略的多目标粒子群算法.该算法在每次迭代时,采用SPEA2中的环境选择和配对选择策略及适应度值计算方法,以此来提高种群粒子之间的信息交换力度,减少标准多目标粒子群算法中大量的随机性,使种群粒子能够更快速地收敛于怕累托最优边界.经典测试函数的仿真实验结果表明,在标准多目标粒子群算法中运用SPEA2的环境选择、配对选择策略和适应度值计算方法,能够使种群粒子更快速地收敛于帕累托最优边界,验证了算法改进的可行性和有效性.     

基于动态邻居和变异因子的多目标粒子群算法*

为了克服粒子群算法求解多目标问题极易收敛到伪Pareto前沿(等价于单目标优化问题中的局部最优解)和收敛速度较慢的缺陷,提出一种合并帕累托占优概念到动态邻居和变异因子的粒子群算法(particle swarm optimizer based on dynamic neighbor topology and mutation operator,DNMPSO)来处理多目标优化问题(DNMMOPSO),该算法也合并了外部存档技术来存储每次迭代产生的非劣解。模拟结果表明,提出的算法在多目标检测问题上要优于其他算法     

融合Shapley值和粒子群优化算法的混合特征选择算法

针对在模式分类问题中,数据往往存在不相关的或冗余的特征,从而影响分类的准确性的问题,提出一种融合Shapley值和粒子群优化算法的混合特征选择算法,以利用最少的特征获得最佳分类效果。在粒子群优化算法的局部搜索中引入博弈论的Shapley值,首先计算粒子（特征子集）中每个特征对分类效果的贡献值（Shapley值）,然后逐步删除Shapley值最低的特征以优化特征子集,进而更新粒子,同时也增强了算法的全局搜索能力,最后将改进后的粒子群优化算法运用于特征选择,以支持向量机分类器的分类性能和选择的特征数目作为特征子集评价标准,对UCI机器学习数据集和基因表达数据集的17个具有不同特征数量的医疗数据集进行分类实验。实验结果表明所提算法能有效地删除数据集中55%以上不相关的或冗余的特征,尤其对于中大型数据集能删减80%以上,并且所选择的特征子集也具有较好的分类能力,分类准确率能提高2至23个百分点。     

Semi-supervised relevance index for feature selection

This paper presents a new relevance index based on mutual information that is based on labeled and unlabeled data. The proposed index, which is based in Mutual Information, takes into account the similarity between features and their joint influence on the output variable. Based on this principle, a method to select features is developed to eliminate redundant and irrelevant features when the relevance index value is less then a threshold value. A strategy to set the threshold is also proposed in this work. Experiments show that the new method is capable of capturing important joint relations between input and output variables, which are incorporated into a new feature selection clustering approach.

     

Mutual information-based method for selecting informative feature sets

Feature selection is one of the fundamental problems in pattern recognition and data mining. A popular and effective approach to feature selection is based on information theory, namely the mutual information of features and class variable. In this paper we compare eight different mutual information-based feature selection methods. Based on the analysis of the comparison results, we propose a new mutual information-based feature selection method. By taking into account both the class-dependent and class-independent correlation among features, the proposed method selects a less redundant and more informative set of features. The advantage of the proposed method over other methods is demonstrated by the results of experiments on UCI datasets (Asuncion and Newman, 2010 [1]) and object recognition.     

New mechanism for archive maintenance in PSO-based multi-objective feature selection

In classification problems, a large number of features are typically used to describe the problem’s instances. However, not all of these features are useful for classification. Feature selection is usually an important pre-processing step to overcome the problem of “curse of dimensionality”. Feature selection aims to choose a small number of features to achieve similar or better classification performance than using all features. This paper presents a particle swarm Optimization (PSO)-based multi-objective feature selection approach to evolving a set of non-dominated feature subsets which achieve high classification performance. The proposed algorithm uses local search techniques to improve a Pareto front and is compared with a pure multi-objective PSO algorithm, three well-known evolutionary multi-objective algorithms and a current state-of-the-art PSO-based multi-objective feature selection approach. Their performances are examined on 12 benchmark datasets. The experimental results show that in most cases, the proposed multi-objective algorithm generates better Pareto fronts than all other methods.     

A binary ABC algorithm based on advanced similarity scheme for feature selection

Feature selection is the basic pre-processing task of eliminating irrelevant or redundant features through investigating complicated interactions among features in a feature set. Due to its critical role in classification and computational time, it has attracted researchers’ attention for the last five decades. However, it still remains a challenge. This paper proposes a binary artificial bee colony (ABC) algorithm for the feature selection problems, which is developed by integrating evolutionary based similarity search mechanisms into an existing binary ABC variant. The performance analysis of the proposed algorithm is demonstrated by comparing it with some well-known variants of the particle swarm optimization (PSO) and ABC algorithms, including standard binary PSO, new velocity based binary PSO, quantum inspired binary PSO, discrete ABC, modification rate based ABC, angle modulated ABC, and genetic algorithms on 10 benchmark datasets. The results show that the proposed algorithm can obtain higher classification performance in both training and test sets, and can eliminate irrelevant and redundant features more effectively than the other approaches. Note that all the algorithms used in this paper except for standard binary PSO and GA are employed for the first time in feature selection.     

基于神经网络的飞参数据特征选择方法

针对飞参数据中存在的大量冗余和不相关,提出了一种基于神经网络的飞参数据特征选择方法.为克服传统算法收敛速度慢、易陷入局部极小等缺陷,神经网络的训练采用粒子群优化算法和Levenberg-Marquardt优化算法相结合的方式.神经网络训练结束后,先利用网络权值信息对飞参数据特征的相对重要度进行排序,然后根据重要度次序对飞参数据特征进行选择.实验结果表明该方法能快速有效地删除冗余飞参数据特征,同时提高网络的泛化能力.     

基于局部子空间的多标记特征选择算法*

在已有的特征选择算法中,常用策略是通过相关准则选择与标记集合相关性较强的特征,然而该策略不一定是最优选择,因为与标记集合相关性较弱的特征可能是决定某些类别标记的关键特征.基于这一假设,文中提出基于局部子空间的多标记特征选择算法.该算法首先利用特征与标记集合之间的互信息得到一个重要度由高到低的特征序列,然后将新的特征排序空间划分为几个局部子空间,并在每个子空间设置采样比例以选择冗余性较小的特征,最后融合各子空间的特征子集,得到一组合理的特征子集.在6个数据集和4个评价指标上的实验表明,文中算法优于一些通用的多标记特征选择算法.     

Supervised hybrid feature selection based on PSO and rough sets for medical diagnosis

Medical datasets are often classified by a large number of disease measurements and a relatively small number of patient records. All these measurements (features) are not important or irrelevant/noisy. These features may be especially harmful in the case of relatively small training sets, where this irrelevancy and redundancy is harder to evaluate. On the other hand, this extreme number of features carries the problem of memory usage in order to represent the dataset. Feature Selection (FS) is a solution that involves finding a subset of prominent features to improve predictive accuracy and to remove the redundant features. Thus, the learning model receives a concise structure without forfeiting the predictive accuracy built by using only the selected prominent features. Therefore, nowadays, FS is an essential part of knowledge discovery. In this study, new supervised feature selection methods based on hybridization of Particle Swarm Optimization (PSO), PSO based Relative Reduct (PSO-RR) and PSO based Quick Reduct (PSO-QR) are presented for the diseases diagnosis. The experimental result on several standard medical datasets proves the efficiency of the proposed technique as well as enhancements over the existing feature selection techniques.     

针对高维数据的马尔科夫毯特征选择

针对不满足忠实分布的高维数据分类问题,一种新的基于粒子群算法的马尔科夫毯特征选择方法被提出。它通过有效地提取相关特征和剔除冗余特征,能够产生更好的分类结果。在特征预处理阶段,该算法通过最大信息系数衡量标准对特征的相关度和冗余性进行分析得到类属性的马尔科夫毯代表集和次最优特征子集;在搜索评价阶段,采用新的适应度函数通过粒子群算法选出最优特征子集;用此模型对测试集进行预测。实验结果表明,该算法在12个数据集上具有一定的优势。     

基于高维k-近邻互信息的特征选择方法

针对多元序列预测建模过程中特征选择问题,提出了一种基于数据驱动型高维k-近邻互信息的特征选择方法。该方法首先将数据驱动型k-近邻法扩展用于高维特征变量之间互信息的估计,然后采用前向累加策略给出全部特征最优排序,根据预设无关特征个数剔除无关特征,再利用后向交叉策略找出并剔除冗余特征,最终得到最优强相关特征子集。以Friedman数据、Housing数据和实际污水处理出水总磷预测数据为例,采用多层感知器神经网络预测模型进行仿真实验,验证了所提方法的有效性。