Performance evaluation of evolutionary multiobjective optimization algorithms for multiobjective fuzzy genetics-based machine learning

Recently, evolutionary multiobjective optimization (EMO) algorithms have been utilized for the design of accurate and interpretable fuzzy rule-based systems. This research area is often referred to as multiobjective genetic fuzzy systems (MoGFS), where EMO algorithms are used to search for non-dominated fuzzy rule-based systems with respect to their accuracy and interpretability. In this paper, we examine the ability of EMO algorithms to efficiently search for Pareto optimal or near Pareto optimal fuzzy rule-based systems for classification problems. We use NSGA-II (elitist non-dominated sorting genetic algorithm), its variants, and MOEA/D (multiobjective evolutionary algorithm based on decomposition) in our multiobjective fuzzy genetics-based machine learning (MoFGBML) algorithm. Classification performance of obtained fuzzy rule-based systems by each EMO algorithm is evaluated for training data and test data under various settings of the available computation load and the granularity of fuzzy partitions. Experimental results in this paper suggest that reported classification performance of MoGFS in the literature can be further improved using more computation load, more efficient EMO algorithms, and/or more antecedent fuzzy sets from finer fuzzy partitions.     

基于IFI与FUA的Pareto遗传算法

在适应值快速辨识算法和基于聚类排挤的外部种群快速替换算法的基础上,提出了搜索Pareto最优解集的快速遗传算法。在该算法中,IFI算法实现个体适应值的快速辨识,FUA维持种群多样度和Pareto最优解集的均匀分布性。采用FPGA算法对多种多目标0/1背包问题进行仿真优化,FPGA算法能够以较少的计算成本搜索到高精度、分布均匀、高质量的Pareto非劣解集,收敛速度和收敛准确性均优于强度Pareto进化算法(SPEA)。     

A preference multi-objective optimization based on adaptive rank clone and differential evolution

Evolutionary multi-objective optimization (EMO) algorithms have been used in various real-world applications. However, most of the Pareto domination based multi-objective optimization evolutionary algorithms are not suitable for many-objective optimization. Recently, EMO algorithm incorporated decision maker’s preferences became a new trend for solving many-objective problems and showed a good performance. In this paper, we first use a new selection scheme and an adaptive rank based clone scheme to exploit the dynamic information of the online antibody population. Moreover, a special differential evolution (DE) scheme is combined with directional information by selecting parents for the DE calculation according to the ranks of individuals within a population. So the dominated solutions can learn the information of the non-dominated ones by using directional information. The proposed method has been extensively compared with two-archive algorithm, light beam search non-dominated sorting genetic algorithm II and preference rank immune memory clone selection algorithm over several benchmark multi-objective optimization problems with from two to ten objectives. The experimental results indicate that the proposed algorithm achieves competitive results.     

基于动态拥挤距离的混合多目标免疫优化算法

多目标免疫优化算法的研究目标是种群均匀分布于优化问题的非劣最优域并使算法快速收敛。为进一步提高多目标优化问题非支配解集合的分布均匀性和收敛性,提出了一种基于动态拥挤距离的混合多目标免疫优化算法。该算法基于动态拥挤距离来对个体进行比较和更新操作,从而保持最终解集的均匀分布,同时借鉴经典差分进化算法中的变异引导算子来加强免疫优化算法的局部搜索能力并提高搜索精度。基于5个经典测试函数的仿真结果表明, 与其他几种有效的多目标优化算法相比,所提算法不仅在求得Pareto最优解集的逼近性、均匀性和宽广性上有明显优势,而且收敛速度也有较大的改进和提高。     

Balance between genetic search and local search in memetic algorithms for multiobjective permutation flowshop scheduling

This paper shows how the performance of evolutionary multiobjective optimization (EMO) algorithms can be improved by hybridization with local search. The main positive effect of the hybridization is the improvement in the convergence speed to the Pareto front. On the other hand, the main negative effect is the increase in the computation time per generation. Thus, the number of generations is decreased when the available computation time is limited. As a result, the global search ability of EMO algorithms is not fully utilized. These positive and negative effects are examined by computational experiments on multiobjective permutation flowshop scheduling problems. Results of our computational experiments clearly show the importance of striking a balance between genetic search and local search. In this paper, we first modify our former multiobjective genetic local search (MOGLS) algorithm by choosing only good individuals as initial solutions for local search and assigning an appropriate local search direction to each initial solution. Next, we demonstrate the importance of striking a balance between genetic search and local search through computational experiments. Then we compare the modified MOGLS with recently developed EMO algorithms: the strength Pareto evolutionary algorithm and revised nondominated sorting genetic algorithm. Finally, we demonstrate that a local search can be easily combined with those EMO algorithms for designing multiobjective memetic algorithms.     

Pareto frontier for simultaneous structural and manufacturing optimization of a composite part

Optimized design of composite structures requires simultaneous optimization of structural performance and manufacturing process. Such a challenge calls for a multi-objective optimization. Here, a generating multi-objective optimization method called normalized normal constraint method, which attains a set of optimal solutions and allows the designer to explore design alternatives before making the final decision, is coupled with a local-global search called constrained globalized bounded Nelder–Mead method. The proposed approach is applied to the design of a Z-shaped composite bracket for optimization of structural and manufacturing objectives. Comparison of the results with non-dominated sorting genetic algorithm (NSGA-II) shows that when only a small number of function evaluations are possible and a few Pareto optima are desired, the proposed method outperforms NSGA-II in terms of convergence to the true Pareto frontier. The results are validated by an enumeration search and by exploring the neighbourhood of the final solutions.     

On Set-Based Multiobjective Optimization

Assuming that evolutionary multiobjective optimization (EMO) mainly deals with set problems, one can identify three core questions in this area of research: 1) how to formalize what type of Pareto set approximation is sought; 2) how to use this information within an algorithm to efficiently search for a good Pareto set approximation; and 3) how to compare the Pareto set approximations generated by different optimizers with respect to the formalized optimization goal. There is a vast amount of studies addressing these issues from different angles, but so far only a few studies can be found that consider all questions under one roof. This paper is an attempt to summarize recent developments in the EMO field within a unifying theory of set-based multiobjective search. It discusses how preference relations on sets can be formally defined, gives examples for selected user preferences, and proposes a general preference-independent hill climber for multiobjective optimization with theoretical convergence properties. Furthermore, it shows how to use set preference relations for statistical performance assessment and provides corresponding experimental results. The proposed methodology brings together preference articulation, algorithm design, and performance assessment under one framework and thereby opens up a new perspective on EMO.      

多目标拆卸线平衡问题的Pareto细菌觅食算法*

拆卸线平衡问题的优化涉及多个目标,为克服传统方法在求解多目标拆卸线平衡问题时不能很好处理各子目标间冲突及易于早熟等不足,提出了一种多目标细菌觅食优化算法。算法采用Pareto非劣排序技术对种群进行分级,并结合拥挤距离机制评价同级个体的优劣。为提高算法收敛性能,在趋向性操作结束后引入精英保留策略保留优秀个体,并采用全局信息共享策略引导菌群不断向均匀分布的Pareto最优前沿趋近。通过不同规模算例的对比验证表明了算法的有效性与优越性。     

基于平衡搜索策略的多目标粒子群优化算法*

鉴于平衡全局和局部搜索在多目标粒子群优化算法获取完整均匀Pareto最优前沿方面的重要性,设计平衡全局和局部搜索策略,进而提出改进的多目标粒子群优化算法(bsMOPSO).文中策略在局部搜索方面设计归档集自挖掘子策略,通过对归档集中均匀分布的部分粒子进行柯西扰动,使归档集涵盖整个前沿面的局部搜索.在全局搜索方面设计边界最优粒子引导搜索子策略,以边界最优粒子替换部分粒子的全局最优解,引导粒子向各维目标的边界区域搜索.选取4种对比算法在ZDT和DTLZ系列的部分测试函数上进行实验,结果表明bsMOPSO具有更快的Pareto最优前沿收敛效率和更好的分布性.     

基于自适应学习的多目标粒子群优化算法

将进化算法应用于某些多目标优化问题时,采用增加种群规模和进化代数的方法往往耗费大量的目标函数计算开销,且达不到提高种群进化效率的目的,为此提出了一种基于自适应学习最优搜索方向的多目标粒子群优化算法。采用自适应惯性权值平衡算法的全局和局部搜索能力,采用聚类排挤方法保持Pareto非支配解集的分布均匀性,使用最近邻学习方法为每个粒子在Pareto非支配解集中寻找一个最优飞行目标来提高其收敛速度并保持粒子群搜索方向的多样性。实验结果表明,提出的算法可在显著地降低函数评估成本的前提下实现快速的搜索,并使粒子群均匀地逼近Pareto最优面。     

模型辅助的计算费时进化高维多目标优化

代理模型能够辅助进化算法在计算资源有限的情况下加快找到问题的最优解集,因此建立高效的代理模型辅助多目标进化搜索逐渐受到了重视.然而随着目标数量的增加,对每个目标分别建立高斯过程模型时个体整体估值的不确定度会随之增加.因此通过对模型最优解集的搜索探索原问题潜在的非支配解集,并基于个体的收敛性,种群的多样性和估值的不确定度...     

基于改进MOEA/D算法的WSN覆盖优化方法*

为了优化无线传感器网络（WSN）的覆盖方法,针对MOEA/D中缺少对本代优质个体的保存和最优解集中的个体极少的两个问题,提出了粒子群优化的基于分解的多目标进化算法（MOEA/D-PSO）。通过保留种群本代优质个体,改进本地优化解集在进化过程中的搜索方向和搜索进度,弥补了MOEA/D不足。仿真实验证明,相对于MOEA/D和非支配排序遗传算法（NSGA-II）,MOEA/D-PSO所得非支配解更接近Pareto最优曲面,解集分布的均匀性和多样性表现更佳,WSN的覆盖范围更广,能量消耗更少。     

基于ε占优的正交多目标差分演化算法研究

演化多目标优化是目前演化计算中热门研究方向之一.但是,要设计一种高效、鲁棒的演化多目标优化算法,使其找到接近最优和完整的非劣解集是一项很困难的任务.为了能有效求解多目标优化问题,提出了一种新的多目标差分演化算法.新算法具有如下特征:1)利用正交实验设计和连续空间量化的方法产生初始群体,使得初始群体中的个体可以均匀分布于搜索空间,并且可以使好的个体在演化过程中得到利用;2)采用Archive群体保存非劣解,并利用ε占优方法更新Archive群体,从而可以使算法较快获得分布很好的Pareto解集;3)为了加快算法收敛,提出一种基于随机选择和精英选择的混合选择机制.通过8个标准测试函数对新算法进行测试,并与其他一些多目标演化算法进行比较,其结果表明新算法可以有效逼近真实Pareto前沿且分布均匀,并且在收敛性和多样性的求解精度和稳     

多目标资源优化分配问题的Memetic 算法

针对传统算法求解多目标资源优化分配问题收敛慢、Pareto解不能有效分布在Pareto 前沿面的问题, 提出一种新的Memetic 算法. 在遗传算法的交叉算子中引入模拟退火算法, 加强了遗传算法的局部搜索能力, 加快了收敛速度. 为了使Pareto 最优解均匀分布在Pareto 前沿面, 在染色体编码中引入禁忌表, 增加了种群的多样性, 避免了传统遗传算法后期Pareto 解集过于集中的缺点. 通过与已有的遗传算法、蚁群算法、粒子群算法进行比较, 仿真实验表明了所提出算法的有效性, 并分析了禁忌表长度和模拟退火参数对算法收敛性的影响.

     

基于分解和多策略变异的多目标差分进化算法*

差分进化是一种有效的优化技术,已成功用于多目标优化问题。但也存在Pareto最优集合的收敛慢和多样性差等问题。针对上述不足,本文提出了一种基于分解和多策略变异的多目标差分进化算法(MODE/DMSM)。该算法利用基于分解的方法将多目标优化问题分解为多个单目标优化问题;通过高效的非支配排序方法选择具有良好收敛性和多样性的解来指导差分进化过程;采用了多策略变异方法来平衡进化过程中收敛性和多样性。在ZDT和DTLZ的10个测试函数上的仿真结果表明,本文算法在Parato最优集合的收敛性和多样性优于其他六种代表性多目标优化算法。     

随机扰动不同种群变异策略的多目标进化算法

为了提高多目标优化问题非支配解集的收敛性和多样性,解决算法后期易陷入局部最优的问题,根据不同差分进化策略特点,添加随机扰动,基于改进切比雪夫机制提出了一种自适应差分进化策略的分解多目标进化算法（MOEA/D-ADE-levy）。首先使用混合水平正交实验产生均匀权重向量并应用于改进切比雪夫机制分解子问题得到均匀分布的初始种群;其次将种群分为优秀个体、中间个体和较差个体,对不同个体采用不同的变异策略,对变异因子F和交叉概率CR采用自适应机制,提高非支配解集的收敛性和多样性;最后对陷入局部最优的解集增加levy随机扰动,增大其全局搜索的能力,跳出局部最优。采用DTLZ测试函数验证算法有效性,将所提算法与NSGA2、NSGA3、MOEA\D、MOEA\D-DE等常用算法进行比较,使用GD和IGD评价指标对算法进行多样性和收敛性分析,实验结果表明,该算法在收敛性和多样性方面得到了改进与提高,能得到更优的Pareto解集。     

融合指标分组的高维混合多目标进化优化

高维混合多目标优化问题因包含多个不同类型指标,目前尚缺乏有效求解该问题的进化优化方法。提出一种基于目标分组的高维混合多目标并行进化优化方法。采用深度学习神经网络预测种群隐式性能指标;基于指标相关性,将高维混合多目标优化问题分解为若干子优化问题;采用多种群并行进化算法,求解分解后的每一子优化问题,并基于各子种群的非被占优解构建外部保存集;采用聚合函数对外部保存集个体进一步优化,得到Pareto最优解集。在室内布局优化问题中验证所提方法,实验结果表明,所提方法的Pareto最优解在收敛性、分布性以及延展性等方面均优于对比方法。     

SP-MEC算法的收敛性分析

进化算法求解多目标优化问题具有独特的优势。SP-MEC是一种新的利用思维进化算法(MEC)解决多目标优化问题的算法,数值实验结果验证了它的可行性与有效性。文章利用概率论的基本理论对其收敛性进行分析,提出局部Pareto最优解集、局部Pareto最优态集及趋同过程产生的序列强收敛的概念,证明了在满足一定条件下趋同过程产生的序列强收敛于局部Pareto最优态集。     

一种用于多目标优化的混合粒子群优化算法

将粒子群算法与局部优化方法相结合,提出了一种混合粒子群多目标优化算法（HMOPSO）。该算法针对粒子群局部优化性能较差的缺点,引入多目标线搜索与粒子群算法相结合的策略,以增强粒子群算法的局部搜索能力。HMOPSO首先运行PSO算法,得到近似的Pareto最优解;然后启动多目标线搜索,发挥传统数值优化算法的优势,对其进行进一步的优化。数值实验表明,HMOPSO具有良好的全局优化性能和较强的局部搜索能力,同时HMOPSO所得的非劣解集在分散性、错误率和逼近程度等量化指标上优于MOPSO。     

面向多目标优化的适应度共享免疫克隆算法

多目标优化的日标在于使得解集能够快速的逼近真实Pareto前沿.针对解的分布性问题,以免疫克隆算法为框架,引入适应度共享策略,提出了一种新的具有良好分布性保持的多目标优化进化算法;算法建立外部群体以保存非支配解,以Pareto优和共亨适应度作为外部群体更新与激活抗体选择的双重标准.为了增强算法对决策空间的开发能力,引入...