Differential evolution with improved individual-based parameter setting and selection strategy

In this paper, a novel differential evolution (DE) algorithm is proposed to improve the search efficiency of DE by employing the information of individuals to adaptively set the parameters of DE and update population. Firstly, a combined mutation strategy is developed by using two mixed mutation strategies with a prescribed probability. Secondly, the fitness values of original and guiding individuals are used to guide the parameter setting. Finally, a diversity-based selection strategy is designed by assembling greedy selection strategy and defining a new weighted fitness value based on the fitness values and positions of target and trial individuals. The proposed algorithm compares with eight existing algorithms on CEC 2005 and 2014 contest test instances, and is applied to solve the Spread Spectrum Radar Polly Code Design. Experimental results show that the proposed algorithm is very competitive.     

Multiple Elite Individual Guided Piecewise Search-Based Differential Evolution

The differential evolution (DE) algorithm relies mainly on mutation strategy and control parameters’ selection. To take full advantage of top elite individuals in terms of fitness and success rates, a new mutation operator is proposed. The control parameters such as scale factor and crossover rate are tuned based on their success rates recorded over past evolutionary stages. The proposed DE variant, MIDE, performs the evolution in a piecewise manner, i.e., after every predefined evolutionary stages, MIDE adjusts its settings to enrich its diversity skills. The performance of the MIDE is validated on two different sets of benchmarks: CEC 2014 and CEC 2017 (special sessions & competitions on real-parameter single objective optimization) using different performance measures. In the end, MIDE is also applied to solve constrained engineering problems. The efficiency and effectiveness of the MIDE are further confirmed by a set of experiments.      

多模态优化问题的邻域低密度个体差分进化算法

针对多模态优化问题(MultiModal Optimization Problems, MMOPs)的求解,提出了一种基于邻域低密度个体的差分进化算法.该算法在每一代,首先使用密度峰值聚类的方法求得每一个个体的密度,然后,将当前个体邻域范围内密度更低的个体作为变异算子的基向量,随着种群的进化,算法将会自动从探索阶段转化为收敛阶段,进而平衡算法的探索与收敛能力.将提出的算法应用于CEC2013多模态基准测试函数并进行仿真实验,结果表明本文算法在评价指标峰值比和稳定性上与其它基于差分进化的多模态优化算法相比具有明显的优势,并随着测试函数的维度与复杂性的增大,优势就更加明显,其性能优于许多现有的基于差分进化的多模态优化算法.     

Random Controlled Pool Base Differential Evolution Algorithm (RCPDE)

This paper presents a novel random controlled pool base differential evolution algorithm (RCPDE) where powerful mutation strategy and control parameter pools have been used. The mutation strategy pool contains mutations strategies having diverse parameter values, whereas the control parameter pool contains varying nature pairs of control parameter values. It has also been observed that with the addition of rarely used control parameter values in these pools are highly beneficial to enhance the performance of the DE algorithm. The proposed mutation strategy and control parameter pools improve the solution quality and the convergence speed of DE algorithm. The simulation results of the proposed RCPDE algorithm shows significant performance as compared to other algorithms when tested over a set of multi-dimensional benchmark functions.     

A novel mutation strategy selection mechanism for differential evolution based on local fitness landscape

The performance of differential evolution (DE) algorithm highly depends on the selection of mutation strategy. However, there are six commonly used mutation strategies in DE. Therefore, it is a challenging task to choose an appropriate mutation strategy for a specific optimization problem. For a better tackle this problem, in this paper, a novel DE algorithm based on local fitness landscape called LFLDE is proposed, in which the local fitness landscape information of the problem is investigated to guide the selection of the mutation strategy for each given problem at each generation. In addition, a novel control parameter adaptive mechanism is used to improve the proposed algorithm. In the experiments, a total of 29 test functions originated from CEC2017 single-objective test function suite which are utilized to evaluate the performance of the proposed algorithm. The Wilcoxon rank-sum test and Friedman rank test results reveal that the performance of the proposed algorithm is better than the other five representative DE algorithms.

     

基于多代种群进化信息改进的差分进化算法研究

差分进化算法是进化算法中一种性能较为优良的全局数值优化算法,已在人工智能、信号处理等方面取得广泛应用,但当前研究往往仅考虑进化过程中某一代种群的分布信息,而忽略进化过程中多代种群累积的分布信息,造成信息利用不充分。借助自适应协方差矩阵进化策略的思想,充分利用进化过程中累积的种群分布信息,同时,由于自适应协方差矩阵存在收敛早熟、易陷入局部最优的缺点,先后对变异和交叉操作进行相应改进,以平衡算法的全局搜索能力和局部搜索能力。首先,根据种群中个体适应度值进行排序,由余弦函数改进的概率模型计算个体参与变异操作的概率,基向量和差分向量中末端向量根据概率值降序选择,差分向量中起始向量升序选择,从而提高种群的搜索范围;然后,对协方差矩阵进行特征分解,并在由特征向量构建的坐标系中执行交叉操作,该种方式生成的实验向量更接近全局最优解。针对上述改进操作,采用IEEE CEC2014作为评估函数,实验结果表明,相比现有的差分进化改进算法,本改进算法的实验性能提升更为明显。     

采用概率判定法的分组变异自适应差分进化算法

为了平衡差分进化算法(DE)的全局探索和局部开发过程,提高算法避免陷入局部最优的能力,文中提出采用概率判定法的分组变异自适应差分进化算法(GVADE).GVADE采用概率判定法判定个体进化状态为较好、较差或一般,并根据个体进化状态为个体选择合适的变异算子和控制参数组.同时,为了满足进化状态较差个体变异的需要,设计具有较强全局探索能力的变异算子.在CEC2005标准测试集合上的实验表明,GVADE优于现有的其它DE算法,可以更好地平衡全局探索和局部开发,具有更高的收敛精度.     

Differential evolution with guiding archive for global numerical optimization

Differential evolution (DE) is a simple, yet efficient, population-based global evolutionary algorithm. DE may suffer from stagnation. This study presents a DE framework with guiding archive (GAR-DE) to help DE escape from the situation of stagnation. The proposed framework constructs a guiding archive and executes stagnation detection at each iteration. Guiding archive is composed of a certain number of relatively high-quality solutions. These solutions are collected in terms of fitness as well as diversity. If a stagnated individual is detected, the proposed framework selects a solution from guiding archive to replace the base vector in mutation operator. In this way, more promising solutions are provided to guide the evolution and effectively help DE escape from the situation of stagnation. The proposed framework is applied to six original DE algorithms, as well as two advanced DE variants. Experimental results on 28 benchmark functions and 8 real-world application problems show that the proposed framework can enhance the performance of most DE algorithms studied.     

Constrained differential evolution with multiobjective sorting mutation operators for constrained optimization

Differential evolution (DE) is a simple and powerful evolutionary algorithm for global optimization. DE with constraint handling techniques, named constrained differential evolution (CDE), can be used to solve constrained optimization problems (COPs). In existing CDEs, the parents are randomly selected from the current population to produce trial vectors. However, individuals with fitness and diversity information should have more chances to be selected. This study proposes a new CDE framework that uses nondominated sorting mutation operator based on fitness and diversity information, named MS-CDE. In MS-CDE, firstly, the fitness of each individual in the population is calculated according to the current population situation. Secondly, individuals in the current population are ranked according to their fitness and diversity contribution. Lastly, parents in the mutation operators are selected in proportion to their rankings based on fitness and diversity. Thus, promising individuals with better fitness and diversity are more likely to be selected as parents. The MS-CDE framework can be applied to most CDE variants. In this study, the framework is applied to two popular representative CDE variants, (μ + λ)-CDE and ECHT-DE. Experiment results on 24 benchmark functions from CEC’2006 and 18 benchmark functions from CEC’2010 show that the proposed framework is an effective approach to enhance the performance of CDE algorithms.     

基于搜索空间大小的动态变异算子差分进化算法

差分进化算法（DE）是一种较新的进化计算技术,具有概念简单、易于实现、收敛速度快等优点,得到了广泛的关注和应用.为了解决经典DE计算开销大,参数设置与问题本身过于相关等缺陷,提出了一种改进的差分进化算法（IDE）,它采用了一种动态变异算子,可根据进化代数的增加,基于搜索空间大小,实时地调整变异步长,从而提高算法的求解精度.通过在MATLAB仿真环境下对著名的基准测试函数分别进行求解,将改进后的算法和已有的多种优化算法进行比较,结果表明,改进的IDE算法性能明显优于已知的算法,证明动态变异是一种有效的改进思路.     

Opposition-based learning in the shuffled differential evolution algorithm

This paper proposes using the opposition-based learning (OBL) strategy in the shuffled differential evolution (SDE). In the SDE, population is divided into several memeplexes and each memeplex is improved by the differential evolution (DE) algorithm. The OBL by comparing the fitness of an individual to its opposite and retaining the fitter one in the population accelerates search process. The objective of this paper is to introduce new versions of the DE which, on one hand, use the partitioning and shuffling concepts of SDE to compensate for the limited amount of search moves of the original DE and, on the other hand, employ the OBL to accelerate the DE without making premature convergence. Four versions of DE algorithm are proposed based on the OBL and SDE strategies. All algorithms similarly use the opposition-based population initialization to achieve fitter initial individuals and their difference is in applying opposition-based generation jumping. Experiments on 25 benchmark functions designed for the special session on real-parameter optimization of CEC2005 and non-parametric analysis of obtained results demonstrate that the performances of the proposed algorithms are better than the SDE. The fourth version of proposed algorithm has a significant difference compared to the SDE in terms of all considered aspects. The emphasis of comparison results is to obtain some successful performances on unsolved functions for the first time, which so far have not been reported any successful runs on them. In a later part of the comparative experiments, performance comparisons of the proposed algorithm with some modern DE algorithms reported in the literature confirm a significantly better performance of our proposed algorithm, especially on high-dimensional functions.     

基于新变异策略的动态自适应差分进化算法

针对差分进化算法在复杂优化问题求解时后期收敛速度慢、易陷入局部最优和参数设置繁琐等问题,提出一种基于新变异策略的动态自适应差分进化算法p-ADE.首先,新变异策略中通过利用种群的全局最优解和目标个体的历史最优解引导种群搜索方向,为下一代个体的生成引入更多有效的方向性信息,避免差分向量中个体随机选择导致的搜索盲目性.其次,为加快收敛速度、提高算法稳定性、避免参数设置的繁琐与不精确,提出一种参数动态自适应调整策略,动态平衡算法局部搜索与全局搜索间的关系,有效调节个体在进化过程中的变异程度.在10个Benchmark函数上的实验结果表明,p-ADE相对于多种先进DE优化策略和全局优化算法在收敛精度、速度和鲁棒性上均具有明显优势.     

自适应混沌变异蛙跳算法*

研究蛙跳算法的寻优性能,主要在基本蛙跳算法的全局搜索过程中加入自适应混沌变异操作, 提出一种改进蛙跳算法。改进后的算法采用Logistic混沌序列构造混沌变异算子, 同时结合个体适应度和进化代数自适应调整变异尺度, 从而增强蛙跳算法搜索最优解的能力。仿真实验结果表明, 改进后的算法寻优精度和收敛速度得到了有效提高, 具有较好的实用性能。     

A DE and PSO based hybrid algorithm for dynamic optimization problems

Many real world optimization problems are dynamic in which the fitness landscape is time dependent and the optima change over time. Such problems challenge traditional optimization algorithms. For such problems, optimization algorithms not only have to find the global optimum but also need to closely track its trajectory. In this paper, a new hybrid algorithm integrating a differential evolution (DE) and a particle swarm optimization (PSO) is proposed for dynamic optimization problems. Multi-population strategy is adopted to enhance the diversity and try to keep each subpopulation on a different peak in the fitness landscape. A hybrid operator combining DE and PSO is designed, in which each individual is sequentially carried out DE and PSO operations. An exclusion scheme is proposed that integrates the distance based exclusion scheme with the hill-valley function to track the adjacent peaks. The algorithm is applied to the set of benchmark functions used in CEC 2009 competition for dynamic environment. Experimental results show that it is more effective in terms of overall performance than other comparative algorithms.     

A novel differential evolution algorithm for solving constrained engineering optimization problems

This paper introduces a novel differential evolution (DE) algorithm for solving constrained engineering optimization problems called (NDE). The key idea of the proposed NDE is the use of new triangular mutation rule. It is based on the convex combination vector of the triplet defined by the three randomly chosen vectors and the difference vectors between the best, better and the worst individuals among the three randomly selected vectors. The main purpose of the new approach to triangular mutation operator is the search for better balance between the global exploration ability and the local exploitation tendency as well as enhancing the convergence rate of the algorithm through the optimization process. In order to evaluate and analyze the performance of NDE, numerical experiments on three sets of test problems with different features, including a comparison with thirty state-of-the-art evolutionary algorithms, are executed where 24 well-known benchmark test functions presented in CEC’2006, five widely used constrained engineering design problems and five constrained mechanical design problems from the literature are utilized. The results show that the proposed algorithm is competitive with, and in some cases superior to, the compared ones in terms of the quality, efficiency and robustness of the obtained final solutions.     

Cooperative differential evolution with fast variable interdependence learning and cross-cluster mutation

Cooperative optimization algorithms have been applied with success to solve many optimization problems. However, many of them often lose their effectiveness and advantages when solving large scale and complex problems, e.g., those with interacted variables. A key issue involved in cooperative optimization is the task of problem decomposition. In this paper, a fast search operator is proposed to capture the interdependencies among variables. Problem decomposition is performed based on the obtained interdependencies. Another key issue involved is the optimization of the subproblems. A cross-cluster mutation strategy is proposed to further enhance exploitation and exploration. More specifically, each operator is identified as exploitation-biased or exploration-biased. The population is divided into several clusters. For the individuals within each cluster, the exploitation-biased operators are applied. For the individuals among different clusters, the exploration-biased operators are applied. The proposed operators are incorporated into the original differential evolution algorithm. The experiments were carried out on CEC2008, CEC2010, and CEC2013 benchmarks. For comparison, six algorithms that yield top ranked results in CEC competition are selected. The comparison results demonstrated that the proposed algorithm is robust and comprehensive for large scale optimization problems.     

Multiobjective differential evolution using homeostasis based mutation for application in software cost estimation

The problem in software cost estimation revolves around accuracy. To improve the accuracy, heuristic/meta-heuristic algorithms have been known to yield better results when it is applied in the domain of software cost estimation. For the sake of accuracy in results, we are still modifying these algorithms. Here we have proposed a new meta-heuristic algorithm based on Differential Evolution (DE) by Homeostasis mutation operator. Software development requires high prediction and low Root Mean Squared Error (RMSE) and mean magnitude relative error(MMRE). The problem in software cost estimation relates to accurate prediction and minimization of RMSE and MMRE, which are used to solve multiobjective optimization. Many versions of DE were proposed, however multi-objective versions where the concept of Pareto optimality is used, are most popular. Pareto-Based Differential Evolution (PBDE) is one of them. Although the performance of this algorithm is very good, its convergence rate can be further improved by minimizing the time complexity of nondominated sorting, and by improving the diversity of solutions. This has been implemented by using efficient nondominated algorithm whose time complexity is better than the previous one and a new mutation scheme is implemented in DE which can provide more diversity among solutions. The proposed variant multiplies the Homeostasis value with one more vector, named the Homeostasis mutation vector, in the existing mutation vector to provide more bandwidth for selecting effective mutant solutions. The proposed approach provides more promising solutions to guide the evolution and helps DE escape the situation of stagnation. The performance of the proposed algorithm is evaluated on twelve benchmark test functions (bi-objective and tri-objective) on the Pareto-optimal front. The performance of the proposed algorithm is compared with other state-of-the-art algorithms on five multi-objective evolutionary algorithms (MOEAs). The result verifies that our proposed Homeostasis mutation strategy performs better than other state-of-the-art algorithms. Finally, application of MODE-HBM is applied to solve in terms of Pareto front, representing the trade-off between development RMSE, MMRE, and prediction for COCOMO model.     

Improving differential evolution with a new selection method of parents for mutation

In differential evolution (DE), the salient feature lies in its mutationmechanismthat distinguishes it from other evolutionary algorithms. Generally, for most of the DE algorithms, the parents for mutation are randomly chosen from the current population. Hence, all vectors of population have the equal chance to be selected as parents without selective pressure at all. In this way, the information of population cannot be fully exploited to guide the search. To alleviate this drawback and improve the performance of DE, we present a new selection method of parents that attempts to choose individuals for mutation by utilizing the population information effectively. The proposed method is referred as fitnessand- position based selection (FPS), which combines the fitness and position information of population simultaneously for selecting parents in mutation of DE. In order to evaluate the effectiveness of FPS, FPS is applied to the original DE algorithms, as well as several DE variants, for numerical optimization. Experimental results on a suite of benchmark functions indicate that FPS is able to enhance the performance of most DE algorithms studied. Compared with other selection methods, FPS is also shown to be more effective to utilize information of population for guiding the search of DE.     

基于标准差的自适应激素调节遗传算法

基于生物内分泌系统的激素调节原理,提出了一种新的自适应遗传算法。该算法以内分泌激素调节的H ill函数下降形式为基础,设计了自适应交叉算子和自适应变异算子,使交叉率和变异率在遗传算法迭代过程中,能够根据函数适应度值的标准差进行自适应调节,使得整个进化过程中将种群多样性维持在合理水平,从而保证算法的正常进化。4种测试函数及三维人脑图像分割的实验结果显示,提出的自适应遗传算法可较好地保持种群多样性并克服早熟现象,性能优于其他3种自适应遗传算法及传统遗传算法。     

基于多尺度并行免疫克隆优化聚类算法

针对无监督分类问题,提出一种多尺度并行免疫克隆优化聚类算法.算法中,进化在多个子群之间并行进行,不同子群的抗体根据子群适应度采用不同变异尺度.进化初期,利用大尺度变异子群实现全局最优解空间的快速定位,同时变异尺度随着适应值的提升逐渐降低;进化后期,利用小尺度变异子群完成局部解空间的精确搜索.将新算法与其他聚类算法进行比较,所得结果表明新算法具有较好的聚类性能和鲁棒性.