Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization

Differential evolution (DE) is an efficient and powerful population-based stochastic search technique for solving optimization problems over continuous space, which has been widely applied in many scientific and engineering fields. However, the success of DE in solving a specific problem crucially depends on appropriately choosing trial vector generation strategies and their associated control parameter values. Employing a trial-and-error scheme to search for the most suitable strategy and its associated parameter settings requires high computational costs. Moreover, at different stages of evolution, different strategies coupled with different parameter settings may be required in order to achieve the best performance. In this paper, we propose a self-adaptive DE (SaDE) algorithm, in which both trial vector generation strategies and their associated control parameter values are gradually self-adapted by learning from their previous experiences in generating promising solutions. Consequently, a more suitable generation strategy along with its parameter settings can be determined adaptively to match different phases of the search process/evolution. The performance of the SaDE algorithm is extensively evaluated (using codes available from P. N. Suganthan) on a suite of 26 bound-constrained numerical optimization problems and compares favorably with the conventional DE and several state-of-the-art parameter adaptive DE variants.     

Remote sensing image subpixel mapping based on adaptive differential evolution

In this paper, a novel subpixel mapping algorithm based on an adaptive differential evolution (DE) algorithm, namely, adaptive-DE subpixel mapping (ADESM), is developed to perform the subpixel mapping task for remote sensing images. Subpixel mapping may provide a fine-resolution map of class labels from coarser spectral unmixing fraction images, with the assumption of spatial dependence. In ADESM, to utilize DE, the subpixel mapping problem is transformed into an optimization problem by maximizing the spatial dependence index. The traditional DE algorithm is an efficient and powerful population-based stochastic global optimizer in continuous optimization problems, but it cannot be applied to the subpixel mapping problem in a discrete search space. In addition, it is not an easy task to properly set control parameters in DE. To avoid these problems, this paper utilizes an adaptive strategy without user-defined parameters, and a reversible-conversion strategy between continuous space and discrete space, to improve the classical DE algorithm. During the process of evolution, they are further improved by enhanced evolution operators, e.g., mutation, crossover, repair, exchange, insertion, and an effective local search to generate new candidate solutions. Experimental results using different types of remote images show that the ADESM algorithm consistently outperforms the previous subpixel mapping algorithms in all the experiments. Based on sensitivity analysis, ADESM, with its self-adaptive control parameter setting, is better than, or at least comparable to, the standard DE algorithm, when considering the accuracy of subpixel mapping, and hence provides an effective new approach to subpixel mapping for remote sensing imagery.     

A self-adaptive differential evolution algorithm for continuous optimization problems

This paper proposes a new self-adaptive differential evolution algorithm (DE) for continuous optimization problems. The proposed self-adaptive differential evolution algorithm extends the concept of the DE/current-to-best/1 mutation strategy to allow the adaptation of the mutation parameters. The control parameters in the mutation operation are gradually self-adapted according to the feedback from the evolutionary search. Moreover, the proposed differential evolution algorithm also consists of a new local search based on the krill herd algorithm. In this study, the proposed algorithm has been evaluated and compared with the traditional DE algorithm and two other adaptive DE algorithms. The experimental results on 21 benchmark problems show that the proposed algorithm is very effective in solving complex optimization problems.     

Modified differential evolution approach for optimization of planar parallel manipulators force capabilities

The global optimization problem is not easy to solve and is still an open challenge for researchers since an analytical optimal solution is difficult to obtain even for relatively simple application problems. Conventional deterministic numerical algorithms tend to stop the search in local minimum nearest to the input starting point, mainly when the optimization problem presents nonlinear, non-convex and non-differential functions, multimodal and nonlinear. Nowadays, the use of evolutionary algorithms (EAs) to solve optimization problems is a common practice due to their competitive performance on complex search spaces. EAs are well known for their ability to deal with nonlinear and complex optimization problems. The primary advantage of EAs over other numerical methods is that they just require the objective function values, while properties such as differentiability and continuity are not necessary. In this context, the differential evolution (DE), a paradigm of the evolutionary computation, has been widely used for solving numerical global optimization problems in continuous search space. DE is a powerful population-based stochastic direct search method. DE simulates natural evolution combined with a mechanism to generate multiple search directions based on the distribution of solutions in the current population. Among DE advantages are its simple structure, ease of use, speed, and robustness, which allows its application on several continuous nonlinear optimization problems. However, the performance of DE greatly depends on its control parameters, such as crossover rate, mutation factor, and population size and it often suffers from being trapped in local optima. Conventionally, users have to determine the parameters for problem at hand empirically. Recently, several adaptive variants of DE have been proposed. In this paper, a modified differential evolution (MDE) approach using generation-varying control parameters (mutation factor and crossover rate) is proposed and evaluated. The proposed MDE presents an efficient strategy to improve the search performance in preventing of premature convergence to local minima. The efficiency and feasibility of the proposed MDE approach is demonstrated on a force optimization problem in Robotics, where the force capabilities of a planar 3-RRR parallel manipulator are evaluated considering actuation limits and different assembly modes. Furthermore, some comparison results of MDE approach with classical DE to the mentioned force optimization problem are presented and discussed.     

An evolving surrogate model-based differential evolution algorithm

Differential evolution (DE) is a simple and effective approach for solving numerical optimization problems. However, the performance of DE is sensitive to the choice of mutation and crossover strategies and their associated control parameters. Therefore, to achieve optimal performance, a time-consuming parameter tuning process is required. In DE, the use of different mutation and crossover strategies with different parameter settings can be appropriate during different stages of the evolution. Therefore, to achieve optimal performance using DE, various adaptation, self-adaptation, and ensemble techniques have been proposed. Recently, a classification-assisted DE algorithm was proposed to overcome trial and error parameter tuning and efficiently solve computationally expensive problems. In this paper, we present an evolving surrogate model-based differential evolution (ESMDE) method, wherein a surrogate model constructed based on the population members of the current generation is used to assist the DE algorithm in order to generate competitive offspring using the appropriate parameter setting during different stages of the evolution. As the population evolves over generations, the surrogate model also evolves over the iterations and better represents the basin of search by the DE algorithm. The proposed method employs a simple Kriging model to construct the surrogate. The performance of ESMDE is evaluated on a set of 17 bound-constrained problems. The performance of the proposed algorithm is compared to state-of-the-art self-adaptive DE algorithms: the classification-assisted DE algorithm, regression-assisted DE algorithm, and ranking-assisted DE algorithm.     

State estimation of nonlinear dynamic systems using weighted variance-based adaptive particle swarm optimization

New heuristic filters are proposed for state estimation of nonlinear dynamic systems based on particle swarm optimization (PSO) and differential evolution (DE). The methodology converts state estimation problem into dynamic optimization to find the best estimate recursively. In the proposed strategy the particle number is adaptively set based on the weighted variance of the particles. To have a filter with minimal parameter settings, PSO with exponential distribution (PSO-E) is selected in conjunction with jDE to self-adapt the other control parameters. The performance of the proposed adaptive evolutionary algorithms i.e. adaptive PSO-E, adaptive DE and adaptive jDE is studied through a comparative study on a suite of well-known uni- and multi-modal benchmark functions. The results indicate an improved performance of the adaptive algorithms relative to original simple versions. Further, the performance of the proposed heuristic filters generally called adaptive particle swarm filters (APSF) or adaptive differential evolution filters (ADEF) are evaluated using different linear (nonlinear)/Gaussian (non-Gaussian) test systems. Comparison of the results to those of the extended Kalman filter, unscented Kalman filter, and particle filter indicate that the adopted strategy fulfills the essential requirements of accuracy for nonlinear state estimation.     

基于差分演化的自适应参数控制蚁群算法

蚁群算法存在对参数的依赖、早熟和停滞等缺点但具有与其他算法容易结合的特点,据此,将差分演化算法应用到蚁群算法的参数选取中,提出一种改进的蚁群算法。将蚁群算法的参数作为差分演化算法解空间的向量元素,在自适应地寻找蚁群算法最优参数组合的同时求解问题的最优解。改进算法对蚁群算法中的参数进行自适应调整,可避免大量盲目的测试,扩大蚁群算法的搜索空间,提高全局搜索能力。在典型的旅行商问题上进行对比实验,结果验证了改进算法的优化性能高于传统的蚁群算法。     

一种改进的微分进化算法

相对于其他优化算法来说,微分进化算法具有控制参数少、易于使用以及鲁棒性强等特点,但在搜索过程中存在着局部搜索能力弱的缺点。针对微分进化算法局部搜索能力弱的缺点,提出了一种基于局部变异的微分进化算法,该算法使个体具有良好快速收敛能力。使用典型优化函数对比较算法进行了测试,算法分析和仿真结果表明,改进以后的算法具有寻优能力...     

自适应动态邻域布谷鸟混合算法求解TSP问题

针对离散布谷鸟算法求解旅行商问题时邻域搜索效率低和易陷入局部最优解等问题,提出了一种自适应动态邻域布谷鸟混合算法（Adaptive Dynamic Neighborhood Hybrid Cuckoo Search algorithm,ADNHCS）。为了提升邻域搜索效率,设计了一种圆限定突变的动态邻域结构来降低经典算法的随机性;此外,提出了可根据迭代过程进行自适应参数调整的策略,并结合禁忌搜索算法来提升全局寻优的能力。使用MATLAB和标准TSPLIB数据库中的若干经典算例对算法性能进行了实验仿真,结果表明与其他基于布谷鸟算法、经典和新型群智能优化算法相比,ADNHCS算法在全局寻优能力以及稳定性方面表现更优。     

An adaptive artificial bee colony algorithm based on objective function value information

Artificial bee colony (ABC) algorithm is a novel biological-inspired optimization algorithm, which has many advantages compared with other optimization algorithm, such as less control parameters, great global optimization ability and easy to carry out. It has proven to be more effective than some evolutionary algorithms (EAs), particle swarm optimization (PSO) and differential evolution (DE) when testing on both benchmark functions and real issues. ABC, however, its solution search equation is poor at exploitation. For overcoming this insufficiency, two new solution search equations are proposed in this paper. They apply random solutions to take the place of the current solution as base vector in order to get more useful information. Exploitation is further improved on the basis of enhancing exploration by utilizing the information of the current best solution. In addition, the information of objective function value is introduced, which makes it possible to adjust the step-size adaptively. Owing to their respective characteristics, the new solution search equations are combined to construct an adaptive algorithm called MTABC. The methods our proposed balance the exploration and exploitation of ABC without forcing severe extra overhead in respect of function evaluations. The performance of the MTABC algorithm is extensively judged on a set of 20 basic functions and a set of 10 shifted or rotated functions, and is compared favorably with other improved ABCs and several state-of-the-art algorithms. The experimental results show that the proposed algorithm has a higher convergence speed and better search ability for almost all functions.     

具有适应性突变和惯性权重的粒子群优化(PSO)算法及其在动态系统参数估计中的应用

An important problem in engineering is the unknown parameters estimation in nonlinear systems. In this paper, a novel adaptive particle swarm optimization (APSO) method is proposed to solve this problem. This work considers two new aspects, namely an adaptive mutation mechanism and a dynamic inertia weight into the conventional particle swarm optimization (PSO) method. These mechanisms are employed to enhance global search ability and to increase accuracy. First, three well-known benchmark functions namely Griewank, Rosenbrock and Rastrigrin are utilized to test the ability of a search algorithm for identifying the global optimum. The performance of the proposed APSO is compared with advanced algorithms such as a nonlinearly decreasing weight PSO (NDWPSO) and a real-coded genetic algorithm (GA), in terms of parameter accuracy and convergence speed. It is confirmed that the proposed APSO is more successful than other aforementioned algorithms. Finally, the feasibility of this algorithm is demonstrated through estimating the parameters of two kinds of highly nonlinear systems as the case studies.     

A novel mutation strategy selection mechanism for differential evolution based on local fitness landscape

The performance of differential evolution (DE) algorithm highly depends on the selection of mutation strategy. However, there are six commonly used mutation strategies in DE. Therefore, it is a challenging task to choose an appropriate mutation strategy for a specific optimization problem. For a better tackle this problem, in this paper, a novel DE algorithm based on local fitness landscape called LFLDE is proposed, in which the local fitness landscape information of the problem is investigated to guide the selection of the mutation strategy for each given problem at each generation. In addition, a novel control parameter adaptive mechanism is used to improve the proposed algorithm. In the experiments, a total of 29 test functions originated from CEC2017 single-objective test function suite which are utilized to evaluate the performance of the proposed algorithm. The Wilcoxon rank-sum test and Friedman rank test results reveal that the performance of the proposed algorithm is better than the other five representative DE algorithms.

     

基于改进细菌觅食算法的飞控系统多模态参数优化

针对飞控系统参数优化过程中存在的解空间非凸性问题,或由于多约束条件下导致的全局最优不可达问题,提出一种基于改进细菌觅食算法的多模态参数优化方法.采用基于格型准则的采样方法以尽可能广泛地搜索解空间,并利用K均值聚类的小生境技术使得多个细菌种群能够分别搜索各自的区域,以尽可能多地获得解空间中不同位置的可行解.同时研究一种自适应深度搜索策略,确保算法在整个寻优过程中的鲁棒性.所提出算法可以在完成对系统优化的基础上,探寻飞控系统中各参数本身的可行域及其在解空间中所处的位置,也能够在一定程度上揭示解空间本身的特性.仿真结果验证了所提出算法可以有效地简化系统调参的过程,更为快速地获得一个满足设计性能期望的飞控系统.     

A new hybrid differential evolution algorithm with self-adaptation for function optimization

In this study, a new hybrid algorithm, hDEBSA, is proposed with the aid of two evolutionary algorithms, Differential Evolution (DE) and Backtracking Search Optimization Algorithm (BSA). The control parameters of both algorithms are simultaneously considered as a self-adaptation basis such that the values of the parameters update automatically during the optimization process to improve performance and convergence speed. To validate the proposed algorithm, twenty-eight CEC2013 test functions are considered. The performance results of hDEBSA are validated by comparing them with several state-of-the-art algorithms that are available in literature. Finally, hDEBSA is applied to solve four real-world optimization problems, and the results are compared with the other algorithms, where it was found that the hDEBSA performance is better than that of the other algorithms.     

基于正交差分演化无迹卡尔曼滤波的短时交通流量预测算法

针对复杂交通路段下的短时交通流量模型的参数估计问题,建立了基于宏观交通流量预测的状态空间模型,提出了基于正交自适应差分演化的无迹卡尔曼滤波(UKF)算法,解决交通流量预测动态模型的参数优化问题.对差分演化算法(DE)的初始化过程,使用基于正交设计和量化技术的交叉算子最大限度地提高种群的多样性,平衡差分演化算法的开采性和勘探性,更高效地搜索无迹卡尔曼滤波的模型参数.并针对UKF、DE的不同情况,分别采用不同的自适应策略提高调节算法性能.实验结果表明,相对于单独使用随机分布的方式初始化,或者根据经验设置模型参数的方法,使用正交设计方法的初始化策略、变异算子以及参数自适应控制策略的差分演化算法能够有效地节省计算资源,提升预测性能和精度,具有更高的鲁棒性.     

Accelerating Differential Evolution Using an Adaptive Local Search

We propose a crossover-based adaptive local search (LS) operation for enhancing the performance of standard differential evolution (DE) algorithm. Incorporating LS heuristics is often very useful in designing an effective evolutionary algorithm for global optimization. However, determining a single LS length that can serve for a wide range of problems is a critical issue. We present a LS technique to solve this problem by adaptively adjusting the length of the search, using a hill-climbing heuristic. The emphasis of this paper is to demonstrate how this LS scheme can improve the performance of DE. Experimenting with a wide range of benchmark functions, we show that the proposed new version of DE, with the adaptive LS, performs better, or at least comparably, to classic DE algorithm. Performance comparisons with other LS heuristics and with some other well-known evolutionary algorithms from literature are also presented.     

Scalability of generalized adaptive differential evolution for large-scale continuous optimization

Differential evolution (DE) has become a very powerful tool for global continuous optimization problems. Parameter adaptations are the most commonly used techniques to improve its performance. The adoption of these techniques has assisted the success of many adaptive DE variants. However, most studies on these adaptive DEs are limited to some small-scale problems, e.g. with less than 100 decision variables, which may be quite small comparing to the requirements of real-world applications. The scalability performance of adaptive DE is still unclear. In this paper, based on the analyses of similarities and drawbacks of existing parameter adaptation schemes in DE, we propose a generalized parameter adaptation scheme. Applying the scheme to DE results in a new generalized adaptive DE (GaDE) algorithm. The scalability performance of GaDE is evaluated on 19 benchmark functions with problem scale from 50 to 1,000 decision variables. Based on the comparison with three other algorithms, GaDE is very competitive in both the performance and scalability aspects.     

Self-adaptive differential evolution with multi-trajectory search for large-scale optimization

In this paper, self-adaptive differential evolution (DE) is enhanced by incorporating the JADE mutation strategy and hybridized with modified multi-trajectory search (MMTS) algorithm (SaDE-MMTS) to solve large-scale continuous optimization problems. The JADE mutation strategy, the “DE/current-to-pbest” which is a variation of the classic “DE/current-to-best”, is used for generating mutant vectors. After the mutation phase, the binomial (uniform) crossover, the exponential crossover as well as no crossover option are used to generate each pair of target and trial vectors. By utilizing the self-adaptation in SaDE, both trial vector generation strategies and their associated control parameter values are gradually self-adapted by learning from their previous experiences in generating promising solutions. Consequently, suitable offspring generation strategy along with associated parameter settings will be determined adaptively to match different phases of the search process. MMTS is applied frequently to refine several diversely distributed solutions at different search stages satisfying both the global and the local search requirement. The initialization of step sizes is also defined by a self-adaption during every MMTS step. The success rates of both SaDE and the MMTS are determined and compared; consequently, future function evaluations for both search algorithms are assigned proportionally to their recent past performance. The proposed SaDE-MMTS is employed to solve the 19 numerical optimization problems in special issue of soft computing on scalability of evolutionary algorithms for large-scale continuous optimization problems and competitive results are presented.     

Adaptive direction information in differential evolution for numerical optimization

Differential evolution (DE) is a powerful evolutionary algorithm (EA) for numerical optimization. It has been successfully used in various scientific and engineering fields. In most of the DE algorithms, the neighborhood and direction information are not fully and simultaneously exploited to guide the search. Most recently, to make full use of these information, a DE framework with neighborhood and direction information (NDi-DE) was proposed. It was experimentally demonstrated that NDi-DE was effective for most of the DE algorithms. However, the performance of NDi-DE heavily depends on the selection of direction information. To alleviate this drawback and improve the performance of NDi-DE, the adaptive operator selection (AOS) mechanism is introduced into NDi-DE to adaptively select the direction information for the specific DE mutation strategy. Therefore, a new DE framework, adaptive direction information based NDi-DE (aNDi-DE), is proposed in this study. With AOS, the good balance between exploration and exploitation of aNDi-DE can be dynamically achieved. In order to evaluate the effectiveness of aNDi-DE, the proposed framework is applied to the original DE algorithms, as well as several advanced DE variants. Experimental results show that aNDi-DE is able to adaptively select the most suitable type of direction information for the specific DE mutation strategy during the evolutionary process. The efficiency and robustness of aNDi-DE are also confirmed by comparing with NDi-DE.     

Artificial bee colony algorithm with strategy and parameter adaptation for global optimization

The artificial bee colony (ABC) algorithm has been successfully applied to solve a wide range of real-world optimization problems. However, the success of ABC in solving a specific problem crucially depends on appropriately choosing the foraging strategies and its associated parameters. In this paper, we propose a strategy and parameter self-adaptive selection ABC algorithm (SPaABC), in which both employed bees search strategies and their associated control parameter values are gradually self-adaptive by learning from their previous experiences in generating promising solutions. In order to verify the performance of our approach, SPaABC algorithm is compared to many recently related algorithms on eighteen benchmark functions. Experimental results indicate that the proposed algorithm achieves competitive performance on most test instances.