Self-adaptive population sizing for a tune-free differential evolution

The study and research of evolutionary algorithms (EAs) is getting great attention in recent years. Although EAs have earned extensive acceptance through numerous successful applications in many fields, the problem of finding the best combination of evolutionary parameters especially for population size that need the manual settings by the user is still unresolved. In this paper, our system is focusing on differential evolution (DE) and its control parameters. To overcome the problem, two new systems were carried out for the self-adaptive population size to test two different methodologies (absolute encoding and relative encoding) in DE and compared their performances against the original DE. Fifty runs are conducted for every 20 well-known benchmark problems to test on every proposed algorithm in this paper to achieve the function optimization without explicit parameter tuning in DE. The empirical testing results showed that DE with self-adaptive population size using relative encoding performed well in terms of the average performance as well as stability compared to absolute encoding version as well as the original DE.     

A self-adaptive differential evolution algorithm for continuous optimization problems

This paper proposes a new self-adaptive differential evolution algorithm (DE) for continuous optimization problems. The proposed self-adaptive differential evolution algorithm extends the concept of the DE/current-to-best/1 mutation strategy to allow the adaptation of the mutation parameters. The control parameters in the mutation operation are gradually self-adapted according to the feedback from the evolutionary search. Moreover, the proposed differential evolution algorithm also consists of a new local search based on the krill herd algorithm. In this study, the proposed algorithm has been evaluated and compared with the traditional DE algorithm and two other adaptive DE algorithms. The experimental results on 21 benchmark problems show that the proposed algorithm is very effective in solving complex optimization problems.     

Exploring dynamic self-adaptive populations in differential evolution

Although the Differential Evolution (DE) algorithm has been shown to be a simple yet powerful evolutionary algorithm for optimizing continuous functions, users are still faced with the problem of preliminary testing and hand-tuning of the evolutionary parameters prior to commencing the actual optimization process. As a solution, self-adaptation has been found to be highly beneficial in automatically and dynamically adjusting evolutionary parameters such as crossover rates and mutation rates. In this paper, we present a first attempt at self-adapting the population size parameter in addition to self-adapting crossover and mutation rates. Firstly, our main objective is to demonstrate the feasibility of self-adapting the population size parameter in DE. Using De Jong's F1–F5 benchmark test problems, we showed that DE with self-adaptive populations produced highly competitive results compared to a conventional DE algorithm with static populations. In addition to reducing the number of parameters used in DE, the proposed algorithm actually outperformed the conventional DE algorithm for one of the test problems. It was also found that that an absolute encoding methodology for self-adapting population size in DE produced results with greater optimization reliability compared to a relative encoding methodology.     

Hybrid adaptive differential evolution for mobile robot localization

This paper introduces a new evolutionary optimization algorithm named hybrid adaptive differential evolution (HADE) and applies it to the mobile robot localization problem. The behaviour of evolutionary algorithms is highly dependent on the parameter selection. This algorithm utilizes an adaptive method to tune the mutation parameter to enhance the rate of convergence and eliminate the need for manual tuning. A hybrid method for mutation is also introduced to give more diversity to the population. This method which constantly switches between two mutation schemes guarantees a sufficient level of diversity to avoid local optima. We use a well-known test set in continuous domain to evaluate HADE’s performance against the standard version of differential evolution (DE) and a self-adaptive version of the algorithm. The results show that HADE outperforms DE and self-adaptive DE in three of four benchmarks. Moreover, we investigate the performance of HADE in the well-known localization problem of mobile robots. Results show that HADE is capable of estimating the robot’s pose accurately with a decreased number of individuals needed for convergence compared with DE and particle swarm optimization methods. Comparative study exposes HADE algorithm as a competitive method for mobile robot localization.     

单参数自适应PID控制的应用研究

为了满足控制工程应用中控制器的控制算法尽量简单、在线整定参数尽量少,及便于掌握等要求,提出了一种简易的单参数自适应PID控制算法。较之于传统PID算法,该算法比较简单,只需整定一个参数,且能够根据误差和误差变化速率按照非线性规律不断地进行修正,且有良好的动态控制性能。现已经用于印染行业中打样机温度的控制,控制结果表明,该算法的控制效果良好,适应能力较强,具有算法简单、参数整定容易等特点,非常适合于工程上的应用。     

Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization

Differential evolution (DE) is an efficient and powerful population-based stochastic search technique for solving optimization problems over continuous space, which has been widely applied in many scientific and engineering fields. However, the success of DE in solving a specific problem crucially depends on appropriately choosing trial vector generation strategies and their associated control parameter values. Employing a trial-and-error scheme to search for the most suitable strategy and its associated parameter settings requires high computational costs. Moreover, at different stages of evolution, different strategies coupled with different parameter settings may be required in order to achieve the best performance. In this paper, we propose a self-adaptive DE (SaDE) algorithm, in which both trial vector generation strategies and their associated control parameter values are gradually self-adapted by learning from their previous experiences in generating promising solutions. Consequently, a more suitable generation strategy along with its parameter settings can be determined adaptively to match different phases of the search process/evolution. The performance of the SaDE algorithm is extensively evaluated (using codes available from P. N. Suganthan) on a suite of 26 bound-constrained numerical optimization problems and compares favorably with the conventional DE and several state-of-the-art parameter adaptive DE variants.     

An evolving surrogate model-based differential evolution algorithm

Differential evolution (DE) is a simple and effective approach for solving numerical optimization problems. However, the performance of DE is sensitive to the choice of mutation and crossover strategies and their associated control parameters. Therefore, to achieve optimal performance, a time-consuming parameter tuning process is required. In DE, the use of different mutation and crossover strategies with different parameter settings can be appropriate during different stages of the evolution. Therefore, to achieve optimal performance using DE, various adaptation, self-adaptation, and ensemble techniques have been proposed. Recently, a classification-assisted DE algorithm was proposed to overcome trial and error parameter tuning and efficiently solve computationally expensive problems. In this paper, we present an evolving surrogate model-based differential evolution (ESMDE) method, wherein a surrogate model constructed based on the population members of the current generation is used to assist the DE algorithm in order to generate competitive offspring using the appropriate parameter setting during different stages of the evolution. As the population evolves over generations, the surrogate model also evolves over the iterations and better represents the basin of search by the DE algorithm. The proposed method employs a simple Kriging model to construct the surrogate. The performance of ESMDE is evaluated on a set of 17 bound-constrained problems. The performance of the proposed algorithm is compared to state-of-the-art self-adaptive DE algorithms: the classification-assisted DE algorithm, regression-assisted DE algorithm, and ranking-assisted DE algorithm.     

Levy distributed parameter control in differential evolution for numerical optimization

Differential evolution (DE) algorithm is a population based stochastic search technique widely applied in scientific and engineering fields for global optimization over real parameter space. The performance of DE algorithm highly depends on the selection of values of the associated control parameters. Therefore, finding suitable values of control parameters is a challenging task and researchers have already proposed several adaptive and self-adaptive variants of DE. In the paper control parameters are adapted by levy distribution, named as Levy distributed DE (LdDE) which efficiently handles exploration and exploitation dilemma in the search space. In order to assure a fair comparison with existing parameter controlled DE algorithms, we apply the proposed method on number of well-known unimodal, basic and expanded multimodal and hybrid composite benchmark optimization functions having different dimensions. The empirical study shows that the proposed LdDE algorithm exhibits an overall better performance in terms of accuracy and convergence speed compared to five prominent adaptive DE algorithms.     

Self-Adaptive Evolutionary Extreme Learning Machine

In this paper, we propose an improved learning algorithm named self-adaptive evolutionary extreme learning machine (SaE-ELM) for single hidden layer feedforward networks (SLFNs). In SaE-ELM, the network hidden node parameters are optimized by the self-adaptive differential evolution algorithm, whose trial vector generation strategies and their associated control parameters are self-adapted in a strategy pool by learning from their previous experiences in generating promising solutions, and the network output weights are calculated using the Moore?CPenrose generalized inverse. SaE-ELM outperforms the evolutionary extreme learning machine (E-ELM) and the different evolutionary Levenberg?CMarquardt method in general as it could self-adaptively determine the suitable control parameters and generation strategies involved in DE. Simulations have shown that SaE-ELM not only performs better than E-ELM with several manually choosing generation strategies and control parameters but also obtains better generalization performances than several related methods.     

A novel adaptive control strategy for decomposition-based multiobjective algorithm

Recently, evolutionary algorithm based on decomposition (MOEA/D) has been found to be very effective and efficient for solving complicated multiobjective optimization problems (MOPs). However, the selected differential evolution (DE) strategies and their parameter settings impact a lot on the performance of MOEA/D when tackling various kinds of MOPs. Therefore, in this paper, a novel adaptive control strategy is designed for a recently proposed MOEA/D with stable matching model, in which multiple DE strategies coupled with the parameter settings are adaptively conducted at different evolutionary stages and thus their advantages can be combined to further enhance the performance. By exploiting the historically successful experience, an execution probability is learned for each DE strategy to perform adaptive adjustment on the candidate solutions. The proposed adaptive strategies on operator selection and parameter settings are aimed at improving both of the convergence speed and population diversity, which are validated by our numerous experiments. When compared with several variants of MOEA/D such as MOEA/D, MOEA/D-DE, MOEA/D-DE+PSO, ENS-MOEA/D, MOEA/D-FRRMAB and MOEA/D-STM, our algorithm performs better on most of test problems.     

Self-adaptive, multipopulation differential evolution in dynamic environments

The present work proposes a simple but effective self-adaptive strategy to control the behaviour of a differential evolution (DE) based multipopulation algorithm for dynamic environments. Specifically, the proposed scheme is aimed to control the creation of random individuals by the self-adaptation of the involved parameter. An interaction scheme between random and conventional DE individuals is also proposed and analyzed. The conducted computational experiments show that self-adaptation is profitable, leading to an algorithm that is as competitive as other efficient methods and able to beat the winner of the CEC 2009 competition on dynamic environments.     

一种改进的微分进化算法

相对于其他优化算法来说,微分进化算法具有控制参数少、易于使用以及鲁棒性强等特点,但在搜索过程中存在着局部搜索能力弱的缺点。针对微分进化算法局部搜索能力弱的缺点,提出了一种基于局部变异的微分进化算法,该算法使个体具有良好快速收敛能力。使用典型优化函数对比较算法进行了测试,算法分析和仿真结果表明,改进以后的算法具有寻优能力...     

多变异策略的自适应差分演化算法

差分演化(Differential Evolution,DE)算法的性能依赖于变异策略的选择和控制参数的设置.不同问题对DE的变异策略和参数的设置各不相同.为了提高DE的性能,提出一种多变异策略的自适应差分演化算法,建立由多种变异策略组成的策略池,两个主要参数自适应策略控制.为了验证所提算法的性能,在测试数据集CEC2013上进行了实验,并将其与使用6种不同变异策略的原始DE和4种改进DE进行比较.实验结果表明,提出的算法是一种有效的DE变种,其性能优于其它DE.     

Performance comparison of self-adaptive and adaptive differential evolution algorithms

Differential evolution (DE) has been shown to be a simple, yet powerful, evolutionary algorithm for global optimization for many real problems. Adaptation, especially self-adaptation, has been found to be highly beneficial for adjusting control parameters, especially when done without any user interaction. This paper presents differential evolution algorithms, which use different adaptive or self-adaptive mechanisms applied to the control parameters. Detailed performance comparisons of these algorithms on the benchmark functions are outlined.     

Remote sensing image subpixel mapping based on adaptive differential evolution

In this paper, a novel subpixel mapping algorithm based on an adaptive differential evolution (DE) algorithm, namely, adaptive-DE subpixel mapping (ADESM), is developed to perform the subpixel mapping task for remote sensing images. Subpixel mapping may provide a fine-resolution map of class labels from coarser spectral unmixing fraction images, with the assumption of spatial dependence. In ADESM, to utilize DE, the subpixel mapping problem is transformed into an optimization problem by maximizing the spatial dependence index. The traditional DE algorithm is an efficient and powerful population-based stochastic global optimizer in continuous optimization problems, but it cannot be applied to the subpixel mapping problem in a discrete search space. In addition, it is not an easy task to properly set control parameters in DE. To avoid these problems, this paper utilizes an adaptive strategy without user-defined parameters, and a reversible-conversion strategy between continuous space and discrete space, to improve the classical DE algorithm. During the process of evolution, they are further improved by enhanced evolution operators, e.g., mutation, crossover, repair, exchange, insertion, and an effective local search to generate new candidate solutions. Experimental results using different types of remote images show that the ADESM algorithm consistently outperforms the previous subpixel mapping algorithms in all the experiments. Based on sensitivity analysis, ADESM, with its self-adaptive control parameter setting, is better than, or at least comparable to, the standard DE algorithm, when considering the accuracy of subpixel mapping, and hence provides an effective new approach to subpixel mapping for remote sensing imagery.     

Classification-based self-adaptive differential evolution and its application in multi-lateral multi-issue negotiation

Multi-lateral multi-issue negotiations are the most complex realistic negotiation problems. Automated approaches have proven particularly promising for complex negotiations and previous research indicates evolutionary computation could be useful for such complex systems. To improve the efficiency of realistic multi-lateral multi-issue negotiations and avoid the requirement of complete information about negotiators, a novel negotiation model based on an improved evolutionary algorithm p-ADE is proposed. The new model includes a new multi-agent negotiation protocol and strategy which utilize p-ADE to improve the negotiation efficiency by generating more acceptable solutions with stronger suitability for all the participants. Where p-ADE is improved based on the well-known differential evolution (DE), in which a new classification-based mutation strategy DE/rand-to-best/pbest as well as a dynamic self-adaptive parameter setting strategy are proposed. Experimental results confirm the superiority of p-ADE over several state-of-the-art evolutionary optimizers. In addition, the p-ADE based multiagent negotiation model shows good performance in solving realistic multi-lateral multi-issue negotiations.     

DE/BBO: a hybrid differential evolution with biogeography-based optimization for global numerical optimization

Differential evolution (DE) is a fast and robust evolutionary algorithm for global optimization. It has been widely used in many areas. Biogeography-based optimization (BBO) is a new biogeography inspired algorithm. It mainly uses the biogeography-based migration operator to share the information among solutions. In this paper, we propose a hybrid DE with BBO, namely DE/BBO, for the global numerical optimization problem. DE/BBO combines the exploration of DE with the exploitation of BBO effectively, and hence it can generate the promising candidate solutions. To verify the performance of our proposed DE/BBO, 23 benchmark functions with a wide range of dimensions and diverse complexities are employed. Experimental results indicate that our approach is effective and efficient. Compared with other state-of-the-art DE approaches, DE/BBO performs better, or at least comparably, in terms of the quality of the final solutions and the convergence rate. In addition, the influence of the population size, dimensionality, different mutation schemes, and the self-adaptive control parameters of DE are also studied.     

基于隐马尔可夫链的自适应MODE及应用

不同的控制参数设定和生成策略（交叉和变异）都会对多目标差分进化算法的性能产生显著影响。为实现其控制参数和变异策略的实时自适应调整,提出一种基于隐马尔可夫链的自适应多目标差分进化算法。该算法利用隐马尔可夫模型对种群信息进行分析并得到最优序列,通过最优序列与实际状态序列的对比得出变异缩放因子[F]与交叉概率[CR]的最大似然估计值,从而实现控制参数的自适应调整;同时,通过隐马尔可夫模型得到一组策略链来辅助多目标差分进化算法来选择合适的变异策略。通过与其他9种多目标进化算法在16个测试函数上的对比研究,结果表明所提算法的整体性能优于其他比较算法。最后,将该算法用于求解海铁联运能耗优化问题,所得结果能够为决策者提供多种可行方案。     

Enhancing differential evolution with role assignment scheme

As one of the most popular evolutionary algorithms, differential evolution (DE) has been used for solving a wide range of real-world problems. The performance of DE highly depends on the chosen mutation strategy and control parameter settings. Although the conventional trial-and-error procedure can be used to elaborately select the proper strategy and to tune the parameter values, this procedure is often very time-consuming and is not suitable for practitioners without a priori experience. To tackle this problem, DE with a novel role assignment (RA) scheme is proposed in this paper. In the RA scheme, both the fitness information and positional information of individuals are utilized to dynamically divide the population into several groups. Each group is considered as a role, which has its own mutation strategy and parameter settings and is expected to play a different role in the evolution process. To verify the performance of our approach, experiments are conducted on 23 well-known benchmark functions. Results show that our approach is better than, or at least comparable to, several state-of-the-art DE variants.     

Automatic generation of controllers for embodied legged organisms: a Pareto evolutionary multi-objective approach

In this paper, we investigate the use of a self-adaptive Pareto evolutionary multi-objective optimization (EMO) approach for evolving the controllers of virtual embodied organisms. The objective of this paper is to demonstrate the trade-off between quality of solutions and computational cost. We show empirically that evolving controllers using the proposed algorithm incurs significantly less computational cost when compared to a self-adaptive weighted sum EMO algorithm, a self-adaptive single-objective evolutionary algorithm (EA) and a hand-tuned Pareto EMO algorithm. The main contribution of the self-adaptive Pareto EMO approach is its ability to produce sufficiently good controllers with different locomotion capabilities in a single run, thereby reducing the evolutionary computational cost and allowing the designer to explore the space of good solutions simultaneously. Our results also show that self-adaptation was found to be highly beneficial in reducing redundancy when compared against the other algorithms. Moreover, it was also shown that genetic diversity was being maintained naturally by virtue of the system's inherent multi-objectivity.