A new particle swarm optimization algorithm with random inertia weight and evolution strategy

The paper gives a new particle swarm optimization algorithm with random inertia weight and evolution strategy （REPSO）. The proposed random inertia weight is using simulated annealing idea and the given evolution strategy is using the fitness variance of particles to improve the global search ability of PSO. The experiments with six benchmark functions show that the convergent speed and accuracy of REPSO is significantly superior to the one of The PSO with linearly decreasing inertia weight LDW-PSO.     

Common model analysis and improvement of particle swarm optimizer

Particle swarm optimizer （PSO）, a new evolutionary computation algorithm, exhibits good performance for optimization problems, although PSO can not guarantee convergence of a global minimum, even a local minimum. However, there are some adjustable parameters and restrictive conditions which can affect performance of the algorithm. In this paper, the algorithm are analyzed as a time-varying dynamic system, and the sufficient conditions for asymptotic stability of acceleration factors, increment of acceleration factors and inertia weight are deduced. The value of the inertia weight is enhanced to （-1, 1）. Based on the deduced principle of acceleration factors, a new adaptive PSO algorithm- harmonious PSO （HPSO） is proposed. Furthermore it is proved that HPSO is a global search algorithm. In the experiments, HPSO are used to the model identification of a linear motor driving servo system. An Akaike information criteria based fitness function is designed and the algorithms can not only estimate the parameters, but also determine the order of the model simultaneously. The results demonstrate the effectiveness of HPSO.     

Acceleration Factor Harmonious Particle Swarm Optimizer

A Particle Swarm Optimizer (PSO) exhibits good performance for optimization problems, although it cannot guarantee convergence to a global, or even local minimum. However, there are some adjustable parameters, and restrictive conditions, which can affect the performance of the algorithm. In this paper, the sufficient conditions for the asymptotic stability of an acceleration factor and inertia weight are deduced, the value of the inertia weight ω is enhanced to (-1,1). Furthermore a new adaptive PSO algorithm - Acceleration Factor Harmonious PSO (AFHPSO) is proposed, and is proved to be a global search algorithm. AFHPSO is used for the parameter design of a fuzzy controller for a linear motor driving servo system. The performance of the nonlinear model for the servo system demonstrates the effectiveness of the optimized fuzzy controller and AFHPSO.     

Orthogonal Methods Based Ant Colony Search for Solving Continuous Optimization Problems

Research into ant colony algorithms for solving continuous optimization problems forms one of the most significant and promising areas in swarm computation. Although traditional ant algorithms are designed for combinatorial optimization, they have shown great potential in solving a wide range of optimization problems, including continuous optimization. Aimed at solving continuous problems effectively, this paper develops a novel ant algorithm termed ＂continuous orthogonal ant colony＂ （COAC）, whose pheromone deposit mechanisms would enable ants to search for solutions collaboratively and effectively. By using the orthogonal design method, ants in the feasible domain can explore their chosen regions rapidly and efficiently. By implementing an ＂adaptive regional radius＂ method, the proposed algorithm can reduce the probability of being trapped in local optima and therefore enhance the global search capability and accuracy. An elitist strategy is also employed to reserve the most valuable points. The performance of the COAC is compared with two other ant algorithms for continuous optimization -API and CACO by testing seventeen functions in the continuous domain. The results demonstrate that the proposed COAC algorithm outperforms the others.     

Dynamic PSO method for nonlinear constrained programming problems

A new approach is presented to solve the nonlinear constrained programming problems. Firstly, the nonlinear constrained programming problem is transformed into a bi-ohjective optimization problem. Based on the reasonable design of the searching operation and different parameters, a new dynamic particle swarm optimization algorithm （TS-MC） is proposed. The numerical experiments show that the proposed algorithm is effective in dealing with the nonlinear constrained programming problems.     

An improved fireworks algorithm for the capacitated vehicle routing problem

The capacitated vehicle routing problem (CVRP), which aims at minimizing travel costs, is a wellknown NP-hard combinatorial optimization. Owing to its hardness, many heuristic search algorithms have been proposed to tackle this problem. This paper explores a recently proposed heuristic algorithm named the fireworks algorithm (FWA), which is a swarm intelligence algorithm. We adopt FWA for the combinatorial CVRP problem with several modifications of the original FWA: it employs a new method to generate "sparks" according to the selection rule, and it uses a new method to determine the explosion amplitude for each firework. The proposed algorithm is compared with several heuristic search methods on some classical benchmark CVRP instances. The experimental results show a promising performance of the proposed method. We also discuss the strengths and weaknesses of our algorithm in contrast to traditional algorithms.     

A hybrid multi-objective PSO algorithm with local search strategy for VLSI partitioning

Very large scale integration （VLSI） circuit par- titioning is an important problem in design automation of VLSI chips and multichip systems; it is an NP-hard combi- national optimization problem. In this paper, an effective hy- brid multi-objective partitioning algorithm, based on discrete particle swarm optimzation （DPSO） with local search strat- egy, called MDPSO-LS, is presented to solve the VLSI two- way partitioning with simultaneous cutsize and circuit delay minimization. Inspired by the physics of genetic algorithm, uniform crossover and random two-point exchange operators are designed to avoid the case of generating infeasible so- lutions. Furthermore, the phenotype sharing function of the objective space is applied to circuit partitioning to obtain a better approximation of a true Pareto front, and the theorem of Markov chains is used to prove global convergence. To improve the ability of local exploration, Fiduccia-Matteyses （FM） strategy is also applied to further improve the cutsize of each particle, and a local search strategy for improving circuit delay objective is also designed. Experiments on IS- CAS89 benchmark circuits show that the proposed algorithm is efficient.     

HPSO-based fuzzy neural network control for AUV

A fuzzy neural network controller for underwater vehicles has many parameters difficult to tune manually. To reduce the numerous work and subjective uncertainties in manual adjustments, a hybrid particle swarm optimization （HPSO） algorithm based on immune theory and nonlinear decreasing inertia weight （NDIW） strategy is proposed. Owing to the restraint factor and NDIW strategy, an HPSO algorithm can effectively prevent premature convergence and keep balance between global and local searching abilities. Meanwhile, the algorithm maintains the ability of handling multimodal and multidimensional problems. The HPSO algorithm has the fastest convergence velocity and finds the best solutions compared to GA, IGA, and basic PSO algorithm in simulation experiments. Experimental results on the AUV simulation platform show that HPSO-based controllers perform well and have strong abilities against current disturbance. It can thus be concluded that the proposed algorithm is feasible for application to AUVs.     

Particle swarm optimization for time-optimal control design

In this paper,a particle swarm optimization(PSO)based method is proposed to obtain the time-optimal bang-bang control law for both linear and nonlinear systems.By introducing a penalty function,the method can be modified to deal with systems with constraints.Compared with existing computational methods,the proposed method can be implemented in a straightforward manner.The convergent solutions can be achieved by selecting suitable PSO parameters regardless of the initial guess of the switching times.A double integrator and a third-order nonlinear system are used to demonstrate the effectiveness and robustness of the proposed method.The method is applied to obtain the time-optimal control law for a high performance linear motion positioning system.The results show the practicality of the proposed algorithm.     

A particle swarm optimizer with chaotic self-feedback for global optimization of multimodal functions

This paper proposes an improved particle swarm optimization （PSO） with iterative chaotic map with infinite collapses （ICMIC） perturbations （ICMICPSO） for global optimization of multimodal functions. The chaotic perturbation generated by the ICMIC is incorporated into the particle＇s velocity updating rule as self-feedback to make the particles have a larger potential space to fly. With the coefficient of chaotic perturbation decaying, the dynamics of ICMICPSO algorithm is a chaotic dynamics first and then a steepest descent dynamics. The proposed ICMICPSO method as hybrid optimization is tested on several widely used multimodal functions. Numerical results of the proposed algorithm are compared with that of some other Chaotic PSO variants available in the existing literature. The performance studies demonstrate that the effectiveness and efficiency of the proposed ICMICPSO approach are comparably to or better than that of the other CPSO variants for solving the global optimization of multimodal functions.     

An improved approximation approach incorporating particle swarm optimization and a priori information into neural networks

In this paper, an improved approach incorporating adaptive particle swarm optimization (APSO) and a priori information into feedforward neural networks for function approximation problem is proposed. It is well known that gradient-based learning algorithms such as backpropagation algorithm have good ability of local search, whereas PSO has good ability of global search. Therefore, in the improved approach, the APSO algorithm encoding the first-order derivative information of the approximated function is used to train network to near global minima. Then, with the connection weights produced by APSO, the network is trained with a modified gradient-based algorithm with magnified gradient function. The modified gradient-based algorithm can reduce input-to-output mapping sensitivity and lessen the chance of being trapped into local minima. By combining APSO with local search algorithm and considering a priori information, the improved approach has better approximation accuracy and convergence rate. Finally, simulation results are given to verify the efficiency and effectiveness of the proposed approach.     

一种自适应柯西变异的反向学习粒子群优化算法

针对传统粒子群优化算法易出现早熟的问题,提出了一种自适应变异的反向学习粒子群优化算法。该算法在一般性反向学习方法的基础上,提出了自适应柯西变异策略(ACM)。采用一般性反向学习策略生成反向解,可扩大搜索空间,增强算法的全局勘探能力。为避免粒子陷入局部最优解而导致搜索停滞现象的发生,采用ACM策略对当前最优粒子进行扰动,自适应地获取变异点,在有效提高算法局部开采能力的同时,使算法能更加平稳快速地收敛到全局最优解。为进一步平衡算法的全局搜索与局部探测能力,采用非线性的自适应惯性权值。将算法在14个测试函数上与多种基于反向学习策略的PSO算法进行对比,实验结果表明提出的算法在解的精度以及收敛速度上得到了大幅度的提高。     

Parameter estimation of bilinear systems based on an adaptive particle swarm optimization

Bilinear models can approximate a large class of nonlinear systems adequately and usually with considerable parsimony in the number of coefficients required. This paper presents the application of Particle Swarm Optimization (PSO) algorithm to solve both offline and online parameter estimation problem for bilinear systems. First, an Adaptive Particle Swarm Optimization (APSO) is proposed to increase the convergence speed and accuracy of the basic particle swarm optimization to save tremendous computation time. An illustrative example for the modeling of bilinear systems is provided to confirm the validity, as compared with the Genetic Algorithm (GA), Linearly Decreasing Inertia Weight PSO (LDW-PSO), Nonlinear Inertia Weight PSO (NDW-PSO) and Dynamic Inertia Weight PSO (DIW-PSO) in terms of parameter accuracy and convergence speed. Second, APSO is also improved to detect and determine varying parameters. In this case, a sentry particle is introduced to detect any changes in system parameters. Simulation results confirm that the proposed algorithm is a good promising particle swarm optimization algorithm for online parameter estimation.     

独立自适应调整参数的粒子群优化算法

针对传统粒子群优化算法在求解复杂优化问题时易陷入局部最优和依赖参数的取值等问题,提出了一种独立自适应参数调整的粒子群优化算法。算法重新定义了粒子进化能力、种群进化能力以及进化率,在此基础上给出了粒子群惯性权重及学习因子的独立调整策略,更好地平衡了算法局部搜索与全局搜索的能力。为保持种群多样性,提高粒子向全局最优位置的收敛速度,在算法迭代过程中,采用粒子重构策略使种群中进化能力较弱的粒子向进化能力较强的粒子进行学习,重新构造生成新粒子。最后通过CEC2013中的10个基准测试函数与4种改进粒子群算法在不同维度下进行测试对比,实验结果验证了该算法在求解复杂函数时具有高效性,通过收敛性分析说明了算法的有效性。     

基于混沌变异的自适应双粒子群优化

针对粒子群优化在解决高维优化问题时收敛性差、搜索效率不高的问题,在对粒子群优化算法收敛性分析的基础上,提出了混沌变异对极值进行扰动的方法,以增强算法摆脱局部最优解的能力.采用自适应惯性权重和局部邻域搜索保持较高的局部搜索性能,并结合双粒子群协同进化的方法,综合平衡优化算法的全局搜索和局部搜索能力.通过对4个典型测试函数进行的对比实验,表明了所提出的算法能大大提高粒子群优化的搜索效率和收敛精度.     

基于搜索空间可调的自适应粒子群优化算法与仿真

针对收缩因子粒子群优化(CPSO)算法易陷入局部最优和发生过早收敛的问题.提出了基于搜索空间可调的自适应粒子群优化(APSO)算法.该算法根据种群早熟收敛程度和个体适应值,在CPSO算法停滞时,将全部粒子有效地划分在3类不同的搜索空间,使种群始终保持搜索空间的多样性,易于跳出局部最优,从而有效地改善了CPSO算法后期的寻优能力.     

改进粒子群优化算法在TDOA定位中的应用

针对TDOA定位估计中的非线性最优化问题,提出了一种基于改进粒子群优化的TDOA定位算法。该算法在自适应粒子群优化算法的基础上,引入禁忌搜索策略,有效地解决了粒子群优化算法容易陷入局部最优的问题,使算法快速收敛到全局最优解。仿真结果表明:该算法性能稳定,定位精度高。     

基于周期性演化策略的粒子群优化算法

针对标准粒子群优化算法(PSO)在寻优过程中容易出现早熟的问题,提出一种基于周期性演化策略的粒子群优化算法.该策略通过在速度更新方程中构建基于粒子群能量的粒子群最优值扰动项,使得粒子群能量在演化过程中可以周期性变化.相比标准PSO算法,当粒子群能量较大时,能够增强局部搜索能力;当粒子群能量较小时,能够增强全局搜索能力.典型优化问题的仿真结果表明,所提出的算法与线性下降惯性权重粒子群优化(LWPSO)和PSO算法相比,优化性能得到了显著提高.     

一类新颖的粒子群优化算法

粒子群优化(PSO)是一类有效的随机全局优化技术。它利用一个粒子群搜索解空间,每个粒子表示一个被优化问题的解,通过粒子间的相互作用发现复杂搜索空间中的最优区域。提出一类新颖的PSO算法,该算法在基本PSO算法的粒子位置更新公式中增加了一个积分控制项。积分控制项根据每个粒子的适应值决定粒子位置的变化,改善了PSO算法摆脱局部极小点的能力。另外,该算法增加了限制搜索空间范围的机制,这对某些函数优化问题是必需的。用5个基准函数做的对比实验结果显示,该算法优于基本PSO算法以及自适应修改惯性因子的PSO算法。     

Solving nonlinear optimal control problems using a hybrid IPSO-SQP algorithm

A hybrid algorithm by integrating an improved particle swarm optimization (IPSO) with successive quadratic programming (SQP), namely IPSO-SQP, is proposed for solving nonlinear optimal control problems. The particle swarm optimization (PSO) is showed to converge rapidly to a near optimum solution, but the search process will become very slow around global optimum. On the contrary, the ability of SQP is weak to escape local optimum but can achieve faster convergent speed around global optimum and the convergent accuracy can be higher. Hence, in the proposed method, at the beginning stage of search process, a PSO algorithm is employed to find a near optimum solution. In this case, an improved PSO (IPSO) algorithm is used to enhance global search ability and convergence speed of algorithm. When the change in fitness value is smaller than a predefined value, the searching process is switched to SQP to accelerate the search process and find an accurate solution. In this way, this hybrid algorithm may find an optimum solution more accurately. To validate the performance of the proposed IPSO-SQP approach, it is evaluated on two optimal control problems. Results show that the performance of the proposed algorithm is satisfactory.