Evolutionary computation of unconstrained and constrained problems using a novel momentum-type particle swarm optimization

This study proposes a novel momentum-type particle swarm optimization (PSO) method, which will find good solutions of unconstrained and constrained problems using a delta momentum rule to update the particle velocity. The algorithm modifies Shi and Eberhart's PSO to enhance the computational efficiency and solution accuracy. This study also presents a continuous non-stationary penalty function, to force design variables to satisfy all constrained functions. Several well-known and widely used benchmark problems were employed to compare the performance of the proposed PSO with Kennedy and Eberhart's PSO and Shi and Eberhart's modified PSO. Additionally, an engineering optimization task for designing a pressure vessel was applied to test the three PSO algorithms. The optimal solutions are presented and compared with the data from other works using different evolutionary algorithms. To show that the proposed momentum-type PSO algorithm is robust, its convergence rate, solution accuracy, mean absolute error, standard deviation, and CPU time were compared with those of both the other PSO algorithms. The experimental results reveal that the proposed momentum-type PSO algorithm can efficiently solve unconstrained and constrained engineering optimization problems.     

An improved hybrid self-inertia weight adaptive particle swarm optimization algorithm with local search

As an evolutionary computing technique, particle swarm optimization (PSO) has good global search ability, but the swarm can easily lose its diversity, leading to premature convergence. To solve this problem, an improved self-inertia weight adaptive particle swarm optimization algorithm with a gradient-based local search strategy (SIW-APSO-LS) is proposed. This new algorithm balances the exploration capabilities of the improved inertia weight adaptive particle swarm optimization and the exploitation of the gradient-based local search strategy. The self-inertia weight adaptive particle swarm optimization (SIW-APSO) is used to search the solution. The SIW-APSO is updated with an evolutionary process in such a way that each particle iteratively improves its velocities and positions. The gradient-based local search focuses on the exploitation ability because it performs an accurate search following SIW-APSO. Experimental results verified that the proposed algorithm performed well compared with other PSO variants on a suite of benchmark optimization functions.     

Parallel global optimization with the particle swarm algorithm

Present day engineering optimization problems often impose large computational demands, resulting in long solution times even on a modern high-end processor. To obtain enhanced computational throughput and global search capability, we detail the coarse-grained parallelization of an increasingly popular global search method, the particle swarm optimization (PSO) algorithm. Parallel PSO performance was evaluated using two categories of optimization problems possessing multiple local minima-large-scale analytical test problems with computationally cheap function evaluations and medium-scale biomechanical system identification problems with computationally expensive function evaluations. For load-balanced analytical test problems formulated using 128 design variables, speedup was close to ideal and parallel efficiency above 95% for up to 32 nodes on a Beowulf cluster. In contrast, for load-imbalanced biomechanical system identification problems with 12 design variables, speedup plateaued and parallel efficiency decreased almost linearly with increasing number of nodes. The primary factor affecting parallel performance was the synchronization requirement of the parallel algorithm, which dictated that each iteration must wait for completion of the slowest fitness evaluation. When the analytical problems were solved using a fixed number of swarm iterations, a single population of 128 particles produced a better convergence rate than did multiple independent runs performed using sub-populations (8 runs with 16 particles, 4 runs with 32 particles, or 2 runs with 64 particles). These results suggest that (1) parallel PSO exhibits excellent parallel performance under load-balanced conditions, (2) an asynchronous implementation would be valuable for real-life problems subject to load imbalance, and (3) larger population sizes should be considered when multiple processors are available.     

Guided particle swarm optimization method to solve general nonlinear optimization problems

The development of hybrid algorithms is becoming an important topic in the global optimization research area. This article proposes a new technique in hybridizing the particle swarm optimization (PSO) algorithm and the Nelder–Mead (NM) simplex search algorithm to solve general nonlinear unconstrained optimization problems. Unlike traditional hybrid methods, the proposed method hybridizes the NM algorithm inside the PSO to improve the velocities and positions of the particles iteratively. The new hybridization considers the PSO algorithm and NM algorithm as one heuristic, not in a sequential or hierarchical manner. The NM algorithm is applied to improve the initial random solution of the PSO algorithm and iteratively in every step to improve the overall performance of the method. The performance of the proposed method was tested over 20 optimization test functions with varying dimensions. Comprehensive comparisons with other methods in the literature indicate that the proposed solution method is promising and competitive.     

Enhanced particle swarm optimization for size and shape optimization of truss structures

This article presents an enhanced particle swarm optimization (EPSO) algorithm for size and shape optimization of truss structures. The proposed EPSO introduces a particle categorization mechanism into the particle swarm optimization (PSO) to eliminate unnecessary structural analyses during the optimization process and improve the computational efficiency of the PSO-based structural optimization. The numerical investigation, including three benchmark truss optimization problems, examines the efficiency of the EPSO. The results demonstrate that the particle categorization mechanism greatly reduces the computational requirements of the PSO-based approaches while maintaining the original search capability of the algorithms in solving optimization problems with computationally cheap objective function and expensive constraints.     

Multi-objective optimization of engineering systems using game theory and particle swarm optimization

This study proposes particle swarm optimization (PSO) based algorithms to solve multi-objective engineering optimization problems involving continuous, discrete and/or mixed design variables. The original PSO algorithm is modified to include dynamic maximum velocity function and bounce method to enhance the computational efficiency and solution accuracy. The algorithm uses a closest discrete approach (CDA) to solve optimization problems with discrete design variables. A modified game theory (MGT) approach, coupled with the modified PSO, is used to solve multi-objective optimization problems. A dynamic penalty function is used to handle constraints in the optimization problem. The methodologies proposed are illustrated by several engineering applications and the results obtained are compared with those reported in the literature.     

基于粒子群与聚类的多目标优化算法

针对粒子群优化算法容易陷入局部最优的问题,提出了一种基于粒子群优化与分解聚类方法相结合的多目标优化算法。算法基于参考向量分解的方法,通过聚类优选粒子策略来更新全局最优解。首先,通过每条均匀分布的参考向量对粒子进行聚类操作,来促进粒子的多样性。从每个聚类中选择一个具有最小聚合函数适应度值的粒子,以平衡收敛性和多样性。动态更新全局最优解和个体最优解,引导种群均匀分布在帕累托前沿附近。通过仿真实验,与4种粒子群多目标优化算法进行对比。实验结果表明,提出的算法在27个选定的基准测试问题中获得了20个反世代距离(IGD)最优值。     

基于粒子群算法的空间直线度误差评定

提出了一种满足最小区域法的空间直线度误差评价的新方法--粒子群算法。根据最小区域条件,建立了空间直线的数学模型以及优化目标函数。阐述了粒子群优化算法的原理和实现方法,然后根据粒子群算法优化求解。实例表明该方法对于空间直线度误差评定等非线性优化问题能得到最优解,可用于三坐标测量机等测量系统的空间直线度误差测量的数据处理。     

Biogeography-based particle swarm optimization with fuzzy elitism and its applications to constrained engineering problems

In evolutionary algorithms, elites are crucial to maintain good features in solutions. However, too many elites can make the evolutionary process stagnate and cannot enhance the performance. This article employs particle swarm optimization (PSO) and biogeography-based optimization (BBO) to propose a hybrid algorithm termed biogeography-based particle swarm optimization (BPSO) which could make a large number of elites effective in searching optima. In this algorithm, the whole population is split into several subgroups; BBO is employed to search within each subgroup and PSO for the global search. Since not all the population is used in PSO, this structure overcomes the premature convergence in the original PSO. Time complexity analysis shows that the novel algorithm does not increase the time consumption. Fourteen numerical benchmarks and four engineering problems with constraints are used to test the BPSO. To better deal with constraints, a fuzzy strategy for the number of elites is investigated. The simulation results validate the feasibility and effectiveness of the proposed algorithm.     

Drilling path optimization by the particle swarm optimization algorithm with global convergence characteristics

Drilling path optimization is one of the key problems in holes-machining. This paper presents a new approach to solve the drilling path optimization problem belonging to discrete space, based on the particle swarm optimization (PSO) algorithm. Since the standard PSO algorithm is not guaranteed to be global convergent or local convergent, based on the mathematical model, the algorithm is improved by adopting the method to generate the stop evolution particle once again to obtain the ability of convergence on the global optimization solution. Also, the operators are proposed by establishing the Order Exchange Unit (OEU) and the Order Exchange List (OEL) to satisfy the need of integer coding in drilling path optimization. The experimentations indicate that the improved algorithm has the characteristics of easy realization, fast convergence speed, and better global convergence capability. Hence the new PSO can play a role in solving the problem of drilling path optimization.     

A particle swarm optimization algorithm for hybrid flow-shop scheduling with multiprocessor tasks

The multistage hybrid flow-shop scheduling problem with multiprocessor tasks has been found in many practical situations. Due to the essential complexity of the problem, many researchers started to apply metaheuristics to solve the problem. In this paper, we address the problem by using particle swarm optimization (PSO), a novel metaheuristic inspired by the flocking behaviour of birds. The proposed PSO algorithm has several features, such as a new encoding scheme, an implementation of the best velocity equation and neighbourhood topology among several different variants, and an effective incorporation of local search. To verify the PSO algorithm, computational experiments are conducted to make a comparison with two existing genetic algorithms (GAs) and an ant colony system (ACS) algorithm based on the same benchmark problems. The results show that the proposed PSO algorithm outperforms all the existing algorithms for the considered problem.     

A new images segmentation method based on modified particle swarm optimization algorithm

The partitioning of an image into several constituent components is called image segmentation. Many approaches have been developed; one of them is the particle swarm optimization (PSO) algorithm, which is widely used. PSO algorithm is one of the most recent stochastic optimization strategies. In this article, a new efficient technique for the magnetic resonance imaging (MRI) brain images segmentation thematic based on PSO is proposed. The proposed algorithm presents an improved variant of PSO, which is particularly designed for optimal segmentation and it is called modified particle swarm optimization. The fitness function is used to evaluate all the particle swarm in order to arrange them in a descending order. The algorithm is evaluated by performance measures such as run time execution and the quality of the image after segmentation. The performance of the segmentation process is demonstrated by using a defined set of benchmark images and compared against conventional PSO, genetic algorithm, and PSO with Mahalanobis distance based segmentation methods. Then we applied our method on MRI brain image to determinate normal and pathological tissues. © 2013 Wiley Periodicals, Inc. Int J Imaging Syst Technol, 23, 265–271, 2013     

Parallel asynchronous particle swarm optimization

The high computational cost of complex engineering optimization problems has motivated the development of parallel optimization algorithms. A recent example is the parallel particle swarm optimization (PSO) algorithm, which is valuable due to its global search capabilities. Unfortunately, because existing parallel implementations are synchronous (PSPSO), they do not make efficient use of computational resources when a load imbalance exists. In this study, we introduce a parallel asynchronous PSO (PAPSO) algorithm to enhance computational efficiency. The performance of the PAPSO algorithm was compared to that of a PSPSO algorithm in homogeneous and heterogeneous computing environments for small- to medium-scale analytical test problems and a medium-scale biomechanical test problem. For all problems, the robustness and convergence rate of PAPSO were comparable to those of PSPSO. However, the parallel performance of PAPSO was significantly better than that of PSPSO for heterogeneous computing environments or heterogeneous computational tasks. For example, PAPSO was 3.5 times faster than was PSPSO for the biomechanical test problem executed on a heterogeneous cluster with 20 processors. Overall, PAPSO exhibits excellent parallel performance when a large number of processors (more than about 15) is utilized and either (1) heterogeneity exists in the computational task or environment, or (2) the computation-to-communication time ratio is relatively small.     

改进的混合粒子群优化算法

针对粒子群算法后期收敛速度较慢,易陷入局部最优的缺点,提出了改进的混合粒子群算法.通过更改现有的速度更新公式,加入扰动项,以及引入交叉和变异算子等措施,改进了粒子群算法的性能.数值试验表明,改进后的粒子群算法在全局寻优和局部寻优能力上均得到提高,是一种有效的优化算法.     

Swarm algorithms for single- and multi-objective optimization problems incorporating sensitivity analysis

Swarm algorithms such as particle swarm optimization (PSO) are non-gradient probabilistic optimization algorithms that have been successfully applied for global searches in complex problems such as multi-peak problems. However, application of these algorithms to structural and mechanical optimization problems still remains a complex matter since local optimization capability is still inferior to general numerical optimization methods. This article discusses new swarm metaphors that incorporate design sensitivities concerning objective and constraint functions and are applicable to structural and mechanical design optimization problems. Single- and multi-objective optimization techniques using swarm algorithms are combined with a gradient-based method. In the proposed techniques, swarm optimization algorithms and a sequential linear programming (SLP) method are conducted simultaneously. Finally, truss structure design optimization problems are solved by the proposed hybrid method to verify the optimization efficiency.     

Applicability of surrogates to improve efficiency of particle swarm optimization for simulation-based problems

Particle swarm optimization (PSO) is a population-based, heuristic technique based on social behaviour that performs well on a variety of problems including those with non-convex, non-smooth objective functions with multiple minima. However, the method can be computationally expensive in that a large number of function calls is required. This is a drawback when evaluations depend on an off-the-shelf simulation program, which is often the case in engineering applications. An algorithm is proposed which incorporates surrogates as a stand-in for the expensive objective function, within the PSO framework. Numerical results are presented on standard benchmarking problems and a simulation-based hydrology application to show that this hybrid can improve efficiency. A comparison is made between the application of a global PSO and a standard PSO to the same formulations with surrogates. Finally, data profiles, probability of success, and a measure of the signal-to-noise ratio of the the objective function are used to assess the use of a surrogate.     

基于速度交流的共生多种群粒子群算法

为了提高粒子群算法的求解精度,改善算法的搜索性能,提出一种基于速度交流的共生多种群粒子群算法(SMPSO)。该算法采用速度交流机制划分整个从种群为多个子种群,负责解空间的全局搜索,将获得的最优信息分享给主种群;主种群综合从种群与自身最优经验,负责局部深度优化,获得最优信息反馈给从种群,从而建立主从群间的共生关系,实现解空间的充分搜索。迭代后期,在主种群中引入自适应变异策略,提高算法跳出局部最优的能力。将提出的SMPSO算法应用于基准测试函数中,与其它改进的PSO算法进行比较。实验结果表明,SMPSO算法在求解精度、搜索能力、稳定性等方面均有较大的提高。     

Swarm algorithms with chaotic jumps for optimization of multimodal functions

In this article, the use of some well-known versions of particle swarm optimization (PSO) namely the canonical PSO, the bare bones PSO (BBPSO) and the fully informed particle swarm (FIPS) is investigated on multimodal optimization problems. A hybrid approach which consists of swarm algorithms combined with a jump strategy in order to escape from local optima is developed and tested. The jump strategy is based on the chaotic logistic map. The hybrid algorithm was tested for all three versions of PSO and simulation results show that the addition of the jump strategy improves the performance of swarm algorithms for most of the investigated optimization problems. Comparison with the off-the-shelf PSO with local topology (l _best model) has also been performed and indicates the superior performance of the standard PSO with chaotic jump over the standard both using local topology (l _best model).     

A new multi-objective particle swarm optimizer using empirical movement and diversified search strategies

Most real-world optimization problems involve the optimization task of more than a single objective function and, therefore, require a great amount of computational effort as the solution procedure is designed to anchor multiple compromised optimal solutions. Abundant multi-objective evolutionary algorithms (MOEAs) for multi-objective optimization have appeared in the literature over the past two decades. In this article, a new proposal by means of particle swarm optimization is addressed for solving multi-objective optimization problems. The proposed algorithm is constructed based on the concept of Pareto dominance, taking both the diversified search and empirical movement strategies into account. The proposed particle swarm MOEA with these two strategies is thus dubbed the empirical-movement diversified-search multi-objective particle swarm optimizer (EMDS-MOPSO). Its performance is assessed in terms of a suite of standard benchmark functions taken from the literature and compared to other four state-of-the-art MOEAs. The computational results demonstrate that the proposed algorithm shows great promise in solving multi-objective optimization problems.     

基于信息熵改进的粒子群算法在桁架结构

提出了信息熵改进的粒子群优化算法用于解决有应力约束、位移约束的桁架结构杆件截面尺寸优化设计问题.首先介绍了信息熵基本理论和基本粒子群优化算法理论,然后对粒子群优化算法作了合理的参数设置,并将信息熵引入粒子群优化算法的适应函数和停机判别准则中.最后对2个经典的优化问题进行求解并与其他算法进行了比较.数据结果表明信息熵改进后的粒子群优化算法在桁架结构优化设计中优于其他同类算法.