A particle swarm optimization algorithm for hybrid flow-shop scheduling with multiprocessor tasks

The multistage hybrid flow-shop scheduling problem with multiprocessor tasks has been found in many practical situations. Due to the essential complexity of the problem, many researchers started to apply metaheuristics to solve the problem. In this paper, we address the problem by using particle swarm optimization (PSO), a novel metaheuristic inspired by the flocking behaviour of birds. The proposed PSO algorithm has several features, such as a new encoding scheme, an implementation of the best velocity equation and neighbourhood topology among several different variants, and an effective incorporation of local search. To verify the PSO algorithm, computational experiments are conducted to make a comparison with two existing genetic algorithms (GAs) and an ant colony system (ACS) algorithm based on the same benchmark problems. The results show that the proposed PSO algorithm outperforms all the existing algorithms for the considered problem.     

A surrogate-assisted particle swarm optimization algorithm based on efficient global optimization for expensive black-box problems

Evolutionary algorithms cannot effectively handle computationally expensive problems because of the unaffordable computational cost brought by a large number of fitness evaluations. Therefore, surrogates are widely used to assist evolutionary algorithms in solving these problems. This article proposes an improved surrogate-assisted particle swarm optimization (ISAPSO) algorithm, in which a hybrid particle swarm optimization (PSO) is combined with global and local surrogates. The global surrogate is not only used to predict fitness values for reducing computational burden but also regarded as a global searcher to speed up the global search process of PSO by using an efficient global optimization algorithm, while the local one is constructed for a local search in the neighbourhood of the current optimal solution by finding the predicted optimal solution of the local surrogate. Empirical studies on 10 widely used benchmark problems and a real-world structural design optimization problem of a driving axle show that the ISAPSO algorithm is effective and highly competitive.     

Enhancing particle swarm optimization algorithm using two new strategies for optimizing design of truss structures

This work develops an augmented particle swarm optimization (AugPSO) algorithm using two new strategies,: boundary-shifting and particle-position-resetting. The purpose of the algorithm is to optimize the design of truss structures. Inspired by a heuristic, the boundary-shifting approach forces particles to move to the boundary between feasible and infeasible regions in order to increase the convergence rate in searching. The purpose of the particle-position-resetting approach, motivated by mutation scheme in genetic algorithms (GAs), is to increase the diversity of particles and to prevent the solution of particles from falling into local minima. The performance of the AugPSO algorithm was tested on four benchmark truss design problems involving 10, 25, 72 and 120 bars. The convergence rates and final solutions achieved were compared among the simple PSO, the PSO with passive congregation (PSOPC) and the AugPSO algorithms. The numerical results indicate that the new AugPSO algorithm outperforms the simple PSO and PSOPC algorithms. The AugPSO achieved a new and superior optimal solution to the 120-bar truss design problem. Numerical analyses showed that the AugPSO algorithm is more robust than the PSO and PSOPC algorithms.     

Swarm algorithms for single- and multi-objective optimization problems incorporating sensitivity analysis

Swarm algorithms such as particle swarm optimization (PSO) are non-gradient probabilistic optimization algorithms that have been successfully applied for global searches in complex problems such as multi-peak problems. However, application of these algorithms to structural and mechanical optimization problems still remains a complex matter since local optimization capability is still inferior to general numerical optimization methods. This article discusses new swarm metaphors that incorporate design sensitivities concerning objective and constraint functions and are applicable to structural and mechanical design optimization problems. Single- and multi-objective optimization techniques using swarm algorithms are combined with a gradient-based method. In the proposed techniques, swarm optimization algorithms and a sequential linear programming (SLP) method are conducted simultaneously. Finally, truss structure design optimization problems are solved by the proposed hybrid method to verify the optimization efficiency.     

An improved hybrid self-inertia weight adaptive particle swarm optimization algorithm with local search

As an evolutionary computing technique, particle swarm optimization (PSO) has good global search ability, but the swarm can easily lose its diversity, leading to premature convergence. To solve this problem, an improved self-inertia weight adaptive particle swarm optimization algorithm with a gradient-based local search strategy (SIW-APSO-LS) is proposed. This new algorithm balances the exploration capabilities of the improved inertia weight adaptive particle swarm optimization and the exploitation of the gradient-based local search strategy. The self-inertia weight adaptive particle swarm optimization (SIW-APSO) is used to search the solution. The SIW-APSO is updated with an evolutionary process in such a way that each particle iteratively improves its velocities and positions. The gradient-based local search focuses on the exploitation ability because it performs an accurate search following SIW-APSO. Experimental results verified that the proposed algorithm performed well compared with other PSO variants on a suite of benchmark optimization functions.     

基于速度交流的共生多种群粒子群算法

为了提高粒子群算法的求解精度,改善算法的搜索性能,提出一种基于速度交流的共生多种群粒子群算法(SMPSO)。该算法采用速度交流机制划分整个从种群为多个子种群,负责解空间的全局搜索,将获得的最优信息分享给主种群;主种群综合从种群与自身最优经验,负责局部深度优化,获得最优信息反馈给从种群,从而建立主从群间的共生关系,实现解空间的充分搜索。迭代后期,在主种群中引入自适应变异策略,提高算法跳出局部最优的能力。将提出的SMPSO算法应用于基准测试函数中,与其它改进的PSO算法进行比较。实验结果表明,SMPSO算法在求解精度、搜索能力、稳定性等方面均有较大的提高。     

Biogeography-based particle swarm optimization with fuzzy elitism and its applications to constrained engineering problems

In evolutionary algorithms, elites are crucial to maintain good features in solutions. However, too many elites can make the evolutionary process stagnate and cannot enhance the performance. This article employs particle swarm optimization (PSO) and biogeography-based optimization (BBO) to propose a hybrid algorithm termed biogeography-based particle swarm optimization (BPSO) which could make a large number of elites effective in searching optima. In this algorithm, the whole population is split into several subgroups; BBO is employed to search within each subgroup and PSO for the global search. Since not all the population is used in PSO, this structure overcomes the premature convergence in the original PSO. Time complexity analysis shows that the novel algorithm does not increase the time consumption. Fourteen numerical benchmarks and four engineering problems with constraints are used to test the BPSO. To better deal with constraints, a fuzzy strategy for the number of elites is investigated. The simulation results validate the feasibility and effectiveness of the proposed algorithm.     

改进的 QPSO 算法在自融资投资组合中的应用

针对量子粒子群优化 (Quantum Particle Swarm Optimization, QPSO) 算法的缺陷,提出了一种基于 L$\acute{\rm e}$vy 飞行策略和混合概率分布的改进量子粒子群优化 (Hybrid Quantum Particle Swarm Optimization, HQPSO) 算法。在算法的设计中,借助 L$\acute{\rm e}$vy 飞行策略对粒子位置的迭代公式进行更新,用于改善算法的局部收敛精度,增强其全局探索能力。另外,考虑到迭代后期的早熟问题,在势阱模型中引入了指数分布和正态分布相结合的混合概率分布,帮助算法及时逃离局部最优。基于 16 个基准函数的测试结果表明,HQPSO 算法在收敛精度和鲁棒性上比其他几种算法表现更好。最后,将改进的 QPSO 算法应用到自融资投资组合模型的求解中,其数值结果与差分进化、粒子群优化算法和量子粒子群优化算法相比,HQPSO 算法展现出更好的可比性和优越性。     

Guided particle swarm optimization method to solve general nonlinear optimization problems

The development of hybrid algorithms is becoming an important topic in the global optimization research area. This article proposes a new technique in hybridizing the particle swarm optimization (PSO) algorithm and the Nelder–Mead (NM) simplex search algorithm to solve general nonlinear unconstrained optimization problems. Unlike traditional hybrid methods, the proposed method hybridizes the NM algorithm inside the PSO to improve the velocities and positions of the particles iteratively. The new hybridization considers the PSO algorithm and NM algorithm as one heuristic, not in a sequential or hierarchical manner. The NM algorithm is applied to improve the initial random solution of the PSO algorithm and iteratively in every step to improve the overall performance of the method. The performance of the proposed method was tested over 20 optimization test functions with varying dimensions. Comprehensive comparisons with other methods in the literature indicate that the proposed solution method is promising and competitive.     

采用混合粒子群算法实现匹配追踪算法

针对匹配追踪信号稀疏分解的巨大计算量问题,在具有全局优化能力的粒子群算法基础上,提出了一种结合BFGS(Broyden、Fletcher、Goldfarb和Shanno)方法和变异操作的混合粒子群算法实现信号匹配追踪分解。利用BFGS方法增强了算法的局部开发能力,加快了信号特征提取速度;通过变异操作控制种群多样性以避免早熟收敛,增强了算法全局探测能力,提高了信号特征提取精度。通过与单一粒子群算法和遗传算法实现仿真信号匹配追踪分解的结果进行对比,证明了使用混合粒子群算法的匹配追踪分解能够快速准确提取信号特征参数。最后,将该算法应用于某内圈损伤轴承振动信号中的冲击特征提取,结果表明该算法在工程应用中具有一定的准确性和实用性。     

A hybrid evolutionary algorithm for distribution feeder reconfiguration

Distribution feeder reconfiguration (DFR) is formulated as a multi-objective optimization problem which minimizes real power losses, deviation of the node voltages and the number of switching operations and also balances the loads on the feeders. In the proposed method, the distance (λ ₂ norm) between the vector-valued objective function and the worst-case vector-valued objective function in the feasible set is maximized. In the algorithm, the status of tie and sectionalizing switches are considered as the control variables. The proposed DFR problem is a non-differentiable optimization problem. Therefore, a new hybrid evolutionary algorithm based on combination of fuzzy adaptive particle swarm optimization (FAPSO) and ant colony optimization (ACO), called HFAPSO, is proposed to solve it. The performance of HFAPSO is evaluated and compared with other methods such as genetic algorithm (GA), ACO, the original PSO, Hybrid PSO and ACO (HPSO) considering different distribution test systems.     

Application of Metaheuristic Algorithms for Optimizing Longitudinal Square Porous Fins

The objectives of this study involve the optimization of longitudinal porous fins of square cross-section using metaheuristic algorithms. A generalized nonlinear ordinary differential equation is derived using Darcy and Fourier’s laws in the energy balance around a control volume and is solved numerically using RFK 45 method. The temperature of the base surface is higher than the fin surface, and the fin tip is kept adiabatic or cooled by convection heat transfer. The other pertinent parameters include Rayleigh number (100 ≤ Ra ≤ 10⁴), Darcy number, (10⁻⁴ ≤ Da ≤ 10⁻²), relative thermal conductivity ratio of solid phase to fluid (1000 ≤ k_r ≤ 8000), Nusselt number (10 ≤ Nu ≤ 100), porosity (0.1 ≤ φ ≤ 0.9). The impacts of these parameters on the entropy generation rate are investigated and optimized using metaheuristic algorithms. In computer science, metaheuristic algorithms are one of the most widely used techniques for optimization problems. In this research, three metaheuristic algorithms, including the firefly algorithm (FFA), particle swarm algorithm (PSO), and hybrid algorithm (FFA-PSO) are employed to examine the performance of square fins. It is demonstrated that FFA-PSO takes fewer iterations and less computational time to converge compared to other algorithms.     

Feasibility-Guided Constraint-Handling Techniques for Engineering Optimization Problems

The particle swarm optimization (PSO) algorithm is an established nature-inspired population-based meta-heuristic that replicates the synchronizing movements of birds and fish. PSO is essentially an unconstrained algorithm and requires constraint handling techniques (CHTs) to solve constrained optimization problems (COPs). For this purpose, we integrate two CHTs, the superiority of feasibility (SF) and the violation constraint-handling (VCH), with a PSO. These CHTs distinguish feasible solutions from infeasible ones. Moreover, in SF, the selection of infeasible solutions is based on their degree of constraint violations, whereas in VCH, the number of constraint violations by an infeasible solution is of more importance. Therefore, a PSO is adapted for constrained optimization, yielding two constrained variants, denoted SF-PSO and VCH-PSO. Both SF-PSO and VCH-PSO are evaluated with respect to five engineering problems: the Himmelblau’s nonlinear optimization, the welded beam design, the spring design, the pressure vessel design, and the three-bar truss design. The simulation results show that both algorithms are consistent in terms of their solutions to these problems, including their different available versions. Comparison of the SF-PSO and the VCH-PSO with other existing algorithms on the tested problems shows that the proposed algorithms have lower computational cost in terms of the number of function evaluations used. We also report our disagreement with some unjust comparisons made by other researchers regarding the tested problems and their different variants.     

A new hybrid teaching–learning particle swarm optimization algorithm for synthesis of linkages to generate path

This paper proposes a novel hybrid teaching–learning particle swarm optimization (HTLPSO) algorithm, which merges two established nature-inspired algorithms, namely, optimization based on teaching–learning (TLBO) and particle swarm optimization (PSO). The HTLPSO merges the best half of population obtained after the teacher phase in TLBO with the best half of the population obtained after PSO. The population so obtained is used subsequently in learner phase of TLBO. To validate the proposed algorithm, five constrained benchmark functions are considered to prove its robustness and efficiency. The proposed algorithm is applied to synthesize four-bar linkage for prescribed path. It is found that the HTLPSO performs better than other single nature-inspired algorithms for path synthesis problem in mechanism theory. Hence, HTLPSO may prove to be an important tool for mechanism design to follow the prescribed path.     

On the optimal control of steel annealing processes via various versions of genetic and particle swarm optimization algorithms

7 This paper elucidates the computation of optimal controls for steel annealing processes as hybrid systems which comprise of one or more furnaces integrated with plant-wide planning and scheduling operations. A class of hybrid system is considered to capture the trade-off between metallurgical quality requirement and timely product delivery. Various optimization algorithms including particle swarm optimization algorithm (PSO) with time varying inertia weight methods, PSO with globally and locally tuned parameters (GLBest PSO), parameter free PSO (pf-PSO) and PSO like algorithm via extrapolation (ePSO), real coded genetic algorithm (RCGA) and two-phase hybrid real coded genetic algorithm (HRCGA) are considered to solve the optimal control problems for the steel annealing processes (SAP). The optimal solutions including optimal line speed, optimal cost, and job completion time and convergence rate obtained through all these optimization algorithms are compared with each other and also those obtained via the existing method, forward algorithm (FA). Various statistical analyses and analysis of variance (ANOVA) test and hypothesis t-test are carried out in order to compare the performance of each method in solving the optimal control problems of SAP. The comparative study of the performance of the various algorithms indicates that the PSO like algorithms, pf-PSO and ePSO are equally good and are also better than all the other optimization methods considered in this chapter.     

求解VRP问题的混沌模拟退火萤火虫算法

目的使萤火虫优化算法(GSO)能够适用于车辆路径问题(VRP)的求解,同时提高该算法的求解性能。方法通过对GSO算法的改进,提出求解VRP问题的混沌模拟退火萤火虫优化算法(CSAGSO)。首先,设计改进的GSO算法(IGSO)使IGSO算法能够适应VRP问题的求解;其次,在IGSO算法中引入模拟退火机制,提出模拟退火萤火虫优化算法(SAGSO),使IGSO算法可有效避免陷入局部极小并最终趋于全局最优。然后,在SAGSO算法中引入混沌机制,提出CSAGSO算法,对SAGSO算法的荧光素浓度值进行混沌初始化和混沌扰动;最后,对标准算例集进行仿真测试。结果与遗传算法、蚁群算法和粒子群算法相比,CSAGSO算法的全局寻优能力、收敛速度及稳定性均改善了50%以上。结论对GSO算法的改进是合理的,且CSAGSO算法的全局优化能力、收敛速度和稳定性均优于遗传算法、蚁群算法和粒子群算法。     

Comparison of linear and classical velocity update rules in particle swarm optimization: notes on diversity

In this study, we investigate the significance of diversity in the particle swarm optimization (PSO) algorithm. To do so, we study two different implementations of the PSO, being the so‐called linear and classical PSO formulations. While the behaviour of these two implementations is markedly different, they only differ in the formulation of the velocity update rule. In fact, the differences are merely due to subtle differences in the introduction of randomness into the algorithm. In this paper, we show that in algorithms employing the linear PSO velocity update rule, particle trajectories collapse to line searches in n‐dimensional space. The classical formulation does not suffer this drawback. Instead, directional diverse stochastic search trajectories are retained, which in turn helps to alleviate premature convergence. The performance of the classical implementation is therefore superior for all test problems considered, due to the presence of adequate diversity. Copyright © 2006 John Wiley & Sons, Ltd.     

改进的混合粒子群优化算法

针对粒子群算法后期收敛速度较慢,易陷入局部最优的缺点,提出了改进的混合粒子群算法.通过更改现有的速度更新公式,加入扰动项,以及引入交叉和变异算子等措施,改进了粒子群算法的性能.数值试验表明,改进后的粒子群算法在全局寻优和局部寻优能力上均得到提高,是一种有效的优化算法.     

背包问题的混合粒子群优化算法

经典的粒子群是一个有效的寻找连续函数极值的方法，结合遗传算法的思想提出的混合粒子群算法来解决背包问题，经过比较测试，6种混合粒子群算法的效果都比较好，特别交叉策略A和变异策略C的混合粒子群算法是最好的且简单有效的算法，并成功地运用在投资问题中。对于目前还没有好的解法的组合优化问题，很容易地修改此算法就可解决     

Evolutionary computation of unconstrained and constrained problems using a novel momentum-type particle swarm optimization

This study proposes a novel momentum-type particle swarm optimization (PSO) method, which will find good solutions of unconstrained and constrained problems using a delta momentum rule to update the particle velocity. The algorithm modifies Shi and Eberhart's PSO to enhance the computational efficiency and solution accuracy. This study also presents a continuous non-stationary penalty function, to force design variables to satisfy all constrained functions. Several well-known and widely used benchmark problems were employed to compare the performance of the proposed PSO with Kennedy and Eberhart's PSO and Shi and Eberhart's modified PSO. Additionally, an engineering optimization task for designing a pressure vessel was applied to test the three PSO algorithms. The optimal solutions are presented and compared with the data from other works using different evolutionary algorithms. To show that the proposed momentum-type PSO algorithm is robust, its convergence rate, solution accuracy, mean absolute error, standard deviation, and CPU time were compared with those of both the other PSO algorithms. The experimental results reveal that the proposed momentum-type PSO algorithm can efficiently solve unconstrained and constrained engineering optimization problems.