Hybrid simplex search and particle swarm optimization for the global optimization of multimodal functions

This article proposes the hybrid Nelder–Mead (NM)–Particle Swarm Optimization (PSO) algorithm based on the NM simplex search method and PSO for the optimization of multimodal functions. The hybrid NM–PSO algorithm is very easy to implement, in practice, since it does not require gradient computation. This hybrid procedure performed the exploration with PSO and the exploitation with the NM simplex search method. In a suite of 17 multi-optima test functions taken from the literature, the computational results via various experimental studies showed that the hybrid NM–PSO approach is superior to the two original search techniques (i.e. NM and PSO) in terms of solution quality and convergence rate. In addition, the presented algorithm is also compared with eight other published methods, such as hybrid genetic algorithm (GA), continuous GA, simulated annealing (SA), and tabu search (TS) by means of a smaller set of test functions. On the whole, the new algorithm is demonstrated to be extremely effective and efficient at locating best-practice optimal solutions for multimodal functions.     

Comparison between hybridized algorithm of GA–SA and ABC,GA, DE and PSO for vertical-handover in heterogeneous wireless networks

Genetic algorithms (GAs) and simulated annealing (SA) have emerged as leading methods for search and optimization problems in heterogeneous wireless networks. In this paradigm, various access technologies need to be interconnected; thus, vertical handovers are necessary for seamless mobility. In this paper, the hybrid algorithm for real-time vertical handover using different objective functions has been presented to find the optimal network to connect with a good quality of service in accordance with the user’s preferences. As it is, the characteristics of the current mobile devices recommend using fast and efficient algorithms to provide solutions near to real-time. These constraints have moved us to develop intelligent algorithms that avoid slow and massive computations. This was to, specifically, solve two major problems in GA optimization, i.e. premature convergence and slow convergence rate, and the facilitation of simulated annealing in the merging populations phase of the search. The hybrid algorithm was expected to improve on the pure GA in two ways, i.e., improved solutions for a given number of evaluations, and more stability over many runs. This paper compares the formulation and results of four recent optimization algorithms: artificial bee colony (ABC), genetic algorithm (GA), differential evolution (DE), and particle swarm optimization (PSO). Moreover, a cost function is used to sustain the desired QoS during the transition between networks, which is measured in terms of the bandwidth, BER, ABR, SNR, and monetary cost. Simulation results indicated that choosing the SA rules would minimize the cost function and the GA–SA algorithm could decrease the number of unnecessary handovers, and thereby prevent the ‘Ping-Pong’ effect.     

混合粒子群算法在混流装配线优化调度中的应用

应用粒子群算法求解混流装配线的优化调度问题,给出粒子的构造方法,并针对算法中存在过早收敛的问题,提出了一种与局部优化和粒子微变异方法相结合的混合粒子群算法.给出了一个实例,实例应用粒子群算法和混合粒子群算法分别进行求解,与其他一些方法比较表明,混合粒子群算法可以有效、快速地求得混流装配线优化调度问题的解.     

Design of high-performing hybrid meta-heuristics for unrelated parallel machine scheduling with machine eligibility and precedence constraints

This study involves an unrelated parallel machine scheduling problem in which sequence-dependent set-up times, different release dates, machine eligibility and precedence constraints are considered to minimize total late works. A new mixed-integer programming model is presented and two efficient hybrid meta-heuristics, genetic algorithm and ant colony optimization, combined with the acceptance strategy of the simulated annealing algorithm (Metropolis acceptance rule), are proposed to solve this problem. Manifestly, the precedence constraints greatly increase the complexity of the scheduling problem to generate feasible solutions, especially in a parallel machine environment. In this research, a new corrective algorithm is proposed to obtain the feasibility in all stages of the algorithms. The performance of the proposed algorithms is evaluated in numerical examples. The results indicate that the suggested hybrid ant colony optimization statistically outperformed the proposed hybrid genetic algorithm in solving large-size test problems.     

混流装配线调度问题的离散粒子群优化解

混流装配线调度问题是JIT生产中的一个重要问题。借鉴二进制遗传算法中的交叉操作过程，对传统的连续型粒子群算法进行改进，使其适用于离散问题的优化处理。然后以丰田公司的汽车组装调度函数作为目标函数，利用改进的离散粒子群算法进行求解。对比分析表明：新算法所得结果优于常用的目标追随法、遗传算法、模拟退火等方法。     

A particle swarm optimization algorithm for hybrid flow-shop scheduling with multiprocessor tasks

The multistage hybrid flow-shop scheduling problem with multiprocessor tasks has been found in many practical situations. Due to the essential complexity of the problem, many researchers started to apply metaheuristics to solve the problem. In this paper, we address the problem by using particle swarm optimization (PSO), a novel metaheuristic inspired by the flocking behaviour of birds. The proposed PSO algorithm has several features, such as a new encoding scheme, an implementation of the best velocity equation and neighbourhood topology among several different variants, and an effective incorporation of local search. To verify the PSO algorithm, computational experiments are conducted to make a comparison with two existing genetic algorithms (GAs) and an ant colony system (ACS) algorithm based on the same benchmark problems. The results show that the proposed PSO algorithm outperforms all the existing algorithms for the considered problem.     

A hybrid optimization model for proficient bidding strategies with no Karush–Kuhn–Tucker optimality conditions

The computational complexity behind the bi‐level optimization problem has led the researchers to adopt Karush–Kuhn–Tucker (KKT) optimality conditions. However, the problem function has more number of complex constraints to be satisfied. Classical optimization algorithms are impotent to handle the function. This paper presents a simplified minimization function, in which both the profit maximization problem and the ISO market clearance problem are considered, but with no KKT optimality conditions. Subsequently, this paper solves the minimization function using a hybrid optimization algorithm. The hybrid optimization algorithm is developed by combining the operations of group search optimizer (GSO) and genetic algorithm (GA). The hybridization enables the dispersion process of GSO to be a new mutated dispersion process for improving the convergence rate. We evaluate the methodology by experimenting on IEEE 14 and IEEE 30 bus systems. The obtained results are compared with the outcomes of bidding strategies that are based on GSO, PSO, and GA. The results demonstrate that the hybrid optimization algorithm solves the minimization function better than PSO, GA, and GSO. Hence, the profit maximization in the proposed methodology is relatively better than that of the conventional algorithms. Copyright © 2015 John Wiley & Sons, Ltd.     

基于智能混合策略的测试集优化

利用基于粒子群和蚁群算法的智能混合优化策略,删除冗余测试向量以解决测试集的优化问题. 利用蚁群算法的并行搜索能力构造初始解集,通过粒子群优化算法将解集维数降低,确定每次迭代的个体最优解和全局最优解,并利用新粒子信息更新信息素,最终通过多次迭代找到一个或多个最优测试集. 通过多组数据实例分析可知: 该智能混合优化策略与蚁群算法等其他测试集优化算法相比,可得到多个可行性最优测试集;与蚁群算法相比可提高收敛速度,并降低蚁群算法参数选取对收敛结果的影响,从而避免次优解的出现.     

A robust optimization approach for integrated steel production and batch delivery scheduling with uncertain rolling times and deterioration effect

Efficient collaboration between various sub-processes of steel production is of considerable significance, which directly affects a product’s production cycle and energy consumption. However, current collaborative optimisation models and methods in steel production are still limited: (1) Most of the current collaborative manufacturing problems in steel production focus on obtaining joint schedule between steel-making and continuous casting (SCC), and the works considering continuous casting and hot rolling (CCHR) are very few. (2) The processing time is assumed as a constant in most of the existing SCC scheduling models. However, the rolling time of a product in hot rolling operation is actually uncertain and deteriorating. (3) Exact algorithms cannot be applied to solve the complicated collaborative optimisation problems because of their high complexities. To address these problems, we propose an integrated CCHR and batch delivery scheduling model where interval rolling time and linear deterioration effect are considered. With the concept of min–max regret value, we formulate the collaborative optimisation problem as a robust optimisation problem. Instead of using the exact algorithm, we develop an Improved Variable Neighborhood Search (IVNS) algorithm incorporated a novel population update mechanism and neighbourhood structures to solve the robust optimisation problem. Moreover, we develop an exact algorithm that combines CPLEX solver and two dynamic programming algorithms to obtain the maximum regret value of a given rolling sequence. The results of computational experiments show the excellent performance of the proposed algorithms.

Abbreviations: IVNS: improved variable neighbourhood search; TOPSIS: technique for order of preference by similarity to ideal solution; PUM-TOPSIS: population update mechanism based on TOPSIS; DP: dynamic programming; NSs-PUC: neighbourhood structures based on the parameterised uniform crossover; SNRT: shortest normal rolling time; SNRT-DP: DP algorithm based on SNRT rule; BRKGA: biased random-key genetic algorithm; SCC: steelmaking and continuous casting; MINP: mixed integer nonlinear programme; CCHR: continuous casting and hot rolling; PSO: particle swarm optimisation; GA: genetic algorithm; VNS-HS: variable neighbourhood search and harmony search; HPSO?+?GA: hybrid PSO and GA; SA: simulated annealing; B&B: branch-and-bound; TPSO: two-phase soft optimisation; TSAUN: tabued simulated annealing with united-scenario neighbourhood; VNS: variable neighbourhood search; ABC: artificial bee colony; PRVNS: population-based reduced variable neighbourhood search; NS1: neighbourhood structure 1; NS2: neighbourhood structure 2; DE: differential evolution; WSR: Wilcoxon signed-rank test; ENS: exchange neighbourhood structure; IVNS-ENS: IVNS with ENS; RPI: relative percentage increase; ARPI: average RPI; SD: standard deviation.     

Evolutionary computation of unconstrained and constrained problems using a novel momentum-type particle swarm optimization

This study proposes a novel momentum-type particle swarm optimization (PSO) method, which will find good solutions of unconstrained and constrained problems using a delta momentum rule to update the particle velocity. The algorithm modifies Shi and Eberhart's PSO to enhance the computational efficiency and solution accuracy. This study also presents a continuous non-stationary penalty function, to force design variables to satisfy all constrained functions. Several well-known and widely used benchmark problems were employed to compare the performance of the proposed PSO with Kennedy and Eberhart's PSO and Shi and Eberhart's modified PSO. Additionally, an engineering optimization task for designing a pressure vessel was applied to test the three PSO algorithms. The optimal solutions are presented and compared with the data from other works using different evolutionary algorithms. To show that the proposed momentum-type PSO algorithm is robust, its convergence rate, solution accuracy, mean absolute error, standard deviation, and CPU time were compared with those of both the other PSO algorithms. The experimental results reveal that the proposed momentum-type PSO algorithm can efficiently solve unconstrained and constrained engineering optimization problems.     

Coupling ant colony optimization and the extended great deluge algorithm for the discrete facility layout problem

This article uses a hybrid optimization approach to solve the discrete facility layout problem (FLP), modelled as a quadratic assignment problem (QAP). The idea of this approach design is inspired by the ant colony meta-heuristic optimization method, combined with the extended great deluge (EGD) local search technique. Comparative computational experiments are carried out on benchmarks taken from the QAP-library and from real life problems. The performance of the proposed algorithm is compared to construction and improvement heuristics such as H63, HC63-66, CRAFT and Bubble Search, as well as other existing meta-heuristics developed in the literature based on simulated annealing (SA), tabu search and genetic algorithms (GAs). This algorithm is compared also to other ant colony implementations for QAP. The experimental results show that the proposed ant colony optimization/extended great deluge (ACO/EGD) performs significantly better than the existing construction and improvement algorithms. The experimental results indicate also that the ACO/EGD heuristic methodology offers advantages over other algorithms based on meta-heuristics in terms of solution quality.     

A hybrid multi-objective particle swarm algorithm for a mixed-model assembly line sequencing problem

Mixed-model assembly line sequencing is one of the most important strategic problems in the field of production management where diversified customers' demands exist. In this article, three major goals are considered: (i) total utility work, (ii) total production rate variation and (iii) total setup cost. Due to the complexity of the problem, a hybrid multi-objective algorithm based on particle swarm optimization (PSO) and tabu search (TS) is devised to obtain the locally Pareto-optimal frontier where simultaneous minimization of the above-mentioned objectives is desired. In order to validate the performance of the proposed algorithm in terms of solution quality and diversity level, the algorithm is applied to various test problems and its reliability, based on different comparison metrics, is compared with three prominent multi-objective genetic algorithms, PS-NC GA, NSGA-II and SPEA-II. The computational results show that the proposed hybrid algorithm significantly outperforms existing genetic algorithms in large-sized problems.     

A surrogate-assisted particle swarm optimization algorithm based on efficient global optimization for expensive black-box problems

Evolutionary algorithms cannot effectively handle computationally expensive problems because of the unaffordable computational cost brought by a large number of fitness evaluations. Therefore, surrogates are widely used to assist evolutionary algorithms in solving these problems. This article proposes an improved surrogate-assisted particle swarm optimization (ISAPSO) algorithm, in which a hybrid particle swarm optimization (PSO) is combined with global and local surrogates. The global surrogate is not only used to predict fitness values for reducing computational burden but also regarded as a global searcher to speed up the global search process of PSO by using an efficient global optimization algorithm, while the local one is constructed for a local search in the neighbourhood of the current optimal solution by finding the predicted optimal solution of the local surrogate. Empirical studies on 10 widely used benchmark problems and a real-world structural design optimization problem of a driving axle show that the ISAPSO algorithm is effective and highly competitive.     

A particle swarm optimizer for constrained multi-objective engineering design problems

This article presents a particle swarm optimizer (PSO) capable of handling constrained multi-objective optimization problems. The latter occur frequently in engineering design, especially when cost and performance are simultaneously optimized. The proposed algorithm combines the swarm intelligence fundamentals with elements from bio-inspired algorithms. A distinctive feature of the algorithm is the utilization of an arithmetic recombination operator, which allows interaction between non-dominated particles. Furthermore, there is no utilization of an external archive to store optimal solutions. The PSO algorithm is applied to multi-objective optimization benchmark problems and also to constrained multi-objective engineering design problems. The algorithmic effectiveness is demonstrated through comparisons of the PSO results with those obtained from other evolutionary optimization algorithms. The proposed particle swarm optimizer was able to perform in a very satisfactory manner in problems with multiple constraints and/or high dimensionality. Promising results were also obtained for a multi-objective engineering design problem with mixed variables.     

Swarm algorithms with chaotic jumps for optimization of multimodal functions

In this article, the use of some well-known versions of particle swarm optimization (PSO) namely the canonical PSO, the bare bones PSO (BBPSO) and the fully informed particle swarm (FIPS) is investigated on multimodal optimization problems. A hybrid approach which consists of swarm algorithms combined with a jump strategy in order to escape from local optima is developed and tested. The jump strategy is based on the chaotic logistic map. The hybrid algorithm was tested for all three versions of PSO and simulation results show that the addition of the jump strategy improves the performance of swarm algorithms for most of the investigated optimization problems. Comparison with the off-the-shelf PSO with local topology (l _best model) has also been performed and indicates the superior performance of the standard PSO with chaotic jump over the standard both using local topology (l _best model).     

A new hybrid teaching–learning particle swarm optimization algorithm for synthesis of linkages to generate path

This paper proposes a novel hybrid teaching–learning particle swarm optimization (HTLPSO) algorithm, which merges two established nature-inspired algorithms, namely, optimization based on teaching–learning (TLBO) and particle swarm optimization (PSO). The HTLPSO merges the best half of population obtained after the teacher phase in TLBO with the best half of the population obtained after PSO. The population so obtained is used subsequently in learner phase of TLBO. To validate the proposed algorithm, five constrained benchmark functions are considered to prove its robustness and efficiency. The proposed algorithm is applied to synthesize four-bar linkage for prescribed path. It is found that the HTLPSO performs better than other single nature-inspired algorithms for path synthesis problem in mechanism theory. Hence, HTLPSO may prove to be an important tool for mechanism design to follow the prescribed path.     

A hybrid evolutionary algorithm for distribution feeder reconfiguration

Distribution feeder reconfiguration (DFR) is formulated as a multi-objective optimization problem which minimizes real power losses, deviation of the node voltages and the number of switching operations and also balances the loads on the feeders. In the proposed method, the distance (λ ₂ norm) between the vector-valued objective function and the worst-case vector-valued objective function in the feasible set is maximized. In the algorithm, the status of tie and sectionalizing switches are considered as the control variables. The proposed DFR problem is a non-differentiable optimization problem. Therefore, a new hybrid evolutionary algorithm based on combination of fuzzy adaptive particle swarm optimization (FAPSO) and ant colony optimization (ACO), called HFAPSO, is proposed to solve it. The performance of HFAPSO is evaluated and compared with other methods such as genetic algorithm (GA), ACO, the original PSO, Hybrid PSO and ACO (HPSO) considering different distribution test systems.     

Multi-objective optimization of combined Brayton and inverse Brayton cycles using advanced optimization algorithms

This study explores the use of teaching-learning-based optimization (TLBO) and artificial bee colony (ABC) algorithms for determining the optimum operating conditions of combined Brayton and inverse Brayton cycles. Maximization of thermal efficiency and specific work of the system are considered as the objective functions and are treated simultaneously for multi-objective optimization. Upper cycle pressure ratio and bottom cycle expansion pressure of the system are considered as design variables for the multi-objective optimization. An application example is presented to demonstrate the effectiveness and accuracy of the proposed algorithms. The results of optimization using the proposed algorithms are validated by comparing with those obtained by using the genetic algorithm (GA) and particle swarm optimization (PSO) on the same example. Improvement in the results is obtained by the proposed algorithms. The results of effect of variation of the algorithm parameters on the convergence and fitness values of the objective functions are reported.     

Breast cancer diagnosis from mammographic images using optimized feature selection and neural network architecture

Breast cancer is one of the deadly diseases in women that have raised the mortality rate of women. An accurate and early detection of breast cancer using mammogram images is still a complex task. Hence, this article proposes a novel breast cancer detection model, which included five major phases: (a) preprocessing, (b) segmentation, (c) feature extraction, (d) feature selection, and (e) classification. The input mammogram image is initially preprocessed using contrast limited adaptive histogram equalization (CLAHE) and median filtering. The preprocessed image is then subjected to segmentation via the region growing algorithm. Subsequently, geometric features, texture features and gradient features are extracted from the segmented image. Since the length of the feature vector is large, it is essential to select the optimal features. Here, the selection of optimal features is done by a hybrid optimization algorithm. Once the optimal features are selected, they are subjected to the classification process involving the neural network (NN) classifier. As a novelty, the weight of NN is selected optimally to enhance the accuracy of diagnosis (benign and malignant). The optimal feature selection as well as the weight optimization of NN is accomplished by merging the Lion algorithm (LA) and particle swarm optimization (PSO), named as velocity updated lion algorithm (VU‐LA). Finally, a performance‐based evaluation is carried out between VU‐LA and the existing models like, whale optimization algorithm (WOA), gray wolf optimization (GWO), firefly (FF), PSO, and LA.     

A Hybrid Method for Structural System Reliability‐Based Design Optimization and its Application to Trusses

Most research studies on structural optimum design have focused on single‐objective optimization of deterministic structures, while little study has been carried out to address multi‐objective optimization of random structures. Statistical parameters and redundancy allocation problems should be considered in structural optimization. In order to address these problems, this paper presents a hybrid method for structural system reliability‐based design optimization (SRBDO) and applies it to trusses. The hybrid method integrates the concepts of the finite element method, radial basis function (RBF) neural networks, and genetic algorithms. The finite element method was used to compute structural responses under random loads. The RBF neural networks were employed to approximate structural responses for the purpose of replacing the structural limit state functions. The system reliabilities were calculated by Monte Carlo simulation method together with the trained RBF neural networks. The optimal parameters were obtained by genetic algorithms, where the system reliabilities were converted into penalty functions in order to address the constrained optimization. The hybrid method applied to trusses was demonstrated by two examples which were a typical 10‐bar truss and a steel truss girder structure. Detailed discussions and parameter analysis for the failure sequences such as web‐bucking failure and beam‐bending failure in the SRBDO were given. This hybrid method provides a new idea for SRBDO of trusses. Copyright © 2015 John Wiley & Sons, Ltd.