A novel hybrid PSO–GWO algorithm for optimization problems

Engineering with Computers - In this study, we propose a new hybrid algorithm fusing the exploitation ability of the particle swarm optimization (PSO) with the exploration ability of the grey wolf...     

A multi-objective cost–benefit optimization algorithm for network hardening

International Journal of Information Security - Network hardening is an optimization problem to find the best combination of countermeasures to protect a network from cyber-attacks. While an...     

A hybrid CBO–PSO algorithm for optimal design of truss structures with dynamic constraints

The vibration domain of structures can be reduced by imposing some constraints on their natural frequencies. For this purpose optimal design of structures under frequency constraints is required which involves highly non-linear and non-convex problems. In this paper an efficient hybrid algorithm is developed for solving such optimization problems. This algorithm utilizes the recently developed colliding bodies optimization (CBO) algorithm as the main engine and uses the positive properties of the particle swarm optimization (PSO) algorithm to increase the efficiency of the CBO. The distinct feature of the present hybrid algorithm is that it requires no parameter tuning. The CBO is known for being parameter independent, and avoiding the use of the traditional penalty method to handle the constraints upholds this property. Two mathematical constrained functions taken from the literature are studied to verify the performance of the algorithm. The algorithm is then applied to optimize truss structures with frequency limitations. The numerical results demonstrate the efficiency of the presented algorithm for this class of problems.     

Implementation of hybrid ANN–PSO algorithm on FPGA for harmonic estimation

Harmonic estimation is the main process in active filters for harmonic reduction. A hybrid Adaptive Neural Network–Particle Swarm Optimization (ANN–PSO) algorithm is being proposed for harmonic isolation. Originally Fourier Transformation is used to analyze a distorted wave. In order to improve the convergence rate and processing speed an Adaptive Neural Network Algorithm called Adaline has then been used. A further improvement has been provided to reduce the error and increase the fineness of harmonic isolation by combining PSO algorithm with Adaline algorithm. The inertia weight factor of PSO is combined along with the weight factor of Adaline and trained in Neural Network environment for better results. ANN–PSO provides uniform convergence with the convergence rate comparable that of Adaline algorithm. The proposed ANN–PSO algorithm is implemented on an FPGA. To validate the performance of ANN–PSO; results are compared with Adaline algorithm and presented herein.     

A hybrid Kaczmarz–Conjugate Gradient algorithm for image reconstruction

The present paper is a theoretical contribution to the field of iterative methods for solving inconsistent linear least squares problems arising in image reconstruction from projections in computerized tomography. It consists on a hybrid algorithm which includes in each iteration a CG-like step for modifying the right-hand side and a Kaczmarz-like step for producing the approximate solution. We prove convergence of the hybrid algorithm for general inconsistent and rank-deficient least-squares problems. Although the new algorithm has potential for more applied experiments and comparisons, we restrict them in this paper to a regularized image reconstruction problem involving a 2D medical data set.     

Improving the multi-objective evolutionary optimization algorithm for hydropower reservoir operations in the California Oroville–Thermalito complex

This study demonstrates the application of an improved Evolutionary optimization Algorithm (EA), titled Multi-Objective Complex Evolution Global Optimization Method with Principal Component Analysis and Crowding Distance Operator (MOSPD), for the hydropower reservoir operation of the Oroville–Thermalito Complex (OTC) – a crucial head-water resource for the California State Water Project (SWP). In the OTC's water-hydropower joint management study, the nonlinearity of hydropower generation and the reservoir's water elevation–storage relationship are explicitly formulated by polynomial function in order to closely match realistic situations and reduce linearization approximation errors. Comparison among different curve-fitting methods is conducted to understand the impact of the simplification of reservoir topography. In the optimization algorithm development, techniques of crowding distance and principal component analysis are implemented to improve the diversity and convergence of the optimal solutions towards and along the Pareto optimal set in the objective space. A comparative evaluation among the new algorithm MOSPD, the original Multi-Objective Complex Evolution Global Optimization Method (MOCOM), the Multi-Objective Differential Evolution method (MODE), the Multi-Objective Genetic Algorithm (MOGA), the Multi-Objective Simulated Annealing approach (MOSA), and the Multi-Objective Particle Swarm Optimization scheme (MOPSO) is conducted using the benchmark functions. The results show that best the MOSPD algorithm demonstrated the best and most consistent performance when compared with other algorithms on the test problems. The newly developed algorithm (MOSPD) is further applied to the OTC reservoir releasing problem during the snow melting season in 1998 (wet year), 2000 (normal year) and 2001 (dry year), in which the more spreading and converged non-dominated solutions of MOSPD provide decision makers with better operational alternatives for effectively and efficiently managing the OTC reservoirs in response to the different climates, especially drought, which has become more and more severe and frequent in California.     

A statistical model-based algorithm for ‘black-box’ multi-objective optimisation

The problem of multi-objective optimisation with ‘expensive’ ‘black-box’ objective functions is considered. An algorithm is proposed that generalises the single objective P-algorithm constructed using the statistical model of multimodal functions and concepts of the theory of rational decisions under uncertainty. Computational examples are included demonstrating that the algorithm proposed possess several expected properties.     

A novel hybrid PSO–GWO approach for unit commitment problem

Particle swarm optimization algorithm is a inhabitant-based stochastic search procedure, which provides a populace-based search practice for getting the best solution from the problem by taking particles and moving them around in the search space and efficient for global search. Grey Wolf Optimizer is a recently developed meta-heuristic search algorithm inspired by Canis-lupus. This research paper presents solution to single-area unit commitment problem for 14-bus system, 30-bus system and 10-generating unit model using swarm-intelligence-based particle swarm optimization algorithm and a hybrid PSO–GWO algorithm. The effectiveness of proposed algorithms is compared with classical PSO, PSOLR, HPSO, hybrid PSOSQP, MPSO, IBPSO, LCA–PSO and various other evolutionary algorithms, and it is found that performance of NPSO is faster than classical PSO. However, generation cost of hybrid PSO–GWO is better than classical and novel PSO, but convergence of hybrid PSO–GWO is much slower than NPSO due to sequential computation of PSO and GWO.     

A hybrid genetic algorithm for the discrete time–cost trade-off problem

In this paper we present a hybrid strategy developed using genetic algorithms (GAs), simulated annealing (SA), and quantum simulated annealing techniques (QSA) for the discrete time–cost trade-off problem (DTCTP). In the hybrid algorithm (HA), SA is used to improve hill-climbing ability of GA. In addition to SA, the hybrid strategy includes QSA to achieve enhanced local search capability. The HA and a sole GA have been coded in Visual C++ on a personal computer. Ten benchmark test problems with a range of 18 to 630 activities are used to evaluate performance of the HA. The benchmark problems are solved to optimality using mixed integer programming technique. The results of the performance analysis indicate that the hybrid strategy improves convergence of GA significantly and HA provides a powerful alternative for the DTCTP.     

A new hybrid GA−ACO−PSO algorithm for solving various engineering design problems

The intention of this hybridization is to further enhance the exploratory and exploitative search capabilities involving simple concepts. The proposed algorithm adopts the combined discrete and continuous probability distribution scheme of ant colony optimization (ACO) to specifically assist genetic algorithm in the aspect of exploratory search. Besides, distinctive crossover and mutation operators are introduced, in which, two types of mutation operators, namely, standard mutation and refined mutation are suggested. In early iterations, standard mutation is utilized collaboratively with the concept of unrepeated tours of ACO to evade local entrapment, while refined mutation is used in later iterations to supplement the exploitative search, which is mainly controlled by particle swarm optimization. The proposed method has been validated in solving test functions and well-known engineering design problems. It exhibits a great global search capability even in the presence of non-linearity, multimodality and constraints, involving a large number of dimensions as well as large search areas.     

A hybrid cuckoo search and genetic algorithm for reliability–redundancy allocation problems

Solving reliability and redundancy allocation problems via meta-heuristic algorithms has attracted increasing attention in recent years. In this study, a recently developed meta-heuristic optimization algorithm cuckoo search (CS) is hybridized with well-known genetic algorithm (GA) called CS–GA is proposed to solve the reliability and redundancy allocation problem. By embedding the genetic operators in standard CS, the balance between the exploration and exploitation ability further improved and more search space are observed during the algorithms’ performance. The computational results carried out on four classical reliability–redundancy allocation problems taken from the literature confirm the validity of the proposed algorithm. Experimental results are presented and compared with the best known solutions. The comparison results with other evolutionary optimization methods demonstrate that the proposed CS–GA algorithm proves to be extremely effective and efficient at locating optimal solutions.     

AnnoFin–A hybrid algorithm to annotate financial text

In this work, we study the problem of annotating a large volume of Financial text by learning from a small set of human-annotated training data. The training data is prepared by randomly selecting some text sentences from the large corpus of financial text. Conventionally, bootstrapping algorithm is used to annotate large volume of unlabeled data by learning from a small set of annotated data. However, the small set of annotated data have to be carefully chosen as seed data. Thus, our approach is a digress from the conventional approach of bootstrapping as we let the users randomly select the seed data. We show that our proposed algorithm has an accuracy of 73.56% in classifying the financial texts into the different categories (“Accounting”, “Cost”, “Employee”, “Financing”, “Sales”, “Investments”, “Operations”, “Profit”, “Regulations” and “Irrelevant”) even when the training data is just 30% of the total data set. Additionally, the accuracy improves by an approximate average of 2% for an increase of the training data by 10% and the accuracy of our system is 77.91% when the training data is about 50% of the total data set. As a dictionary of hand chosen keywords prepared by domain experts are often used for financial text extraction, we assumed the existence of almost linearly separable hyperplanes between the different classes and therefore, we have used Linear Support Vector Machine along with a modified version of Label Propagation Algorithm which exploits the notion of neighborhood (in Euclidean space) for classification. We believe that our proposed techniques will be of help to Early Warning Systems used in banks where large volumes of unstructured texts need to be processed for better insights about a company.     

Hybrid BFOA–PSO algorithm for automatic generation control of linear and nonlinear interconnected power systems

In the bacteria foraging optimization algorithm (BFAO), the chemotactic process is randomly set, imposing that the bacteria swarm together and keep a safe distance from each other. In hybrid bacteria foraging optimization algorithm and particle swarm optimization (hBFOA–PSO) algorithm the principle of swarming is introduced in the framework of BFAO. The hBFOA–PSO algorithm is based on the adjustment of each bacterium position according to the neighborhood environment. In this paper, the effectiveness of the hBFOA–PSO algorithm has been tested for automatic generation control (AGC) of an interconnected power system. A widely used linear model of two area non-reheat thermal system equipped with proportional-integral (PI) controller is considered initially for the design and analysis purpose. At first, a conventional integral time multiply absolute error (ITAE) based objective function is considered and the performance of hBFOA–PSO algorithm is compared with PSO, BFOA and GA. Further a modified objective function using ITAE, damping ratio of dominant eigenvalues and settling time with appropriate weight coefficients is proposed to increase the performance of the controller. Further, robustness analysis is carried out by varying the operating load condition and time constants of speed governor, turbine, tie-line power in the range of +50% to ?50% as well as size and position of step load perturbation to demonstrate the robustness of the proposed hBFOA–PSO optimized PI controller. The proposed approach is also extended to a non-linear power system model by considering the effect of governor dead band non-linearity and the superiority of the proposed approach is shown by comparing the results of craziness based particle swarm optimization (CRAZYPSO) approach for the identical interconnected power system. Finally, the study is extended to a three area system considering both thermal and hydro units with different PI coefficients and comparison between ANFIS and proposed approach has been provided.     

A new iterative mutually coupled hybrid GA–PSO approach for curve fitting in manufacturing

Fitting data points to curves (usually referred to as curve reconstruction) is a major issue in computer-aided design/manufacturing (CAD/CAM). This problem appears recurrently in reverse engineering, where a set of (possibly massive and noisy) data points obtained by 3D laser scanning have to be fitted to a free-form parametric curve (typically a B-spline). Despite the large number of methods available to tackle this issue, the problem is still challenging and elusive. In fact, no satisfactory solution to the general problem has been achieved so far. In this paper we present a novel hybrid evolutionary approach (called IMCH-GAPSO) for B-spline curve reconstruction comprised of two classical bio-inspired techniques: genetic algorithms (GA) and particle swarm optimization (PSO), accounting for data parameterization and knot placement, respectively. In our setting, GA and PSO are mutually coupled in the sense that the output of one system is used as the input of the other and vice versa. This coupling is then repeated iteratively until a termination criterion (such as a prescribed error threshold or a fixed number of iterations) is attained. To evaluate the performance of our approach, it has been applied to several illustrative examples of data points from real-world applications in manufacturing. Our experimental results show that our approach performs very well, being able to reconstruct with very high accuracy extremely complicated shapes, unfeasible for reconstruction with current methods.     

A hybrid genetic algorithm–fuzzy c-means approach for incomplete data clustering based on nearest-neighbor intervals

Incomplete data are often encountered in data sets used in clustering problems, and inappropriate treatment of incomplete data can significantly degrade the clustering performance. In view of the uncertainty of missing attributes, we put forward an interval representation of missing attributes based on nearest-neighbor information, named nearest-neighbor interval, and a hybrid approach utilizing genetic algorithm and fuzzy c-means is presented for incomplete data clustering. The overall algorithm is within the genetic algorithm framework, which searches for appropriate imputations of missing attributes in corresponding nearest-neighbor intervals to recover the incomplete data set, and hybridizes fuzzy c-means to perform clustering analysis and provide fitness metric for genetic optimization simultaneously. Several experimental results on a set of real-life data sets are presented to demonstrate the better clustering performance of our hybrid approach over the compared methods.     

A hybrid teaching–learning slime mould algorithm for global optimization and reliability-based design optimization problems

Neural Computing and Applications - Slime mould algorithm (SMA) is a novel metaheuristic algorithm with good performance for optimization problems, but it may encounter premature or low accuracy in...     

A novel hybrid PSO–GA meta-heuristic for scheduling of DAG with communication on multiprocessor systems

This work presents a novel hybrid meta-heuristic that combines particle swarm optimization and genetic algorithm (PSO–GA) for the job/tasks in the form of directed acyclic graph (DAG) exhibiting inter-task communication. The proposed meta-heuristic starts with PSO and enters into GA when local best result from PSO is obtained. Thus, the proposed PSO–GA meta-heuristic is different than other such hybrid meta-heuristics as it aims at improving the solution obtained by PSO using GA. In the proposed meta-heuristic, PSO is used to provide diversification while GA is used to provide intensification. The PSO–GA is tested for task scheduling on two standard well-known linear algebra problems: LU decomposition and Gauss–Jordan elimination. It is also compared with other states-of-the-art heuristics for known solutions. Furthermore, its effectiveness is evaluated on few large sizes of random task graphs. Comparative study of the proposed PSO-GA with other heuristics depicts that the PSO–GA performs quite effectively for multiprocessor DAG scheduling problem.     

A Dantzig–Wolfe decomposition algorithm for linear economic model predictive control of dynamically decoupled subsystems

This paper presents a warm-started Dantzig–Wolfe decomposition algorithm tailored to economic model predictive control of dynamically decoupled subsystems. We formulate the constrained optimal control problem solved at each sampling instant as a linear program with state space constraints, input limits, input rate limits, and soft output limits. The objective function of the linear program is related directly to the cost of operating the subsystems, and the cost of violating the soft output constraints. Simulations for large-scale economic power dispatch problems show that the proposed algorithm is significantly faster than both state-of-the-art linear programming solvers, and a structure exploiting implementation of the alternating direction method of multipliers. It is also demonstrated that the control strategy presented in this paper can be tuned using a weighted ℓ₁-regularization term. In the presence of process and measurement noise, such a regularization term is critical for achieving a well-behaved closed-loop performance.     

A new hybrid ANFIS–PSO model for prediction of peak particle velocity due to bench blasting

In this paper, a novel hybrid approach is proposed for predicting peak particle velocity (PPV) due to bench blasting in open pit mines. The proposed approach is based on the combination of adaptive neuro-fuzzy inference system (ANFIS) and particle swarm optimization (PSO). In this approach, the PSO is used to improve the performance of ANFIS. Furthermore, a model is developed based on support vector regression (SVR) approach. The models are trained and tested based on actual data compiled from 120 blast rounds in Sarcheshmeh copper mine. To determine the accuracy and efficiency of ANFIS–PSO and SVR models, a statistical model (USBM equation) is applied. According to the obtained results, both techniques can be used to predict the PPV, but the comparison of models shows that the ANFIS–PSO model provides better results. Root mean square error (RMSE), variance account for (VAF), and coefficient of determination (R ²) indices were obtained as 1.83, 93.37 and 0.957 for ANFIS–PSO model, respectively.     

An accelerated non-Euclidean hybrid proximal extragradient-type algorithm for convex–concave saddle-point problems

This paper describes an accelerated HPE-type method based on general Bregman distances for solving convex–concave saddle-point (SP) problems. The algorithm is a special instance of a non-Euclidean hybrid proximal extragradient framework introduced by Svaiter and Solodov [An inexact hybrid generalized proximal point algorithm and some new results on the theory of Bregman functions, Math. Oper. Res. 25(2) (2000), pp. 214–230] where the prox sub-inclusions are solved using an accelerated gradient method. It generalizes the accelerated HPE algorithm presented in He and Monteiro [An accelerated HPE-type algorithm for a class of composite convex–concave saddle-point problems, SIAM J. Optim. 26 (2016), pp. 29–56] in two ways, namely: (a) it deals with general monotone SP problems instead of bilinear structured SPs and (b) it is based on general Bregman distances instead of the Euclidean one. Similar to the algorithm of He and Monteiro [An accelerated HPE-type algorithm for a class of composite convex–concave saddle-point problems, SIAM J. Optim. 26 (2016), pp. 29–56], it has the advantage that it works for any constant choice of proximal stepsize. Moreover, a suitable choice of the stepsize yields a method with the best known iteration-complexity for solving monotone SP problems. Computational results show that the new method is superior to Nesterov's [Smooth minimization of non-smooth functions, Math. Program. 103(1) (2005), pp. 127–152] smoothing scheme.