A novel hybrid combination optimization algorithm based on search area segmentation and fast Fourier transform

A novel hybrid optimization algorithm combining search area segmentation technique and the fast Fourier transform (HSAS/FFT) is presented to solve the numerical optimization problems. Firstly, the spectrum of each dimension of the objective function can be acquired by the FFT. The search space is segmented by using the spectrum to ensure that each subspace is unimodal. Secondly, the population of subspaces is produced and the optimal individual can be obtained by gradient descent algorithm. Finally, the local optimal solution in the optimal subspace is generated by the binary search algorithm. Make the optimal individual the new search space and repeat the process until meeting the termination condition. The proposed HSAS/FFT was tested on the CEC2017 benchmark, which evaluates the performance of the proposed algorithm on solving global optimization problems. Results obtained show that HSAS/FFT has an excellent performance and better convergence speed in comparison with some of the state-of-the-art algorithms.     

A TABOO SEARCH BASED APPROACH TO FIND THE PARETO OPTIMAL SET IN MULTIPLE OBJECTIVE OPTIMIZATION

Taboo search is a heuristic optimization technique which works with a neighbourhood of solutions to optimize a given objective function. It is generally applied to single objective optimization problems. Taboo search has the potential for solving multiple objective optimization (MOO) problems, because it works with more than one solution at a time, and this gives it the opportunity to evaluate multiple objective functions simultaneously. In this paper, a taboo search based algorithm is developed to find Pareto optimal solutions in multiple objective optimization problems. The developed algorithm has been tested with a number of problems and compared with other techniques. Results obtained from this work have proved that a taboo search based algorithm can find Pareto optimal solutions in MOO effectively.     

SSABA: Search Step Adjustment Based Algorithm

Finding the suitable solution to optimization problems is a fundamental challenge in various sciences. Optimization algorithms are one of the effective stochastic methods in solving optimization problems. In this paper, a new stochastic optimization algorithm called Search Step Adjustment Based Algorithm (SSABA) is presented to provide quasi-optimal solutions to various optimization problems. In the initial iterations of the algorithm, the step index is set to the highest value for a comprehensive search of the search space. Then, with increasing repetitions in order to focus the search of the algorithm in achieving the optimal solution closer to the global optimal, the step index is reduced to reach the minimum value at the end of the algorithm implementation. SSABA is mathematically modeled and its performance in optimization is evaluated on twenty-three different standard objective functions of unimodal and multimodal types. The results of optimization of unimodal functions show that the proposed algorithm SSABA has high exploitation power and the results of optimization of multimodal functions show the appropriate exploration power of the proposed algorithm. In addition, the performance of the proposed SSABA is compared with the performance of eight well-known algorithms, including Particle Swarm Optimization (PSO), Genetic Algorithm (GA), Teaching-Learning Based Optimization (TLBO), Gravitational Search Algorithm (GSA), Grey Wolf Optimization (GWO), Whale Optimization Algorithm (WOA), Marine Predators Algorithm (MPA), and Tunicate Swarm Algorithm (TSA). The simulation results show that the proposed SSABA is better and more competitive than the eight compared algorithms with better performance.     

An evolutionary algorithm for global optimization based on self-organizing maps

In this article, a new population-based algorithm for real-parameter global optimization is presented, which is denoted as self-organizing centroids optimization (SOC-opt). The proposed method uses a stochastic approach which is based on the sequential learning paradigm for self-organizing maps (SOMs). A modified version of the SOM is proposed where each cell contains an individual, which performs a search for a locally optimal solution and it is affected by the search for a global optimum. The movement of the individuals in the search space is based on a discrete-time dynamic filter, and various choices of this filter are possible to obtain different dynamics of the centroids. In this way, a general framework is defined where well-known algorithms represent a particular case. The proposed algorithm is validated through a set of problems, which include non-separable problems, and compared with state-of-the-art algorithms for global optimization.     

Spent potliner treatment process optimization using a MADS algorithm

In this paper, the general problem of chemical process optimization defined by a computer simulation is formulated. It is generally a nonlinear, non-convex, non-differentiable optimization problem over a disconnected set. A brief overview of popular optimization methods from the chemical engineering literature is presented. The recent mesh adaptive direct search (MADS) algorithm is detailed. It is a direct search algorithm, so it uses only function values and does not compute or approximate derivatives. This is useful when the functions are noisy, costly or undefined at some points, or when derivatives are unavailable or unusable. In this work, the MADS algorithm is used to optimize a spent potliners (toxic wastes from aluminum production) treatment process. In comparison with the best previously known objective function value, a 37% reduction is obtained even if the model failed to return a value 43% of the time.     

A new Kriging–Bat Algorithm for solving computationally expensive black-box global optimization problems

Many global optimization (GO) algorithms have been introduced in recent decades to deal with the Computationally Expensive Black-Box (CEBB) optimization problems. The high number of objective function evaluations, required by conventional GO methods, is prohibitive or at least inconvenient for practical design applications. In this work, a new Kriging–Bat algorithm (K–BA) is introduced for solving CEBB problems with further improved search efficiency and robustness. A Kriging surrogate model (SM) is integrated with the Bat Algorithm (BA) to find the global optimum using substantially reduced number of evaluations of the computationally expensive objective function. The new K–BA algorithm is tested and compared with other well-known GO algorithms, using a set of standard benchmark problems with 2 to 16 design variables, as well as a real-life engineering optimization application, to determine its search capability, efficiency and robustness. Results of the comprehensive tests demonstrated the suitability and superior capability of the new K–BA.     

OPTIMIZATION OF COMPOSITE LAMINATES WITH CUTOUTS USING GENETIC ALGORITHM,VARIABLE METRIC AND COMPLEX SEARCH METHODS

Optimization of composite laminates with cutouts is a complex problem, involving non-differentiable objective function and constraints. Choice of the optimization method is generally based on the nature and complexity of the objective function, constraints and how easily and/or accurately the first derivatives can be found. Many researchers have attempted and applied different classical optimization techniques for non-convex optimization problems. This paper clearly brings out the advantages of a non-traditional optimization method-Genetic algorithm (GA) over conventional techniques, the limitations of conventional techniques and GA's ability to approach the global optimum in an n-dimensional search space, for composite laminates.     

A quadratic approximation for structural topology optimization

In topology optimization, it is customary to use reciprocal‐like approximations, which result in monotonically decreasing approximate objective functions. In this paper, we demonstrate that efficient quadratic approximations for topology optimization can also be derived, if the approximate Hessian terms are chosen with care. To demonstrate this, we construct a dual SAO algorithm for topology optimization based on a strictly convex, diagonal quadratic approximation to the objective function. Although the approximation is purely quadratic, it does contain essential elements of reciprocal‐like approximations: for self‐adjoint problems, our approximation is identical to the quadratic or second‐order Taylor series approximation to the exponential approximation. We present both a single‐point and a two‐point variant of the new quadratic approximation. Copyright © 2009 John Wiley & Sons, Ltd.     

Applying multiple objective tabu search to continuous optimization problems with a simple neighbourhood strategy

One of the first multiple objective versions of the tabu search (TS) algorithm is proposed by the author. The idea of applying TS to multiple objective optimization is inspired from its solution structure. TS works with more than one solution (neighbourhood solutions) at a time and this situation gives the opportunity to evaluate multiple objectives simultaneously in one run. The selection and updating stages are modified to enable the original TS algorithm to work with more than one objective. In this paper, the multiple objective tabu search (MOTS) algorithm is applied to multiple objective non‐linear optimization problems with continuous variables using a simple neighbourhood strategy. The algorithm is applied to four mechanical components design problems. The results are compared with several other solution techniques including multiple objective genetic algorithms. It is observed that MOTS is able to find better and much wider spread of solutions than the reported ones. Copyright © 2005 John Wiley & Sons, Ltd.     

A weight-based multiobjective immune algorithm: WBMOIA

A novel immune algorithm is suggested for finding Pareto-optimal solutions to multiobjective optimization problems based on opt-aiNET, the artificial immune system algorithm for multi-modal optimization. In the proposed algorithm, a randomly weighted sum of multiple objectives is used as a fitness function, and a local search algorithm is incorporated to facilitate the exploitation of the search space. Specifically, a new truncation algorithm with similar individuals (TASI) is proposed to preserve the diversity of the population. Also, a new selection operator is presented to create the new population based on TASI. Simulation results on seven standard problems (ZDT2, ZDT6, DEB, VNT, BNH, OSY and KIT) show that the proposed algorithm is able to find a much better spread of solutions and better convergence near the true Pareto-optimal front compared to the vector immune algorithm and the elitist non-dominated sorting genetic system.     

MISO: mixed-integer surrogate optimization framework

We introduce MISO, the mixed-integer surrogate optimization framework. MISO aims at solving computationally expensive black-box optimization problems with mixed-integer variables. This type of optimization problem is encountered in many applications for which time consuming simulation codes must be run in order to obtain an objective function value. Examples include optimal reliability design and structural optimization. A single objective function evaluation may take from several minutes to hours or even days. Thus, only very few objective function evaluations are allowable during the optimization. The development of algorithms for this type of optimization problems has, however, rarely been addressed in the literature. Because the objective function is black-box, derivatives are not available and numerically approximating the derivatives requires a prohibitively large number of function evaluations. Therefore, we use computationally cheap surrogate models to approximate the expensive objective function and to decide at which points in the variable domain the expensive objective function should be evaluated. We develop a general surrogate model framework and show how sampling strategies of well-known surrogate model algorithms for continuous optimization can be modified for mixed-integer variables. We introduce two new algorithms that combine different sampling strategies and local search to obtain high-accuracy solutions. We compare MISO in numerical experiments to a genetic algorithm, NOMAD version 3.6.2, and SO-MI. The results show that MISO is in general more efficient than NOMAD and the genetic algorithm with respect to finding improved solutions within a limited budget of allowable evaluations. The performance of MISO depends on the chosen sampling strategy. The MISO algorithm that combines a coordinate perturbation search with a target value strategy and a local search performs best among all algorithms.     

A new multi-objective particle swarm optimizer using empirical movement and diversified search strategies

Most real-world optimization problems involve the optimization task of more than a single objective function and, therefore, require a great amount of computational effort as the solution procedure is designed to anchor multiple compromised optimal solutions. Abundant multi-objective evolutionary algorithms (MOEAs) for multi-objective optimization have appeared in the literature over the past two decades. In this article, a new proposal by means of particle swarm optimization is addressed for solving multi-objective optimization problems. The proposed algorithm is constructed based on the concept of Pareto dominance, taking both the diversified search and empirical movement strategies into account. The proposed particle swarm MOEA with these two strategies is thus dubbed the empirical-movement diversified-search multi-objective particle swarm optimizer (EMDS-MOPSO). Its performance is assessed in terms of a suite of standard benchmark functions taken from the literature and compared to other four state-of-the-art MOEAs. The computational results demonstrate that the proposed algorithm shows great promise in solving multi-objective optimization problems.     

A sequential quadratically constrained quadratic programming technique for a multi-objective optimization problem

In this article a line search algorithm is proposed for solving constrained multi-objective optimization problems. At every iteration of the proposed method, a subproblem is formulated using quadratic approximation of all functions. A feasible descent direction is obtained as a solution of this subproblem. This scheme takes care some ideas of the sequential quadratically constrained quadratic programming technique for single objective optimization problems. A non-differentiable penalty function is used to restrict constraint violations at every iterating point. Convergence of the scheme is justified under the Slater constraint qualification along with some reasonable assumptions. The proposed algorithm is verified and compared with existing methods with a set of test problems. It is observed that this algorithm provides better results in most of the test problems.     

Archery Algorithm: A Novel Stochastic Optimization Algorithm for Solving Optimization Problems

Finding a suitable solution to an optimization problem designed in science is a major challenge. Therefore, these must be addressed utilizing proper approaches. Based on a random search space, optimization algorithms can find acceptable solutions to problems. Archery Algorithm (AA) is a new stochastic approach for addressing optimization problems that is discussed in this study. The fundamental idea of developing the suggested AA is to imitate the archer's shooting behavior toward the target panel. The proposed algorithm updates the location of each member of the population in each dimension of the search space by a member randomly marked by the archer. The AA is mathematically described, and its capacity to solve optimization problems is evaluated on twenty-three distinct types of objective functions. Furthermore, the proposed algorithm's performance is compared vs. eight approaches, including teaching-learning based optimization, marine predators algorithm, genetic algorithm, grey wolf optimization, particle swarm optimization, whale optimization algorithm, gravitational search algorithm, and tunicate swarm algorithm. According to the simulation findings, the AA has a good capacity to tackle optimization issues in both unimodal and multimodal scenarios, and it can give adequate quasi-optimal solutions to these problems. The analysis and comparison of competing algorithms’ performance with the proposed algorithm demonstrates the superiority and competitiveness of the AA.     

STRUCTURAL OPTIMIZATION USING A NEW LOCAL APPROXIMATION METHOD

A new method for solving structural optimization problems using a local function approximation algorithm is proposed. This new algorithm, called the Generalized Convex Approximation (GCA), uses the design sensitivity information from the current and previous design points to generate a sequence of convex, separable subproblems. The paper contains the derivation of the parameters associated with the approximation and the formulation of the approximated problem. Numerical results from standard test problems solved using this method are presented. It is observed that this algorithm generates local approximations which lead to faster convergence for structural optimization problems.     

Load Allocation Research in a Manufacturing System

Based on queuing theory, a nonlinear optimization model is proposed in this paper, which has the service load as its objective function and includes three inequality constraints of Work In Progress （WIP）. A novel transformation of optimization variables is also devised and the constraints are properly combined so as to make this model into a convex one from which the Lagrangian function and the Karurh Kuhn Tucker （KKT） conditions are derived. The interior-point method for convex optimization is presented here as a computationaUy efficient tool. Finally, this model is evaluated on a real example, from which such conclusions are reached that the optimum result can ensure the full utilization of machines and the least amount of WIP in manufacturing systems; the interior-point method needs fewer iterations with significant computational savings and it is possible to make nonlinear and complicated optimization problems convexified so as to obtain the optimum.     

MULTIOBJECTIVE DESIGN OF A MARINE VEHICLE WITH AID OF DESIGN KNOWLEDGE

To generate the Pareto optimal set efficiently in multiobjective optimization, a hybrid optimizer is developed by coupling the genetic algorithm and the direct search method. This method determines a candidate region around the global optimum point by using the genetic algorithm, then searches the global optimum point by the direct search method concentrating in this region, thus reducing calculation time and increasing search efficiency. Although the hybrid optimizer provides cost-effectiveness, the design optimization process involves a number of tasks which require human expertise and experience. Therefore, methods of optimization and associated programs have been used mostly by experts in the real design world. Hence, this hybrid optimizer incorporates a knowledge-based system with heuristic and analytic knowledge, thereby narrowing the feasible space of the objective function. Some domain knowledge is retrieved from database and design experts. The obtained knowledge is stored in the knowledge base. The results of this paper, through application to marine vehicle design with multiobjective optimization, show that the hybrid optimizer with aid of design knowledge can be a useful tool for multiobjective optimum design. © 1997 John Wiley & Sons, Ltd.     

Multiple colony ant algorithm for job-shop scheduling problem

Ant colony optimization (ACO) is a metaheuristic that takes inspiration from the foraging behaviour of a real ant colony to solve the optimization problem. This paper presents a multiple colony ant algorithm to solve the Job-shop Scheduling Problem with the objective that minimizes the makespan. In a multiple colony ant algorithm, ants cooperate to find good solutions by exchanging information among colonies which are stored in a master pheromone matrix that serves the role of global memory. The exploration of the search space in each colony is guided by different heuristic information. Several specific features are introduced in the algorithm in order to improve the efficiency of the search. Among others is the local search method by which the ant can fine-tune their neighbourhood solutions. The proposed algorithm is tested over set of benchmark problems and the computational results demonstrate that the multiple colony ant algorithm performs well on the benchmark problems.     

Effective multi-objective optimization with the coral reefs optimization algorithm

In this article a new algorithm for multi-objective optimization is presented, the Multi-Objective Coral Reefs Optimization (MO-CRO) algorithm. The algorithm is based on the simulation of processes in coral reefs, such as corals' reproduction and fight for space in the reef. The adaptation to multi-objective problems is a process based on domination or non-domination during the process of fight for space in the reef. The final MO-CRO is an easily-implemented and fast algorithm, simple and robust, since it is able to keep diversity in the population of corals (solutions) in a natural way. The experimental evaluation of this new approach for multi-objective optimization problems is carried out on different multi-objective benchmark problems, where the MO-CRO has shown excellent performance in cases with limited computational resources, and in a real-world problem of wind speed prediction, where the MO-CRO algorithm is used to find the best set of features to predict the wind speed, taking into account two objective functions related to the performance of the prediction and the computation time of the regressor.