A parallel particle swarm optimization algorithm for multi-objective optimization problems

In this article, a new proposal of using particle swarm optimization algorithms to solve multi-objective optimization problems is presented. The algorithm is constructed based on the concept of Pareto dominance, as well as a state-of-the-art ‘parallel’ computing technique that intends to improve algorithmic effectiveness and efficiency simultaneously. The proposed parallel particle swarm multi-objective evolutionary algorithm (PPS-MOEA) is tested through a variety of standard test functions taken from the literature; its performance is compared with six noted multi-objective algorithms. The computational experience gained from the first two experiments indicates that the algorithm proposed in this article is extremely competitive when compared with other MOEAs, being able to accurately, reliably and robustly approximate the true Pareto front in almost every tested case. To justify the motivation behind the research of the parallel swarm structure, the computational results of the third experiment confirm the PPS-MOEA's merit in solving really high-dimensional multi-objective optimization problems.     

MOEA/D-SQA: a multi-objective memetic algorithm based on decomposition

A multi-objective memetic algorithm based on decomposition is proposed in this article, in which a simplified quadratic approximation (SQA) is employed as a local search operator for enhancing the performance of a multi-objective evolutionary algorithm based on decomposition (MOEA/D). The SQA is used for a fast local search and the MOEA/D is used as the global optimizer. The multi-objective memetic algorithm based on decomposition, i.e. a hybrid of the MOEA/D with the SQA (MOEA/D-SQA), is designed to balance local versus global search strategies so as to obtain a set of diverse non-dominated solutions as quickly as possible. The emphasis of this article is placed on demonstrating how this local search scheme can improve the performance of MOEA/D for multi-objective optimization. MOEA/D-SQA has been tested on a wide set of benchmark problems with complicated Pareto set shapes. Experimental results indicate that the proposed approach performs better than MOEA/D. In addition, the results obtained are very competitive when comparing MOEA/D-SQA with other state-of-the-art techniques.     

A new multi-objective evolutionary algorithm: neighbourhood exploring evolution strategy

This article proposes a new multi-objective evolutionary algorithm, called neighbourhood exploring evolution strategy (NEES). This approach incorporates the idea of neighbourhood exploration together with other techniques commonly used in the multi-objective evolutionary optimization literature (namely, non-dominated sorting and diversity preservation mechanisms). The main idea of the proposed approach was derived from a single-objective evolutionary algorithm, called the line-up competition algorithm (LCA), and it consists of assigning neighbourhoods of different sizes to different solutions. Within each neighbourhood, new solutions are generated using a (1+λ)-ES (evolution strategy). This scheme naturally balances the effect of local search (which is performed by the neighbourhood exploration mechanism) with that of the global search performed by the algorithm, and gradually impels the population to progress towards the true Pareto-optimal front of the problem to explore the extent of that front. Three versions of the proposal are studied: a (1+1)-NEES, a (1+2)-NEES and a (1+4)-NEES. Such approaches are validated on a set of standard test problems reported in the specialized literature. Simulation results indicate that, for continuous numerical optimization problems, the proposal (particularly the (1+1)-NEES) is competitive with respect to NSGA-II, which is an algorithm representative of the state-of-the-art in evolutionary multi-objective optimization. Moreover, all the versions of NEES improve on the results of NSGA-II when dealing with a discrete optimization problem. Although preliminary, such results might indicate a potential application area in which the proposed approach could be particularly useful.     

A hybrid evolutionary graph-based multi-objective algorithm for layout optimization of truss structures

In this paper a new graph-based evolutionary algorithm, gM-PAES, is proposed in order to solve the complex problem of truss layout multi-objective optimization. In this algorithm a graph-based genotype is employed as a modified version of Memetic Pareto Archive Evolution Strategy (M-PAES), a well-known hybrid multi-objective optimization algorithm, and consequently, new graph-based crossover and mutation operators perform as the solution generation tools in this algorithm. The genetic operators are designed in a way that helps the multi-objective optimizer to cover all parts of the true Pareto front in this specific problem. In the optimization process of the proposed algorithm, the local search part of gM-PAES is controlled adaptively in order to reduce the required computational effort and enhance its performance. In the last part of the paper, four numeric examples are presented to demonstrate the performance of the proposed algorithm. Results show that the proposed algorithm has great ability in producing a set of solutions which cover all parts of the true Pareto front.     

A multi-objective genetic algorithm approach to the design of cellular manufacturing systems

In this paper, a multi-objective integer programming model is constructed for the design of cellular manufacturing systems with independent cells. A genetic algorithm with multiple fitness functions is proposed to solve the formulated problem. The proposed algorithm finds multiple solutions along the Pareto optimal frontier. There are some features that make the proposed algorithm different from other algorithms used in the design of cellular manufacturing systems. These include: (1) a systematic uniform design-based technique, used to determine the search directions, and (2) searching the solution space in multiple directions instead of single direction. Four problems are selected from the literature to evaluate the performance of the proposed approach. The results validate the effectiveness of the proposed method in designing the manufacturing cells.     

A new multi-objective particle swarm optimizer using empirical movement and diversified search strategies

Most real-world optimization problems involve the optimization task of more than a single objective function and, therefore, require a great amount of computational effort as the solution procedure is designed to anchor multiple compromised optimal solutions. Abundant multi-objective evolutionary algorithms (MOEAs) for multi-objective optimization have appeared in the literature over the past two decades. In this article, a new proposal by means of particle swarm optimization is addressed for solving multi-objective optimization problems. The proposed algorithm is constructed based on the concept of Pareto dominance, taking both the diversified search and empirical movement strategies into account. The proposed particle swarm MOEA with these two strategies is thus dubbed the empirical-movement diversified-search multi-objective particle swarm optimizer (EMDS-MOPSO). Its performance is assessed in terms of a suite of standard benchmark functions taken from the literature and compared to other four state-of-the-art MOEAs. The computational results demonstrate that the proposed algorithm shows great promise in solving multi-objective optimization problems.     

A new optimization algorithm based on a combination of particle swarm optimization,convergence and divergence operators for single-objective and multi-objective problems

Particle swarm optimization (PSO) is a randomized and population-based optimization method that was inspired by the flocking behaviour of birds and human social interactions. In this work, multi-objective PSO is modified in two stages. In the first stage, PSO is combined with convergence and divergence operators. Here, this method is named CDPSO. In the second stage, to produce a set of Pareto optimal solutions which has good convergence, diversity and distribution, two mechanisms are used. In the first mechanism, a new leader selection method is defined, which uses the periodic iteration and the concept of the particle's neighbour number. This method is named periodic multi-objective algorithm. In the second mechanism, an adaptive elimination method is employed to limit the number of non-dominated solutions in the archive, which has influences on computational time, convergence and diversity of solution. Single-objective results show that CDPSO performs very well on the complex test functions in terms of solution accuracy and convergence speed. Furthermore, some benchmark functions are used to evaluate the performance of periodic multi-objective CDPSO. This analysis demonstrates that the proposed algorithm operates better in three metrics through comparison with three well-known elitist multi-objective evolutionary algorithms. Finally, the algorithm is used for Pareto optimal design of a two-degree of freedom vehicle vibration model. The conflicting objective functions are sprung mass acceleration and relative displacement between sprung mass and tyre. The feasibility and efficiency of periodic multi-objective CDPSO are assessed in comparison with multi-objective modified NSGAII.     

A particle swarm optimizer for constrained multi-objective engineering design problems

This article presents a particle swarm optimizer (PSO) capable of handling constrained multi-objective optimization problems. The latter occur frequently in engineering design, especially when cost and performance are simultaneously optimized. The proposed algorithm combines the swarm intelligence fundamentals with elements from bio-inspired algorithms. A distinctive feature of the algorithm is the utilization of an arithmetic recombination operator, which allows interaction between non-dominated particles. Furthermore, there is no utilization of an external archive to store optimal solutions. The PSO algorithm is applied to multi-objective optimization benchmark problems and also to constrained multi-objective engineering design problems. The algorithmic effectiveness is demonstrated through comparisons of the PSO results with those obtained from other evolutionary optimization algorithms. The proposed particle swarm optimizer was able to perform in a very satisfactory manner in problems with multiple constraints and/or high dimensionality. Promising results were also obtained for a multi-objective engineering design problem with mixed variables.     

Effective multi-objective optimization with the coral reefs optimization algorithm

In this article a new algorithm for multi-objective optimization is presented, the Multi-Objective Coral Reefs Optimization (MO-CRO) algorithm. The algorithm is based on the simulation of processes in coral reefs, such as corals' reproduction and fight for space in the reef. The adaptation to multi-objective problems is a process based on domination or non-domination during the process of fight for space in the reef. The final MO-CRO is an easily-implemented and fast algorithm, simple and robust, since it is able to keep diversity in the population of corals (solutions) in a natural way. The experimental evaluation of this new approach for multi-objective optimization problems is carried out on different multi-objective benchmark problems, where the MO-CRO has shown excellent performance in cases with limited computational resources, and in a real-world problem of wind speed prediction, where the MO-CRO algorithm is used to find the best set of features to predict the wind speed, taking into account two objective functions related to the performance of the prediction and the computation time of the regressor.     

Synergy of ICA and MCDM for multi‐response optimisation problems

Of late, attempts are being made to optimise production system problems by minimum cost. A good available device in this area is response surface methodology. This methodology combines experimental designs and statistical techniques for empirical model building and optimising. In most situations simulated models for real world problems are non‐linear multi‐response, while responses are conflicting. The simultaneous optimisation of several conflicting responses is computationally expensive. So this makes the problem solving extremely complex. Since few attempts have been made to scrutinise this domain, in this paper the nonlinear continuous multi‐response problem is investigated. In order to tackle multi‐response optimisation difficulties, we propose a new hybrid meta heuristic based on the imperialist competitive algorithm. It simulates a socio–economical procedure, imperialistic competition. When there are some non‐dominated solutions in searching space, a technique for order performance by similarity to ideal solution is used to identify which non‐dominated solutions are imperialists and which ones belong to colonial societies. A particle swarm‐like mechanism is employed to model the influence of imperialists on colonies. The algorithm will continue until only one imperialist obtains all countries’ possessions. In order to prevent carrying out extensive experiments to find optimum parameters of the algorithm, we apply the Taguchi approach. Since there is no standard benchmark in this field, we use three case studies from distinguished papers in the multi‐response optimisation field. Comparing the results with some works mentioned in the literature reveals the superiority of the proposed algorithm.     

Billiards Optimization Algorithm: A New Game-Based Metaheuristic Approach

Metaheuristic algorithms are one of the most widely used stochastic approaches in solving optimization problems. In this paper, a new metaheuristic algorithm entitled Billiards Optimization Algorithm (BOA) is proposed and designed to be used in optimization applications. The fundamental inspiration in BOA design is the behavior of the players and the rules of the billiards game. Various steps of BOA are described and then its mathematical model is thoroughly explained. The efficiency of BOA in dealing with optimization problems is evaluated through optimizing twenty-three standard benchmark functions of different types including unimodal, high-dimensional multimodal, and fixed-dimensional multimodal functions. In order to analyze the quality of the results obtained by BOA, the performance of the proposed approach is compared with ten well-known algorithms. The simulation results show that BOA, with its high exploration and exploitation abilities, achieves an impressive performance in providing solutions to objective functions and is superior and far more competitive compared to the ten competitor algorithms.     

A multi-phase covering Pareto-optimal front method to multi-objective parallel machine scheduling

This paper considers the problem of parallel machine scheduling with sequence-dependent setup times to minimise both makespan and total earliness/tardiness in the due window. To tackle the problem considered, a multi-phase algorithm is proposed. The goal of the initial phase is to obtain a good approximation of the Pareto-front. In the second phase, to improve the Pareto-front, non-dominated solutions are unified to constitute a big population. In this phase, based on the local search in the Pareto space concept, three multi-objective hybrid metaheuristics are proposed. Covering the whole set of Pareto-optimal solutions is a desired task of multi-objective optimisation methods. So in the third phase, a new method using an e-constraint hybrid metaheuristic is proposed to cover the gaps between the non-dominated solutions and improve the Pareto-front. Appropriate combinations of multi-objective methods in various phases are considered to improve the total performance. The multi-phase algorithm iterates over a genetic algorithm in the first phase and three hybrid metaheuristics in the second and third phases. Experiments on the test problems with different structures show that the multi-phase method is a better tool to approximate the efficient set than the global archive sub-population genetic algorithm presented previously.     

Skill Optimization Algorithm: A New Human-Based Metaheuristic Technique

Metaheuristic algorithms are widely used in solving optimization problems. In this paper, a new metaheuristic algorithm called Skill Optimization Algorithm (SOA) is proposed to solve optimization problems. The fundamental inspiration in designing SOA is human efforts to acquire and improve skills. Various stages of SOA are mathematically modeled in two phases, including: (i) exploration, skill acquisition from experts and (ii) exploitation, skill improvement based on practice and individual effort. The efficiency of SOA in optimization applications is analyzed through testing this algorithm on a set of twenty-three standard benchmark functions of a variety of unimodal, high-dimensional multimodal, and fixed-dimensional multimodal types. The optimization results show that SOA, by balancing exploration and exploitation, is able to provide good performance and appropriate solutions for optimization problems. In addition, the performance of SOA in optimization is compared with ten metaheuristic algorithms to evaluate the quality of the results obtained by the proposed approach. Analysis and comparison of the obtained simulation results show that the proposed SOA has a superior performance over the considered algorithms and achieves much more competitive results.     

SSABA: Search Step Adjustment Based Algorithm

Finding the suitable solution to optimization problems is a fundamental challenge in various sciences. Optimization algorithms are one of the effective stochastic methods in solving optimization problems. In this paper, a new stochastic optimization algorithm called Search Step Adjustment Based Algorithm (SSABA) is presented to provide quasi-optimal solutions to various optimization problems. In the initial iterations of the algorithm, the step index is set to the highest value for a comprehensive search of the search space. Then, with increasing repetitions in order to focus the search of the algorithm in achieving the optimal solution closer to the global optimal, the step index is reduced to reach the minimum value at the end of the algorithm implementation. SSABA is mathematically modeled and its performance in optimization is evaluated on twenty-three different standard objective functions of unimodal and multimodal types. The results of optimization of unimodal functions show that the proposed algorithm SSABA has high exploitation power and the results of optimization of multimodal functions show the appropriate exploration power of the proposed algorithm. In addition, the performance of the proposed SSABA is compared with the performance of eight well-known algorithms, including Particle Swarm Optimization (PSO), Genetic Algorithm (GA), Teaching-Learning Based Optimization (TLBO), Gravitational Search Algorithm (GSA), Grey Wolf Optimization (GWO), Whale Optimization Algorithm (WOA), Marine Predators Algorithm (MPA), and Tunicate Swarm Algorithm (TSA). The simulation results show that the proposed SSABA is better and more competitive than the eight compared algorithms with better performance.     

An improved multi-objective genetic algorithm for heterogeneous coverage RFID network planning

Recent research has demonstrated the potential benefits of radio frequency identification (RFID) technology in the supply chain and production management via its item-level visibility. However, the RFID coverage performance is largely impacted by the surrounding environment and potential collisions between the RFID devices. Thus, through RFID network planning (RNP) to achieve the desired coverage within the budget becomes a key factor for success. In this study, we establish a novel and generic multi-objective RNP model by simultaneously optimising two conflicted objectives with satisfying the heterogeneous coverage requirements. Then, we design an improved multi-objective genetic algorithm (IMOGA) integrating a divide-and-conquer greedy heuristic algorithm to solve the model. We further construct a number of computational cases abstracted from an automobile mixed-model assembly line to illustrate how the proposed model and algorithm are applied in a real RNP application. The results show that the proposed IMOGA achieves highly competitive solutions compared with Pareto optimal solutions and the solutions given by four recently developed well-known multi-objective evolutionary and swarm-based optimisers (SPEA2, NSGA-II, MOPSO and MOPS²O) in terms of solution quality and computational robustness.     

MONSS: A multi-objective nonlinear simplex search approach

This article presents a novel methodology for dealing with continuous box-constrained multi-objective optimization problems (MOPs). The proposed algorithm adopts a nonlinear simplex search scheme in order to obtain multiple elements of the Pareto optimal set. The search is directed by a well-distributed set of weight vectors, each of which defines a scalarization problem that is solved by deforming a simplex according to the movements described by Nelder and Mead's method. Considering an MOP with n decision variables, the simplex is constructed using n+1 solutions which minimize different scalarization problems defined by n+1 neighbor weight vectors. All solutions found in the search are used to update a set of solutions considered to be the minima for each separate problem. In this way, the proposed algorithm collectively obtains multiple trade-offs among the different conflicting objectives, while maintaining a proper representation of the Pareto optimal front. In this article, it is shown that a well-designed strategy using just mathematical programming techniques can be competitive with respect to the state-of-the-art multi-objective evolutionary algorithms against which it was compared.     

Self-adaptive multi-objective harmony search for optimal design of water distribution networks

In multi-objective optimization computing, it is important to assign suitable parameters to each optimization problem to obtain better solutions. In this study, a self-adaptive multi-objective harmony search (SaMOHS) algorithm is developed to apply the parameter-setting-free technique, which is an example of a self-adaptive methodology. The SaMOHS algorithm attempts to remove some of the inconvenience from parameter setting and selects the most adaptive parameters during the iterative solution search process. To verify the proposed algorithm, an optimal least cost water distribution network design problem is applied to three different target networks. The results are compared with other well-known algorithms such as multi-objective harmony search and the non-dominated sorting genetic algorithm-II. The efficiency of the proposed algorithm is quantified by suitable performance indices. The results indicate that SaMOHS can be efficiently applied to the search for Pareto-optimal solutions in a multi-objective solution space.     

Lexicographic fuzzy multi-objective model for minimisation of exceptional and void elements in manufacturing cell formation

This research proposes a lexicographic fuzzy multi-objective model based on perfect grouping for concurrent solving the part-family and machine-cell formation problems in a cellular manufacturing system. New simplified mathematical expressions of exceptional and void elements are proposed, opposing conventional quadratic and absolute functions. The main objectives of the proposed solution model, that is, the minimisation of both the number of exceptional elements and the number of void elements is defined by fuzzy goals as pre-emptive ordering. A lexicographic fuzzy goal model is developed to enhance cell performance and machine utilisation simultaneously. A satisfactory efficient solution can easily be obtained, and alternative solutions can also be generated by capturing flexibility of the proposed fuzzy multi-objective programming model. The formulated model can be solved by existing integer programming solvers. Finally, the evaluation of cell formation problems is briefly discussed to show the performance of the proposed model.     

Integrated process planning and scheduling using an imperialist competitive algorithm

Effective performance of modern manufacturing systems requires integrating process planning and scheduling more tightly, which is consistently challenged by the intrinsic interrelation and intractability of these two problems. Traditionally, these two problems are treated sequentially or separately. Integration of process planning and scheduling (IPPS) provides a valuable approach to improve system performance. However, IPPS is more complex than job shop scheduling or process planning. IPPS is strongly NP-hard in that, compared to an NP-hard job shop scheduling problem with a determined process plan, the process plan for each job in IPPS is also to be optimised. So, an imperialist competitive algorithm (ICA) is proposed to address the IPPS problem with an objective of makespan minimisation. An extended operation-based representation scheme is presented to include information on various flexibilities of process planning with respect to determined job shop scheduling. The main steps of the proposed ICA, including empires construction, assimilation, imperialistic competition, revolution and elimination, are elaborated using an illustrative example. Performance of the proposed ICA was evaluated on four sets of experiments taken from the literature. Computational results of the ICA were compared with that of some existing algorithms developed for IPPS, which validates the efficiency and effectiveness of the ICA in solving the IPPS problem.     

Evolutionary multi-objective concurrent maximisation of process tolerances

Concurrent tolerancing which simultaneously optimises process tolerance based on constraints of both dimensional and geometrical tolerances (DGTs), and process accuracy with multi-objective functions is tedious to solve by a conventional optimisation technique like a linear programming approach. Concurrent tolerancing becomes an optimisation problem to determine optimum allotment of the process tolerances under the design function constraints. Optimum solution for this advanced tolerance design problem is difficult to obtain using traditional optimisation techniques. The proposed algorithms (elitist non-dominated sorting genetic algorithm (NSGA-II) and multi-objective differential evolution (MODE)) significantly outperform the previous algorithms for obtaining the optimum solution. The average fitness factor method and the normalised weighting objective function method are used to select the best optimal solution from Pareto optimal fronts. Two multi-objective performance measures namely solution spread measure and ratio of non-dominated individuals are used to evaluate the strength of the Pareto optimal fronts. Two more multi-objective performance measures namely optimiser overhead and algorithm effort are used to find the computational effort of the NSGA-II and MODE algorithms. Comparison of the results establishes that the proposed algorithms are superior to the algorithms in the literature.