Efficient Pareto Frontier Exploration using Surrogate Approximations

In this paper we present an efficient and effective method of using surrogate approximations to explore the design space and capture the Pareto frontier during multiobjective optimization. The method employs design of experiments and metamodeling techniques (e.g., response surfaces and kriging models) to sample the design space, construct global approximations from the sample data, and quickly explore the design space to obtain the Pareto frontier without specifying weights for the objectives or using any optimization. To demonstrate the method, two mathematical example problems are presented. The results indicate that the proposed method is effective at capturing convex and concave Pareto frontiers even when discontinuities are present. After validating the method on the two mathematical examples, a design application involving the multiobjective optimization of a piezoelectric bimorph grasper is presented. The method facilitates multiobjective optimization by enabling us to efficiently and effectively obtain the Pareto frontier and identify candidate designs for the given design requirements.     

A kriging metamodel-assisted robust optimization method based on a reverse model

The goal of robust optimization methods is to obtain a solution that is both optimum and relatively insensitive to uncertainty factors. Most existing robust optimization approaches use outer–inner nested optimization structures where a large amount of computational effort is required because the robustness of each candidate solution delivered from the outer level should be evaluated in the inner level. In this article, a kriging metamodel-assisted robust optimization method based on a reverse model (K-RMRO) is first proposed, in which the nested optimization structure is reduced into a single-loop optimization structure to ease the computational burden. Ignoring the interpolation uncertainties from kriging, K-RMRO may yield non-robust optima. Hence, an improved kriging-assisted robust optimization method based on a reverse model (IK-RMRO) is presented to take the interpolation uncertainty of kriging metamodel into consideration. In IK-RMRO, an objective switching criterion is introduced to determine whether the inner level robust optimization or the kriging metamodel replacement should be used to evaluate the robustness of design alternatives. The proposed criterion is developed according to whether or not the robust status of the individual can be changed because of the interpolation uncertainties from the kriging metamodel. Numerical and engineering cases are used to demonstrate the applicability and efficiency of the proposed approach.     

Novel orthogonal simulated annealing with fractional factorial analysis to solve global optimization problems

A classical simulated annealing (SA) method is a generic probabilistic and heuristic approach to solving global optimization problems. It uses a stochastic process based on probability, rather than a deterministic procedure, to seek the minima or maxima in the solution space. Although the classical SA method can find the optimal solution to most linear and nonlinear optimization problems, the algorithm always requires numerous numerical iterations to yield a good solution. The method also usually fails to achieve optimal solutions to large parameter optimization problems. This study incorporates well-known fractional factorial analysis, which involves several factorial experiments based on orthogonal tables to extract intelligently the best combination of factors, with the classical SA to enhance the numerical convergence and optimal solution. The novel combination of the classical SA and fractional factorial analysis is termed the orthogonal SA herein. This study also introduces a dynamic penalty function to handle constrained optimization problems. The performance of the proposed orthogonal SA method is evaluated by computing several representative global optimization problems such as multi-modal functions, noise-corrupted data fitting, nonlinear dynamic control, and large parameter optimization problems. The numerical results show that the proposed orthogonal SA method markedly outperforms the classical SA in solving global optimization problems with linear or nonlinear objective functions. Additionally, this study addressed two widely used nonlinear functions, proposed by Keane and Himmelblau to examine the effectiveness of the orthogonal SA method and the presented penalty function when applied to the constrained problems. Moreover, the orthogonal SA method is applied to two engineering optimization design problems, including the designs of a welded beam and a coil compression spring, to evaluate the capacity of the method for practical engineering design. The computational results show that the proposed orthogonal SA method is effective in determining the optimal design variables and the value of objective function.     

An adaptive metamodel-based global optimization algorithm for black-box type problems

In this article, an adaptive metamodel-based global optimization (AMGO) algorithm is presented to solve unconstrained black-box problems. In the AMGO algorithm, a type of hybrid model composed of kriging and augmented radial basis function (RBF) is used as the surrogate model. The weight factors of hybrid model are adaptively selected in the optimization process. To balance the local and global search, a sub-optimization problem is constructed during each iteration to determine the new iterative points. As numerical experiments, six standard two-dimensional test functions are selected to show the distributions of iterative points. The AMGO algorithm is also tested on seven well-known benchmark optimization problems and contrasted with three representative metamodel-based optimization methods: efficient global optimization (EGO), GutmannRBF and hybrid and adaptive metamodel (HAM). The test results demonstrate the efficiency and robustness of the proposed method. The AMGO algorithm is finally applied to the structural design of the import and export chamber of a cycloid gear pump, achieving satisfactory results.     

Reliability-based design optimization with progressive surrogate models

Reliability-based design optimization (RBDO) has traditionally been solved as a nested (bilevel) optimization problem, which is a computationally expensive approach. Unilevel and decoupled approaches for solving the RBDO problem have also been suggested in the past to improve the computational efficiency. However, these approaches also require a large number of response evaluations during optimization. To alleviate the computational burden, surrogate models have been used for reliability evaluation. These approaches involve construction of surrogate models for the reliability computation at each point visited by the optimizer in the design variable space. In this article, a novel approach to solving the RBDO problem is proposed based on a progressive sensitivity surrogate model. The sensitivity surrogate models are built in the design variable space outside the optimization loop using the kriging method or the moving least squares (MLS) method based on sample points generated from low-discrepancy sampling (LDS) to estimate the most probable point of failure (MPP). During the iterative deterministic optimization, the MPP is estimated from the surrogate model for each design point visited by the optimizer. The surrogate sensitivity model is also progressively updated for each new iteration of deterministic optimization by adding new points and their responses. Four example problems are presented showing the relative merits of the kriging and MLS approaches and the overall accuracy and improved efficiency of the proposed approach.     

Drilling path optimization by the particle swarm optimization algorithm with global convergence characteristics

Drilling path optimization is one of the key problems in holes-machining. This paper presents a new approach to solve the drilling path optimization problem belonging to discrete space, based on the particle swarm optimization (PSO) algorithm. Since the standard PSO algorithm is not guaranteed to be global convergent or local convergent, based on the mathematical model, the algorithm is improved by adopting the method to generate the stop evolution particle once again to obtain the ability of convergence on the global optimization solution. Also, the operators are proposed by establishing the Order Exchange Unit (OEU) and the Order Exchange List (OEL) to satisfy the need of integer coding in drilling path optimization. The experimentations indicate that the improved algorithm has the characteristics of easy realization, fast convergence speed, and better global convergence capability. Hence the new PSO can play a role in solving the problem of drilling path optimization.     

A framework for parallelized efficient global optimization with application to vehicle crashworthiness optimization

This article presents a framework for simulation-based design optimization of computationally expensive problems, where economizing the generation of sample designs is highly desirable. One popular approach for such problems is efficient global optimization (EGO), where an initial set of design samples is used to construct a kriging model, which is then used to generate new ‘infill’ sample designs at regions of the search space where there is high expectancy of improvement. This article attempts to address one of the limitations of EGO, where generation of infill samples can become a difficult optimization problem in its own right, as well as allow the generation of multiple samples at a time in order to take advantage of parallel computing in the evaluation of the new samples. The proposed approach is tested on analytical functions, and then applied to the vehicle crashworthiness design of a full Geo Metro model undergoing frontal crash conditions.     

Dual-mode nested search method for categorical uncertain multi-objective optimization

Categorical multi-objective optimization is an important issue involved in many matching design problems. Non-numerical variables and their uncertainty are the major challenges of such optimizations. Therefore, this article proposes a dual-mode nested search (DMNS) method. In the outer layer, kriging metamodels are established using standard regular simplex mapping (SRSM) from categorical candidates to numerical values. Assisted by the metamodels, a k-cluster-based intelligent sampling strategy is developed to search Pareto frontier points. The inner layer uses an interval number method to model the uncertainty of categorical candidates. To improve the efficiency, a multi-feature convergent optimization via most-promising-area stochastic search (MFCOMPASS) is proposed to determine the bounds of objectives. Finally, typical numerical examples are employed to demonstrate the effectiveness of the proposed DMNS method.     

An efficient and practical approach to obtain a better optimum solution for structural optimization

For many structural optimization problems, it is hard or even impossible to find the global optimum solution owing to unaffordable computational cost. An alternative and practical way of thinking is thus proposed in this research to obtain an optimum design which may not be global but is better than most local optimum solutions that can be found by gradient-based search methods. The way to reach this goal is to find a smaller search space for gradient-based search methods. It is found in this research that data mining can accomplish this goal easily. The activities of classification, association and clustering in data mining are employed to reduce the original design space. For unconstrained optimization problems, the data mining activities are used to find a smaller search region which contains the global or better local solutions. For constrained optimization problems, it is used to find the feasible region or the feasible region with better objective values. Numerical examples show that the optimum solutions found in the reduced design space by sequential quadratic programming (SQP) are indeed much better than those found by SQP in the original design space. The optimum solutions found in a reduced space by SQP sometimes are even better than the solution found using a hybrid global search method with approximate structural analyses.     

A surrogate-assisted particle swarm optimization algorithm based on efficient global optimization for expensive black-box problems

Evolutionary algorithms cannot effectively handle computationally expensive problems because of the unaffordable computational cost brought by a large number of fitness evaluations. Therefore, surrogates are widely used to assist evolutionary algorithms in solving these problems. This article proposes an improved surrogate-assisted particle swarm optimization (ISAPSO) algorithm, in which a hybrid particle swarm optimization (PSO) is combined with global and local surrogates. The global surrogate is not only used to predict fitness values for reducing computational burden but also regarded as a global searcher to speed up the global search process of PSO by using an efficient global optimization algorithm, while the local one is constructed for a local search in the neighbourhood of the current optimal solution by finding the predicted optimal solution of the local surrogate. Empirical studies on 10 widely used benchmark problems and a real-world structural design optimization problem of a driving axle show that the ISAPSO algorithm is effective and highly competitive.     

Engineering optimization using a real-parameter genetic-algorithm-based hybrid method

A hybrid optimization algorithm which combines the respective merits of the genetic algorithm and the simulated annealing algorithm is proposed. The proposed algorithm incorporates adaptive mechanisms designed to adjust the probabilities of the cross-over and mutation operators such that its hill-climbing ability towards the optimum solution is improved. The algorithm is used to optimize the weight of four planar or space truss structures and the results are compared with those obtained using other well-known optimization schemes. The evaluation trials investigate the performance of the algorithm in optimizing over discrete sizing variables only and over both discrete sizing variables and continuous configuration variables. The results show that the proposed algorithm consistently outperforms the other optimization methods in terms of its weight-saving capabilities. It is also shown that the global searching ability and convergence speed of the proposed algorithm are significantly improved by the inclusion of adaptive mechanisms to adjust the values of the genetic operators. Hence the hybrid algorithm provides an efficient and robust technique for solving engineering design optimization problems.     

Solving bi-level optimization problems in engineering design using kriging models

Stackelberg game-theoretic approaches are applied extensively in engineering design to handle distributed collaboration decisions. Bi-level genetic algorithms (BLGAs) and response surfaces have been used to solve the corresponding bi-level programming models. However, the computational costs for BLGAs often increase rapidly with the complexity of lower-level programs, and optimal solution functions sometimes cannot be approximated by response surfaces. This article proposes a new method, namely the optimal solution function approximation by kriging model (OSFAKM), in which kriging models are used to approximate the optimal solution functions. A detailed example demonstrates that OSFAKM can obtain better solutions than BLGAs and response surface-based methods, and at the same time reduce the workload of computation remarkably. Five benchmark problems and a case study of the optimal design of a thin-walled pressure vessel are also presented to illustrate the feasibility and potential of the proposed method for bi-level optimization in engineering design.     

A deterministic global approach for mixed-discrete structural optimization

This study proposes a novel approach for finding the exact global optimum of a mixed-discrete structural optimization problem. Although many approaches have been developed to solve the mixed-discrete structural optimization problem, they cannot guarantee finding a global solution or they adopt too many extra binary variables and constraints in reformulating the problem. The proposed deterministic method uses convexification strategies and linearization techniques to convert a structural optimization problem into a convex mixed-integer nonlinear programming problem solvable to obtain a global optimum. To enhance the computational efficiency in treating complicated problems, the range reduction technique is also applied to tighten variable bounds. Several numerical experiments drawn from practical structural design problems are presented to demonstrate the effectiveness of the proposed method.     

Simultaneous partial topology and size optimization of a wing structure using ant colony and gradient based methods

This article presents a methodology and process for a combined wing configuration partial topology and structure size optimization. It is aimed at achieving a minimum structural weight by optimizing the structure layout and structural component size simultaneously. This design optimization process contains two types of design variables and hence was divided into two sub-problems. One is structure layout topology to obtain an optimal number and location of spars with discrete integer design variables. Another is component size optimization with continuous design variables in the structure FE model. A multi city-layer ant colony optimization (MCLACO) method is proposed and applied to the topology sub-problem. A gradient based optimization method (GBOM) built in the MSC.NASTRAN SOL-200 module was employed in the component size optimization sub-problem. For each selected layout of the wing structure, a size optimization process is performed to obtain the optimum result and feedback to the layout topology process. The numerical example shows that the proposed MCLACO method and a combination with the GBOM are effective for solving such a wing structure optimization problem. The results also indicate that significant structural weight saving can be achieved.     

区块链系统分布式计算的ADMM算法及其在主动配电网中的应用

区块链作为一种新颖的计算机技术,由于具备诸多的优点,其在未来主动配电网中有较大的应用潜力。因此如何将配电网中的集中式优化任务融入区块链系统的分布式计算模块是亟待解决的问题。以配电网动态经济调度优化的分布式建模为例,借助二阶锥规划（second-order cone programming,SOCP）凸松弛理论,参考了IEC 61970标准中CIM的建模思想,将传统的配电网耦合模型转换为一种分散式的电气模型;并提出一种运行于区块链上的基于交替方向乘子法（alternating direction method of multipliers,ADMM）的分布式最优潮流求解方法,从而使传统集中式优化在未来主动配电网中所面临的诸多难题得以解决。该方法无需对配电网进行全局协调或分层分区,仅利用区块链相邻节点间少量的通信即可通过并行计算得出模型的全局最优解。     

A Global Optimization Approach to Classification

We reduce the classification problem to solving a global optimization problem and a method based on a combination of the cutting angle method and a local search is applied to the solution of this problem. The proposed method allows to solve classification problems for databases with an arbitrary number of classes. Numerical experiments have been carried out with databases of small to medium size. We present their results and provide comparisons of these results with those obtained by 29 different classification algorithms. The best performance overall was achieved with the global optimization method.     

A global single-loop deterministic approach for reliability-based design optimization of truss structures with continuous and discrete design variables

A single-loop deterministic method (SLDM) has previously been proposed for solving reliability-based design optimization (RBDO) problems. In SLDM, probabilistic constraints are converted to approximate deterministic constraints. Consequently, RBDO problems can be transformed into approximate deterministic optimization problems, and hence the computational cost of solving such problems is reduced significantly. However, SLDM is limited to continuous design variables, and the obtained solutions are often trapped into local extrema. To overcome these two disadvantages, a global single-loop deterministic approach is developed in this article, and then it is applied to solve the RBDO problems of truss structures with both continuous and discrete design variables. The proposed approach is a combination of SLDM and improved differential evolution (IDE). The IDE algorithm is an improved version of the original differential evolution (DE) algorithm with two improvements: a roulette wheel selection with stochastic acceptance and an elitist selection technique. These improvements are applied to the mutation and selection phases of DE to enhance its convergence rate and accuracy. To demonstrate the reliability, efficiency and applicability of the proposed method, three numerical examples are executed, and the obtained results are compared with those available in the literature.     

AN OPTIMIZATION METHOD FOR THE DESIGN OF LARGE,HIGHLY CONSTRAINED COMPLEX SYSTEMS

A practical and efficient optimization method for the rational design of large, highly constrained complex systems is presented. The design of such systems is iterative and requires the repeated formulation and solution of an analysis model, followed by the formulation and solution of a redesign model. The latter constitutes an optimization problem. The versatility and efficiency of the method for solving the optimization problem is of fundamental importance for a successful implementation of any rational design procedure.

In this paper, a method is presented for solving optimization problems formulated in terms of continuous design variables. The objective function may be linear or non-linear, single or multiple. The constraints may be any mix of linear or non-linear functions, and these may be any mix of inequalities and equalities. These features permit the solution of a wide spectrum of optimization problems, ranging from the standard linear and non-linear problems to a non-linear problem with multiple objective functions (goal programming). The algorithm for implementing the method is presented in sufficient detail so that a computer program, in any computing language, can be written.     

Development of a new multi-criteria optimization method for engineering design problems

In this study, we developed a new multiple criteria optimization method in the context of engineering design. The design of experiment (DoE) and Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) methods are combined to identify an objective function of the selected problem by fitting a polynomial to the experimental data in a multiple linear regression analysis. Then, the regression function is incorporated into a mathematical model with the criteria constraints to determine an optimal criteria set. The proposed method can be used to compare the functionality and results provided by different scenario analyses of a building design optimization problem, which represent design solutions. We applied the DoE–TOPSIS model to solve different multi-criteria design optimization problems using two examples from the literature and obtained satisfactory results. In the examples, the results obtained using the combined DoE–TOPSIS model are almost in agreement with those derived from conventional multi-criteria design optimization methods, which demonstrates the simplicity, usability, and flexibility of the proposed method in solving engineering design problems.     

Multi-objective hierarchical genetic algorithms for multilevel redundancy allocation optimization

Multilevel redundancy allocation optimization problems (MRAOPs) occur frequently when attempting to maximize the system reliability of a hierarchical system, and almost all complex engineering systems are hierarchical. Despite their practical significance, limited research has been done concerning the solving of simple MRAOPs. These problems are not only NP hard but also involve hierarchical design variables. Genetic algorithms (GAs) have been applied in solving MRAOPs, since they are computationally efficient in solving such problems, unlike exact methods, but their applications has been confined to single-objective formulation of MRAOPs. This paper proposes a multi-objective formulation of MRAOPs and a methodology for solving such problems. In this methodology, a hierarchical GA framework for multi-objective optimization is proposed by introducing hierarchical genotype encoding for design variables. In addition, we implement the proposed approach by integrating the hierarchical genotype encoding scheme with two popular multi-objective genetic algorithms (MOGAs)—the strength Pareto evolutionary genetic algorithm (SPEA2) and the non-dominated sorting genetic algorithm (NSGA-II). In the provided numerical examples, the proposed multi-objective hierarchical approach is applied to solve two hierarchical MRAOPs, a 4- and a 3-level problems. The proposed method is compared with a single-objective optimization method that uses a hierarchical genetic algorithm (HGA), also applied to solve the 3- and 4-level problems. The results show that a multi-objective hierarchical GA (MOHGA) that includes elitism and mechanism for diversity preserving performed better than a single-objective GA that only uses elitism, when solving large-scale MRAOPs. Additionally, the experimental results show that the proposed method with NSGA-II outperformed the proposed method with SPEA2 in finding useful Pareto optimal solution sets.