共查询到20条相似文献,搜索用时 15 毫秒
1.
《Optimization methods & software》2012,27(6):1001-1024
Augmented Lagrangian methods are effective tools for solving large-scale nonlinear programming problems. At each outer iteration, a minimization subproblem with simple constraints, whose objective function depends on updated Lagrange multipliers and penalty parameters, is approximately solved. When the penalty parameter becomes very large, solving the subproblem becomes difficult; therefore, the effectiveness of this approach is associated with the boundedness of the penalty parameters. In this paper, it is proved that under more natural assumptions than the ones employed until now, penalty parameters are bounded. For proving the new boundedness result, the original algorithm has been slightly modified. Numerical consequences of the modifications are discussed and computational experiments are presented. 相似文献
2.
Mongi Benhamadou 《Advances in Engineering Software》2002,33(11-12)
The purpose of this paper is an amelioration of the ‘product form of the inverse’ related to the revised simplex method. We give an algorithm to compute the inverse of the current basic matrix. This calculation requires approximately m2 operations by using a tensor product and matrix addition. We apply this idea to the Gauss and Gauss–Jordan algorithms. 相似文献
3.
《Optimization methods & software》2012,27(4):587-637
In this paper we define new classes of globally convergent block-coordinate techniques for the unconstrained minimization of a continuously differentiable function. More specifically, we first describe conceptual models of decomposition algorithms based on the interconnection of elementary operations performed on the block components of the variable vector. Then we characterize the elementary operations defined through a suitable line search or the global minimization in a component subspace. Using these models, we establish new results on the convergence of the nonlinear Gauss–Seidel method and we prove that this method with a two-block decomposition is globally convergent towards stationary points, even in the absence of convexity or uniqueness assumptions. In the general case of nonconvex objective function and arbitrary decomposition we define new globally convergent line-search-based schemes that may also include partial global inimizations with respect to some component. Computational aspects are discussed and, in particular, an application to a learning problem in a Radial Basis Function neural network is illustrated. 相似文献
4.
《Concurrency and Computation》2017,29(4)
In this paper, different variants of the block Gauss–Huard algorithm with column pivoting and correspondingly interchanging of columns are presented and implemented on a hybrid CPU–GPU architecture. The study gives numerical evidence that the algorithms yield numerical solutions as good as those obtained by Gaussian elimination with partial pivoting and performance evidence that they are more suitable for parallel architectures. This is confirmed by solving systems of linear equations for a set of randomly generated matrices. Copyright © 2016 John Wiley & Sons, Ltd. 相似文献
5.
Jiahong Guo Huiling Liu Xiantao Xiao 《International Transactions in Operational Research》2022,29(1):63-86
In this paper, we consider a class of constrained stochastic programs in which the gradient of the random function in the objective and the projection onto the feasible set are assumed to be prohibitive to compute. We propose a class of mini-batch gradient-free Frank–Wolfe methods. Under mild conditions, we conduct a unified convergence analysis for both convex and nonconvex problems. 相似文献
6.
In industrial applications, optimal control problems frequently appear in the context of decision-making under incomplete information. In such framework, decisions must be adapted dynamically to account for possible regime changes of the underlying dynamics. Using stochastic filtering theory, Markovian evolution can be modelled in terms of latent variables, which naturally leads to high-dimensional state space, making practical solutions to these control problems notoriously challenging. In our approach, we utilise a specific structure of this problem class to present a solution in terms of simple, reliable, and fast algorithms. The algorithms presented in this paper have already been implemented in an R package. 相似文献
7.
Adilson Elias Xavier 《International Transactions in Operational Research》2001,8(6):659-671
This work intends to present and to analyze a new penalty method that purposes to solve the general nonlinear programming problem subject to inequality constraints. The proposed method has the important feature of being completely differentiable and combines features of both exterior and interior penalty methods. Numerical results for some problems are commented on. 相似文献
8.
9.
Improving a Lagrangian decomposition for the unconstrained binary quadratic programming problem 总被引:1,自引:0,他引:1
Geraldo Regis Mauri Luiz Antonio Nogueira Lorena 《Computers & Operations Research》2012,39(7):1577-1581
This paper presents a new alternative of Lagrangian decomposition based on column generation technique to solve the unconstrained binary quadratic programming problem. We use a mixed binary linear version of the original quadratic problem with constraints represented by a graph. This graph is partitioned into clusters of vertices forming subproblems whose solutions use the dual variables obtained by a coordinator problem. Computational experiments consider a set of difficult instances and the results are compared against other methods reported recently in the literature. 相似文献
10.
In the last decade or so, the Lattice–Boltzmann method (LBM) has achieved great success in computational fluid dynamics. The Fully–Lagrangian method (FLM) is the generalization of LBM for conservation systems. LBM can also be developed from FLM. In this paper a FL model and a LB model are developed for D-dimensional advection-diffusion equation. The LB model can be viewed as an improved version of the FL model. Numerical results of simulation of 1-dimensional advection-diffusion equation are presented. The numerical results are found to be in good agreement with the analytic solution. 相似文献
11.
ABSTRACTWe consider the problem of minimizing a smooth nonconvex function over a structured convex feasible set, that is, defined by two sets of constraints that are easy to treat when considered separately. In order to exploit the structure of the problem, we define an equivalent formulation by duplicating the variables and we consider the augmented Lagrangian of this latter formulation. Following the idea of the Alternating Direction Method of Multipliers (ADMM), we propose an algorithm where a two-blocks decomposition method is embedded within an augmented Lagrangian framework. The peculiarities of the proposed algorithm are the following: (1) the computation of the exact solution of a possibly nonconvex subproblem is not required; (2) the penalty parameter is iteratively updated once an approximated stationary point of the augmented Lagrangian is determined. Global convergence results are stated under mild assumptions and without requiring convexity of the objective function. Although the primary aim of the paper is theoretical, we perform numerical experiments on a nonconvex problem arising in machine learning, and the obtained results show the practical advantages of the proposed approach with respect to classical ADMM. 相似文献
12.
The problem of state estimation occurs in many applications of fluid flow. For example, to produce a reliable weather forecast it is essential to find the best possible estimate of the true state of the atmosphere. To find this best estimate a nonlinear least squares problem has to be solved subject to dynamical system constraints. Usually this is solved iteratively by an approximate Gauss–Newton method where the underlying discrete linear system is in general unstable. In this paper we propose a new method for deriving low order approximations to the problem based on a recently developed model reduction method for unstable systems. To illustrate the theoretical results, numerical experiments are performed using a two-dimensional Eady model – a simple model of baroclinic instability, which is the dominant mechanism for the growth of storms at mid-latitudes. It is a suitable test model to show the benefit that may be obtained by using model reduction techniques to approximate unstable systems within the state estimation problem. 相似文献
13.
Víctor M. Albornoz Pablo Benario Manuel E. Rojas 《International Transactions in Operational Research》2004,11(3):243-257
In this paper the obtaining of an optimum policy in the capacity expansion planning of a particular thermal‐electric power system is proposed. Therefore, a two‐stage stochastic integer programming is formulated. The model includes, through a finite group of scenarios, the existent uncertainty related to the future availability of the thermal plants currently under operation. The resultant model is solved numerically by the application of the L‐shaped method, whose implementation and development were executed using the software AMPL, with CPLEX as a solver. The results reached are shown, which validate the use of the methodology adopted in this work. 相似文献
14.
A nonconvex mathematical programming problem on a topological linear space in the presence of an inequality constraint is considered. An augmented Lagrangian function is constructed by using supporting cones to the epigraph of a usual perturbation function. Extremal values of prime and dual problems are shown to be equivalent under the stability conditions derived. 相似文献
15.
I. L. Galabova 《Optimization methods & software》2020,35(3):488-501
ABSTRACTWe provide the first meaningful documentation and analysis of the ‘Idiot’ crash implemented by Forrest in Clp that aims to obtain an approximate solution to linear programming (LP) problems for warm-starting the primal simplex method. The underlying algorithm is a penalty method with naive approximate minimization in each iteration. During initial iterations an approach similar to augmented Lagrangian is used. Later the technique corresponds closely to a classical quadratic penalty method. We discuss the extent to which it can be used to obtain fast approximate solutions of LP problems, in particular when applied to linearizations of quadratic assignment problems. 相似文献
16.
Peiyi Tang 《Concurrency and Computation》2012,24(18):2282-2301
The most efficient way to parallelize computation is to build and evaluate the task graph constrained only by the data dependencies between the tasks. Both Intel's C++ Concurrent Collections (CnC) and Threading Building Blocks (TBB) libraries allow such task‐based parallel programming. CnC also adapts the macro data flow model by providing only single‐assignment data objects in its global data space. Although CnC makes parallel programming easier, by specifying data flow dependencies only through single‐assignment data objects, its macro data flow model incurs overhead. Intel's C++ CnC library is implemented on top of its C++ TBB library. We can measure the overhead of CnC by comparing its performance with that of TBB. In this paper, we analyze all three types of data dependencies in the tiled in‐place Gauss–Jordan elimination algorithm for the first time. We implement the task‐based parallel tiled Gauss–Jordan algorithm in TBB using the data dependencies analyzed and compare its performance with that of the CnC implementation. We find that the overhead of CnC over TBB is only 12%– 15% of the TBB time, and CnC can deliver as much as 87%– 89% of the TBB performance for Gauss–Jordan elimination, using the optimal tile size. Copyright © 2012 John Wiley & Sons, Ltd. 相似文献
17.
Algencan is a well established safeguarded Augmented Lagrangian algorithm introduced in [R. Andreani, E. G. Birgin, J. M. Martínez, and M. L. Schuverdt, On Augmented Lagrangian methods with general lower-level constraints, SIAM J. Optim. 18 (2008), pp. 1286–1309]. Complexity results that report its worst-case behaviour in terms of iterations and evaluations of functions and derivatives that are necessary to obtain suitable stopping criteria are presented in this work. In addition, its computational performance considering all problems from the CUTEst collection is presented, which shows that it is a useful tool for solving large-scale constrained optimization problems. 相似文献
18.
In this paper, a particle‐based multiphase method for creating realistic animations of bubbles in water–solid interaction is presented. To generate bubbles from gas dissolved in the water on the fly, we propose an approximate model for the creation of bubbles, which takes into account the influence of gas concentration in the water, the solid material, and water–solid velocity difference. As the air particle on the bubble surface is treated as a virtual nucleation site, the bubble absorbs air from surrounding water and grows. The density and pressure forces of air bubbles are computed separately using smoothed particle hydrodynamics; then, the two‐way coupling of bubbles with water and solid is solved by a new drag force, so the generated bubbles’ flow on the surface of solid and the deformation in the rising process can be simulated. Additionally, touching bubbles merge together under the cohesion forces weighted by the smoothing kernel and velocity difference. The experimental results show that this method is capable of simulating bubbles in water–solid interaction under different physical conditions. Copyright © 2012 John Wiley & Sons, Ltd. 相似文献
19.
20.
N. Bidabadi 《Optimization methods & software》2019,34(4):693-706
In this paper, we use a spectral scaled structured BFGS formula for approximating projected Hessian matrices in an exact penalty approach for solving constrained nonlinear least-squares problems. We show this spectral scaling formula has a good self-correcting property. The reported numerical results show that the use of the spectral scaling structured BFGS method outperforms the standard structured BFGS method. 相似文献