Global convergence of a filter-trust-region algorithm for solving nonsmooth equations

In this paper, we present a new algorithm for solving nonsmooth equations, where the function is locally Lipschitzian. The algorithm attempts to combine the efficiency of filter techniques and the robustness of trust-region method. Global convergence for this algorithm is established under reasonable assumptions.     

On affine-scaling inexact dogleg methods for bound-constrained nonlinear systems

Within the framework of affine-scaling trust-region methods for bound-constrained problems, we discuss the use of an inexact dogleg method as a tool for simultaneously handling the trust-region and the bound constraints while seeking for an approximate minimizer of the model. Then, we focus on large-scale bound-constrained systems of nonlinear equations which often arise in practical applications when some of the unknowns are naturally subject to constraints due to physical arguments. We introduce an inexact affine-scaling method for such a class of problems that employs the inexact dogleg procedure. Global convergence results are established without any Lipschitz assumption on the Jacobian matrix, and locally fast convergence is shown under standard assumptions. Convergence analysis is performed without specifying the scaling matrix that is used to handle the bounds, and a rather general class of scaling matrices is allowed in actual algorithms. Numerical results showing the performance of the method are also given.     

An effective trust-region-based approach for symmetric nonlinear systems

This paper presents a new trust-region procedure for solving symmetric nonlinear systems of equations having several variables. The proposed approach takes advantage of the combination of both an effective adaptive trust-region radius and a non-monotone strategy. It is believed that the selection of an appropriate adaptive radius and the application of a suitable non-monotone strategy can improve the efficiency and robustness of the trust-region framework as well as decrease the computational costs of the algorithm by decreasing the required number of subproblems to be solved. The global convergence and the quadratic convergence of the proposed approach are proved without the non-degeneracy assumption of the exact Jacobian. The preliminary numerical results of the proposed algorithm indicating the promising behaviour of the new procedure for solving nonlinear systems are also reported.     

一个结合信赖域技术的修正的Levenberg-Marquardt方法

在文献[1]的基础上,结合信赖域技术和Levenberg-Marquardt方法求解非线性方程组的特点,提出了一种求解奇异非线性方程组的修正的Levenberg-Marquardt方法,给出了算法的全局收敛性,并在弱于非奇异条件的局部误差有界的条件下,证明了修正的Levenberg-Marquardt方法仍具有局部二阶收敛速度,数值试验表明算法是非常有效的。     

An affine scaling interior trust-region method combining with nonmonotone line search filter technique for linear inequality constrained minimization

This paper proposes an affine scaling interior trust-region method in association with nonmonotone line search filter technique for solving nonlinear optimization problems subject to linear inequality constraints. Based on a Newton step which is derived from the complementarity conditions of linear inequality constrained optimization, a trust-region subproblem subject only to an ellipsoidal constraint is defined by minimizing a quadratic model with an appropriate quadratic function and scaling matrix. The nonmonotone schemes combining with trust-region strategy and line search filter technique can bring about speeding up the convergence progress in the case of high nonlinear. A new backtracking relevance condition is given which assures global convergence without using the switching condition used in the traditional line search filter technique. The fast local convergence rate of the proposed algorithm is achieved which is not depending on any external restoration procedure. The preliminary numerical experiments are reported to show effectiveness of the proposed algorithm.     

A new class of nonmonotone adaptive trust-region methods for nonlinear equations with box constraints

A nonmonotone trust-region method for the solution of nonlinear systems of equations with box constraints is considered. The method differs from existing trust-region methods both in using a new nonmonotonicity strategy in order to accept the current step and a new updating technique for the trust-region-radius. The overall method is shown to be globally convergent. Moreover, when combined with suitable Newton-type search directions, the method preserves the local fast convergence. Numerical results indicate that the new approach is more effective than existing trust-region algorithms.     

Trust-region method for box-constrained semismooth equations and its applications to complementary problems

In this paper, we propose a new trust-region algorithm for bound-constrained semismooth systems of equations. Trust-region subproblem is defined by minimizing a quadratic function subject only to a rectangular constraint. By employing a new active set and nonmonotone techniques, solution of the equations can be found effective. Global and local convergence results of the proposed algorithm are established under reasonable conditions. The algorithm is applied and tested on complementary problems and the experiments show that our method is efficient.     

A trust-region algorithm combining line search filter technique for nonlinear constrained optimization

In this paper, we propose a trust-region algorithm in association with line search filter technique for solving nonlinear equality constrained programming. At current iteration, a trial step is formed as the sum of a normal step and a tangential step which is generated by trust-region subproblem and the step size is decided by interior backtracking line search together with filter methods. Then, the next iteration is determined. This is different from general trust-region methods in which the next iteration is determined by the ratio of the actual reduction to the predicted reduction. The global convergence analysis for this algorithm is presented under some reasonable assumptions and the preliminary numerical results are reported.     

A BFGS trust-region method for nonlinear equations

In this paper, a new trust-region subproblem combining with the BFGS update is proposed for solving nonlinear equations, where the trust region radius is defined by a new way. The global convergence without the nondegeneracy assumption and the quadratic convergence are obtained under suitable conditions. Numerical results show that this method is more effective than the norm method.     

Successive Chebyshev pseudospectral convex optimization method for nonlinear optimal control problems

This article aims at proposing a successive Chebyshev pseudospectral convex optimization method for solving general nonlinear optimal control problems (OCPs). First, Chebyshev pseudospectral discrete scheme is used to discretize a general nonlinear OCP. At the same time, a convex subproblem is formulated by using the first-order Taylor expansion to convexify the discretized nonlinear dynamic constraints. Second, a trust-region penalty term is added to the performance index of the subproblem, and a successive convex optimization algorithm is proposed to solve the subproblem iteratively. Noted that the trust-region penalty parameters can be adjusted according to the linearization error in iterative process, which improves convergence rate. Third, the Karush–Kuhn–Tucker conditions of the subproblem are derived, and furthermore, a proof is given to show that the algorithm will iteratively converge to the subproblem. Additionally, the global convergence of the algorithm is analyzed and proved, which is based on three key lemmas. Finally, the orbit transfer problem of spacecraft is used to test the performance of the proposed method. The simulation results demonstrate the optimal control is bang-bang form, which is consistent with the result of theoretical proof. Also, the algorithm is of efficiency, fast convergence rate, and high accuracy. Therefore, the proposed method provides a new approach for solving nonlinear OCPs online and has great potential in engineering practice.     

A non-monotone pattern search approach for systems of nonlinear equations

In this paper, a new pattern search is proposed to solve the systems of nonlinear equations. We introduce a new non-monotone strategy which includes a convex combination of the maximum function of some preceding successful iterates and the current function. First, we produce a stronger non-monotone strategy in relation to the generated strategy by Gasparo et al. [Nonmonotone algorithms for pattern search methods, Numer. Algorithms 28 (2001), pp. 171–186] whenever iterates are far away from the optimizer. Second, when iterates are near the optimizer, we produce a weaker non-monotone strategy with respect to the generated strategy by Ahookhosh and Amini [An efficient nonmonotone trust-region method for unconstrained optimization, Numer. Algorithms 59 (2012), pp. 523–540]. Third, whenever iterates are neither near the optimizer nor far away from it, we produce a medium non-monotone strategy which will be laid between the generated strategy by Gasparo et al. [Nonmonotone algorithms for pattern search methods, Numer. Algorithms 28 (2001), pp. 171–186] and Ahookhosh and Amini [An efficient nonmonotone trust-region method for unconstrained optimization, Numer. Algorithms 59 (2012), pp. 523–540]. Reported are numerical results of the proposed algorithm for which the global convergence is established.     

An affine-scaling derivative-free trust-region method for solving nonlinear systems subject to linear inequality constraints

In this paper, an affine-scaling derivative-free trust-region method with interior backtracking line search technique is considered for solving nonlinear systems subject to linear inequality constraints. The proposed algorithm is designed to take advantage of the problem structured by building polynomial interpolation models for each function in the nonlinear system function F. The proposed approach is developed by forming a quadratic model with an appropriate quadratic function and scaling matrix: there is no need to handle the constraints explicitly. By using both trust-region strategy and interior backing line search technique, each iteration switches to backtracking step generated by the trust-region subproblem and satisfies strict interior point feasibility by line search backtracking technique. Under reasonable conditions, the global convergence and fast local convergence rate of the proposed algorithm are established. The results of numerical experiments are reported to show the effectiveness of the proposed algorithms.     

H-矩阵方程组的预条件迭代法

针对系数矩阵A为H-矩阵的线性方程组Ax=b,引入了预条件矩阵I＋S_α~β,通过对系数矩阵施行初等行变换,提出了求解线性方程组Ax=b的一种新的预条件Gauss-Seidel方法.论文中首先证明了若A为H-矩阵,则（I＋S_α~β）A仍然是H-矩阵;其次,以定理的形式给出了新的预条件Gauss-Seidel方法收敛的充分条件,即给出了为保证新的预条件Gauss-Seidel方法收敛时参数所需满足的条件;然后从理论上证明了新的预条件Gauss-Seidel迭代方法较经典的Gauss-Seidel迭代方法收敛速度快,论文中提出的新的预条件Gauss-Seidel迭代方法推广了文[1-2]中提出的预条件方法;最后又通过数值算例说明了新的预条件Gauss-Seidel迭代方法的有效性.     

An efficient adaptive trust-region method for systems of nonlinear equations

We present an adaptive trust-region algorithm to solve systems of nonlinear equations. Using the nonmonotone technique of Grippo, Lampariello and Lucidi, we introduce a new adaptive radius to decrease the total number of iterations and function evaluations. In contrast with the pervious methods, the new adaptive radius ensures that the size of radius is not too large or too small. We show that the sequence generated by the proposed adaptive radius is decreasing, so it prevents the production of too large radius as possible. Furthermore, it is shown that this sequence is reduced slowly, so it prevents the production of the intensely small radius. The global and quadratic convergence of the proposed approach are proved. Preliminary numerical results of our algorithm are also reported which indicate the promising behaviour of the new procedure to solve systems of nonlinear equations.     

RoboCup中传球策略研究

Fletcher和Leyffer提出的关于非线性规划问题的SequentialQuadraticProgramming(SQP)Trust-regionfilter基础算法是解决中等规模非线性问题的有效方法,其filter由二元组组成,该文提出了收敛速率的概念,形成三元组fil-ter,这样既保持了原来算法的优点又同时改善了收敛速率和信任域半径,将给出相应改进算法。文章在SQPfilter算法的基础上提出了RoboCup传球策略算法,由于RoboCup本身具有的离散化特点,此算法与SQPfilter算法在具体实现上有所不同。     

非线性迭代学习控制问题的延拓修正牛顿法

对于非线性迭代学习控制问题,提出基于延拓法和修正Newton法的具有全局收敛性的迭代学习控制新方法.由于一般的Newton型迭代学习控制律都是局部收敛的,在实际应用中有很大局限性.为拓宽收敛范围,该方法将延拓法引入迭代学习控制问题,提出基于同伦延拓的新的Newton型迭代学习控制律,使得初始控制可以较为任意的选择.新的迭代学习控制算法将求解过程分成N个子问题,每个子问题由换列修正Newton法利用简单的递推公式解出.本文给出算法收敛的充分条件,证明了算法的全局收敛性.该算法对于非线性系统迭代学习控制具有全局收敛和计算简单的优点.     

Implementable L ∞ penalty-function method for semi-infinite optimization

This paper considers general non-linear semi-infinite programming problems and presents an implementable method which employs an exact L _∞ penalty function. Since the L _∞ penalty function is continuous even if the number of representative constraints changes, trust-region techniques may effectively be adopted to obtain global convergence. Numerical results are given to show the efficiency of the proposed algorithm.     

求解大型非对称线性系统的一种新的预处理方法

针对大型稀疏非对称正定线性方程组,本文提出了新的预处理GMRES方法,并分析了谱半径和最优参数α的选取.最后通过数值例子比较GMRES方法,HSS预处理和新的预处理GMRES方法,发现新的预处理方法具有更好的收敛率.     

A cubic regularization algorithm for unconstrained optimization using line search and nonmonotone techniques

In recent years, cubic regularization algorithms for unconstrained optimization have been defined as alternatives to trust-region and line search schemes. These regularization techniques are based on the strategy of computing an (approximate) global minimizer of a cubic overestimator of the objective function. In this work we focus on the adaptive regularization algorithm using cubics (ARC) proposed in Cartis et al. [Adaptive cubic regularisation methods for unconstrained optimization. Part I: motivation, convergence and numerical results, Mathematical Programming A 127 (2011), pp. 245–295]. Our purpose is to design a modified version of ARC in order to improve the computational efficiency preserving global convergence properties. The basic idea is to suitably combine a Goldstein-type line search and a nonmonotone accepting criterion with the aim of advantageously exploiting the possible good descent properties of the trial step computed as (approximate) minimizer of the cubic model. Global convergence properties of the proposed nonmonotone ARC algorithm are proved. Numerical experiments are performed and the obtained results clearly show satisfactory performance of the new algorithm when compared to the basic ARC algorithm.     

Incomplete Jacobian Newton method for nonlinear equations

This paper presents a new modified Newton method for nonlinear equations. This method uses a part of elements of the Jacobian matrix to obtain the next iteration point and is refereed to as the incomplete Jacobian Newton (IJN) method. The IJN method may be fit for solving large scale nonlinear equations with dense Jacobian. The conditions of linear, superlinear and quadratic convergence of the IJN method are given and the local convergence results are analyzed and proved. Some special IJN algorithms are designed and numerical experiments are given. The results show that the IJN method is promising.