A smooth Newton method with 3-1 piecewise NCP function for generalized nonlinear complementarity problem

In this paper, based on the 3-1 piecewise nonlinear complementarity problem (NCP) function, we proposed a smoothing Newton-type method for the generalized nonlinear complementarity problem (GNCP) with a modified non-monotone line search. The algorithm for a GNCP is more difficult than that for an NCP, because two functions must be considered in the problem. We reformulate the (GNCP) to a smoothing system of equations by two independent variables, and then develop a smoothing Newton-type method for solving it. Under reasonable conditions, we obtain the global convergent properties. Also, the numerical experiments are reported in this paper.     

Trust-region method for box-constrained semismooth equations and its applications to complementary problems

In this paper, we propose a new trust-region algorithm for bound-constrained semismooth systems of equations. Trust-region subproblem is defined by minimizing a quadratic function subject only to a rectangular constraint. By employing a new active set and nonmonotone techniques, solution of the equations can be found effective. Global and local convergence results of the proposed algorithm are established under reasonable conditions. The algorithm is applied and tested on complementary problems and the experiments show that our method is efficient.     

A non-monotone inexact regularized smoothing Newton method for solving nonlinear complementarity problems

In the paper [S.P. Rui and C.X. Xu, A smoothing inexact Newton method for nonlinear complementarity problems, J. Comput. Appl. Math. 233 (2010), pp. 2332–2338], the authors proposed an inexact smoothing Newton method for nonlinear complementarity problems (NCP) with the assumption that F is a uniform P function. In this paper, we present a non-monotone inexact regularized smoothing Newton method for solving the NCP which is based on Fischer–Burmeister smoothing function. We show that the proposed algorithm is globally convergent and has a locally superlinear convergence rate under the weaker condition that F is a P ₀ function and the solution of NCP is non-empty and bounded. Numerical results are also reported for the test problems, which show the effectiveness of the proposed algorithm.     

A predictor-corrector smoothing Newton method for solving the mixed complementarity problem with a P 0-function

The mixed complementarity problem (denoted by MCP(F)) can be reformulated as the solution of a nonsmooth system of equations. In the paper, based on a perturbed mid function, we contract a new smoothing function. The existence and continuity of a smooth path for solving the mixed complementarity problem with a P ₀ function are discussed. Then we presented a predictor-corrector smoothing Newton algorithm to solve the MCP with a P ₀-function. The global convergence of the proposed algorithm is verified under mild conditions. And by using the smooth and semismooth technique, the local superlinear convergence of the method is proved under some suitable assumptions.     

A non-monotone inexact non-interior continuation method based on a parametric smoothing function for LWCP

This paper considers the linear weighted complementarity problem (denoted by LWCP). We introduce a parametric smoothing function which is a broad class of smoothing functions for the LWCP and enjoys some favourable properties. Based on this function, we propose a new non-interior continuation method for solving the LWCP. In general, the non-interior continuation method consists of finding an exact solution of a system of equations at each iteration, which may be cumbersome if one is solving a large-scale problem. To overcome this difficulty, our method uses an inexact Newton method to solve the corresponding linear system approximately and adopts a non-monotone line search to obtain a step size. Under suitable assumptions, we show that the proposed method is globally and locally quadratically convergent. Preliminary numerical results are also reported.     

A new SQP approach for nonlinear complementarity problems

Sequential quadratic programming (SQP) methods have been extensively studied to handle nonlinear programming problems. In this paper, a new SQP approach is employed to tackle nonlinear complementarity problems (NCPs). At each iterate, NCP conditions are divided into two parts. The inequalities and equations in NCP conditions, which are violated in the current iterate, are treated as the objective function, and the others act as constraints, which avoids finding a feasible initial point and feasible iterate points. NCP conditions are consequently transformed into a feasible nonlinear programming subproblem at each step. New SQP techniques are therefore successful in handling NCPs.     

A globally and locally superlinearly convergent inexact Newton-GMRES method for large-scale variational inequality problem

In this paper, we propose an inexact Newton-generalized minimal residual method for solving the variational inequality problem. Based on a new smoothing function, the variational inequality problem is reformulated as a system of parameterized smooth equations. In each iteration, the corresponding linear system is solved only approximately. Under mild assumptions, it is proved that the proposed algorithm has global convergence and local superlinear convergence properties. Preliminary numerical results indicate that the method is effective for a large-scale variational inequality problem.     

On the iterative refinement of the solution of ill-conditioned linear system of equations

Recently, Salkuyeh and Fahim [A new iterative refinement of the solution of ill-conditioned linear system of equations, Int. Comput. Math. 88(5) (2011), pp. 950–956] have proposed a two-step iterative refinement of the solution of an ill-conditioned linear system of equations. In this paper, we first present a generalized two-step iterative refinement procedure to solve ill-conditioned linear system of equations and study its convergence properties. Afterward, it is shown that the idea of an orthogonal projection technique together with a basic stationary iterative method can be utilized to construct a new efficient and neat hybrid algorithm for solving the mentioned problem. The convergence of the offered hybrid approach is also established. Numerical examples are examined to demonstrate the feasibility of proposed algorithms and their superiority to some of existing approaches for solving ill-conditioned linear system of equations.     

A smoothing inexact Newton method for variational inequality problems

In this paper, we reformulate the variational inequality problem as an equivalent smooth non-linear equation system by introducing the Chen–Harker–Kanzow–Smale smoothing function. A new smoothing inexact Newton algorithm is proposed to solve the smooth equations. In each iteration, the corresponding linear system is solved approximately. We prove that the proposed algorithm converges globally and superlinearly under mild conditions. Preliminary numerical results indicate that the method is effective.     

An efficient adaptive trust-region method for systems of nonlinear equations

We present an adaptive trust-region algorithm to solve systems of nonlinear equations. Using the nonmonotone technique of Grippo, Lampariello and Lucidi, we introduce a new adaptive radius to decrease the total number of iterations and function evaluations. In contrast with the pervious methods, the new adaptive radius ensures that the size of radius is not too large or too small. We show that the sequence generated by the proposed adaptive radius is decreasing, so it prevents the production of too large radius as possible. Furthermore, it is shown that this sequence is reduced slowly, so it prevents the production of the intensely small radius. The global and quadratic convergence of the proposed approach are proved. Preliminary numerical results of our algorithm are also reported which indicate the promising behaviour of the new procedure to solve systems of nonlinear equations.     

An approximation algorithm for the solution of the nonlinear Lane-Emden type equations arising in astrophysics using Hermite functions collocation method

In this paper we propose a collocation method for solving some well-known classes of Lane-Emden type equations which are nonlinear ordinary differential equations on the semi-infinite domain. They are categorized as singular initial value problems. The proposed approach is based on a Hermite function collocation (HFC) method. To illustrate the reliability of the method, some special cases of the equations are solved as test examples. The new method reduces the solution of a problem to the solution of a system of algebraic equations. Hermite functions have prefect properties that make them useful to achieve this goal. We compare the present work with some well-known results and show that the new method is efficient and applicable.     

A modified trust region algorithm for nonlinear equations with new updating rule of trust region radius

In this article, we present a trust region algorithm for the nonlinear equations with a new updating rule of the trust region radius, which takes some function of the residual. We show that under the local error bound condition which is weaker than the non-singularity, the new algorithm converges quadratically to some solution of the nonlinear equations. Numerical results show that the new algorithm performs very well for some singular nonlinear equations.     

A quasi-Newton modified LP-Newton method

We consider a method to solve constrained system of nonlinear equations based on a modification of the Linear-Programming-Newton method and replacing the first-order information with a quasi-Newton secant update, providing a computationally simple method. The proposed strategy combines good properties of two methods: the least change secant update for unconstrained system of nonlinear equations with isolated solutions and the Linear-Programming-Newton for constrained nonlinear system of equations with possible nonisolated solutions. We analyse the local convergence of the proposed method under a standard error bound condition proving its linear convergence for nonisolated solutions. Numerical experiments were done in order to show the claimed convergence rate.     

A nonmonotone ODE-based method for unconstrained optimization

This paper presents a new hybrid algorithm for unconstrained optimization problems, which combines the idea of the IMPBOT algorithm with the nonmonotone line search technique. A feature of the proposed method is that at each iteration, a system of linear equations is solved only once to obtain a trial step, via a modified limited-memory BFGS two loop recursion that requires only matrix–vector products, thus reducing the computations and storage. Furthermore, when the trial step is not accepted, the proposed method performs a line search along it using a modified nonmonotone scheme, thus a larger stepsize can be yielded in each line search procedure. Under some reasonable assumptions, the convergence properties of the proposed algorithm are analysed. Numerical results are also reported to show the efficiency of this proposed method.     

求解非线性互补问题的熵函数认知优化算法

提出了一个求解非线性互补问题的熵函数社会认知优化算法。首先将非线性互补问题转化为非线性方程组来求解,然后利用熵函数法将非线性方程组求解转化为一个光滑的无约束优化问题,最后应用社会认知优化算法求解此优化问题。实验结果表明,该算法收敛速度快,稳定性好,是求解非线性互补问题的一种有效算法。     

Special Issue on Discrete Geometry for Computer Imagery

We consider a bilevel optimisation approach for parameter learning in higher-order total variation image reconstruction models. Apart from the least squares cost functional, naturally used in bilevel learning, we propose and analyse an alternative cost based on a Huber-regularised TV seminorm. Differentiability properties of the solution operator are verified and a first-order optimality system is derived. Based on the adjoint information, a combined quasi-Newton/semismooth Newton algorithm is proposed for the numerical solution of the bilevel problems. Numerical experiments are carried out to show the suitability of our approach and the improved performance of the new cost functional. Thanks to the bilevel optimisation framework, also a detailed comparison between \(\text {TGV}^2\) and \(\text {ICTV}\) is carried out, showing the advantages and shortcomings of both regularisers, depending on the structure of the processed images and their noise level.     

A quasi-Newton method for unconstrained non-smooth problems

We present a method, based on a variational problem, for solving a non-smooth unconstrained optimization problem. We assume that the objective function is a Lipschitz continuous and a regular function. In this case the function of our variational problem is semismooth and a quasi-Newton method may be used to solve the variational problem. A convergence theorem for our algorithm and its discrete version is also proved. Preliminary computational results show that the method performs quite well and can compete with other methods.     

An efficient augmented Lagrangian method for support vector machine

ABSTRACT

Support vector machine (SVM) has proved to be a successful approach for machine learning. Two typical SVM models are the L1-loss model for support vector classification (SVC) and ε-L1-loss model for support vector regression (SVR). Due to the non-smoothness of the L1-loss function in the two models, most of the traditional approaches focus on solving the dual problem. In this paper, we propose an augmented Lagrangian method for the L1-loss model, which is designed to solve the primal problem. By tackling the non-smooth term in the model with Moreau–Yosida regularization and the proximal operator, the subproblem in augmented Lagrangian method reduces to a non-smooth linear system, which can be solved via the quadratically convergent semismooth Newton's method. Moreover, the high computational cost in semismooth Newton's method can be significantly reduced by exploring the sparse structure in the generalized Jacobian. Numerical results on various datasets in LIBLINEAR show that the proposed method is competitive with the most popular solvers in both speed and accuracy.     

Hybrid Bernstein Block–Pulse functions for solving system of fractional integro-differential equations

This paper deals with the numerical solution of system of fractional integro-differential equations. In this work, we approximate the unknown functions based on the hybrid Bernstein Block–Pulse functions, in conjunction with the collocation method. We introduce the Riemann–Liouville fractional integral operator for the hybrid Bernstein Block–Pulse functions. This operator will be approximated by the Gauss quadrature formula with respect to the Legendre weight function and then it is utilized to reduce the solution of the fractional integro-differential equations to a system of algebraic equations. This system can be easily solved by any usual numerical methods. The existence and uniqueness of the solution have been discussed. Moreover, the convergence analysis of this algorithm will be shown by preparing some theorems. Numerical experiments are presented to show the superiority and efficiency of proposed method in comparison with some other well-known methods.     

On the superlinear convergence in computational elasto-plasticity

We consider the convergence properties of return algorithms for a large class of rate-independent plasticity models. Based on recent results for semismooth functions, we can analyze these algorithms in the context of semismooth Newton methods guaranteeing local superlinear convergence. This recovers results for classical models but also extends to general hardening laws, multi-yield plasticity, and to several non-associated models. The superlinear convergence is also numerically shown for a large-scale parallel simulation of Drucker–Prager elasto-plasticity and an example for the modified Cam-clay model.