Nonlocal quasi-Newton method for solving convex variational inequalities

Conclusion In the optimization problem [f ₀(x)│h_i(x)<-0,i=1,…,l] relaxation of the functionf ₀(x)+Nh⁺(x) does not produce, as we know [6, 7], α_k=1 in Newton's method with the auxiliary problem (5), (6), whereF(x)=f _0′(x). For this reason, Newton type methods based on relaxation off ₀(x)+Nh⁺(x) are not superlinearly convergent (so-called Maratos effect). The results of this article indicate that if (F(x)=f _0′(x), then replacement of the initial optimization problem with a larger equivalent problem (7) eliminates the Maratos effect in the proposed quasi-Newton method. This result is mainly of theoretical interest, because Newton type optimization methods in the space of the variablesx ∈R ⁿ are less complex. However to the best of our knowledge, the difficulties with nonlocal convergence arising in these methods (choice of parameters, etc.) have not been fully resolved [10, 11]. The discussion of these difficulties and comparison with the proposed method fall outside the scope of the present article, which focuses on solution of variational inequalities (1), (2) for the general caseF′(x)≠F′ ^T(x). Translated from Kibernetika i Sistemnyi Analiz, No. 6, pp. 78–91, November–December, 1994.     

Large-deviation inequalities for parameter estimators in stochastic systems

Translated from Kibernetika i Sistemnyi Analiz, No. 2, pp. 95–112, March–April, 1994.