Necessary and sufficient conditions of risk‐sensitive optimal control and differential games for stochastic differential delayed equations

In this paper, we consider risk‐sensitive optimal control and differential games for stochastic differential delayed equations driven by Brownian motion. The problems are related to robust stochastic optimization with delay due to the inherent feature of the risk‐sensitive objective functional. For both problems, by using the logarithmic transformation of the associated risk‐neutral problem, the necessary and sufficient conditions for the risk‐sensitive maximum principle are obtained. We show that these conditions are characterized in terms of the variational inequality and the coupled anticipated backward stochastic differential equations (ABSDEs). The coupled ABSDEs consist of the first‐order adjoint equation and an additional scalar ABSDE, where the latter is induced due to the nonsmooth nonlinear transformation of the adjoint process of the associated risk‐neutral problem. For applications, we consider the risk‐sensitive linear‐quadratic control and game problems with delay, and the optimal consumption and production game, for which we obtain explicit optimal solutions.     

带有随机跳跃干扰的线性二次随机最优控制问题

给出一类布朗运动和泊松过程混合驱动的正倒向随机微分方程解的存在唯一性结果, 应用这一结果研究带有随机跳跃干扰的线性二次随机最优控制问题,并得到最优控制的显式形 式,可以证明最优控制是唯一的.然后,引入和研究一类推广的黎卡提方程系统,讨论该方程系统 的可解性并由该方程的解得到带有随机跳跃干扰的线性二次随机最优控制问题最优的线性反馈.     

The optimal control related to Riemannian manifolds and the viscosity solutions to Hamilton–Jacobi–Bellman equations

In this paper we study the optimal stochastic control problem for stochastic differential equations on Riemannian manifolds. The cost functional is specified by controlled backward stochastic differential equations in Euclidean space. Under some suitable assumptions, we conclude that the value function is the unique viscosity solution to the associated Hamilton–Jacobi–Bellman equation which is a fully nonlinear parabolic partial differential equation on Riemannian manifolds.     

A Partially Observed Nonzero‐Sum Stochastic Differential Game with Delays and its Application to Finance

In this paper, we deal with a new kind of partially observed nonzero‐sum differential game governed by stochastic differential delay equations. One of the special features is that the controlled system and the utility functionals involve both delays in the state variable and the control variables under different observation equations for each player. We obtain a maximum principle and a verification theorem for the game problem by virtue of Girsanov's theorem and the convex variational method. In addition, based on the theoretical results and Malliavin derivative techniques, we solve a production and consumption choice game problem.     

Optimal control of a stochastic delay heat equation with boundary-noise and boundary-control

In this paper, a controlled stochastic delay heat equation with Neumann boundary-noise and boundary-control is considered. The existence and uniqueness of the mild solution for the associated Hamilton–Jacobi–Bellman equations are obtained by means of the backward stochastic differential equations, which is applied to the optimal control problem.     

正倒向随机微分方程与一类线性二次随机最优控制问题

讨论一类正倒向随机微分方程解的存在唯一性及其对应的一类线性二次随机最优控制 问题,利用单调性方法证明了一类特殊的正倒向随机微分方程解的存在唯一性定理,利用该结果 研究一类耦合了一个倒向随机微分方程的线性随机控制系统广义最优指标随机控制问题,得到 由正倒向随机微分方程的解所表示的唯一最优控制的显式表达式,并得到精确的线性反馈及其 对应的Riccati方程.     

Optimal control problem for stochastic evolution equations in Hilbert spaces

In this article, we consider an optimal control problem in which the controlled state dynamics is governed by a stochastic evolution equation in Hilbert spaces and the cost functional has a quadratic growth. The existence and uniqueness of the optimal control are obtained by the means of an associated backward stochastic differential equations with a quadratic growth and an unbounded terminal value. As an application, an optimal control of stochastic partial differential equations with dynamical boundary conditions is also given to illustrate our results.     

Stochastic maximum principle for SPDEs with noise and control on the boundary

In this paper we prove necessary conditions for optimality of a stochastic control problem for a class of stochastic partial differential equations that is controlled through the boundary. This kind of problem can be interpreted as a stochastic control problem for an evolution system in a Hilbert space. The regularity of the solution of the adjoint equation, that is a backward stochastic equation in infinite dimension, plays a crucial role in the formulation of the maximum principle.     

Recursive Stochastic H2/H∞ Control Problem for Delay Systems Involving Continuous and Impulse Controls

In this paper, we discuss the recursive stochastic H₂/H_∞ control problem of delay systems with random coefficients involving both continuous and impulse controls. By virtue of a new type of forward backward stochastic differential equations, a necessary and sufficient condition for the existence of a unique solution to the control problem under consideration is derived. The existence and uniqueness of the forward backward stochastic differential equations are also be proved.     

Linear−quadratic optimal control and nonzero‐sum differential game of forward−backward stochastic system

An existence and uniqueness result for one kind of forward–backward stochastic differential equations with double dimensions was obtained under some monotonicity conditions. Then this result was applied to the linear‐quadratic stochastic optimal control and nonzero‐sum differential game of forward–backward stochastic system. The explicit forms of the optimal control and the Nash equilibrium point are obtained respectively. We note that our method is effective in studying the uniqueness of Nash equilibrium point. Copyright © 2011 John Wiley and Sons Asia Pte Ltd and Chinese Automatic Control Society     

The maximum principle for stochastic differential systems with general cost functional

In this paper, under the framework of Fréchet derivatives, we study a stochastic optimal control problem driven by a stochastic differential equation with general cost functional. By constructing a series of first-order and second-order adjoint equations, we establish the stochastic maximum principle and get the related Hamilton systems.     

Multi-valued stochastic differential equations driven by G-Brownian motion and related stochastic control problems

In this paper, we prove the existence and uniqueness of a solution for a class of multi-valued stochastic differential equations driven by G-Brownian motion (MSDEG) by means of the Yosida approximation method. Moreover, we set up an optimality principle of stochastic control problem and prove the value function of the control problem is the unique viscosity solution of a class of nonlinear partial differential variational inequalities.     

Stochastic maximum principle for delayed doubly stochastic control systems and their applications

ABSTRACT

In this paper, we investigate the optimal control problems for delayed doubly stochastic control systems. We first discuss the existence and uniqueness of the delayed doubly stochastic differential equation by martingale representation theorem and contraction mapping principle. As a necessary condition of the optimal control, we deduce a stochastic maximum principle under some assumption. At the same time, a sufficient condition of optimality is obtained by using the duality method. At the end of the paper, we apply our stochastic maximum principle to a class of linear quadratic optimal control problem and obtain the explicit expression of the optimal control.     

Singular optimal control for stochastic linear quadratic singular system using ant colony programming

In this article, singular optimal control for stochastic linear singular system with quadratic performance is obtained using ant colony programming (ACP). To obtain the optimal control, the solution of matrix Riccati differential equation is computed by solving differential algebraic equation using a novel and nontraditional ACP approach. The obtained solution in this method is equivalent or very close to the exact solution of the problem. Accuracy of the solution computed by the ACP approach to the problem is qualitatively better. The solution of this novel method is compared with the traditional Runge Kutta method. An illustrative numerical example is presented for the proposed method.     

Singular control of stochastic linear systems with recursive utility

We formulate a class of singular stochastic control problem with recursive utility where the cost function is determined by a backward stochastic differential equation. Some characteristics of the value function of the control problem are obtained by the method of approximation via penalization, and the optimal control process is constructed.     

Existence of optimal controls for SPDE with locally monotone coefficients

The aim of this paper is to investigate the existence of optimal controls for systems described by stochastic partial differential equations (SPDEs) with locally monotone coefficients controlled by external forces which are feedback controls. To attain our objective we adapt the argument of Lisei (2002) where the existence of optimal controls to the stochastic Navier–Stokes equation was studied. The results obtained in the present paper may be applied to demonstrate the existence of optimal controls to various types of controlled SPDEs such as: a stochastic nonlocal equation and stochastic semilinear equations which are locally monotone equations; we also apply the result to a monotone equation such as the stochastic reaction–diffusion equation and to a stochastic linear equation.     

Non‐Zero Sum Differential Games of Backward Stochastic Differential Delay Equations Under Partial Information

In this paper, we study a new type of differential game problems of backward stochastic differential delay equations under partial information. A class of time‐advanced stochastic differential equations (ASDEs) is introduced as the adjoint process via duality relation. By means of ASDEs, we suggest the necessary and sufficient conditions called maximum principle for an equilibrium point of non‐zero sum games. As an application, an economic problem is putted into our framework to illustrate the theoretical results. In terms of the maximum principle and some auxiliary filtering results, an equilibrium point is obtained.     

带Poisson跳的线性二次随机微分博弈及其在鲁棒控制中的应用

研究了一类带Poisson跳扩散过程的线性二次随机微分博弈,包括非零和博弈的Nash均衡策略与零和博弈的鞍点均衡策略问题．利用微分博弈的最大值原理,得到Nash均衡策略的存在条件等价于两个交叉耦合的矩阵Riccati方程存在解,鞍点均衡策略的存在条件等价于一个矩阵Riccati方程存在解的结论,并给出了均衡策略的显式表达及最优性能泛函值．最后,将所得结果应用于现代鲁棒控制中的随机H₂/H_∞控制与随机H_∞控制问题,得到了鲁棒控制策略的存在条件及显式表达,并验证所得结果在金融市场投资组合优化问题中的应用．     

Optimal control problems for stochastic delay evolution equations in Banach spaces

We consider the optimal control for a Banach space valued stochastic delay evolution equation. The existence and uniqueness of the mild solution for the associated Hamilton–Jacobi–Bellman equations are obtained by means of backward stochastic differential equations. An application to optimal control of stochastic delay partial differential equations is also given.     

Verification Theorem Of Stochastic Optimal Control With Mixed Delay And Applications To Finance

This paper focuses on a general model of a controlled stochastic differential equation with mixed delay in the state variable. Based on the Itô formula, stochastic analysis, convex analysis, and inequality technique, we obtain a semi‐coupled forward‐backward stochastic differential equation with mixed delay and mixed initial‐terminal conditions and prove that such forward‐backward system admits a unique adapted solution. The verification theorem for an optimal control of a system with mixed delay is established. The obtained results generalize and improve some recent results, and they are more easily verified and applied in practice. As an application, we conclude with finding explicitly the optimal consumption rate from the wealth process of a person given by a stochastic differential equation with mixed delay which fit into our general model.