Maximum principle for the stochastic optimal control problem with delay and application

In this paper, we consider an optimal control problem for the stochastic system described by stochastic differential equations with delay. We obtain the maximum principle for the optimal control of this problem by virtue of the duality method and the anticipated backward stochastic differential equations. Our results can be applied to a production and consumption choice problem. The explicit optimal consumption rate is obtained.     

A stochastic maximum principle for systems with jumps, with applications to finance

We consider a stochastic control problem with linear dynamics with jumps, convex cost criterion, and convex state constraint, in which the control enters the drift, the diffusion, and the jump coefficients. We allow these coefficients to be random, and do not impose any L^p-bounds on the control.

We obtain a stochastic maximum principle for this model that provides both necessary and sufficient conditions of optimality. This is the first version of the stochastic maximum principle that covers the consumption–investment problem in which there are jumps in the price system.     

Verification Theorem Of Stochastic Optimal Control With Mixed Delay And Applications To Finance

This paper focuses on a general model of a controlled stochastic differential equation with mixed delay in the state variable. Based on the Itô formula, stochastic analysis, convex analysis, and inequality technique, we obtain a semi‐coupled forward‐backward stochastic differential equation with mixed delay and mixed initial‐terminal conditions and prove that such forward‐backward system admits a unique adapted solution. The verification theorem for an optimal control of a system with mixed delay is established. The obtained results generalize and improve some recent results, and they are more easily verified and applied in practice. As an application, we conclude with finding explicitly the optimal consumption rate from the wealth process of a person given by a stochastic differential equation with mixed delay which fit into our general model.     

Pathwise space approximations of semi-linear parabolic SPDEs with multiplicative noise

We provide convergence rates for space approximations of semi-linear stochastic differential equations with multiplicative noise in a Hilbert space. The space approximations we consider are spectral Galerkin and finite elements, and the type of convergence we consider is almost sure uniform convergence, i.e. pathwise convergence. The proofs are based on a recent perturbation result for such equations.     

一种求解非线性随机微分方程的算法及其实现

提出了一种求解非线性随机微分方程的算法 ,该算法具有简单、通用且易于实现的特点 .文中给出算法的详细推导过程及其实现 .文末还给出了采用该算法求解两个典型模型的实验结果 ,表明了该算法的正确性和可行性 .本算法为研究噪声背景下的非线性系统提供了一个有力的工具     

Singular control of stochastic linear systems with recursive utility

We formulate a class of singular stochastic control problem with recursive utility where the cost function is determined by a backward stochastic differential equation. Some characteristics of the value function of the control problem are obtained by the method of approximation via penalization, and the optimal control process is constructed.     

The relaxed optimal control problem for Mean-Field SDEs systems and application

The present study deals with a new approach of optimal control problems where the state equation is a Mean-Field stochastic differential equation, and the set of strict (classical) controls need not be convex and the diffusion coefficient depends on the term control. Our consideration is based on only one adjoint process, and the necessary conditions as well as a sufficient condition for optimality in the form of a relaxed maximum principle are obtained, with application to Linear quadratic stochastic control problem with mean-field type.     

Risk-sensitive control for a class of homing problems

A result of Lefebvre [Lefebvre, M. (2001). A different class of homing problems. Systems & Control Letters 42, 347-352] is here extended to a two-dimensional homing problem with a risk-sensitive cost criterion. It is shown that the optimal control is given explicitly, and moreover, the optimal value function has a simple probabilistic representation associated with a backward stochastic differential equation with a random terminal time.     

Null controllability of an infinite dimensional SDE with state- and control-dependent noise

We consider a controlled stochastic linear differential equation with state- and control-dependent noise in a Hilbert space H. We investigate the relation between the null controllability of the equation and the existence of the solution of “singular” Riccati operator equations. Moreover, for a fixed interval of time, the null controllability is characterized in terms of the dual state. Examples of stochastic PDEs are also considered.     

Maximum principle for mean-field jump–diffusion stochastic delay differential equations and its application to finance

This paper investigates a stochastic optimal control problem with delay and of mean-field type, where the controlled state process is governed by a mean-field jump–diffusion stochastic delay differential equation. Two sufficient maximum principles and one necessary maximum principle are established for the underlying system. As an application, a bicriteria mean–variance portfolio selection problem with delay is studied to demonstrate the effectiveness and potential of the proposed techniques. Under certain conditions, explicit expressions are provided for the efficient portfolio and the efficient frontier, which are as elegant as those in the classical mean–variance problem without delays.     

A risk‐sensitive stochastic maximum principle for fully coupled forward‐backward stochastic differential equations with applications

In this paper, we are interested in the problem of optimal control where the system is given by a fully coupled forward‐backward stochastic differential equation with a risk‐sensitive performance functional. As a preliminary step, we use the risk neutral which is an extension of the initial control system where the admissible controls are convex, and an optimal solution exists.Then, we study the necessary as well as sufficient optimality conditions for risk sensitive performance. At the end of this work, we illustrate our main result by giving an example that deals with an optimal portfolio choice problem in financial market, specifically the model of control cash flow of a firm or project where, for instance, we can set the model of pricing and managing an insurance contract.     

Near-optimal control for stochastic recursive problems

It is well documented (e.g. Zhou (1998) [8]) that the near-optimal controls, as the alternative to the “exact” optimal controls, are of great importance for both the theoretical analysis and practical application purposes due to its nice structure and broad-range availability, feasibility as well as flexibility. However, the study of near-optimality on the stochastic recursive problems, to the best of our knowledge, is a totally unexplored area. Thus we aim to fill this gap in this paper. As the theoretical result, a necessary condition as well as a sufficient condition of near-optimality for stochastic recursive problems is derived by using Ekeland’s principle. Moreover, we work out an ε-optimal control example to shed light on the application of the theoretical result. Our work develops that of [8] but in a rather different backward stochastic differential equation (BSDE) context.     

正倒向随机微分方程与一类线性二次随机最优控制问题

讨论一类正倒向随机微分方程解的存在唯一性及其对应的一类线性二次随机最优控制问题,利用单调性方法证明了一类特殊的正倒向随机微分方程解的存在唯一性定理,利用该结果研究一类耦合了一个倒向随机微分方程的线性随机控制系统广义最优指标随机控制问题,得到由正倒向随机微分方程的解所表示的唯一最优控制的显式表达式,并得到精确的线性反馈及其对应的Riccati方程.     

Stochastic differential games and inverse optimal control and stopper policies

In this paper, we consider a two-player stochastic differential game problem over an infinite time horizon where the players invoke controller and stopper strategies on a nonlinear stochastic differential game problem driven by Brownian motion. The optimal strategies for the two players are given explicitly by exploiting connections between stochastic Lyapunov stability theory and stochastic Hamilton–Jacobi–Isaacs theory. In particular, we show that asymptotic stability in probability of the differential game problem is guaranteed by means of a Lyapunov function which can clearly be seen to be the solution to the steady-state form of the stochastic Hamilton–Jacobi–Isaacs equation, and hence, guaranteeing both stochastic stability and optimality of the closed-loop control and stopper policies. In addition, we develop optimal feedback controller and stopper policies for affine nonlinear systems using an inverse optimality framework tailored to the stochastic differential game problem. These results are then used to provide extensions of the linear feedback controller and stopper policies obtained in the literature to nonlinear feedback controllers and stoppers that minimise and maximise general polynomial and multilinear performance criteria.     

New results on the relationship between dynamic programming and the maximum principle

The dynamic programming approach to optimal control theory attempts to characterize the value functionV as a solution to the Hamilton-Jacobian-Bellman equation. Heuristic arguments have long been advanced relating the Pontryagin maximum principle and dynamic programming according to the equation (H(t, x ^* (t), u ^* (t), p(t)),−p(t))=√V(t,x ^* (t)), where (x^*, u^*) is the optimal control process under consideration,p(t), is the coextremal, andH is the Hamiltonian. The relationship has previously been verified under only very restrictive hypotheses. We prove new results, establishing the relationship, now expressed in terms of the generalized gradient ofV, for a large class of nonsmooth problems.     

Stochastic optimal control via Bellman''s principle

This paper presents a strategy for finding optimal controls of non-linear systems subject to random excitations. The method is capable to generate global control solutions when state and control constraints are present. The solution is global in the sense that controls for all initial conditions in a region of the state space are obtained. The approach is based on Bellman's principle of optimality, the cumulant neglect closure method and the short-time Gaussian approximation. Problems with state-dependent diffusion terms, non-closeable hierarchies of moment equations for the states and singular state boundary condition are considered in the examples. The uncontrolled and controlled system responses are evaluated by creating a Markov chain with a control dependent transition probability matrix via the generalized cell mapping method. In all numerical examples, excellent controlled performances were obtained.     

A second-order maximum principle for discrete-time bilinear control systems with applications to discrete-time linear switched systems

A powerful approach for analyzing the stability of continuous-time switched systems is based on using optimal control theory to characterize the “most unstable” switching law. This reduces the problem of determining stability under arbitrary switching to analyzing stability for the specific “most unstable” switching law. For discrete-time switched systems, the variational approach received considerably less attention. This approach is based on using a first-order necessary optimality condition in the form of a maximum principle (MP), and typically this is not enough to completely characterize the “most unstable” switching law. In this paper, we provide a simple and self-contained derivation of a second-order necessary optimality condition for discrete-time bilinear control systems. This provides new information that cannot be derived using the first-order MP. We demonstrate several applications of this second-order MP to the stability analysis of discrete-time linear switched systems.