带有随机跳跃干扰的线性二次随机最优控制问题

给出一类布朗运动和泊松过程混合驱动的正倒向随机微分方程解的存在唯一性结果, 应用这一结果研究带有随机跳跃干扰的线性二次随机最优控制问题,并得到最优控制的显式形 式,可以证明最优控制是唯一的.然后,引入和研究一类推广的黎卡提方程系统,讨论该方程系统 的可解性并由该方程的解得到带有随机跳跃干扰的线性二次随机最优控制问题最优的线性反馈.     

正倒向随机微分方程与一类线性二次随机最优控制问题

讨论一类正倒向随机微分方程解的存在唯一性及其对应的一类线性二次随机最优控制 问题,利用单调性方法证明了一类特殊的正倒向随机微分方程解的存在唯一性定理,利用该结果 研究一类耦合了一个倒向随机微分方程的线性随机控制系统广义最优指标随机控制问题,得到 由正倒向随机微分方程的解所表示的唯一最优控制的显式表达式,并得到精确的线性反馈及其 对应的Riccati方程.     

带Markov跳的离散时间随机控制系统的最大值原理

本文研究一类同时含有Markov跳过程和乘性噪声的离散时间非线性随机系统的最优控制问题, 给出并证明了相应的最大值原理. 首先, 利用条件期望的平滑性, 通过引入具有适应解的倒向随机差分方程, 给出了带有线性差分方程约束的线性泛函的表示形式, 并利用Riesz定理证明其唯一性. 其次, 对带Markov跳的非线性随机控制系统, 利用针状变分法, 对状态方程进行一阶变分, 获得其变分所满足的线性差分方程. 然后, 在引入Hamilton函数的基础上, 通过一对由倒向随机差分方程刻画的伴随方程, 给出并证明了带有Markov跳的离散时间非线性随机最优控制问题的最大值原理, 并给出该最优控制问题的一个充分条件和相应的Hamilton-Jacobi-Bellman方程. 最后, 通过 一个实际例子说明了所提理论的实用性和可行性.     

一类具有漂移、扩散及停时的奇异型随机控制

以随机分析的知识和最优控制理论为基础,推广了一类带停时的奇异型随机控制中的折扣费用模型,主要在受控状态过程中增加了漂移因子和扩散因子,使其为一随机微分方程的解,并将费用函数一般化.通过求解一组变分方程,证明了最优控制及最优停时的存在性,并给出了最优费用函数的解析表达式.     

乘性随机离散系统的最优控制

基于对系统随机不确定因素的分析,文中定义了一种新型随机离散系统--乘性随机 离散系统,并研究该类系统的线性二次型(LQ)最优控制问题.首先给出了该类系统的有限时间 和无限时间LQ最优控制律,并着重分析、证明了无限时间LQ最优控制问题的Riccati方程的 正定矩阵解的存在性及相应数值求解算法与收敛性,以及闭环系统的稳定性等问题.仿真结果 表明了该方法的有效性.     

基于策略迭代的连续时间系统的随机线性二次最优控制

针对模型参数部分未知的随机线性连续时间系统, 通过策略迭代算法求解无限时间随机线性二次(LQ) 最优控制问题. 求解随机LQ最优控制问题等价于求随机代数Riccati 方程(SARE) 的解. 首先利用伊藤公式将随机微分方程转化为确定性方程, 通过策略迭代算法给出SARE 的解序列; 然后证明SARE 的解序列收敛到SARE 的解, 而且在迭代过程中系统是均方可镇定的; 最后通过仿真例子表明策略迭代算法的可行性.

     

约束随机线性二次最优控制的研究

本文研究线性终端状态约束下不定随机线性二次最优控制问题.首先利用Lagrange Multiplier 定理得到了存在最优线性状态反馈解的必要条件, 而在加强的条件下也得到了最优控制存在的充分条件. 从某种意义上讲, 以往关于无约束随机线性二次最优控制的一些结果可以看成本文主要定理的推论.     

带有随机通信时滞的状态估计

研究了测量值不带时间戳的网络控制系统的最优状态估计问题. 当最大的随机时滞界是一步滞后时, 对可能存在的乱序测量提出新的测量模型. 基于每一时刻收到的所有测量值的平均值构造估计器以保证不稳定网络控制系统的估计器是线性无偏的及估计误差协方差一致有界, 并通过求解离散黎卡提方程得到估计器增益. 在无偏性及误差协方差一致有界的意义下保证估计器是最优的. 最后给出仿真实例验证了该算法的有效性.     

随机Rayleigh振子的首次穿越和最优控制

研究随机Rayleigh振子的首次穿越和最优控制问题.利用随机平均法给出了系统运动方程的随机平均微分方程,并对平均方程建立了条件可靠性函数的后向Kolmogorov方程,得出相应的首次穿越条件概率密度函数,并利用Lyapunov指数法对受控系统的平均方程进行了随机稳定化,得到了最优控制率.     

线性二次最优控制的精细积分法

LQ控制虽然是最优控制的最基本问题,但其数值求解仍有很多问题.黎卡提微分 方程的精细积分法利用黎卡提方程的解析特点,求出计算机上高度精密的解,并已证明误差 在计算机倍精度数的误差范围之外.这对于Kalman-Bucy滤波,LQG问题以及H∞控制及滤 波等都可运用,精细积分还求解了反馈后的状态微分方程.数例验证了其高精度特性.     

Linear‐Quadratic Optimal Control Problems for Mean‐Field Stochastic Differential Equations with Jumps

In this paper, we study a linear‐quadratic optimal control problem for mean‐field stochastic differential equations driven by a Poisson random martingale measure and a one‐dimensional Brownian motion. Firstly, the existence and uniqueness of the optimal control is obtained by the classic convex variation principle. Secondly, by the duality method, the optimality system, also called the stochastic Hamilton system which turns out to be a linear fully coupled mean‐field forward‐backward stochastic differential equation with jumps, is derived to characterize the optimal control. Thirdly, applying a decoupling technique, we establish the connection between two Riccati equations and the stochastic Hamilton system and then prove the optimal control has a state feedback representation.     

Backward Stochastic H2/H∞ Control with Random Jumps

This paper is concerned with H₂/H_∞ control of a new class of stochastic systems. The most distinguishing feature, compared with the existing literature, is that the systems are described by backward stochastic differential equations (BSDEs) with Brownian motion and random jumps. It is shown that the backward stochastic H₂/H_∞ control under consideration is associated with the of the corresponding uncontrolled backward stochastic perturbed system. A necessary and sufficient condition for the existence of a unique solution to the control problem under consideration is derived. The resulting solution is characterized by the solution of an uncontrolled forward backward stochastic differential equation (FBSDE) with Brownian motion and random jumps. When the coefficients are all deterministic, the equivalent linear feedback solution involves a pair of Riccati‐type equations and an uncontrolled BSDE. In addition an uncontrolled forward stochastic differential equation (SDE) is given.     

Infinite horizon indefinite stochastic linear quadratic control for discrete-time systems

This paper discusses discrete-time stochastic linear quadratic (LQ) problem in the infinite horizon with state and control dependent noise, where the weighting matrices in the cost function are assumed to be indefinite. The problem gives rise to a generalized algebraic Riccati equation (GARE) that involves equality and inequality constraints. The well-posedness of the indefinite LQ problem is shown to be equivalent to the feasibility of a linear matrix inequality (LMI). Moreover, the existence of a stabilizing solution to the GARE is equivalent to the attainability of the LQ problem. All the optimal controls are obtained in terms of the solution to the GARE. Finally, we give an LMI -based approach to solve the GARE via a semidefinite programming.     

一类双线性随机系统M量测不定LQ控制

研究了带有乘性噪声和受扰动观测的离散时间随机系统不定线性二次(Linear quadratic, LQ) 最优输出反馈控制问题. 对此类问题而言,二次成本函数的加权矩阵不定号,并且最优控制具有对偶效果.为在最优性和计算复杂度间 进行折衷,本文采用了一种M量测反馈控制设计方法.基于动态规划方法,将未来的测量结合到当前控制 计算当中的M量测反馈控制可以通过倒向求解一类与原系统维数相同的广义差分Riccati方程(Generalized difference Riccati equation, GDRE)得到.仿真结果 表明本文提出的算法与目前普遍采用的确定等价性方法相比具有优越性.     

A generalized multi-period mean-variance portfolio optimization with Markov switching parameters

In this paper, we deal with a generalized multi-period mean-variance portfolio selection problem with market parameters subject to Markov random regime switchings. Problems of this kind have been recently considered in the literature for control over bankruptcy, for cases in which there are no jumps in market parameters (see [Zhu, S. S., Li, D., & Wang, S. Y. (2004). Risk control over bankruptcy in dynamic portfolio selection: A generalized mean variance formulation. IEEE Transactions on Automatic Control, 49, 447-457]). We present necessary and sufficient conditions for obtaining an optimal control policy for this Markovian generalized multi-period mean-variance problem, based on a set of interconnected Riccati difference equations, and on a set of other recursive equations. Some closed formulas are also derived for two special cases, extending some previous results in the literature. We apply the results to a numerical example with real data for risk control over bankruptcy in a dynamic portfolio selection problem with Markov jumps selection problem.     

Existence of Solution for Generalized Coupled Differential Riccati Equation

By means of the recursive method, the existence of solution is obtained for the generalized coupled differential Riccati equation. As an application, we apply the existence results to consider the optimal control of Markovian jump linear singular system, and obtain the desired explicit representation of the optimal controller for the optimal control problem with the finite horizon.     

Indefinite quadratic with linear costs optimal control of Markov jump with multiplicative noise systems

In this paper we consider the stochastic optimal control problem of discrete-time Markov jump with multiplicative noise linear systems. The performance criterion is assumed to be formed by a linear combination of a quadratic part and a linear part in the state and control variables. The weighting matrices of the state and control for the quadratic part are allowed to be indefinite. We present a necessary and sufficient condition under which the problem is well posed and a state feedback solution can be derived from a set of coupled generalized Riccati difference equations interconnected with a set of coupled linear recursive equations. For the case in which the quadratic-term matrices are non-negative, this necessary and sufficient condition can be written in a more explicit way. The results are applied to a problem of portfolio optimization.     

带Poisson跳的线性二次随机微分博弈及其在鲁棒控制中的应用

研究了一类带Poisson跳扩散过程的线性二次随机微分博弈,包括非零和博弈的Nash均衡策略与零和博弈的鞍点均衡策略问题．利用微分博弈的最大值原理,得到Nash均衡策略的存在条件等价于两个交叉耦合的矩阵Riccati方程存在解,鞍点均衡策略的存在条件等价于一个矩阵Riccati方程存在解的结论,并给出了均衡策略的显式表达及最优性能泛函值．最后,将所得结果应用于现代鲁棒控制中的随机H₂/H_∞控制与随机H_∞控制问题,得到了鲁棒控制策略的存在条件及显式表达,并验证所得结果在金融市场投资组合优化问题中的应用．