正倒向随机微分方程与一类线性二次随机最优控制问题

讨论一类正倒向随机微分方程解的存在唯一性及其对应的一类线性二次随机最优控制 问题,利用单调性方法证明了一类特殊的正倒向随机微分方程解的存在唯一性定理,利用该结果 研究一类耦合了一个倒向随机微分方程的线性随机控制系统广义最优指标随机控制问题,得到 由正倒向随机微分方程的解所表示的唯一最优控制的显式表达式,并得到精确的线性反馈及其 对应的Riccati方程.     

跳跃扩散股价的最优投资组合选择

假定股票价格服从跳跃扩散过程.在传统均值-方差组合投资模型基础上,最大化最终收益的期望及最小化最终财富的方差.引进一个随机线性二次最优控制问题作为原问题的近似问题.证明了一个状态为跳跃扩散过程的一般最优控制问题的验证性定理.应用验证性定理求解HJB(Hamilton-Jacobi-Bellman)方程得到了原问题的最优策略.最后还给出了原问题有效前沿的表达式.     

一类带随机跳跃的完全耦合的线性二次随机控制问题

研究一类带随机跳跃的完全耦合的线性二次随机控制问题. 得到了最优控制的显式解, 并可以证明最优控制是唯一的. 引入了一类推广的黎卡提方程并讨论了其可解性. 利用这一类推广的黎卡提方程的解, 得到了上述带随机跳跃的最优控制问题的线性状态反馈调节器.     

带有随机跳跃干扰的线性二次随机最优控制问题

给出一类布朗运动和泊松过程混合驱动的正倒向随机微分方程解的存在唯一性结果, 应用这一结果研究带有随机跳跃干扰的线性二次随机最优控制问题,并得到最优控制的显式形 式,可以证明最优控制是唯一的.然后,引入和研究一类推广的黎卡提方程系统,讨论该方程系统 的可解性并由该方程的解得到带有随机跳跃干扰的线性二次随机最优控制问题最优的线性反馈.     

基于动态规划的约束优化问题多参数规划求解方法及应用

结合动态规划和单步多参数二次规划, 提出一种新的约束优化控制问题多参数规划求解方法. 一方面能得到约束线性二次优化控制问题最优控制序列与状态之间的显式函数关系, 减少多参数规划问题求解的工作量; 另一方面能够同时求解得到状态反馈最优控制律. 应用本文提出的多参数二次规划求解方法, 建立无限时间约束优化问题状态反馈显式最优控制律. 针对电梯机械系统振动控制模型做了数值仿真计算.     

δ算子下的网络控制系统最优控制方法

研究网络控制系统的随机最优控制问题，提出了针对随机时延的网络控制系统最优控制律和二次型性能指标极小的控制律设计方案．在δ算子域内应用动态规划理论．设计网络控制系统的最优状态反馈和输出反馈控制律，得到的线性二次型高斯控制器可对系统中的随机长时延进行动态补偿．最后通过实例仿真验证了上述最优控制方案的可行性和有效性．     

关于Hybrid线性二次最优控制问题

本文证明了文[3]所讨论的具有Hybrid指标的线性二次最优控制问题实际上可被归入 经典的线性二次最优控制问题,并且利用本文的方法还可把更一般的Hybrid线性二次最优 控制问题也归人经典的线性二次最优控制问题,从而可借助关于后者的现成的理论推出针对 前者的结论.     

鲁棒稳定性对最优二次型控制设计的约束

高品质反馈系统中,对象的模型不确定性给最优控制设计带来许多困难.本文针对车载"动中通"天线伺服系统,研究了一种内模扩展的线性二次调节器(LQR)最优控制设计方法.根据卡尔曼等式和小增益定理,给出了系统的鲁棒稳定性对控制器设计参数的约束条件,以及鲁棒稳定裕量与二次最优性能指标参数的定量关系.最后通过MATLAB仿真和实际系统实验,验证了控制器的有效性.     

线性–非二次最优控制问题的一种解法

讨论了求解状态终端无约束线性–非二次最优控制问题的拟Riccati方程方法, 并据此提出了计算无约束线性–非二次问题之数值解的方法; 然后将这个方法与一种能近似地化有约束问题为无约束问题的惩罚方法结合起来, 给出了一种算法, 可以计算状态终端有约束的线性–非二次最优控制问题之近似解.     

遗传算法在受电弓主动控制器中的应用

为了提高高速列车的受流能力, 降低离网率, 本文以线性二次型最优控制为基础设计了受电弓的主动控制器. 针对线性二次型最优控制中权矩阵Q和R的取值问题, 采用遗传算法进行优化, 通过系统的动态性能指标计算出系统的目标函数并得到权矩阵的最优值, 解决了传统线性二次型最优控制中权矩阵由经验设计所带来的全局最优难实现的问题. 通过仿真分析不同时速下接触网的刚度变化和弓网之间接触压力的参数变化, 本文设计的主动控制器能够很好的减小和控制接触压力的波动, 提高了弓网系统的动态性能指标.     

Linear stochastic control with constraints

This paper concerns the control of some process driven by linear stochastic equation with a quadratic cost and an average quadratic constraint. The constraint can be for example a limitation of the average energy consumption. The existence of an optimal control is proved and an approximate solution is constructed.     

Positive definiteness of a quadratic functional

In a 1975 paper, Molinari [1] proved that under certain continuity and controllability hypotheses, the infinum of a quadratic linear functional subject to linear differential equations constraints and a linear terminal constraint, is a quadratic function of the initial state. We show here how to constructively find this quadratic form under the addition of a positivity assumption. We also show that if a strengthened generalized Legendre-Clebsch condition holds then there is a linear optimal feedback control law.     

Indefinite quadratic with linear costs optimal control of Markov jump with multiplicative noise systems

In this paper we consider the stochastic optimal control problem of discrete-time Markov jump with multiplicative noise linear systems. The performance criterion is assumed to be formed by a linear combination of a quadratic part and a linear part in the state and control variables. The weighting matrices of the state and control for the quadratic part are allowed to be indefinite. We present a necessary and sufficient condition under which the problem is well posed and a state feedback solution can be derived from a set of coupled generalized Riccati difference equations interconnected with a set of coupled linear recursive equations. For the case in which the quadratic-term matrices are non-negative, this necessary and sufficient condition can be written in a more explicit way. The results are applied to a problem of portfolio optimization.     

On a general optimal algorithm for multirate output feedbackcontrollers for linear stochastic periodic systems

A modified optimal algorithm for multirate output feedback controllers of linear stochastic periodic systems is developed. By combining the discrete-time linear quadratic regulation (LQR) control problem and the discrete-time stochastic linear quadratic regulation (SLQR) control problem to obtain an extended linear quadratic regulation (ELQR) control problem, one derives a general optimal algorithm to balance the advantages of the optimal transient response of the LQR control problem and the optimal steady-state regulation of the SLQR control problem. In general, the solution of this algorithm is obtained by solving a set of coupled matrix equations. Special cases for which the coupled matrix equations can be reduced to a discrete-time algebraic Riccati equation are discussed. A reducable case is the optimal algorithm derived by H.M. Al-Rahmani and G.F. Franklin (1990), where the system has complete state information and the discrete-time quadratic performance index is transformed from a continuous-time one     

Stochastic maximum principle for delayed doubly stochastic control systems and their applications

ABSTRACT

In this paper, we investigate the optimal control problems for delayed doubly stochastic control systems. We first discuss the existence and uniqueness of the delayed doubly stochastic differential equation by martingale representation theorem and contraction mapping principle. As a necessary condition of the optimal control, we deduce a stochastic maximum principle under some assumption. At the same time, a sufficient condition of optimality is obtained by using the duality method. At the end of the paper, we apply our stochastic maximum principle to a class of linear quadratic optimal control problem and obtain the explicit expression of the optimal control.     

The design of optimal compensators for linear constant systems with inaccessible states

This paper considers the problem of designing an optimal linear time-invariant dynamic compensator for the regulation of annth-order linear time-invariant plant. The usual quadratic cost on the state and control is averaged over initial plant state values. The globally optimal compensator gains and dynamic order are determined by showing that this problem is mathematically identical to a steady-state stochastic control problem whose optimal solution is known.     

Linear‐Quadratic Optimal Control Problems for Mean‐Field Stochastic Differential Equations with Jumps

In this paper, we study a linear‐quadratic optimal control problem for mean‐field stochastic differential equations driven by a Poisson random martingale measure and a one‐dimensional Brownian motion. Firstly, the existence and uniqueness of the optimal control is obtained by the classic convex variation principle. Secondly, by the duality method, the optimality system, also called the stochastic Hamilton system which turns out to be a linear fully coupled mean‐field forward‐backward stochastic differential equation with jumps, is derived to characterize the optimal control. Thirdly, applying a decoupling technique, we establish the connection between two Riccati equations and the stochastic Hamilton system and then prove the optimal control has a state feedback representation.     

Discrete-time optimal control for stochastic nonlinear polynomial systems

This paper presents a solution to the discrete-time optimal control problem for stochastic nonlinear polynomial systems over linear observations and a quadratic criterion. The solution is obtained in two steps: the optimal control algorithm is developed for nonlinear polynomial systems by considering complete information when generating a control law. Then, the state estimate equations for discrete-time stochastic nonlinear polynomial system over linear observations are employed. The closed-form solution is finally obtained substituting the state estimates into the obtained control law. The designed optimal control algorithm can be applied to both distributed and lumped systems. To show effectiveness of the proposed controller, an illustrative example is presented for a second degree polynomial system. The obtained results are compared to the optimal control for the linearized system.     

Optimal control for linear systems with state equality constraints

This paper deals with the optimal control problem for linear systems with linear state equality constraints. For deterministic linear systems, first we find various existence conditions for constraining state feedback control and determine all constraining feedback gains, from which the optimal feedback gain is derived by reducing the dimension of the control input space. For systems with stochastic noises, it is shown that the same gain used for constraining the deterministic system also optimally constrains the expectation of states inside the constraint subspace and minimizes the expectation of the squared constraint error. We compare and discuss performance differences between unconstrained (using penalty method), projected, and constrained controllers for both deterministic and stochastic systems. Finally, numerical examples are used to demonstrate the performance difference of the three controllers.     

Finite Horizon Minimax Optimal Control of Stochastic Partially Observed Time Varying Uncertain Systems

We consider a linear-quadratic problem of minimax optimal control for stochastic uncertain control systems with output measurement. The uncertainty in the system satisfies a stochastic integral quadratic constraint. To convert the constrained optimization problem into an unconstrained one, a special S-procedure is applied. The resulting unconstrained game-type optimization problem is then converted into a risk-sensitive stochastic control problem with an exponential-of-integral cost functional. This is achieved via a certain duality relation between stochastic dynamic games and risk-sensitive stochastic control. The solution of the risk-sensitive stochastic control problem in terms of a pair of differential matrix Riccati equations is then used to establish a minimax optimal control law for the original uncertain system with uncertainty subject to the stochastic integral quadratic constraint. Date received: May 13, 1997. Date revised: March 18, 1998.