Optimum H designs under sampled state measurements

We present the complete solution to the H^∞-optimal control problem when only sampled values of the state are available. For linear time-varying systems the optimum controller is characterized in terms of the solution of a particular generalized Riccati-differential equation, with the optimum performance determined by the conjugate point conditions associated with a family of generalized Riccati differential equations. For the infinite-horizon time-invariant problem, however, the optimum controller is characterized in terms of the solution of a particular generalized algebraic Riccati equation, and the performance is determined in terms of the conjugate-point conditions of a single generalized Riccati equation, defined on the longest sampling interval. If the distribution of the sampling times is also taken as part of the general design, uniform sampling turns out to be optimal for the infinite horizon case, while for the finite horizon problem a nonuniform sampling generally leads to a better performance.     

线性Markov 切换系统的随机Nash 微分博弈及混合H2/H∞ 控制

研究线性Markov切换系统的随机Nash微分博弈问题。首先借助线性Markov切换系统随机最优控制的相关结果,得到了有限时域和无线时域Nash均衡解的存在条件等价于其相应微分(代数) Riccati方程存在解,并给出了最优解的显式形式;然后应用相应的微分博弈结果分析线性Markov切换系统的混合H2/H∞控制问题;最后通过数值算例验证了所提出方法的可行性。     

Risk-sensitive control of Markov jump linear systems: Caveats and difficulties

In this technical note, we revisit the risk-sensitive optimal control problem for Markov jump linear systems (MJLSs). We first demonstrate the inherent difficulty in solving the risk-sensitive optimal control problem even if the system is linear and the cost function is quadratic. This is due to the nonlinear nature of the coupled set of Hamilton-Jacobi-Bellman (HJB) equations, stemming from the presence of the jump process. It thus follows that the standard quadratic form of the value function with a set of coupled Riccati differential equations cannot be a candidate solution to the coupled HJB equations. We subsequently show that there is no equivalence relationship between the problems of risk-sensitive control and H ^∞ control of MJLSs, which are shown to be equivalent in the absence of any jumps. Finally, we show that there does not exist a large deviation limit as well as a risk-neutral limit of the risk-sensitive optimal control problem due to the presence of a nonlinear coupling term in the HJB equations.

     

General receding horizon control for linear time-delay systems

A general receding horizon control (RHC), or model predictive control (MPC), for time-delay systems is proposed. The proposed RHC is obtained by minimizing a new cost function that includes two terminal weighting terms, which are closely related to the closed-loop stability. The general solution of the proposed RHC is derived using the generalized Riccati method. Furthermore, an explicit solution is obtained for the case where the horizon length is less than or equal to the delay size. A linear matrix inequality (LMI) condition on the terminal weighting matrices is proposed, under which the optimal cost is guaranteed to be monotonically non-increasing. It is shown that the monotonic condition of the optimal cost guarantees closed-loop stability of the RHC. Simulations demonstrate that the proposed RHC effectively stabilizes time-delay systems.     

Guaranteeing cost strategies for linear quadratic differential games under uncertain dynamics

This paper deals with the design of closed loop strategies for a class of two players zero-sum linear quadratic differential games, where each player does not know exactly the state equation and model it through a system subject to norm-bounded uncertainties. The finite horizon and the infinite horizon problems are both solved: it turns out that the optimal strategies, guaranteeing to each player a given level of performance, require, to be evaluated, the solution of two scaled differential (algebraic in the infinite horizon case) Riccati equations. A numerical example illustrates an application of the proposed technique.     

Mixed ℋ︁2/ℋ︁∞ nonlinear filtering

In this paper, we consider the mixed ??₂/??_∞ filtering problem for affine nonlinear systems. Sufficient conditions for the solvability of this problem with a finite‐dimensional filter are given in terms of a pair of coupled Hamilton–Jacobi–Isaacs equations (HJIEs). For linear systems, it is shown that these conditions reduce to a pair of coupled Riccati equations similar to the ones for the control case. Both the finite‐horizon and the infinite‐horizon problems are discussed. Simulation results are presented to show the usefulness of the scheme, and the results are generalized to include other classes of nonlinear systems. Copyright © 2008 John Wiley & Sons, Ltd.     

无限时间长时延网络控制系统的随机最优控制

考虑二次性能指标下线性网络控制系统的随机最优控制问题,建立了控制器为事件驱动时长时延线性网络控制系统的数学模型,证明了在无限时间情况下离散随机黎卡提代数方程解的存在性,设计出无限时间情况下线性网络控制系统的随机最优控制器,得到相应的最优性能指标的表达形式,并证明了相应的随机最优控制器可使网络控制系统均方指数稳定.最后以网络控制下的倒立摆为对象进行仿真研究,仿真结果表明该方法的正确性和有效性.     

事件驱动的网络化系统最优控制

针对随机事件驱动的网络化控制系统, 研究其中的有限时域和无限时域内最优控制器的设计问题. 首先, 根据执行器介质访问机制将网络化控制系统建模为具有多个状态的马尔科夫跳变系统; 然后, 基于动态规划和马尔科夫跳变线性系统理论设计满足二次型性能指标的最优控制序列, 通过求解耦合黎卡提方程的镇定解, 给出最优控制律的计算方法, 使得网络化控制系统均方指数稳定; 最后, 通过仿真实验表明了所提出方法的有效性.

     

On ℋ∞ control for dead-time systems

A mixed sensitivity ℋ_∞ problem is solved for dead-time systems. It is shown that for a given bound on the ℋ_∞-norm causal stabilizing controllers exist that achieve this bound if and only if a related finite-dimensional Riccati equation has a solution with a certain nonsingularity property. In the case of zero time delay, the Riccati equation is a standard Riccati equation and the nonsingularity condition is that the solution be nonnegative definite. For nonzero time delay, the nonsingularity condition is more involved but still allows us to obtain controllers. All suboptimal controllers are parameterized, and the central controller is shown to be a feedback interconnection of a finite-dimensional system and a finite memory system, both of which can be implemented. Some ℋ_∞ problems are rewritten as pure rational ℋ _∞, problems using a Smith predictor parameterization of the controller     

H∞滤波问题数值求解的精细积分算法

有限时间H∞滤波的Riccati方程和滤波方程分别为非线性矩阵微分方程和线性变系 数微分方程,而且Riccati微分方程解的存在性还依赖于参数 γ-2,因此求这些方程的数值解一 般比较困难.按照结构力学与最优控制的模拟关系,Riccati方程解存在的临界参数 γ-2cr对应于 广义Rayleigh商的一阶本征值.因此可以用精细积分法结合扩展的Wittrick-Williams(W-W) 算法计算 γ-2cr .并求解Ricclati方程,滤波微分方程的解也可以由精细积分法计算.     

Monte Carlo TD(λ)-methods for the optimal control of discrete-time Markovian jump linear systems

In this paper, we present an iterative technique based on Monte Carlo simulations for deriving the optimal control of the infinite horizon linear regulator problem of discrete-time Markovian jump linear systems for the case in which the transition probability matrix of the Markov chain is not known. We trace a parallel with the theory of TD(λ) algorithms for Markovian decision processes to develop a TD(λ) like algorithm for the optimal control associated to the maximal solution of a set of coupled algebraic Riccati equations (CARE). It is assumed that either there is a sample of past observations of the Markov chain that can be used for the iterative algorithm, or it can be generated through a computer program. Our proofs rely on the spectral radius of the closed loop operators associated to the mean square stability of the system being less than 1.     

Characterizing all optimal controls for an indefinite stochasticlinear quadratic control problem

This paper is concerned with a stochastic linear quadratic (LQ) control problem in the infinite-time horizon, with indefinite state and control weighting matrices in the cost function. It is shown that the solvability of this problem is equivalent to the existence of a so-called static stabilizing solution to a generalized algebraic Riccati equation. Moreover, another algebraic Riccati equation is introduced and all the possible optimal controls, including the ones in state feedback form, of the underlying LQ problem are explicitly obtained in terms of the two Riccati equations     

Discrete‐time mixed ℋ︁2/ℋ︁∞ nonlinear filtering

In this paper, we consider the discrete‐time mixed ??₂/??_∞ filtering problem for affine nonlinear systems. Necessary and sufficient conditions for the solvability of this problem with a finite‐dimensional filter are given in terms of a pair of coupled discrete‐time Hamilton–Jacobi‐Isaac's equations (DHJIE) with some side‐conditions. For linear systems, it is shown that these conditions reduce to a pair of coupled discrete‐time algebraic‐Riccati‐equations (DAREs) or a system of linear matrix inequalities (LMIs) similar to the ones for the control case. Both the finite‐horizon and infinite‐horizon problems are discussed. Moreover, sufficient conditions for approximate solvability of the problem are also derived. These solutions are especially useful for computational purposes, considering the difficulty of solving the coupled DHJIEs. An example is also presented to demonstrate the approach. Copyright © 2010 John Wiley & Sons, Ltd.     

带马尔科夫跳和乘积噪声的随机系统的最优控制

讨论了N个选手随机系统的最优控制问题. 设计了无限时间的带有马尔科夫跳和乘积噪声的随机系统的Pareto最优控制器. 应用推广的Lyapunov方法和解随机Riccati代数方程得到了系统的Pareto最优解, 证明了最优控制器是稳定的反馈控制器, 以及对应于最优控制器的反馈增益中的随机Riccati代数方程的解是最小解.     

线性离散奇异系统的不定二次最优控制问题: Krein空间方法

The finite time horizon indefinite linear quadratic(LQ) optimal control problem for singular linear discrete time-varying systems is discussed. Indefinite LQ optimal control problem for singular systems can be transformed to that for standard state-space systems under a reasonable assumption. It is shown that the indefinite LQ optimal control problem is dual to that of projection for backward stochastic systems. Thus, the optimal LQ controller can be obtained by computing the gain matrices of Kalman filter. Necessary and sufficient conditions guaranteeing a unique solution for the indefinite LQ problem are given. An explicit solution for the problem is obtained in terms of the solution of Riccati difference equations.     

Stabilization of linear autonomous systems of differential equations with distributed delay

Consideration is given to the problem of optimal stabilization of differential equation systems with distributed delay. The optimal stabilizing control is formed according to the principle of feedback. The formulation of the problem in the functional space of states is used. It was shown that coefficients of the optimal stabilizing control are defined by algebraic and functional-differential Riccati equations. To find solutions to Riccati equations, the method of successive approximations is used. The problem for this control law and performance criterion is to find coefficients of a differential equation system with distributed delay, for which the chosen control is a control of optimal stabilization. A class of control laws for which the posed problem admits an analytic solution is described.     

Solvability of indefinite stochastic Riccati equations and linear quadratic optimal control problems

A new approach to study the indefinite stochastic linear quadratic (LQ) optimal control problems, which we called the “equivalent cost functional method”, is introduced by Yu (2013) in the setup of Hamiltonian system. On the other hand, another important issue along this research direction, is the possible state feedback representation of optimal control and the solvability of associated indefinite stochastic Riccati equations. As the response, this paper continues to develop the equivalent cost functional method by extending it to the Riccati equation setup. Our analysis is featured by its introduction of some equivalent cost functionals which enable us to have the bridge between the indefinite and positive-definite stochastic LQ problems. With such bridge, some solvability relation between the indefinite and positive-definite Riccati equations is further characterized. It is remarkable the solvability of the former is rather complicated than the latter, hence our relation provides some alternative but useful viewpoint. Consequently, the corresponding indefinite linear quadratic problem is discussed for which the unique optimal control is derived in terms of state feedback via the solution of the Riccati equation. In addition, some example is studied using our theoretical results.     

Maximal and Stabilizing Hermitian Solutions for Discrete-Time Coupled Algebraic Riccati Equations

Discrete-time coupled algebraic Riccati equations that arise in quadratic optimal control and H _∞-control of Markovian jump linear systems are considered. First, the equations that arise from the quadratic optimal control problem are studied. The matrix cost is only assumed to be hermitian. Conditions for the existence of the maximal hermitian solution are derived in terms of the concept of mean square stabilizability and a convex set not being empty. A connection with convex optimization is established, leading to a numerical algorithm. A necessary and sufficient condition for the existence of a stabilizing solution (in the mean square sense) is derived. Sufficient conditions in terms of the usual observability and detectability tests for linear systems are also obtained. Finally, the coupled algebraic Riccati equations that arise from the H _∞-control of discrete-time Markovian jump linear systems are analyzed. An algorithm for deriving a stabilizing solution, if it exists, is obtained. These results generalize and unify several previous ones presented in the literature of discrete-time coupled Riccati equations of Markovian jump linear systems. Date received: November 14, 1996. Date revised: January 12, 1999.     

Another look at finite horizon H control problems for systems with input delays

We discuss a finite horizon H^∞ control problem for time-varying systems with input delays. Clarifying a relationship between two H^∞ control problems in input delay case and in measurement delay case, we derive a solution in input delay case based on the known result for the H^∞ control problem in measurement delay case, and show that the solution has the same predictor-observer structure as the solution in measurement delay case has. Using this structural information on the solution, we also present an elementary proof of the solution to the finite horizon H^∞ control problem for systems with input delays, which is based only on completion of squares.     

Discrete-time LQ-optimal control problems for infinite Markov jumpparameter systems

Optimal control problems for discrete-time linear systems subject to Markovian jumps in the parameters are considered for the case in which the Markov chain takes values in a countably infinite set. Two situations are considered: the noiseless case and the case in which an additive noise is appended to the model. The solution for these problems relies, in part, on the study of a countably infinite set of coupled algebraic Riccati equations (ICARE). Conditions for existence and uniqueness of a positive semidefinite solution to the ICARE are obtained via the extended concepts of stochastic stabilizability (SS) and stochastic detectability (SD), which turn out to be equivalent to the spectral radius of certain infinite dimensional linear operators in a Banach space being less than one. For the long-run average cost, SS and SD guarantee existence and uniqueness of a stationary measure and consequently existence of an optimal stationary control policy. Furthermore, an extension of a Lyapunov equation result is derived for the countably infinite Markov state-space case