Existence conditions and properties for the maximal periodic solution of periodic Riccati difference equations

The existence and properties of the maximal symmetric periodic solution of the periodic Riccati difference equation, is analysed for the optimal filtering problem of linear periodic discrete-time systems. Special emphasis is given to systems not necessarily reversible and subject only to a detectability assumption. Necessary and sufficient conditions for the existence and uniqueness of periodic non-negative definite solutions of the periodic Riccati difference equation which gives rise to a stable filter are also established. Furthermore, the convergence of non-negative definite solutions of the Riccati equation is investigated.     

SDP-based approximation of stabilising solutions for periodic matrix Riccati differential equations

Numerically finding stabilising feedback control laws for linear systems of periodic differential equations is a nontrivial task with no known reliable solutions. The most successful method requires solving matrix differential Riccati equations with periodic coefficients. All previously proposed techniques for solving such equations involve numerical integration of unstable differential equations and consequently fail whenever the period is too large or the coefficients vary too much. Here, a new method for numerical computation of stabilising solutions for matrix differential Riccati equations with periodic coefficients is proposed. Our approach does not involve numerical solution of any differential equations. The approximation for a stabilising solution is found in the form of a trigonometric polynomial, matrix coefficients of which are found solving a specially constructed finite-dimensional semidefinite programming (SDP) problem. This problem is obtained using maximality property of the stabilising solution of the Riccati equation for the associated Riccati inequality and sampling technique. Our previously published numerical comparisons with other methods shows that for a class of problems only this technique provides a working solution. Asymptotic convergence of the computed approximations to the stabilising solution is proved below under the assumption that certain combinations of the key parameters are sufficiently large. Although the rate of convergence is not analysed, it appeared to be exponential in our numerical studies.     

Nonsymmetric Riccati equations: Partitioned algorithms

Generalized partitioned solutions (GPS) of nonsymmetric matric Riccati equations are presented in terms of forward and backward time differential equations that are of theoretical interest and also are computationally powerful. The GPS are the natural framework for the effective change of initial conditions, and the transformation of backward Riccati equation to forward Riccati equation and vice versa.Based on the GPS, computationally effective algorithms are obtained for the numerical solution of Riccati equations. These partitioned numerical algorithms have a decomposed or “partitioned” structure. They are given exactly in terms of a set of elemental solutions which are completely decoupled, and as such computable in either a parallel or serial processing mode. The overall solution is given exactly in terms of a simple recursive operation on the elemental solutions. Except for a subinterval of the total computation interval, the partitioned numerical algorithms are integration-free for the Riccati equation with constant or periodic matrices.Most importantly based on the GPS, a computationally attractive numerical algorithm is obtained for the computation of the steady-state solution of time-invariant Riccati equations. By making use of the GPS and some simple iterative operations, the Riccati solution is obtained in an interval which is twice as long as the previous interval requiring integration only in the initial subinterval.     

Cyclomonotonicity and stabilizability properties of solutions ofthe difference periodic Riccati equation

The Kalman filter associated with a discrete-time linear T-periodic system is tested. The problem considered is that of selecting an initial covariance matrix such that the periodic filter based on the first T values of the Kalman filter gain is stabilizing. Sufficient conditions are given that hinge on the cyclomonotonicity of the solution of the periodic Riccati equation. Potential applications are found in filter design, quasi-linearization techniques for the periodic Riccati equation, and the design of receding-horizon control strategies for periodic and multirate systems. When specialized to time-invariant systems, the results give rise to new sufficient conditions for the cyclomonotonicity of the solutions of the time-invariant Riccati equation and the existence of periodic stabilizing feedback     

Global aspects of the matrix Riccati equation

Matrix Riccati equations are interpreted as differential equations on Grassman manifolds. Necessary conditions for the Riccati equation to be a Morse-Smale system are given in the autonomous and periodic cases. Under this condition, the equation is structurally stable and has a unique asymptotically stable equilibrium point or periodic solution.     

Periodic strong solution for the optimal filtering problem oflinear discrete-time periodic systems

The periodic Riccati difference equation (PRDE) for the optimal filtering problem of linear periodic discrete-time systems is addressed. Specifically, the author provides a number of results on the existence, uniqueness, and stability properties of symmetric periodic nonnegative-definite solutions of the periodic Riccati difference equation in the case of nonreversible and nonstabilizable periodic systems. The convergence of symmetric periodic nonnegative-definite solutions of the periodic Riccati difference equation is also analyzed. The results have been established under weaker assumptions and include both necessary and sufficient conditions. The existence and properties of symmetric periodic nonnegative-definite solutions of the PRDE are established directly from the PRDE     

A new computational solution of the linear optimal regulator problem

A new method is presented for the numerical deterruination of the solution of the steady-state matrix Riccati equation. The equation is converted to a canonical form corresponding to Luenberger's canonical representation for controllable multivariable systems. Three special matrices closely associated with Luenberger's canonical form are defined and two related lemmas are established. These results are used to obtain concise expressions for the eigenvectors of the Hamiltonian matrix associated with the canonical Riccati equation in terms of the solutions of a much simpler reduced Hamiltonian system. Using a theorem due to Potter the solution of the Riccati equation is written in terms of the concise eigenvector expressions. The method is particularly well suited to problems in which the ratio of system states to system inputs is large and it can lead to a 26 to 1 reduction in the computational effort required to solve the Riccati equation.     

Criterion for the convergence of the solution of the Riccati differential equation

The optimal control problem for a linear system with a quadratic cost function leads to the matrix Riccati differential equation. The convergence of the solution of this equation for increasing time interval is investigated as a function of the final state penalty matrix. A necessary and sufficient condition for convergence is derived for stabilizable systems, even if the output in the cost function is not detectable. An algorithm is developed to determine the limiting value of the solution, which is one of the symmetric positive semidefinite solutions of the algebraic Riccati equation. Examples for convergence and nonconvergence are given. A discussion is also included of the convergence properties of the solution of the Riccati differential equation to any real symmetric (not necessarily positive semidefinite) solution of the algebraic Riccati equation.     

The standard H∞ problem in systems with a singleinput delay

The standard H_∞ problem is solved for LTI systems with a single, pure input lag. The solution is based on state-space analysis, mixing a finite-dimensional and an abstract evolution model. Utilizing the relatively simple structure of these distributed systems, the associated operator Riccati equations are reduced to a combination of two algebraic Riccati equations and one differential Riccati equation over the delay interval. The results easily extend to finite time and time-varying problems where the algebraic Riccati equations are substituted by differential Riccati equations over the process time duration     

A note on the maximal solution of the periodic Riccati equation

The periodic symmetric solutions of the periodic Riccati differential equation associated with the filtering problem are considered by the authors. It is proven that, under the sole assumption of detectability, there exists a maximal solution. Moreover, such a solution turns out to be strong, i.e. the characteristic multipliers of the associated closed-loop system belong to the closed unit disk. The proof relies on an iterative linearization technique, which calls for a sequence of periodic Lyapunov equations. Similar results are given for the minimal solution     

Infinite horizon LQR for systems with multiple delays in a single input channel

This paper is concerned with the linear quadratic regulation (LQR) problem for both linear discrete-time systems and linear continuous-time systems with multiple delays in a single input channel. Our solution is given in terms of the solution to a two-dimensional Riccati difference equation for the discrete-time case and a Riccati partial differential equation for the continuous-time case. The conditions for convergence and stability are provided.     

有限时间二次型数值算法研究及其应用

为了实际需要和学术发展的要求,研究了以倒立摆为控制对象,通过闭环网络形成的反馈控制系统的随机传输时延的最优控制问题。在求解有限时间最优控制律过程中,通过矩阵Raccati方程的离散变换,利用Matlab中计算无限时间二次型最优控制器的LQR函数,从而求出有限时间LQR问题的数值解。通过仿真结果证明,研究的方法能够使倒立摆系统最终稳定,从而说明提出的算法对于求解有限时间LQR问题是有效的。     

The Riccati equation with variable coefficients expansion algorithm to find more exact solutions of nonlinear differential equations

In this paper based on a system of Riccati equations with variable coefficients, we present a new Riccati equation with variable coefficients expansion method and its algorithm, which are direct and more powerful than the tanh-function method, sine-cosine method, the generalized hyperbolic-function method and the generalized Riccati equation with constant coefficient expansion method to construct more new exact solutions of nonlinear differential equations in mathematical physics. A pair of generalized Hamiltonian equations is chosen to illustrate our algorithm such that more families of new exact solutions are obtained which contain soliton-like solution and periodic solutions. This algorithm can also be applied to other nonlinear differential equations.     

A nonrecursive algebraic solution for the discrete Riccati equation

Equations for the optimal linear control and filter gains for linear discrete systems with quadratic performance criteria are widely documented. A nonrecursive algebraic solution for the Riccati equation is presented. These relations allow the determination of the steady-state solution of the Riccati equation directly without iteration. The relations also allow the direct determination of the transient solution for any particular time without proceeding recursively from the initial conditions. The method involves finding the eigenvalues and eigenvectors of the canonical state-costate equations.     

On closed form solutions for the differential matrix Riccati equation problem

A new formulation of the differential matrix Riccati equation is presented and a closed analytical solution is obtained under the hypothesis that certain commutativity conditions are fulfilled on a transformed space. The formulation generalizes the results of [1] on algebraic equations to differential matrix Riccati equations. To illustrate the usefulness of the method, a closed analytical solution of the differential matrix Riccati equation is obtained inR^{2 times 2}.     

Numerical solution of the discrete-time periodic Riccati equation

In this paper we present a method for the computation of the periodic nonnegative definite stabilizing solution of the periodic Riccati equation. This method simultaneously triangularizes by orthogonal equivalences a sequence of matrices associated with a cyclic pencil formulation related to the Euler-Lagrange difference equations. In doing so, it is possible to extract a basis for the stable deflating subspace of the extended pencil, from which the Riccati solution is obtained. This algorithm is an extension of the standard QZ algorithm and retains its attractive features, such as quadratic convergence and small relative backward error. A method to compute the optimal feedback controller gains for linear discrete time periodic systems is dealt with     

Closed‐form solution to finite‐horizon suboptimal control of nonlinear systems

Finite‐horizon optimal control of input‐affine nonlinear systems with fixed final time is considered in this study. It is first shown that the associated Hamilton–Jacobi–Bellman partial differential equation to the problem is reducible to a state‐dependent differential Riccati equation after some approximations. With a truncation in the control equation, a near optimal solution to the problem is obtained, and the global onvergence properties of the closed‐loop system are analyzed. Afterwards, an approximate method, called Finite‐horizon State‐Dependent Riccati Equation (Finite‐SDRE), is suggested for solving the differential Riccati equation, which renders the origin a locally exponentially stable point. The proposed method provides online feedback solution for controlling different initial conditions. Finally, through some examples, the performance of the resulting controller in finite‐horizon control is analyzed. Copyright © 2014 John Wiley & Sons, Ltd.     

The difference periodic Ricati equation for the periodic predictionproblem

Gives a comprehensive treatment of several important aspects of the discrete-time periodic Riccati equation (DPRE) arising from the prediction problem for linear discrete-time periodic systems. The authors analyze the symmetric periodic positive semidefinite (SPPS) solution of the DPRE under appropriate assumptions of stabilizability and detectability of the periodic system. Among the results obtained are necessary and sufficient conditions for the existence and uniqueness of the SPPS solution and the stability of the resulting closed-loop system. Some of these results can be seen as extensions of the corresponding results for the time-invariant case; however, a number of them contain contributions to the time-invariant case as well. The paper also gives a numerical algorithm based on an iterative linearization procedure for computing the SPPS solution. The algorithm is a periodic version of Kleinman's algorithm for the time-invariant case     

周期黎卡提微分方程正定解的存在性

讨论了标准的周期黎卡提微分方程,给出了其存在埃尔米特周期正定（HPPD）解的一个完整的充分必要条件。准确地说,在经过一个适当的状态空间基底变换后该条件通过能稳性和能检测性概念表述。结果表明,当HP－PD解存在时,它或者是唯一的,或者有无限多个。这一结果可以看作是Richardson和Kwong的结果对周期时变情况的扩展。     

Optimal control of an advection-dominated catalytic fixed-bed reactor with catalyst deactivation

The paper focuses on the linear-quadratic control problem for a time-varying partial differential equation model of a catalytic fixed-bed reactor. The classical Riccati equation approach, for time-varying infinite-dimensional systems, is extended to cover the two-time scale property of the fixed-bed reactor. Dynamical properties of the linearized model are analyzed using the concept of evolution systems. An optimal LQ-feedback is computed via the solution of a matrix Riccati partial differential equation. Numerical simulations are performed to evaluate the closed loop performance of the designed controller on the fixed-bed reactor. The performance of the proposed controller is compared to performance of an infinite dimensional controller formulated by ignoring the catalyst deactivation. Simulation results show that the performance of the proposed controller is better compared to the controller ignoring the catalyst deactivation when the deactivation time is close to the resident time of the reactor.