Robust stability and H∞ control for uncertain discrete Markovian jump singular systems with mode‐dependent time‐delay

The robust stochastic stability, stabilization and H_∞ control for mode‐dependent time‐delay discrete Markovian jump singular systems with parameter uncertainties are discussed. Based on the restricted system equivalent (r.s.e.) transformation and by introducing new state vectors, the singular system is transformed into a standard linear system, and delay‐dependent linear matrix inequalities (LMIs) conditions for the mode‐dependent time‐delay discrete Markovian jump singular systems to be regular, causal and stochastically stable, and stochastically stable with γ‐disturbance attenuation are obtained, respectively. With these conditions, robust stabilization problem and robust H_∞ control problem are solved, and the LMIs sufficient conditions are obtained. A numerical example illustrates the effectiveness of the method given in the paper. Copyright © 2008 John Wiley & Sons, Ltd.     

Delay-range-dependent robust stabilisation and H ∞ control for nonlinear uncertain stochastic fuzzy systems with mode-dependent time delays and Markovian jump parameters

This article focuses on the problems of robust stabilisation and H _∞ control for nonlinear uncertain stochastic systems with mode-dependent time delay and Markovian jump parameters represented by the Takagi–Sugeno (T-S) fuzzy model approach. The system under consideration involves parameter uncertainties, Itô-type stochastic disturbances, Markovian jump parameters and unknown nonlinear disturbances. The purpose is to design a state feedback controller such that the closed-loop system is robustly exponentially stable in the mean square and satisfies a prescribed H _∞ performance level. Novel delay-range-dependent conditions in the form of linear matrix inequalities (LMIs) are derived for the solvability of robust stabilisation and H _∞ control problem. A desired fuzzy controller can be constructed by solving a set solutions of LMIs and can be easily calculated by Matlab LMI control toolbox. Finally, a numerical example is presented to illustrate the proposed method.     

Robust stability and H-infinity control for uncertain discrete-time Markovian jump singular systems

The robust stability and stabilization, and H-infinity control problems for discrete-time Markovian jump singular systems with parameter uncertainties are discussed. Based on the restricted system equivalent （r.s.e.） transformation and by introducing new state vectors, the singular system is transformed into a discrete-time Markovian jump standard linear system, and the linear matrix inequality （LMI） conditions for the discrete-time Markovian jump singular systems to be regular, causal, stochastically stable, and stochastically stable with 7- disturbance attenuation are obtained, respectively. With these conditions, the robust state feedback stochastic stabilization problem and H-infinity control problem are solved, and the LMI conditions are obtained. A numerical example illustrates the effectiveness of the method given in the oaoer.     

Robust stability,stabilization and ℋ∞ control of time‐delay systems with Markovian jump parameters

In this paper, the problems of stochastic stability and stabilization for a class of uncertain time‐delay systems with Markovian jump parameters are investigated. The jumping parameters are modelled as a continuous‐time, discrete‐state Markov process. The parametric uncertainties are assumed to be real, time‐varying and norm‐bounded that appear in the state, input and delayed‐state matrices. The time‐delay factor is constant and unknown with a known bound. Complete results for both delay‐independent and delay‐dependent stochastic stability criteria for the nominal and uncertain time‐delay jumping systems are developed. The control objective is to design a state feedback controller such that stochastic stability and a prescribed ?_∞‐performance are guaranteed. We establish that the control problem for the time‐delay Markovian jump systems with and without uncertain parameters can be essentially solved in terms of the solutions of a finite set of coupled algebraic Riccati inequalities or linear matrix inequalities. Extension of the developed results to the case of uncertain jumping rates is also provided. Copyright © 2003 John Wiley & Sons, Ltd.     

Robust stability and H-infinity control for uncertain discrete-time Markovian jump singular systems

The robust stability and stabilization, and H-infinity control problems for discrete-time Markovian jump singular systems with parameter uncertainties are discussed. Based on the restricted system equivalent (r.s.e.) transformation and by introducing new state vectors, the singular system is transformed into a discrete-time Markovian jump standard linear system, and the linear matrix inequality (LMI) conditions for the discrete-time Markovian jump singular systems to be regular, causal, stochastically stable, and stochastically stable with °- disturbance attenuation are obtained, respectively. With these conditions, the robust state feedback stochastic stabilization problem and H-infinity control problem are solved, and the LMI conditions are obtained. A numerical example illustrates the effectiveness of the method given in the paper.     

Robust Hinfinity state feedback control of discrete time-delay linear systems with norm-bounded uncertainty

This paper studies, via a linear matrix inequality approach, the problem of Hinfinity control for discrete time-delay linear systems with parametric uncertainty. The system under consideration is subjected to both time-varying norm-bounded parameter uncertainty and time delay in the state. First, the problem of robust stability of the underlying system is investigated. Next, we address the problem of robust Hinfinity state feedback control in which both robust stability and a prescribed Hinfinity performance are required to be achieved irrespective of the uncertainty and time delay. It is shown that the above problem can be solved if a linear matrix inequality has a symmetric positive definite solution.     

Stabilization of discrete-time Markovian jump linear systems via time-delayed controllers

This paper is concerned with the stabilization problem for a class of discrete-time Markovian jump linear systems with time-delays both in the system state and in the mode signal. The delay in the system state may be time-varying. The delay in the mode signal is manifested as a constant mismatch of the modes between the controller and the system. We first show that the resulting closed-loop system is a time-varying delayed Markovian jump linear system with extended state space. Then a sufficient condition is proposed for the design of a controller such that the closed-loop system is stochastically stable. Finally, numerical simulation is used to illustrate the developed theory.     

Finite horizon quadratic optimal control and a separation principle for Markovian jump linear systems

In this note, we consider the finite-horizon quadratic optimal control problem of discrete-time Markovian jump linear systems driven by a wide sense white noise sequence. We assume that the output variable and the jump parameters are available to the controller. It is desired to design a dynamic Markovian jump controller such that the closed-loop system minimizes the quadratic functional cost of the system over a finite horizon period of time. As in the case with no jumps, we show that an optimal controller can be obtained from two coupled Riccati difference equations, one associated to the optimal control problem when the state variable is available, and the other one associated to the optimal filtering problem. This is a principle of separation for the finite horizon quadratic optimal control problem for discrete-time Markovian jump linear systems. When there is only one mode of operation our results coincide with the traditional separation principle for the linear quadratic Gaussian control of discrete-time linear systems.     

Robust H 2-control for discrete-time Markovian jump linear systems

This paper deals with the robust H₂-control of discrete-time Markovian jump linear systems. It is assumed that both the state and jump variables are available to the controller. Uncertainties satisfying some norm bounded conditions are considered on the parameters of the system. An upper bound for the H₂-control problem is derived in terms of a linear matrix inequality (LMI) optimization problem. For the case in which there are no uncertainties, we show that the convex formulation is equivalent to the existence of the mean square stabilizing solution for the set of coupled algebraic Riccati equations arising on the quadratic optimal control problem of discrete-time Markovian jump linear systems. Therefore, for the case with no uncertainties, the convex formulation considered in this paper imposes no extra conditions than those in the usual dynamic programming approach. Finally some numerical examples are presented to illustrate the technique.     

On stabilization of bilinear uncertain time-delay stochasticsystems with Markovian jumping parameters

In this paper, we investigate the stochastic stabilization problem for a class of bilinear continuous time-delay uncertain systems with Markovian jumping parameters. Specifically, the stochastic bilinear jump system under study involves unknown state time-delay, parameter uncertainties, and unknown nonlinear deterministic disturbances. The jumping parameters considered here form a continuous-time discrete-state homogeneous Markov process. The whole system may be regarded as a stochastic bilinear hybrid system that includes both time-evolving and event-driven mechanisms. Our attention is focused on the design of a robust state-feedback controller such that, for all admissible uncertainties as well as nonlinear disturbances, the closed-loop system is stochastically exponentially stable in the mean square, independent of the time delay. Sufficient conditions are established to guarantee the existence of desired robust controllers, which are given in terms of the solutions to a set of either linear matrix inequalities (LMIs), or coupled quadratic matrix inequalities. The developed theory is illustrated by numerical simulation     

Robust observer-based H<Subscript>∞</Subscript> control of a Markovian jump system with different delay and system modes

This paper investigates the problem of robust observer-based stabilization for a delayed Markovian jump system. The sources of randomness in the system mode and the delay mode are assumed to be different. To this end, two different Markov processes are considered for modeling the randomness of the system matrices and the state delay. A two mode-dependent Lyapunov-Krasovskii functional is used to design a robust observer based feedback control rule for the stochastic stability of the closed-loop system. The rule4 should also satisfy the condition of disturbance reduction at a prescribed level in the presence of parametric uncertainties. The procedure is implemented by solving linear matrix inequalities (LMIs). The results are tested within a simulation example and the effectiveness of the proposed design method is verified.     

Robust stabilisation of uncertain delayed Markovian jump systems and its applications

This paper is concerned with the robust stabilsation of uncertain delayed Markovian jump systems. Given a Markovian jump system with time delay and Brownian motion simultaneously, we allow the uncertainty added in the form of additive perturbations and existing in the drift and diffusion sections at the same time. A sufficient condition on the mean square stability of system in the face of such disturbances is obtained, which is similar to small-gain theorem. A kind of partially delay-dependent controller stabilising the resulting closed-loop system is firstly designed to relate to the probability distribution of delay, whose key idea is applied to construct a delayed controller with disordering phenomenon. It is seen that the existence conditions established here could be solved easily. Based on the proposed results, some applications on robust synchronisation of uncertain delayed multi-agent systems with Markovian switching are considered. It is shown that the robust synchronisation of such an uncertain multi-agent network could be achieved by a protocol that each controller being partially delay-dependent or disordering could robustly stabilise a given single Markovian jump system. As for these cases, the proposed protocols could be obtained by solving certain algebraic Riccati equations and inequalities, which also involve weighting factors and depend on the eigenvalues of the Laplacian graph.     

Dissipativity of diffusion Itô processes with Markovain switching and problems of robust stabilization

Consideration is given to a class of systems described by a finite set of controlled diffusion Itô processes that are control-affine, with jump transitions between them, and are defined by the evolution of a uniform Markovian chain (Markovian switching). Each state of this chain corresponds to a certain system mode. A stochastic version of the notion dissipativity by Willems is introduced, and properties of diffusion processes with Markovian switching are studied. The relationship between passivity and stabilizability in the process of output-feedback control is established. The obtained results are applied to the problem of robust simultaneous stabilization for the set of nonlinear systems with undetermined parameters. As a partial case, a problem of robust simultaneous stabilization for the set of linear systems where final results are obtained in terms of linear matrix inequalities.     

New stochastic robust stability criteria for time-varying delay neutral system with Markovian jump parameters

In this paper, the problem of stochastic robust stability of time-varying delay neutral system with Markovian jump parameters is investigated. The jumping parameters are considered as a continuous-time, continuous state Markov process. Based on the Lyapunov-Krasovskii functional approach, a new delay-dependent stochastic stability criteria is presented in terms of LMIs. A numerical example is given to illustrate the effectiveness of the developed method.     

Delay‐dependent robust control for singular discrete‐time Markovian jump systems with time‐varying delay

The problem of delay‐dependent robust stabilization for uncertain singular discrete‐time systems with Markovian jumping parameters and time‐varying delay is investigated. In terms of free‐weighting‐matrix approach and linear matrix inequalities, a delay‐dependent condition is presented to ensure a singular discrete‐time system to be regular, causal and stochastically stable based on which the stability analysis and robust stabilization problem are studied. An explicit expression for the desired state‐feedback controller is also given. Some numerical examples are provided to demonstrate the effectiveness of the proposed approach. Copyright © 2009 John Wiley & Sons, Ltd.     

Robust fuzzy control for uncertain discrete-time nonlinear Markovian jump systems without mode observations

This paper studies the robust fuzzy control problem of uncertain discrete-time nonlinear Markovian jump systems without mode observations. The Takagi and Sugeno (T-S) fuzzy model is employed to represent a discrete-time nonlinear system with norm-bounded parameter uncertainties and Markovian jump parameters. As a result, an uncertain Markovian jump fuzzy system (MJFS) is obtained. A stochastic fuzzy Lyapunov function (FLF) is employed to analyze the robust stability of the uncertain MJFS, which not only is dependent on the operation modes of the system, but also directly includes the membership functions. Then, based on this stochastic FLF and a non-parallel distributed compensation (non-PDC) scheme, a mode-independent state-feedback control design is developed to guarantee that the closed-loop MJFS is stochastically stable for all admissible parameter uncertainties. The proposed sufficient conditions for the robust stability and mode-independent robust stabilization are formulated as a set of coupled linear matrix inequalities (LMIs), which can be solved efficiently by using existing LMI optimization techniques. Finally, it is also demonstrated, via a simulation example, that the proposed design method is effective.     

Control of discrete-time hybrid stochastic systems

A realistic stochastic control problem for hybrid systems with Markovian jump parameters can have switching parameters in both the state and the measurement equations. Furthermore, both the `base' and jump states, in general, are not perfectly observed. There are only two existing controllers for this problem, both with complexity exponentially increasing with time. The authors present another control algorithm for stochastic systems with Markovian jump parameters. This algorithm is derived through the use of stochastic dynamic programming and is designed to be used for realistic stochastic control problems, i.e., with noisy state observations. This scheme has fixed computational requirements at each stage and a natural parallel implementation. Simulation results are used to compare the algorithm with previous schemes     

网络化系统的状态反馈保性能控制

研究了具有随机网络诱导时延且数据包丢失服从马尔可夫链的网络化系统的保性能控制问题．将网络化控制系统建模为具有两种运行模式的马尔可夫跳变线性系统．根据马尔可夫跳变线性系统理论，给出了网络化系统状态反馈保性能控制器存在的充分条件；该保性能控制器为一组线性矩阵不等式的解．通过一个仿真示例说明了本文所提方法的有效性．     

ROBUST H∞ CONTROL FOR UNCERTAIN STOCHASTIC SYSTEMS WITH MARKOVIAN SWITCHING AND TIME‐VARYING DELAYS

This paper is concerned with the problem of robust H_∞ control for uncertain stochastic systems with Markovian jump parameters and time‐varying state delays. A linear matrix inequality approach is developed and state feedback controllers are designed, which guarantee mean square asymptotic stability of the closed‐loop system and a prescribed H_∞ performance level for all modes and admissible uncertainties. A numerical example is provided to demonstrate the application of the proposed method.     

网络化时滞控制系统的有限时间稳定性分析

针对网络控制系统中存在于传感器-控制器-执行器间的双时延问题,提出了一种基于Markov模型的状态反馈控制策略.与传统应用Markov随机过程的方式相比,该策略采用两个Markov链描述每一个时延,通过状态反馈把该随机系统描述为具有四个随机参量的离散Markov跳变系统.利用Lyapunov有限时间稳定性理论分析得到该系统稳定的充分条件,并利用线性矩阵不等式(LMI)得到了可行的反馈矩阵.数值仿真结果进一步证明了该策略的有效性.