and control design for polytopic continuous‐time Markov jump linear systems with uncertain transition rates

This paper investigates the problems of and state feedback control design for continuous‐time Markov jump linear systems. The matrices of each operation mode are supposed to be uncertain, belonging to a polytope, and the transition rate matrix is considered partly known. By appropriately modeling all the uncertain parameters in terms of a multi‐simplex domain, new design conditions are proposed, whose main advantage with respect to the existing ones is to allow the use of polynomially parameter‐dependent Lyapunov matrices to certify the mean square closed‐loop stability. Synthesis conditions are derived in terms of matrix inequalities with a scalar parameter. The conditions, which become LMIs for fixed values of the scalar, can cope with and state feedback control in both mode‐independent and mode‐dependent cases. Using polynomial Lyapunov matrices of larger degrees and performing a search for the scalar parameter, less conservative results in terms of guaranteed costs can be obtained through LMI relaxations. Numerical examples illustrate the advantages of the proposed conditions when compared with other techniques from the literature. Copyright © 2015 John Wiley & Sons, Ltd.     

An iterative approach for the discrete‐time dynamic control of Markov jump linear systems with partial information

The , and mixed dynamic output feedback control of Markov jump linear systems in a partial observation context is studied through an iterative approach. By partial information, we mean that neither the state variable x(k) nor the Markov chain θ(k) are available to the controller. Instead, we assume that the controller relies only on an output y(k) and a measured variable coming from a detector that provides the only information of the Markov chain θ(k). To solve the problem, we resort to an iterative method that starts with a state‐feedback controller and solves at each iteration a linear matrix inequality optimization problem. It is shown that this iterative algorithm yields to a nonincreasing sequence of upper bound costs so that it converges to a minimum value. The effectiveness of the iterative procedure is illustrated by means of two examples in which the conservatism between the upper bounds and actual costs is significantly reduced.     

Filtering of discrete‐time Markov jump linear systems with uncertain transition probabilities

This article addresses the filtering design problem for discrete‐time Markov jump linear systems (MJLS) under the assumption that the transition probabilities are not completely known. We present the methods to determine ??₂‐ and ??_∞‐norm bounded filters for MJLS whose transition probability matrices have uncertainties in a convex polytope and establish an equivalence with the ones with partly unknown elements. The proposed design, based on linear matrix inequalities, allows different assumptions on Markov mode availability to the filter and on system parameter uncertainties to be taken into account. Under mode‐dependent assumption and internal model knowledge, observer‐based filters can be obtained and it is shown theoretically that our method outperforms some available ones in the literature to date. Numerical examples illustrate this claim. Copyright © 2010 John Wiley & Sons, Ltd.     

Quantized feedback stabilization of continuous-time Markov jump systems under asynchronous control

This paper addresses a new asynchronous control scheme for continuous-time Markov jump linear systems (MJLSs). Both controlled system and quantizer are asynchronous with the controller due to the process by which the controller can accurately observe and emit the switching signal being stochastic. The random variable satisfying Bernoulli distribution is introduced to describe this observation. On this basis, two methods are proposed to obtain sufficient conditions for exponential almost sure stability and almost surely asymptotically stability, respectively from the perspective of the linear matrix inequality (LMI). The results are independent of the asynchronous time interval. Finally, a numerical example demonstrates the validity and feasibility of developed theoretical results.     

Decentralized robust control of uncertain Markov jump parameter systems via output feedback

This paper addresses the problem of decentralized robust stabilization and control for a class of uncertain Markov jump parameter systems. Control is via output feedback and knowledge of the discrete Markov state. It is shown that the existence of a solution to a collection of mode-dependent coupled algebraic Riccati equations and inequalities, which depend on certain additional parameters, is both necessary and sufficient for the existence of a robust decentralized switching controller. A guaranteed upper bound on robust performance is also given. To obtain a controller which satisfies this bound, an optimization problem involving rank constrained linear matrix inequalities is introduced, and a numerical approach for solving this problem is presented. To demonstrate the efficacy of the proposed approach, an example stabilization problem for a power system comprising three generators and one on-load tap changing transformer is considered.     

Derandomisation-based multiple frequency control for stochastic Markov jump systems

Under the framework of derandomisation approach, the state feedback control issues for both continuous-time and discrete-time Markov jump linear systems (MJLSs) are investigated to meet multiple performance objectives over multiple frequency ranges. Because of the stochastic jumping among different modes, the generalised Kalman–Yakubovic–Popov lemma-based finite-frequency controller design approach cannot be directly applied to MJLSs. To overcome this limitation, a derandomisation approach is established by transforming the original stochastic multiple modes systems to deterministic ones. Then the multiple frequency controllers for both discrete-time and continuous-time MJLSs are designed to guarantee the multiple performances of the closed-loop systems. To verify the effectiveness of the developed algorithms, examples are presented, where the performance requirements include specifications in low-frequency and high-frequency ranges, respectively.     

Robust control of continuous-time Markov jump linear systems

This paper is concerned with the problem of designing robust H₂ state-feedback controllers for continuous-time Markov jump linear systems subject to polytopic-type parameter uncertainty. Based on the parameter-dependent Lyapunov function approach, a new method for designing robust H₂ controllers is presented in terms of solutions to a set of linear matrix inequalities. A numerical example is given to illustrate the effectiveness of the proposed design method.     

Static output feedback control for discrete‐time hidden Markov jump systems against deception attacks

This paper investigates the static output feedback control problem for Markov jump systems subject to asynchronous mode information and deception attacks. A hidden Markov model is employed to observe the unmeasurable system mode. In this case, the asynchronous phenomenon between the controller and the original system is depicted. By using the mode‐dependent Lyapunov function, a sufficient condition is established such that the resulting closed‐loop system is stochastically mean square exponentially ultimately bounded under randomly occurring deception attacks and external disturbance. Based on this condition, the asynchronous static output feedback controller is designed in view of linear matrix inequalities. Finally, the effectiveness and superiority of the presented method are elaborated via a numerical example and a practical example.     

On reference model tracking for Markov jump systems

This article deals with the tracking problem for the Markov Jump systems with external finite energy disturbance. A state feedback controller that makes the state vector of the system track precisely a given state vector of a reference model is proposed. The tracking problem is formulated as an ?_∞ control problem and an approach to synthesise the state feedback controller that quadratically stabilises the augmented dynamics and at the same time rejects the external disturbance that is developed. This approach is based on the solution of some linear matrix inequalities. A numerical example is provided to show the usefulness of the developed results.     

线性Markov 切换系统的随机Nash 微分博弈及混合H2/H∞ 控制

研究线性Markov切换系统的随机Nash微分博弈问题。首先借助线性Markov切换系统随机最优控制的相关结果,得到了有限时域和无线时域Nash均衡解的存在条件等价于其相应微分(代数) Riccati方程存在解,并给出了最优解的显式形式;然后应用相应的微分博弈结果分析线性Markov切换系统的混合H2/H∞控制问题;最后通过数值算例验证了所提出方法的可行性。     

Dissipativity‐based asynchronous control of discrete‐time Markov jump systems with mixed time delays

This paper addresses the problem of dissipativity‐based asynchronous control for a class of discrete‐time Markov jump systems. A unified framework to design a controller for discrete‐time Markov jump systems with mixed time delays is proposed, which is fairly general and can be reduced to a synchronous controller or a mode‐independent controller. Based on a stochastic Lyapunov function approach, which fully utilizes available information of the system mode and the controller, a sufficient condition is established to ensure the stochastic stability and strictly ( , , ) dissipative performance of the resulting closed‐loop system. Finally, the effectiveness and validity of the proposed method are illustrated with a simulation example.     

Dynamic output‐feedback control for continuous‐time singular Markovian jump systems

This paper considers a dynamic output‐feedback control for continuous‐time singular Markovian jump systems, whereas the existing research studies in literature focused on state‐feedback or static output‐feedback control. While they have only provided the sufficient conditions, this paper successfully obtains the necessary and sufficient condition for the existence of the dynamic output‐feedback control. Furthermore, this condition is expressed with linear matrix inequalities by the so‐called replacement technique. Two numerical examples show the validity of the resulting control.     

Markov跳变系统的非同步事件触发耗散容错控制

本文主要研究一类具有执行器故障的Markov跳变系统的非同步事件触发耗散容错控制问题.通过引入非同步事件触发器来降低传感器的采样数据传输频率,从而降低通信消耗.采用两个独立的隐Markov模型分别描述触发器、控制器与原系统之间的非同步现象.在此框架下,基于Lyapunov稳定性和耗散理论,得到了闭环控制系统在执行器存在故障的情况下随机稳定并严格耗散的充分条件.并借助矩阵不等式变换技术给出了触发器和控制器矩阵参数的求解方法,实现了触发器和控制器的协同设计.最后,通过仿真研究验证了所提出的设计方法的有效性.     

Markov跳变系统的有限时间状态反馈镇定

讨论一类含有限能量未知扰动的线性Markov跳变系统的有限时间镇定问题.针对连续系统和离散系统两种情况,利用构造的Lyapunov-Krasovskii函数,并结合线性矩阵不等式方法,分别证明并给出了跳变系统有限时间镇定控制器有解的充分条件.采用该方法设计的镇定控制器可使连续系统和离散系统对所有满足条件的未知扰动是有限时问有界和有限时间镇定的.最后通过数值示例表明了该设计方法的有效性.     

Fuzzy model‐based fault detection for Markov jump systems

The robust fault detection filter (RFDF) design problems are studied for nonlinear stochastic time‐delay Markov jump systems. By means of the Takagi–Sugeno fuzzy models, the fuzzy RFDF system and the dynamics of filtering error generator are constructed. Moreover, taking into account the sensitivity to faults while guaranteeing robustness against unknown inputs, the H_∞ filtering scheme is proposed to minimize the influences of the unknown inputs and another new performance index is introduced to enhance the sensitivity to faults. A sufficient condition is first established on the stochastic stability using stochastic Lyapunov–Krasovskii function. Then in terms of linear matrix inequalities techniques, the sufficient conditions on the existence of fuzzy RFDF are presented and proved. Finally, the design problem is formulated as a two‐objective optimization algorithm. Simulation results illustrate that the proposed RFDF can detect the faults shortly after the occurrences. Copyright © 2008 John Wiley & Sons, Ltd.     

Sliding mode control for Markov jump linear uncertain systems with partly unknown transition rates

In this paper, based on sliding mode control approach, the robust stabilisation problem for a class of continuous-time Markovian jump linear uncertain systems with partly unknown transition rates is investigated. The transition rate matrix under consideration covers completely known, boundary known and completely unknown elements. By making use of linear matrix inequalities technique, sufficient conditions are presented to derive the linear switching surface and guarantee the stochastic stability of sliding mode dynamics. Then a sliding mode control law is designed to drive the state trajectory of the closed-loop system to the specified linear switching surface in finite time in spite of the existing uncertainties and unknown transition rates. Finally, an example is given to verify the validity of the theoretical results.     

L2–L∞ fuzzy control for Markov jump systems with neutral time-delays

The L₂–L_∞ fuzzy control problem is considered for nonlinear stochastic Markov jump systems with neutral time-delays. By means of Takagi–Sugeno fuzzy models, the fuzzy controller systems and the overall closed-loop fuzzy dynamics are constructed. A sufficient condition is firstly established on the stochastic stability using stochastic Lyapunov–Krasovskii functional. Then in terms of linear matrix inequalities techniques, the sufficient conditions on the existence of mode-dependent state feedback L₂–L_∞ fuzzy controller are presented and proved respectively for constant and time varying case. Finally, the design problems are formulated as optimization algorithms. Simulation results are exploited to illustrate the effectiveness of the developed techniques.     

基于扩展状态观测器的随机隐Markov正跳变系统有限时间异步控制

针对一类含不匹配扰动的随机隐Markov跳变系统, 本文研究了基于扩展状态观测器(ESO)的有限时间异步 控制问题. 首先, 引入一组扩展变量将隐Markov跳变系统转换成一组新的随机扩展系统, 补偿不匹配扰动对系统控 制输出的影响. 基于Lyapunov–Krasovskii泛函方法, 给出使得基于ESO的闭环随机隐Markov增广跳变系统是正系 统, 且有限时间有界的充分条件. 进而得到直接求解观测器增益和控制器增益的线性矩阵不等式. 最后, 通过仿真结 果验证了本文所设计的异步状态反馈控制器和观测器的有效性和可行性.     

Finite‐time asynchronous filtering for discrete‐time Markov jump systems over a lossy network

This paper is concerned with the problem of finite‐time asynchronous filtering for a class of discrete‐time Markov jump systems. The communication links between the system and filter are assumed to be unreliable, which lead to the simultaneous occurrences of packet dropouts, time delays, sensor nonlinearity and nonsynchronous modes. The objective is to design a filter that ensures not only the mean‐square stochastic finite‐time bounded but also a prescribed level of performance for the underlying error system over a lossy network. With the help of the Lyapunov–Krasovskii approach and stochastic analysis theory, sufficient conditions are established for the existence of an admissible filter. By using a novel simple matrix decoupling approach, a desired asynchronous filter can be constructed. Finally, a numerical example is presented and a pulse‐width‐modulation‐driven boost converter model is employed to demonstrate the effectiveness of the proposed approach. Copyright © 2016 John Wiley & Sons, Ltd.