An iterative approach for the discrete‐time dynamic control of Markov jump linear systems with partial information

The , and mixed dynamic output feedback control of Markov jump linear systems in a partial observation context is studied through an iterative approach. By partial information, we mean that neither the state variable x(k) nor the Markov chain θ(k) are available to the controller. Instead, we assume that the controller relies only on an output y(k) and a measured variable coming from a detector that provides the only information of the Markov chain θ(k). To solve the problem, we resort to an iterative method that starts with a state‐feedback controller and solves at each iteration a linear matrix inequality optimization problem. It is shown that this iterative algorithm yields to a nonincreasing sequence of upper bound costs so that it converges to a minimum value. The effectiveness of the iterative procedure is illustrated by means of two examples in which the conservatism between the upper bounds and actual costs is significantly reduced.     

Stochastic stabilization and destabilization of nonlinear and time‐varying hybrid systems by noise

The aim of this article is to design a suitable strength function g(t,x,r(t)) such that the Wiener noise g(t,x(t),r(t))dw(t) either stabilizes or destabilizes a given nonlinear and time‐varying hybrid system . To this end, the basic properties, including the existence and uniqueness of the local and global solutions and the nonzero property of solutions of the nonlinear and time‐varying hybrid stochastic systems, are first investigated as the theoretical basis of the article. Second, two theorems and the corresponding corollaries on the stability and instability of the hybrid stochastic systems are established. Third, the design method for the noise strength g(t,x,r(t)) is then proposed based on the established theorems. We also point out that the Markov jump r(t) may have a stabilizing (respectively, destabilizing) effect when we design the noise strength g(t,x,r(t)) so that the introduced noise g(t,x(t),r(t))dw(t) stabilizes (respectively, destabilizes) the corresponding hybrid system. Finally, we illustrate our method using two examples. Compared with the existing literature, our method is suitable for a wider class of nonlinear and time‐varying systems with weaker conditions than quasi‐linear systems.     

Stochastic stability and extended dissipativity analysis for uncertain neutral systems with semi‐Markovian jumping parameters via novel free matrix–based integral inequality

This paper investigates the issues of stochastic stability and extended dissipativity analysis for uncertain neutral systems with semi‐Markovian jumping parameters. A new criterion about the stochastic stability and extended dissipativity of uncertain neutral systems with semi‐Markovian jumping parameters is obtained based on the new Lyapunov‐Krasovskii functionals together with the introduced novel free matrix–based integral inequality. The major contribution of this study is that the stochastic stability and extended dissipativity concept for uncertain neutral systems with semi‐Markovian jumping parameters can be developed to simultaneously analyze the solutions of the L₂ ? L_∞ performance, H_∞ action, passivity behavior, and dissipativity by selecting different weighting matrices. Finally, several interesting numerical examples are provided to show the effectiveness and less conservatism of the proposed method.     

A mixed numerical–analytical stable pseudo‐inversion method aimed at attaining an almost exact tracking

This paper considers the problem of computing the input u(t) of an internally asymptotically stable, possibly non‐minimum phase, linear, continuous time system Σ yielding a very accurate tracking of a pre‐specified desired output trajectory . The main purpose of the new approach proposed here is to alleviate some limitations that inherent the classical methods developed in the framework of the preview‐based stable inversion, which represents an important reference context for this class of control problems. In particular, the new method allows one to deal with arbitrary and possibly uncertain initial conditions and does not require a pre‐actuation. The desired output to be exactly tracked in steady state is here assumed to belong to the set of polynomials, exponential, and sinusoidal time functions. The desired transient response is specified to obtain a fast and smooth transition toward the steady‐state trajectory , without under and/or overshoot in the case of a set point reset. The transient control input u_t(t) is a priori assumed to be given by a piecewise polynomial function. Once has been specified, this allows the computation of the unknown u_t(t) as the approximate least squares solution of the Fredholm's integral equation corresponding to the explicit formula of the output forced response. The steady‐state input u_s(t) is analytically computed exploiting the steady‐state output response expressions for inputs belonging to the same set of . Copyright © 2013 John Wiley & Sons, Ltd.     

Robust output‐feedback control of state‐multiplicative noisy discrete‐time systems

Linear discrete‐time systems with stochastic and deterministic polytopic type uncertainties in their state‐space model are considered. A dynamic output‐feedback controller is obtained via a new approach that allows a derivation of a controller in spite of parameter uncertainty. In the proposed approach, the system is described via a difference equation and an augmented system is then used to obtain the output‐feedback controller parameters. The controller is obtained without assuming a specific structure to the quadratic Lyapunov function, and it is the first time that an output‐feedback controller is obtained for robust state‐multiplicative systems. The controller minimizes the stochastic L₂‐gain of the closed‐loop where a cost function is defined to be the expected value of the standard performance index with respect to the stochastic uncertainty. Two examples are given where the second of which demonstrates the applicability of our theory to a robot manipulator system. Copyright © 2016 John Wiley & Sons, Ltd.     

Differential graphical games for H∞ control of linear heterogeneous multiagent systems

Differential graphical games have been introduced in the literature to solve state synchronization problem for linear homogeneous agents. When the agents are heterogeneous, the previous notion of graphical games cannot be used anymore and a new definition is required. In this paper, we define a novel concept of differential graphical games for linear heterogeneous agents subject to external unmodeled disturbances, which contain the previously introduced graphical game for homogeneous agents as a special case. Using our new formulation, we can solve both the output regulation and H_∞ output regulation problems. Our graphical game framework yields coupled Hamilton‐Jacobi‐Bellman equations, which are, in general, impossible to solve analytically. Therefore, we propose a new actor‐critic algorithm to solve these coupled equations numerically in real time. Moreover, we find an explicit upper bound for the overall ‐gain of the output synchronization error with respect to disturbance. We demonstrate our developments by a simulation example.     

An interval observer for uncertain continuous‐time linear systems

To design robust interval observers for uncertain continuous‐time linear systems, a new set‐integration approach is proposed to compute trajectory tubes for the estimation error. Because this approach, the order‐preserving condition on the dynamics of the estimation error is no longer required. Therefore, synthesis methods can be used to compute observer gains that reduce the impact of the system uncertainties on the accuracy of the estimated state enclosures. The performance of the proposed approach is showcased through illustrative numerical examples.     

H∞ control for uncertain one‐sided Lipschitz nonlinear systems in finite frequency domain

The current article discusses the H_∞ disturbance attenuation control design problem for one‐sided Lipschitz systems in finite frequency domain. Models containing norm‐bounded parameter uncertainties, disturbances, and input nonlinearities are considered. By contrast to existing full frequency methods, the H_∞ controller is computed depending on the frequency ranges of disturbances. The finite frequency disturbance attenuation index is initially defined. Thanks to Finsler's lemma, sufficient and less conservative analysis conditions are also derived for the closed‐loop system. Then, synthesis conditions in the low, middle, and high frequency ranges as well as the whole frequency range, are formulated in terms of linear matrix inequalities. At last, to prove the effectiveness and the superiority of the proposed approach, a physical example is used and a comparative study is done.     

Dynamic event‐triggered control for linear time‐invariant systems with ‐gain performance

In this paper, a novel dynamic event‐triggered control scheme is presented for linear time‐invariant systems. Under this control scheme, criteria that guarantee the asymptotic stability and the ‐stability are derived, by which the triggered parameters and the feedback gain can be codesigned. The stability criteria are derived by using Lyapunov‐based analysis tools, and a new Lyapunov‐Krasovskii functional is constructed to further reduce conservatism. Moreover, the projection technique and the mathematical induction are introduced in the stability analysis. Compared with the existing results for static strategies, the proposed dynamic strategy is more flexible and generates fewer events. Finally, simulation examples are provided to demonstrate the effectiveness of this new scheme.     

Discrete‐time sector based hands‐off control for nonlinear system

This article presents a hands‐off control design for discrete‐time nonlinear system with a special type of nonlinear sector termed as “discrete‐time sector.” The design method to define the boundary of a discrete‐time sector is done with control‐Lyapunov function. The generalization of nonlinear system is viewed in the perspective of a comparison function. By means of a proposed sector, a switching control is designed such that no control action is experienced inside the sector thus, saving unnecessary control efforts. However, to study the robustness for discrete‐time system, a hands‐off control is modified to ensure the monotonic decrease in the energy of the system. Finally, the proposed approach is verified with the simulation results.     

Iterative ‐conic controller synthesis

This paper proposes a method to synthesize controllers that minimize an upper bound on the closed‐loop ‐norm while imposing desired controller conic bounds. An initial conic controller is synthesized and iteratively improved. Conic sectors can be used to characterize a variety of input‐output properties, such as gain, phase, and minimum gain. If such plant properties hold robustly to uncertainty present, then closed‐loop stability can be ensured robustly via the Conic Sector Theorem by imposing desired controller conic bounds. Consequently, this paper provides a versatile optimal and robust controller synthesis method. Moreover, it relies only on the solution of convex optimization problems subject to linear matrix inequality constraints, making it readily implementable.     

Quasi‐time‐dependent asynchronous filtering for discrete time switched systems via the event triggering mechanism

This article is concerned with the quasi‐time‐dependent asynchronous filter design problem for a class of discrete‐time switched systems via the event‐triggering mechanism. Applying the quasi‐time‐dependent Lyapunov functions and the mode‐dependent average dwell time technique, an asynchronous filter is designed with a weighted performance index; the filter parameter matrices are quasi‐time‐dependent in each event‐triggering‐dependent sampling interval; both cases (Case 1: no more than one switching, Case 2: multiple switchings) are taken into account in this sampling interval, by which the assumption, that the maximal asynchronous period is not larger than the minimal dwell time, is relaxed in this article. Simulation examples are given to show the less conservatism and effectiveness of the proposed results.     

Robust nonfragile observer‐based control of switched discrete singular systems with time‐varying delays: A sliding mode control design

This paper is devoted to the robust sliding mode control issue for a type of switched discrete singular systems with time‐varying delays under arbitrary switching. Since the system states are not available, the nonfragile observer strategy is used to generate the state estimation. By designing a novel sliding surface function, which is established on the estimation, new sufficient conditions via linear matrix inequalities are derived so that the closed‐loop system is admissible with an disturbance attenuation level γ. Furthermore, sliding mode controllers are given to guarantee the reachability of the quasi‐sliding mode and weaken the chattering. At last, examples are presented to verify the validity of our provided approach.     

H∞‐output regulation of linear heterogeneous multiagent systems over switching graphs

In this paper, we analyze H_∞‐output regulation of linear heterogeneous multiagent systems. The agents are subject to modeled and unmodeled disturbances and communicate over a switching graph. We derive a sufficient condition that guarantees H_∞ output regulation for the mentioned setup. This sufficient condition places requirements on both the single‐agent systems and the switching graph. The requirement on the single‐agent systems is an H_∞‐criterion that should be satisfied by a proper design of the controller. Meanwhile, the switching graph needs to be maximally connected. Moreover, we derive an upper bound for the overall ‐gain of the output synchronization error with respect to the unmodeled disturbances over a fixed communication graph. We illustrate our technical developments by a simulation example.     

Network‐based robust event‐triggered control for continuous‐time uncertain semi‐Markov jump systems

This article investigates the event‐triggered (ET) states feedback robust control problem for a class of continuous‐time networked semi‐Markov jump systems (S‐MJSs). An ET scheme, which depends on semi‐Markov process, is presented to design a suitable controller and save communication resources. To cope with the network transmission delay phenomenon, a time‐delay S‐MJSs model under the ET scheme is introduced to describe this phenomenon. Then, it is assumed that the communication links between event detector and zero‐order holder are imperfect, where the signal quantization and the actuator fault occur simultaneously. The sufficient conditions are derived by means of linear matrix inequalities approach, which guarantees the stochastic stability of the constructed time‐delay S‐MJSs in an optimized performance level. Based on these criteria, the parameters of controller under the ET scheme are readily calculated. Some simulation results with respect to F‐404 aircraft engine system for two kinds of ET parameters are given to validate the proposed method.     

Stability and stabilization for singularly perturbed systems with Markovian jumps

This article focuses on the stability and stabilization problems of singularly perturbed jump systems. Here, the singularly perturbed parameter (SPP) is also with Markov switching and satisfies any with positive bound predefined. First, stability conditions expressed ?_i‐free but involving its bound are developed by constructing an ?_i‐dependent Lyapunov function. Then, a method for state feedback stabilization controller depending on SPP is proposed, whose conditions are given in terms of linear matrix inequalities. Moreover, some special cases about deterministic SPP are considered too. Finally, two practical examples are used to demonstrate the effectiveness and superiorities of the proposed methods.     

New interpolation solution and application in system modeling and optimal control with prescribed distance to instability

We present a system theoretic interpretation of a two‐sided interpolation problem with a stable rational matrix U (interpolant) without constraints on its norm. It is known that all solutions U of that problem can be expressed as U = U _h+ U _p, where U _h ranges in the set of all solutions of the associated homogeneous problem, and U _p is a particular solution. We present a new solution for U _p and prove that it is actually the minimal ‐norm interpolant in the set of all interpolants. We apply these results in system modeling and in optimal control of one‐block plants, with a prescribed bound on the distance to instability of the closed‐loop system. The applications are illustrated by examples. Interesting connections to the augmented basic interpolation problem, to Nehari's problem, and to the stability of one‐block plants with multiple unstable invariant zeros are given. Copyright © 2015 John Wiley & Sons, Ltd.     

Semiglobal finite‐time synchronization of complex networks with stochastic disturbance via intermittent control

This paper focuses on the problem of semiglobal finite‐time synchronization of stochastic complex networks via an intermittent control strategy. By establishing a finite‐time criterion condition and a novel finite‐time ‐operator differential inequality, combined with convex techniques, some sufficient conditions are obtained to ensure finite‐time synchronization for stochastic complex networks with time delays. An effective controller is given to guarantee inner finite‐time synchronization, especially for a nondelayed dynamic system. This paper provides a simple controller. Finally, a numerical simulation is given to demonstrate the effectiveness of our results.     

Parameterized bilinear matrix inequality techniques for gain‐scheduling proportional integral derivative control design

Proportional‐integral‐derivative (PID) structured controller is the most popular class of industrial control but still could not be appropriately exploited in gain‐scheduling control systems. To gain the practicability and tractability of gain‐scheduling control systems, this paper addresses the gain‐scheduling PID control. The design of such a controller is based on parameterized bilinear matrix inequalities, which are then solved via a bilinear matrix inequality optimization problem of nonconvex optimization. Several computational procedures are developed for its computation. The merit of the developed algorithms is shown through the benchmark examples.     

Decentralized weighted control for a class of large‐scale systems with multi‐modes

In this paper, the control synthesis problem for a class of large‐scale systems with multi‐modes that are called large‐scale switched systems is addressed. By introducing the concept of decentralized switching signal and the relevant decentralized average dwell time, the asymptotic stability and weighted ?₂ gain performance are investigated. It should be noted that the decentralized switching covers general switching cases for large‐scale switched systems, namely, it admits both time‐dependent switching signal and arbitrary switching signal blended in the decentralized switching. Then, on the basis of the analysis results, the decentralized weighted control scheme including state feedback controller gains and switching signals is studied. Several design algorithms are proposed to meet different controller design problems. Finally, numerical examples are provided to illustrate theoretical findings within this paper. Copyright © 2013 John Wiley & Sons, Ltd.