Observer‐based adaptive control for nonlinear strict‐feedback stochastic systems with output constraints

In this paper, an adaptive output‐feedback control problem is investigated for nonlinear strict‐feedback stochastic systems with input saturation and output constraint. A barrier Lyapunov function is used to solve the problem of output constraint. Then, fuzzy logic systems are used to approximate the unknown nonlinear functions, and a fuzzy state observer is designed to estimate the unmeasured states. To overcome the difficulties in designing the control signal in the saturation, we introduce an auxiliary signal in the n + 1th step in the deduction. By combining Nussbaum technique and the adaptive backstepping technique, an adaptive output‐feedback control method is developed. The proposed control method not only overcomes the problem of the compensation for the nonlinear term from the input saturation but also overcomes the problem of unavailable state measurements. It is proved that all the signals of the closed‐loop system are semiglobally uniformly ultimately bounded. Finally, the effectiveness of the proposed method is verified by the simulation results.     

Adaptive Stabilization for a Class of Stochastic Nonlinear Systems with Prandtl‐Ishlinskii Hysteresis

This paper deals with a class of stochastic nonlinear systems with unknown hysteresis. A stochastic Lyapunov method is applied for systems in strict‐feedback form driven by unknown Prandtl‐Ishlinskii hysteresis and Wiener noises of unknown covariance. An adaptive controller is obtained which guarantees the global asymptotic stabilization in probability. Simulation results are provided to illustrate the effectiveness of the proposed approach.     

Adaptive tracking of stochastic nonlinear systems with Prandtl–Ishlinskii hysteresis

This paper deals with adaptive tracking problems for a class of stochastic nonlinear systems with unknown hysteresis nonlinearities. The system considered is in a strict‐feedback form driven by unknown Prandtl–Ishlinskii hysteresis and Wiener noises of unknown covariance. By employing backstepping design techniques and stochastic Lyapunov design method, parameter adaptive laws and control laws are obtained, which ensure that the tracking error can converge to a small residual set around the origin in the sense of mean quartic value. Copyright © 2011 John Wiley & Sons, Ltd.     

Active disturbance rejection control approach to output‐feedback stabilization of lower triangular nonlinear systems with stochastic uncertainty

In this paper, we apply the active disturbance rejection control approach to output‐feedback stabilization for uncertain lower triangular nonlinear systems with stochastic inverse dynamics and stochastic disturbance. We first design an extended state observer (ESO) to estimate both unmeasured states and stochastic total disturbance that includes unknown system dynamics, unknown stochastic inverse dynamics, external stochastic disturbance, and uncertainty caused by the deviation of control parameter from its nominal value. The stochastic total disturbance is then compensated in the feedback loop. The constant gain and the time‐varying gain are used in ESO design separately. The mean square practical stability for the closed‐loop system with constant gain ESO and the mean square asymptotic stability with time‐varying gain ESO are developed, respectively. Some numerical simulations are presented to demonstrate the effectiveness of the proposed output‐feedback control scheme. Copyright © 2016 John Wiley & Sons, Ltd.     

Adaptive NN output‐feedback decentralized stabilization for a class of large‐scale stochastic nonlinear strict‐feedback systems

In this paper, the decentralized adaptive neural network (NN) output‐feedback stabilization problem is investigated for a class of large‐scale stochastic nonlinear strict‐feedback systems, which interact through their outputs. The nonlinear interconnections are assumed to be bounded by some unknown nonlinear functions of the system outputs. In each subsystem, only a NN is employed to compensate for all unknown upper bounding functions, which depend on its own output. Therefore, the controller design for each subsystem only need its own information and is more simplified than the existing results. It is shown that, based on the backstepping method and the technique of nonlinear observer design, the whole closed‐loop system can be proved to be stable in probability by constructing an overall state‐quartic and parameter‐quadratic Lyapunov function. The simulation results demonstrate the effectiveness of the proposed control scheme. Copyright © 2010 John Wiley & Sons, Ltd.     

Global output‐feedback stabilization for a class of stochastic nonlinear systems via sampled‐data control

In this paper, the global sampled‐data output‐feedback stabilization problem is considered for a class of stochastic nonlinear systems. First, based on output‐feedback domination technique and emulation approach, a systematic design procedure for sampled‐data output‐feedback controller is proposed for a class of stochastic lower‐triangular nonlinear systems. It is proved that the proposed sampled‐data output‐feedback controller will stabilize the given stochastic nonlinear system in the sense of mean square exponential stability. Because of the domination nature of the proposed control approach, it is shown that the proposed control approach can also be used to handle the global sampled‐data output‐feedback stabilization problems for a more general class of stochastic non‐triangular nonlinear systems. Finally, simulation examples are given to demonstrate the effectiveness of the proposed method. Copyright © 2017 John Wiley & Sons, Ltd.     

Robust H∞ control for uncertain discrete‐time stochastic bilinear systems with Markovian switching

This paper is concerned with the problems of robust stochastic stabilization and robust H_∞ control for uncertain discrete‐time stochastic bilinear systems with Markovian switching. The parameter uncertainties are time‐varying norm‐bounded. For the robust stochastic stabilization problem, the purpose is the design of a state feedback controller which ensures the robust stochastic stability of the closed‐loop system irrespective of all admissible parameter uncertainties; while for the robust H_∞ control problem, in addition to the robust stochastic stability requirement, a prescribed level of disturbance attenuation is required to be achieved. Sufficient conditions for the solvability of these problems are obtained in terms of linear matrix inequalities (LMIs). When these LMIs are feasible, explicit expressions of the desired state feedback controllers are also given. An illustrative example is provided to show the effectiveness of the proposed approach. Copyright © 2005 John Wiley & Sons, Ltd.     

Adaptive fuzzy decentralized output feedback control for stochastic nonlinear large‐scale systems using DSC technique

In this paper, an adaptive fuzzy decentralized backstepping output feedback control approach is proposed for a class of uncertain large‐scale stochastic nonlinear systems without the measurements of the states. The fuzzy logic systems are used to approximate the unknown nonlinear functions, and a fuzzy state observer is designed for estimating the unmeasured states. Using the designed fuzzy state observer, and by combining the adaptive backstepping technique with dynamic surface control technique, an adaptive fuzzy decentralized output feedback control approach is developed. It is shown that the proposed control approach can guarantee that all the signals of the resulting closed‐loop system are semi‐globally uniformly ultimately bounded in probability, and the observer errors and the output of the system converge to a small neighborhood of the origin by choosing appropriate design parameters. A simulation example is provided to show the effectiveness of the proposed approaches. Copyright © 2011 John Wiley & Sons, Ltd.     

H∞ output feedback control for stochastic systems with randomly occurring convex‐bounded uncertainties and channel fadings

In this paper, the H_∞ output feedback control problem for a class of stochastic discrete‐time systems with randomly occurring convex‐bounded uncertainties and channel fadings is investigated. A sequence of mutually independent random variables with known probabilistic distributions are utilized to describe the randomness that convex‐bounded uncertainties appear in practical systems. The measurements with channel fadings are given by a stochastic Rice fading model which is regulated by a set of random variables with certain probability density functions. The purpose of this paper is to design an output feedback controller such that the closed‐loop control system is asymptotically stable with a prescribed H_∞ performance level. The less conservative results are obtained by employing the stochastic Lyapunov technique. Numerical examples are presented to illustrate effectiveness of the proposed approach.     

Adaptive neural tracking control for a class of stochastic nonlinear systems

This paper investigates the problem of adaptive neural control design for a class of single‐input single‐output strict‐feedback stochastic nonlinear systems whose output is an known linear function. The radial basis function neural networks are used to approximate the nonlinearities, and adaptive backstepping technique is employed to construct controllers. It is shown that the proposed controller ensures that all signals of the closed‐loop system remain bounded in probability, and the tracking error converges to an arbitrarily small neighborhood around the origin in the sense of mean quartic value. The salient property of the proposed scheme is that only one adaptive parameter is needed to be tuned online. So, the computational burden is considerably alleviated. Finally, two numerical examples are used to demonstrate the effectiveness of the proposed approach. Copyright © 2012 John Wiley & Sons, Ltd.     

Robust adaptive backstepping tracking control of stochastic nonlinear systems with unknown input saturation: A command filter approach

This paper studies the problem of adaptive observer‐based radial basis function neural network tracking control for a class of strict‐feedback stochastic nonlinear systems comprising an unknown input saturation, uncertainties, and unknown disturbances. To handle the issue of a non‐smooth saturation input signal, a smooth function is chosen to approximate the saturation function and the state observer is used to estimate unmeasured states. By the so‐called command filter method in the controller design procedure, the implementation complexity is reduced in the proposed backstepping method. Moreover, a radial basis function neural network is deployed to reconstruct the unknown nonlinear functions. In addition, the gains of all radial basis function neural networks are updated through one updating law leading to a minimal learning parameter which is independent of the number of neural nodes and the order of the system. Comparing with the existing results, the proposed approach can stabilize a constrained stochastic system more effectively and with less computational burden. Finally, a practical example shows the performance of the proposed controller design.     

Output‐feedback control of a class of stochastic nonlinear systems with linearly bounded unmeasurable states

In this paper, the problems of stochastic disturbance attenuation and asymptotic stabilization via output feedback are investigated for a class of stochastic nonlinear systems with linearly bounded unmeasurable states. For the first problem, under the condition that the stochastic inverse dynamics are generalized stochastic input‐to‐state stable, a linear output‐feedback controller is explicitly constructed to make the closed‐loop system noise‐to‐state stable. For the second problem, under the conditions that the stochastic inverse dynamics are stochastic input‐to‐state stable and the intensity of noise is known to be a unit matrix, a linear output‐feedback controller is explicitly constructed to make the closed‐loop system globally asymptotically stable in probability. Using a feedback domination design method, we construct these two controllers in a unified way. Copyright © 2007 John Wiley & Sons, Ltd.     

Nonlinear stochastic passivity,feedback equivalence and global stabilization

This paper addresses several important issues including stochastic passivity, feedback equivalence and global stabilization for a class of nonlinear stochastic systems. Based on a nonlinear stochastic Kalman–Yacubovitch–Popov (KYP) lemma, we investigate the relationship between a stochastic passive system and the corresponding zero‐output system. Different from the deterministic case, it is shown for the first time that feedback equivalence to a stochastic passive system requires a strong minimum‐phase condition, not the minimum‐phase one. Following the stochastic passivity theory, global stabilization results are established for a class of nonlinear stochastic systems with relative degree 1≤r<n. An example is presented to illustrate the effectiveness of our results. Copyright © 2011 John Wiley & Sons, Ltd.     

Adaptive output feedback tracking control of stochastic nonlinear systems with dynamic uncertainties

In this paper, adaptive output feedback tracking control is developed for a class of stochastic nonlinear systems with dynamic uncertainties and unmeasured states. Neural networks are used to approximate the unknown nonlinear functions. K‐filters are designed to estimate the unmeasured states. An available dynamic signal is introduced to dominate the unmodeled dynamics. By combining dynamic surface control technique with backstepping, the condition in which the approximation error is assumed to be bounded is avoided. Using It ô formula and Chebyshev's inequality, it is shown that all signals in the closed‐loop system are bounded in probability, and the error signals are semi‐globally uniformly ultimately bounded in mean square or the sense of four‐moment. Simulation results are provided to illustrate the effectiveness of the proposed approach. Copyright © 2014 John Wiley & Sons, Ltd.     

Razumikhin–Nussbaum‐lemma‐based adaptive neural control for uncertain stochastic pure‐feedback nonlinear systems with time‐varying delays

This paper addresses the problem of adaptive neural control for a class of uncertain stochastic pure‐feedback nonlinear systems with time‐varying delays. Major technical difficulties for this class of systems lie in: (1) the unknown control direction embedded in the unknown control gain function; and (2) the unknown system functions with unknown time‐varying delays. Based on a novel combination of the Razumikhin–Nussbaum lemma, the backstepping technique and the NN parameterization, an adaptive neural control scheme, which contains only one adaptive parameter is presented for this class of systems. All closed‐loop signals are shown to be 4‐Moment semi‐globally uniformly ultimately bounded in a compact set, and the tracking error converges to a small neighborhood of the origin. Finally, two simulation examples are given to demonstrate the effectiveness of the proposed control schemes. Copyright © 2012 John Wiley & Sons, Ltd.     

Two‐stage stability control for strict‐feedback systems with input delays and input nonlinear uncertainties

In this paper, a two‐stage control procedure is proposed for stabilization of a class of strict‐feedback systems with unknown constant time delays and nonlinear uncertainties in the input. A nominal controller is first designed to compensate input time delays without considering input nonlinear uncertainties. Extended from backstepping algorithm, input delay compensation is realized by means of predicted states that are computed through integration of cascaded system dynamics, making the nominal closed‐loop system asymptotically stable. Based on the nominal controller presented for the input delay system, a multi‐timescale system is subsequently developed to estimate the unknown input nonlinearity and make the estimate approach the nominal control input as fast as possible. It is proved that the proposed control scheme can make states of the strict‐feedback systems converge to zero and all the signals of the closed‐loop systems are guaranteed to be bounded in the presence of input time delays and nonlinear uncertainties. Simulation verification is carried out to illuminate the effectiveness of the proposed control approach.     

H∞ tracking of linear continuous‐time systems with stochastic uncertainties and preview

The problem of finite‐horizon H_∞ tracking for linear continuous time‐invariant systems with stochastic parameter uncertainties is investigated for both, the state‐feedback and the output‐feedback control problems. We consider three tracking patterns depending on the nature of the reference signal i.e. whether it is perfectly known in advance, measured on line or previewed in a fixed time‐interval ahead. The stochastic uncertainties appear in both the dynamic and measurement matrices of the system. In the state‐feedback case, for each of the above three cases a game theory approach is applied where, given a specific reference signal, the controller plays against nature which chooses the initial condition and the energy‐bounded disturbance. The problems are solved using the expected value of the standard performance index over the stochastic parameters, where, in the state‐feedback case, necessary and sufficient conditions are found for the existence of a saddle‐point equilibrium. The corresponding infinite‐horizon time‐invariant tracking problem is also solved for the latter case, where a dissipativity approach is considered. The output‐feedback control problem is solved as a max–min problem for the three tracking patterns, where necessary and sufficient condition are obtained for the solution. The theory developed is demonstrated by a simple example where we compare our solution with an alternative solution which models the tracking signal as a disturbance. Copyright © 2004 John Wiley & Sons, Ltd.     

Continuous simultaneous stabilization of single‐input nonlinear stochastic systems

This paper investigates the simultaneous stabilization of a collection of continuous single‐input non‐linear stochastic systems, with coefficients that are not necessarily locally Lipschitz. A sufficient condition for the existence of a continuous simultaneously stabilizing feedback control is proposed — it is based on the generalized stochastic Lyapunov theorem and on the technique of stochastic control Lyapunov functions. This condition is also necessary, provided that the system's coefficients satisfy some regularity conditions. Moreover, the proposed feedback can be chosen to be bounded under the assumption that appropriate control Lyapunov functions are known. All the proposed simultaneously stabilizing state feedback controllers are explicitly constructed. Finally, two simulation examples are provided to demonstrate the effectiveness of the proposed approach.     

State‐feedback stabilization for high‐order stochastic nonlinear systems with stochastic inverse dynamics

For a class of high‐order stochastic nonlinear systems with stochastic inverse dynamics which are neither necessarily feedback linearizable nor affine in the control input, this paper investigates the problem of state‐feedback stabilization for the first time. Under some weaker assumptions, a smooth state‐feedback controller is designed, which ensures that the closed‐loop system has an almost surely unique solution on [0, ∞), the equilibrium at the origin of the closed‐loop system is globally asymptotically stable in probability, and the states can be regulated to the origin almost surely. A simulation example demonstrates the control scheme. Copyright © 2007 John Wiley & Sons, Ltd.