Adaptive NN control for a class of strict-feedback discrete-time nonlinear systems

In this paper, both full state and output feedback adaptive neural network (NN) controllers are presented for a class of strict-feedback discrete-time nonlinear systems. Firstly, Lyapunov-based full-state adaptive NN control is presented via backstepping, which avoids the possible controller singularity problem in adaptive nonlinear control and solves the noncausal problem in the discrete-time backstepping design procedure. After the strict-feedback form is transformed into a cascade form, another relatively simple Lyapunov-based direct output feedback control is developed. The closed-loop systems for both control schemes are proven to be semi-globally uniformly ultimately bounded.     

Neural-Network-Based State Feedback Control of a Nonlinear Discrete-Time System in Nonstrict Feedback Form

In this paper, a suite of adaptive neural network (NN) controllers is designed to deliver a desired tracking performance for the control of an unknown, second-order, nonlinear discrete-time system expressed in nonstrict feedback form. In the first approach, two feedforward NNs are employed in the controller with tracking error as the feedback variable whereas in the adaptive critic NN architecture, three feedforward NNs are used. In the adaptive critic architecture, two action NNs produce virtual and actual control inputs, respectively, whereas the third critic NN approximates certain strategic utility function and its output is employed for tuning action NN weights in order to attain the near-optimal control action. Both the NN control methods present a well-defined controller design and the noncausal problem in discrete-time backstepping design is avoided via NN approximation. A comparison between the controller methodologies is highlighted. The stability analysis of the closed-loop control schemes is demonstrated. The NN controller schemes do not require an offline learning phase and the NN weights can be initialized at zero or random. Results show that the performance of the proposed controller schemes is highly satisfactory while meeting the closed-loop stability.      

Neural networks stabilization and disturbance attenuation for nonlinear switched impulsive systems

In this paper, we address the problem of neural networks (NNs) stabilization and disturbance rejection for a class of nonlinear switched impulsive systems. An adaptive NN feedback control scheme and an impulsive controller for output tracking error disturbance attenuation of nonlinear switched impulsive systems are given under all admissible switched strategy based on NN. The NN is used to compensate for the nonlinear uncertainties of switched impulsive systems, and the approximation error of NN is introduced to the adaptive law in order to improve the tracking attenuation quality of the switched impulsive systems. Impulsive controller is designed to attenuate effect of switching impulse. Under all admissible switching law, impulsive controller and adaptive NN feedback controller can guarantee asymptotic stability of tracking error and improve disturbance attenuation level of tracking error for the overall nonlinear switched impulsive system. Finally, a numerical example is given to demonstrate the effectiveness of the proposed control and stabilization methods.     

Reinforcement learning-based output feedback control of nonlinear systems with input constraints.

A novel neural network (NN)-based output feedback controller with magnitude constraints is designed to deliver a desired tracking performance for a class of multi-input and multi-output (MIMO) strict feedback nonlinear discrete-time systems. Reinforcement learning is proposed for the output feedback controller, which uses three NNs: 1) an NN observer to estimate the system states with the input-output data, 2) a critic NN to approximate certain strategic utility function, and 3) an action NN to minimize both the strategic utility function and the unknown dynamics estimation errors. Using the Lyapunov approach, the uniformly ultimate boundedness (UUB) of the state estimation errors, the tracking errors and weight estimates is shown.     

Distributed adaptive output feedback tracking control for a class of uncertain nonlinear multi-agent systems

This paper addresses the distributed output feedback tracking control problem for multi-agent systems with higher order nonlinear non-strict-feedback dynamics and directed communication graphs. The existing works usually design a distributed consensus controller using all the states of each agent, which are often immeasurable, especially in nonlinear systems. In this paper, based only on the relative output between itself and its neighbours, a distributed adaptive consensus control law is proposed for each agent using the backstepping technique and approximation technique of Fourier series (FS) to solve the output feedback tracking control problem of multi-agent systems. The FS structure is taken not only for tracking the unknown nonlinear dynamics but also the unknown derivatives of virtual controllers in the controller design procedure, which can therefore prevent virtual controllers from containing uncertain terms. The projection algorithm is applied to ensure that the estimated parameters remain in some known bounded sets. Lyapunov stability analysis shows that the proposed control law can guarantee that the output of each agent synchronises to the leader with bounded residual errors and that all the signals in the closed-loop system are uniformly ultimately bounded. Simulation results have verified the performance and feasibility of the proposed distributed adaptive control strategy.     

NN-adaptive output feedback tracking control for a class of discrete-time non-affine systems with a dynamic compensator

The problem of tracking control for a class of uncertain non-affine discrete-time nonlinear systems with internal dynamics is addressed. The fixed point theorem is first employed to ensure the control problem in question is solvable and well-defined. Based on it, an adaptive output feedback control scheme based on neural network (NN) is presented. The proposed control algorithm consists of two parts: a dynamic compensator is introduced to stabilise the linear portion of the tracking error system; a single-hidden-layer neural network (SHL NN) approximation mechanism is introduced to cancel the uncertainties resulting from the non-affine function, where the recursive weight update rules of NN estimation are derived from the discrete-time version of Lyapunov control theory. Ultimate boundedness of the error signals is shown through Lyapunov’s direct method and the discrete-time version of input-to-state stability (ISS) theory. Finally, a model of automatical underwater vehicle (AUV) is considered to show the effectiveness of the proposed control scheme.     

Robust adaptive NN control for a class of uncertain discrete-time nonlinear MIMO systems

A robust adaptive NN output feedback control is proposed to control a class of uncertain discrete-time nonlinear multi-input–multi-output (MIMO) systems. The high-order neural networks are utilized to approximate the unknown nonlinear functions in the systems. Compared with the previous research for discrete-time MIMO systems, robustness of the proposed adaptive algorithm is obvious improved. Using Lyapunov stability theorem, the results show all the signals in the closed-loop system are semi-globally uniformly ultimately bounded, and the tracking errors converge to a small neighborhood of zero by choosing the design parameters appropriately.     

Observer-based adaptive neural dynamic surface control for a class of non-strict-feedback stochastic nonlinear systems

The problem of adaptive output feedback stabilisation is addressed for a more general class of non-strict-feedback stochastic nonlinear systems in this paper. The neural network (NN) approximation and the variable separation technique are utilised to deal with the unknown subsystem functions with the whole states. Based on the design of a simple input-driven observer, an adaptive NN output feedback controller which contains only one parameter to be updated is developed for such systems by using the dynamic surface control method. The proposed control scheme ensures that all signals in the closed-loop systems are bounded in probability and the error signals remain semi-globally uniformly ultimately bounded in fourth moment (or mean square). Two simulation examples are given to illustrate the effectiveness of the proposed control design.     

基于虚拟参考反馈整定的改进无模型自适应控制

针对一类离散时间非线性系统, 提出一种基于虚拟参考反馈整定的改进无模型自适应控制方案. 首先, 利用动态线性化方法给出非线性系统的紧格式动态线性化模型; 然后, 基于优化技术设计控制算法和伪偏导数估计算法; 最后, 设计基于虚拟参考反馈整定的伪偏导数初值和重置值的估计算法. 该控制方案设计仅依赖于被控系统的输入和输出数据, 且能保证闭环系统的稳定性和收敛性. 仿真比较结果验证了所提出方法的有效性.

     

Adaptive output feedback control for nonlinear time-delay systems using neural network

This paper extends the adaptive neural network （NN） control approaches to a class of unknown output feedback nonlinear time-delay systems. An adaptive output feedback NN tracking controller is designed by backstepping technique. NNs are used to approximate unknown functions dependent on time delay, Delay-dependent filters are introduced for state estimation. The domination method is used to deal with the smooth time-delay basis functions. The adaptive bounding technique is employed to estimate the upper bound of the NN approximation errors. Based on Lyapunov- Krasovskii functional, the semi-global uniform ultimate boundedness of all the signals in the closed-loop system is proved, The feasibility is investigated by two illustrative simulation examples.     

Output feedback strict passivity of discrete-time nonlinear systems and adaptive control system design with a PFC

In this paper, a passivity-based adaptive output feedback control for discrete-time nonlinear systems is considered. Output Feedback Strictly Passive (OFSP) conditions in order to design a stable adaptive output control system will be established. Further, a design scheme of a parallel feedforward compensator (PFC), which is introduced in order to realize an OFSP controlled system, will be provided and an adaptive output feedback control system design scheme with a PFC will be proposed.     

基于神经网络的一类非线性系统自适应输出跟踪

针对一类未知非线性系统,提出了一种输出反馈控制方法.首先,在假设系统状态已 知情况下设计状态反馈控制器,实现跟踪性能;然后,在系统状态不完全可测的情况下,通过 设计高增益观测器对系统的状态进行估计,实现输出反馈控制器设计,证明了所设计的输出 反馈控制器可以获得状态反馈控制器的性能.     

Multiple model-based event-triggered adaptive control of a class of discrete-time nonlinear systems

In this study, the problem of event-triggered-based adaptive control (ETAC) for a class of discrete-time nonlinear systems with unknown parameters and nonlinear uncertainties is considered. Both neural network (NN) based and linear identifiers are used to approximate the unknown system dynamics. The feedback output signals are transmitted, and the parameters and the NN weights of the identifiers are tuned in an aperiodic manner at the event sample instants. A switching mechanism is provided to evaluate the approximate performance of each identifier and decide which estimated output is utilised for the event-triggered controller design, during any two events. The linear identifier with an auxiliary output and an improved adaptive law is introduced so that the nonlinear uncertainties are no longer assumed to be Lipschitz. The number of transmission times are significantly reduced by incorporating multiple model schemes into ETAC. The boundedness of both the parameters of identifiers and the system outputs is demonstrated though the Lyapunov approach. Simulation results demonstrate the effectiveness of the proposed method.     

Reinforcement learning neural-network-based controller for nonlinear discrete-time systems with input constraints.

A novel adaptive-critic-based neural network (NN) controller in discrete time is designed to deliver a desired tracking performance for a class of nonlinear systems in the presence of actuator constraints. The constraints of the actuator are treated in the controller design as the saturation nonlinearity. The adaptive critic NN controller architecture based on state feedback includes two NNs: the critic NN is used to approximate the "strategic" utility function, whereas the action NN is employed to minimize both the strategic utility function and the unknown nonlinear dynamic estimation errors. The critic and action NN weight updates are derived by minimizing certain quadratic performance indexes. Using the Lyapunov approach and with novel weight updates, the uniformly ultimate boundedness of the closed-loop tracking error and weight estimates is shown in the presence of NN approximation errors and bounded unknown disturbances. The proposed NN controller works in the presence of multiple nonlinearities, unlike other schemes that normally approximate one nonlinearity. Moreover, the adaptive critic NN controller does not require an explicit offline training phase, and the NN weights can be initialized at zero or random. Simulation results justify the theoretical analysis.     

Adaptive Neural Network-Based Control for a Class of Nonlinear Pure-Feedback Systems With Time-Varying Full State Constraints

In this paper, an adaptive neural network (NN) control approach is proposed for nonlinear pure-feedback systems with time-varying full state constraints. The pure-feedback systems of this paper are assumed to possess nonlinear function uncertainties. By using the mean value theorem, pure-feedback systems can be transformed into strict feedback forms. For the newly generated systems, NNs are employed to approximate unknown items. Based on the adaptive control scheme and backstepping algorithm, an intelligent controller is designed. At the same time, time-varying Barrier Lyapunov functions (BLFs) with error variables are adopted to avoid violating full state constraints in every step of the backstepping design. All closedloop signals are uniformly ultimately bounded and the output tracking error converges to the neighborhood of zero, which can be verified by using the Lyapunov stability theorem. Two simulation examples reveal the performance of the adaptive NN control approach.      

Adaptive fuzzy backstepping output feedback control of nonlinear uncertain systems with unknown virtual control coefficients using MT-filters

In this paper, an adaptive fuzzy output feedback control approach is developed for a class of SISO nonlinear uncertain systems with unmeasured states and unknown virtual control coefficients. The fuzzy logic systems are used to model the uncertain nonlinear systems. The MT-filters and the state observer are designed to estimate the unmeasured states. Using backstepping design principle and combining the Nussbaum gain functions, an adaptive fuzzy output feedback control scheme is developed. It is proved that the proposed adaptive fuzzy control approach can guarantee all the signals in the closed-loop system are semi-globally uniformly ultimately bounded and the tracking error converges to a small neighborhood of origin. A simulation is included to illustrate the effectiveness of the proposed approach.     

Real-time torque control using discrete-time recurrent high-order neural networks

This paper presents a discrete-time direct current (DC) motor torque tracking controller, based on a recurrent high-order neural network to identify the plant model. In order to train the neural identifier, the extended Kalman filter (EKF) based training algorithm is used. The neural identifier is in series-parallel configuration that constitutes a well approximation method of the real plant by the neural identifier. Using the neural identifier structure that is in the nonlinear controllable form, the block control (BC) combined with sliding modes (SM) control techniques in discrete-time are applied. The BC technique is used to design a nonlinear sliding manifold such that the resulting sliding mode dynamics are described by a desired linear system. For the SM control technique, the equivalent control law is used in order to the plant output tracks a reference signal. For reducing the effect of unknown terms, it is proposed a specific desired dynamics for the sliding variables. The control problem is solved by the indirect approach, where an appropriate neural network (NN) identification model is selected; the NN parameters (synaptic weights) are adjusted according to a specific adaptive law (EKF), such that the response of the NN identifier approximates the response of the real plant for the same input. Then, based on the designed NN identifier a stabilizing or reference tracking controller is proposed (BC combined with SM). The proposed neural identifier and control applicability are illustrated by torque trajectory tracking for a DC motor with separate winding excitation via real-time implementation.     

A multivariable MRAC scheme with application to a nonlinear aircraft model

This paper revisits the multivariable model reference adaptive control (MRAC) problem, by studying adaptive state feedback control for output tracking of multi-input multi-output (MIMO) systems. With such a control scheme, the plant-model matching conditions are much less restrictive than those for state tracking, while the controller has a simpler structure than that of an output feedback design. Such a control scheme is useful when the plant-model matching conditions for state tracking cannot be satisfied. A stable adaptive control scheme is developed based on LDS decomposition of the high-frequency gain matrix, which ensures closed-loop stability and asymptotic output tracking. A simulation study of a linearized lateral-directional dynamics model of a realistic nonlinear aircraft system model is conducted to demonstrate the scheme. This linear design based MRAC scheme is subsequently applied to a nonlinear aircraft system, and the results indicate that this linearization-based adaptive scheme can provide acceptable system performance for the nonlinear systems in a neighborhood of an operating point.     

Adaptive output feedback tracking control for a class of uncertain switched nonlinear systems under arbitrary switching

This paper investigates the problem of adaptive output feedback tracking for uncertain switched nonlinear systems, under arbitrary switching. First, an adaptive output feedback controller is designed, which ensures the boundedness of all the closed-loop signals. Then, a novel adaptive-based robust output feedback control is proposed to drive the tracking error to zero, in which the bound of disturbances is not required to be known in advance. Both control algorithms are based on the common Lyapunov function method, without any restrictions on dwell time. To evaluate the performance of the proposed output feedback control schemes, a numerical example is presented and discussed.     

Learning from NN output feedback control of nonlinear systems in Brunovsky canonical form

In this paper, we investigate the learning issue in the adaptive neural network (NN) output feedback control of nonlinear systems in Brunovsky canonical form with unknown affine term. With only output measurements, a high-gain observer (HGO) is employed to estimate the derivatives of the system output which may be associated with the generation of peaking phenomenon. The adverse effect of peaking on learning and its elimination strategies are analyzed. When the gain of HGO is chosen too high, it may cause the failure of learning from the unknown closed-loop system dynamics. Hence, the gain of HGO is not chosen too high to relieve peaking and guarantee the accuracy of the estimated system states. Then, learning from the unknown closed-loop system dynamics can be achieved. When repeating the same or similar control tasks, a neural learning controller is presented which can effectively recall and reuse the learned knowledge to guarantee the output tracking performance. Finally, simulation results demonstrate the effectiveness of the proposed scheme.