Neural Network Adaptive Robust Control Of Siso Nonlinear Systems In A Normal Form

In this paper, performance oriented control laws are synthesized for a class of single‐input‐single‐output (SISO) n‐th order nonlinear systems in a normal form by integrating the neural networks (NNs) techniques and the adaptive robust control (ARC) design philosophy. All unknown but repeat‐able nonlinear functions in the system are approximated by the outputs of NNs to achieve a better model compensation for an improved performance. While all NN weights are tuned on‐line, discontinuous projections with fictitious bounds are used in the tuning law to achieve a controlled learning. Robust control terms are then constructed to attenuate model uncertainties for a guaranteed output tracking transient performance and a guaranteed final tracking accuracy. Furthermore, if the unknown nonlinear functions are in the functional ranges of the NNs and the ideal NN weights fall within the fictitious bounds, asymptotic output tracking is achieved to retain the perfect learning capability of NNs. The precision motion control of a linear motor drive system is used as a case study to illustrate the proposed NNARC strategy.     

Observer-based adaptive control for nonlinear input-delay systems with unknown control directions

This paper investigates the problem of adaptive control for strict-feedback nonlinear systems with input delay and unknown control directions. The Nussbaum function is utilised to deal with the unknown control directions and a novel compensation system is introduced to handle the time-varying input delay. By using neural network(NN) approximation and backstepping approaches, an adaptive NN controller is designed which can guarantee the semi-global boundedness of all the signals in the closed-loop system. Two simulation examples are also given to illustrate the effectiveness of the proposed method.     

Robust Adaptive Control of Robots Using Neural Network: Global Stability

A desired compensation adaptive law‐based neural network (DCAL‐NN) controller is proposed for the robust position control of rigid‐link robots. The NN is used to approximate a highly nonlinear function. The controller can guarantee the global asymptotic stability of tracking errors and boundedness of NN weights. In addition, the NN weights here are tuned on‐line, with no offline learning phase required. When compared with standard adaptive robot controllers, we do not require linearity in the parameters, or lengthy and tedious preliminary analysis to determine a regression matrix. The controller can be regarded as a universal reusable controller because the same controller can be applied to any type of rigid robots without any modifications. A comparative simulation study with different robust and adaptive controllers is included.     

Adaptive Neural Dynamic Surface Control For Nonlinear Pure‐Feedback Systems With Multiple Time‐Varying Delays: A Lyapunov‐Razumikhin Method

This paper focuses on the problem of adaptive neural control for a class of uncertain nonlinear pure‐feedback systems with multiple unknown time‐varying delays. The considered problem is challenging due to the non‐affine pure‐feedback form and the unknown system functions with multiple unknown time‐varying delays. Based on a novel combination of mean value theorem, Razumikhin functional method, dynamic surface control (DSC) technique and neural network (NN) parameterization, a new adaptive neural controller which contains only one parameter is developed for such systems. Moreover, The DSC technique can overcome the problem of ‘explosion of complexity’ in the traditional backstepping design procedure. All closed‐loop signals are shown to be semi‐globally uniformly ultimately bounded, and the tracking error converges to a small neighborhood of the origin. Two simulation examples are given to verify the effectiveness of the proposed design.     

Adaptive Fault‐Tolerant Control of Uncertain MIMO Systems with Reduced Requirement on Desired Trajectory Under Unknown Control Direction

This paper aims at investigating the tracking control problem for a class of multi‐input multi‐output (MIMO) nonlinear systems with non‐square control gain matrix subject to unknown control direction and uncertain desired trajectory. By using the artificial neural network (NN) reconstructs the target trajectory with actual disguised trajectory, we are able to design a practical and stable tracking control scheme without the need for the unavailable desired trajectory. Nussbaum‐type function is incorporated in the control law to handle the unknown control direction. The remarkable feature of the proposed scheme is that it is robust against modeling uncertainties and tolerant to actuation faults, yet guarantees that the closed‐loop system is stable in the sense of ultimately uniformly bounded (UUB). The effectiveness of the proposed control schemes are illustrated through simulation results.     

NN‐Based Output‐Feedback Control for Stochastic Nonlinear Systems with Unknown Control Directions

This paper addresses the neural network‐based output‐feedback control problem for a class of stochastic nonlinear systems with unknown control directions. The restrictions on the drift and diffusion terms are removed and the conditions on unknown control directions are relaxed. By introducing a proper coordinate transformation, and combining dynamic surface control (DSC) technique with radial basis function neural network (RBF NN) approximation approach, we construct an adaptive output‐feedback controller to guarantee the closed‐loop system to be mean square semi‐globally uniformly ultimately bounded (M‐SGUUB). A simulation example demonstrates the effectiveness of the proposed scheme.     

Online adaptive optimal control for continuous-time nonlinear systems with completely unknown dynamics

An online adaptive optimal control is proposed for continuous-time nonlinear systems with completely unknown dynamics, which is achieved by developing a novel identifier-critic-based approximate dynamic programming algorithm with a dual neural network (NN) approximation structure. First, an adaptive NN identifier is designed to obviate the requirement of complete knowledge of system dynamics, and a critic NN is employed to approximate the optimal value function. Then, the optimal control law is computed based on the information from the identifier NN and the critic NN, so that the actor NN is not needed. In particular, a novel adaptive law design method with the parameter estimation error is proposed to online update the weights of both identifier NN and critic NN simultaneously, which converge to small neighbourhoods around their ideal values. The closed-loop system stability and the convergence to small vicinity around the optimal solution are all proved by means of the Lyapunov theory. The proposed adaptation algorithm is also improved to achieve finite-time convergence of the NN weights. Finally, simulation results are provided to exemplify the efficacy of the proposed methods.     

Adaptive Decentralized NN Control of Nonlinear Interconnected Time‐Delay Systems with Input Saturation

In this paper, a novel decentralized adaptive neural control scheme is proposed for a class of interconnected large‐scale uncertain nonlinear time‐delay systems with input saturation. Radial basis function (RBF) neural networks (NNs) are used to tackle unknown nonlinear functions. Then, the decentralized adaptive NN tracking controller is constructed by combining Lyapunov–Krasovskii functions and the dynamic surface control (DSC) technique, along with the minimal‐learning‐parameters (MLP) algorithm. The stability analysis subject to the effect of input saturation constraints are conducted with the help of an auxiliary design system based on the Lyapunov–Krasovskii method. The proposed controller guarantees uniform ultimate boundedness (UUB) of all of the signals in the closed‐loop large‐scale system, while the tracking errors converge to a small neighborhood around the origin. An advantage of the proposed control scheme lies in the number of adaptive parameters of the whole system being reduced to one and in the solution of the three problems of “computational explosion,” “dimension curse,” and “controller singularity”. Finally, simulation results along with comparisons are presented to demonstrate the advantages, effectiveness, and performance of the proposed scheme.     

Neural-Network-Based Control for Discrete-Time Nonlinear Systems with Input Saturation Under Stochastic Communication Protocol

In this paper,an adaptive dynamic programming(ADP)strategy is investigated for discrete-time nonlinear systems with unknown nonlinear dynamics subject to input saturation.To save the communication resources between the controller and the actuators,stochastic communication protocols(SCPs)are adopted to schedule the control signal,and therefore the closed-loop system is essentially a protocol-induced switching system.A neural network(NN)-based identifier with a robust term is exploited for approximating the unknown nonlinear system,and a set of switch-based updating rules with an additional tunable parameter of NN weights are developed with the help of the gradient descent.By virtue of a novel Lyapunov function,a sufficient condition is proposed to achieve the stability of both system identification errors and the update dynamics of NN weights.Then,a value iterative ADP algorithm in an offline way is proposed to solve the optimal control of protocol-induced switching systems with saturation constraints,and the convergence is profoundly discussed in light of mathematical induction.Furthermore,an actor-critic NN scheme is developed to approximate the control law and the proposed performance index function in the framework of ADP,and the stability of the closed-loop system is analyzed in view of the Lyapunov theory.Finally,the numerical simulation results are presented to demonstrate the effectiveness of the proposed control scheme.     

Razumikhin–Nussbaum‐lemma‐based adaptive neural control for uncertain stochastic pure‐feedback nonlinear systems with time‐varying delays

This paper addresses the problem of adaptive neural control for a class of uncertain stochastic pure‐feedback nonlinear systems with time‐varying delays. Major technical difficulties for this class of systems lie in: (1) the unknown control direction embedded in the unknown control gain function; and (2) the unknown system functions with unknown time‐varying delays. Based on a novel combination of the Razumikhin–Nussbaum lemma, the backstepping technique and the NN parameterization, an adaptive neural control scheme, which contains only one adaptive parameter is presented for this class of systems. All closed‐loop signals are shown to be 4‐Moment semi‐globally uniformly ultimately bounded in a compact set, and the tracking error converges to a small neighborhood of the origin. Finally, two simulation examples are given to demonstrate the effectiveness of the proposed control schemes. Copyright © 2012 John Wiley & Sons, Ltd.     

Adaptive neural control for a class of stochastic nonlinear time‐delay systems with unknown dead zone using dynamic surface technique

This paper investigates the problem of adaptive control for a class of stochastic nonlinear time‐delay systems with unknown dead zone. A neural network‐based adaptive control scheme is developed by using the dynamic surface control (DSC) technique and the minimal learning parameters algorithm. The dynamic surface control technique, which can avoid the problem of ‘explosion of complexity’ inherent in the conventional backstepping design procedure, is first extended to the stochastic nonlinear time‐delay system with unknown dead zone. The unknown nonlinearities are approximated by the function approximation technique using the radial basis function neural network. For the purpose of reducing the numbers of parameters, which are updated online for each subsystem in the process of approximating the unknown functions, the minimal learning parameters algorithm is then introduced. Also, the adverse effects of unknown time‐delay are removed by using the appropriate Lyapunov–Krasovskii functionals. In addition, the proposed control scheme is systematically derived without requiring any information on the boundedness of the dead zone parameters and avoids the possible controller singularity problem in the approximation‐based adaptive control schemes with feedback linearization technique. It is shown that the proposed control approach can guarantee that all the signals of the closed‐loop system are bounded in probability, and the tracking errors can be made arbitrary small by choosing the suitable design parameters. Finally, a simulation example is provided to illustrate the performance of the proposed control scheme. Copyright © 2015 John Wiley & Sons, Ltd.     

A direct NN‐approximation control for uncertain nonaffine systems with unknown control direction

In this paper, we present an adaptive neural network (NN) controller for uncertain nonaffine systems with unknown control direction. Most of the previous NN‐based controllers included a damping term in the adaptive law of NN weights to ensure the closed‐loop stability. The estimated error of the NN weights as well as the tracking error were therefore increased, relying not only on the size of the NN approximation error but also on the ideal NN weights. Compared with those, the proposed controller evades using the damping term through combining a novel adaptive algorithm and a switching mechanism to update the weights. The NN thus can directly approach a target controller with satisfactory accuracy even if the control direction is unknown. Stability analysis shows that the tracking error and the estimated error of NN weights both converge to small neighbors of 0 which solely depend on the NN approximation error. At last, simulations on a Duffing‐Holmes chaotic model show the effectiveness of the proposed controller in comparison to another NN‐based method.     

Asymptotic tracking by a reinforcement learning-based adaptive critic controller

Adaptive critic (AC) based controllers are typically discrete and/or yield a uniformly ultimately bounded stability result because of the presence of disturbances and unknown approximation errors. A continuous-time AC controller is developed that yields asymptotic tracking of a class of uncertain nonlinear systems with bounded disturbances. The proposed AC-based controller consists of two neural networks (NNs) – an action NN, also called the actor, which approximates the plant dynamics and generates appropriate control actions; and a critic NN, which evaluates the performance of the actor based on some performance index. The reinforcement signal from the critic is used to develop a composite weight tuning law for the action NN based on Lyapunov stability analysis. A recently developed robust feedback technique, robust integral of the sign of the error (RISE), is used in conjunction with the feedforward action neural network to yield a semiglobal asymptotic result. Experimental results are provided that illustrate the performance of the developed controller.     

Multiple Lyapunov functions‐based adaptive neural network tracking control of uncertain switched nonlinear systems

In this paper, the problem of adaptive neural network (NN) tracking control of a class of switched strict‐feedback uncertain nonlinear systems is investigated by state‐feedback, in which the solvability of the problem of adaptive NN tracking control for individual subsystems is unnecessary. A multiple Lyapunov functions (MLFs)–based adaptive NN tracking control scheme is established by exploiting backstepping and the generalized MLFs approach. Moreover, based on the proposed scheme, adaptive NN controllers of all subsystems and a state‐dependent switching law simultaneously are constructed, which guarantee that all signals of the resulting closed‐loop system are semiglobally uniformly ultimately bounded, and the tracking error converges to a small neighborhood of the origin. The scheme provided permits removal of a technical condition in which the adaptive NN tracking control problem for individual subsystems is solvable. Finally, the effectiveness of the design scheme proposed is shown by using two examples.     

Online Adaptive Approximate Optimal Tracking Control with Simplified Dual Approximation Structure for Continuous-time Unknown Nonlinear Systems

This paper proposes an online adaptive approximate solution for the infinite-horizon optimal tracking control problem of continuous-time nonlinear systems with unknown dynamics. The requirement of the complete knowledge of system dynamics is avoided by employing an adaptive identifier in conjunction with a novel adaptive law, such that the estimated identifier weights converge to a small neighborhood of their ideal values. An adaptive steady-state controller is developed to maintain the desired tracking performance at the steady-state, and an adaptive optimal controller is designed to stabilize the tracking error dynamics in an optimal manner. For this purpose, a critic neural network (NN) is utilized to approximate the optimal value function of the Hamilton-Jacobi-Bellman (HJB) equation, which is used in the construction of the optimal controller. The learning of two NNs, i.e., the identifier NN and the critic NN, is continuous and simultaneous by means of a novel adaptive law design methodology based on the parameter estimation error. Stability of the whole system consisting of the identifier NN, the critic NN and the optimal tracking control is guaranteed using Lyapunov theory; convergence to a near-optimal control law is proved. Simulation results exemplify the effectiveness of the proposed method.      

Adaptive output-feedback regulation for nonlinear delayed systems using neural network

A novel adaptive neural network （NN） output-feedback regulation algorithm for a class of nonlinear time-varying timedelay systems is proposed. Both the designed observer and controller are independent of time delay. Different from the existing results, where the upper bounding functions of time-delay terms are assumed to be known, we only use an NN to compensate for all unknown upper bounding functions without that assumption. The proposed design method is proved to be able to guarantee semi-global uniform ultimate boundedness of all the signals in the closed system, and the system output is proved to converge to a small neighborhood of the origin. The simulation results verify the effectiveness of the control scheme.     

一类不确定非线性系统反步自适应神经网络控制研究

针对合有高阶不确定扰动项且不可参数线性化的一类非线性系统，采用反步递推方法设计基于多层神经网络的自适应控制器，多层神经网络可较好地逼近非线性系统，其权值能在系统先验知识不多的情况下在线调整，给出了神经网络Lyapunov意义下稳定的在线自适应律，在设计控制器的过程中，采用类加权形式Lyapunov函数，使得控制器能有效处理自适应控制奇异性问题，仿真结果表明，该控制器对系统参数的不确定性和有界干扰具有一定的鲁棒性，并能保证闭环系统全局稳定。     

Direct adaptive controller for nonaffine nonlinear systems using self-structuring neural networks

A direct adaptive state-feedback controller is proposed for highly nonlinear systems. We consider uncertain or ill-defined nonaffine nonlinear systems and employ a neural network (NN) with flexible structure, i.e., an online variation of the number of neurons. The NN approximates and adaptively cancels an unknown plant nonlinearity. A control law and adaptive laws for the weights in the hidden layer and output layer of the NN are established so that the whole closed-loop system is stable in the sense of Lyapunov. Moreover, the tracking error is guaranteed to be uniformly asymptotically stable (UAS) rather than uniformly ultimately bounded (UUB) with the aid of an additional robustifying control term. The proposed control algorithm is relatively simple and requires no restrictive conditions on the design constants for the stability. The efficiency of the proposed scheme is shown through the simulation of a simple nonaffine nonlinear system.     

Adaptive output feedback control for nonlinear time-delay systems using neural network

This paper extends the adaptive neural network （NN） control approaches to a class of unknown output feedback nonlinear time-delay systems. An adaptive output feedback NN tracking controller is designed by backstepping technique. NNs are used to approximate unknown functions dependent on time delay, Delay-dependent filters are introduced for state estimation. The domination method is used to deal with the smooth time-delay basis functions. The adaptive bounding technique is employed to estimate the upper bound of the NN approximation errors. Based on Lyapunov- Krasovskii functional, the semi-global uniform ultimate boundedness of all the signals in the closed-loop system is proved, The feasibility is investigated by two illustrative simulation examples.     

Adaptive neural network control of bilateral teleoperation with unsymmetrical stochastic delays and unmodeled dynamics

In this paper, adaptive NN control is proposed for bilateral teleoperation system with dynamic uncertainties, unknown external disturbances, and unsymmetrical stochastic delays in communication channel to achieve transparency and robust stability. Compared with previous passivity‐based teleoperation framework, the communication delays are unsymmetrical and stochastic. By partial feedback linearization using nominal dynamics, the nonlinear dynamics of the teleoperation system are transformed into two subsystems: local master/slave dynamics control and time‐delay motion tracking. By integrating Markov jump systems and adaptive parameters updating, adaptive NN control strategy is developed. The stability of the closed‐loop system and the boundedness of tracking errors are proved using Lyapunov–Krasovskii functional synthesis under specific linear matrix inequalities conditions. The proposed adaptive NN control is robust against motion disturbances, parametric uncertainties, and unsymmetrical stochastic delay, which effectiveness is validated by extensive simulation studies. Copyright © 2013 John Wiley & Sons, Ltd.