Time-Varying Asymmetrical BLFs Based Adaptive Finite-Time Neural Control of Nonlinear Systems With Full State Constraints

This paper concentrates on asymmetric barrier Lyapunov functions (ABLFs) based on finite-time adaptive neural network (NN) control methods for a class of nonlinear strict feedback systems with time-varying full state constraints. During the process of backstepping recursion, the approximation properties of NNs are exploited to address the problem of unknown internal dynamics. The ABLFs are constructed to make sure that the time-varying asymmetrical full state constraints are always satisfied. According to the Lyapunov stability and finite-time stability theory, it is proven that all the signals in the closed-loop systems are uniformly ultimately bounded (UUB) and the system output is driven to track the desired signal as quickly as possible near the origin. In the meantime, in the scope of finite-time, all states are guaranteed to stay in the pre-given range. Finally, a simulation example is proposed to verify the feasibility of the developed finite time control algorithm.      

Adaptive neural output feedback control for stochastic nonlinear time-delay systems with unknown control directions

This paper first focuses on the problem of adaptive output feedback stabilization for a more general class of stochastic nonlinear time-delay systems with unknown control directions. By using a linear state transformation, the original system is transformed to a new system for which control design becomes feasible. Then a novel adaptive neural network (NN) output feedback control strategy, which only contains one adaptive parameter, is developed for such systems by combining the input-driven filter design, the backstepping technique, the NN’s parameterization, the Nussbaum gain function method and the Lyapunov–Krasovskii approach. The proposed control design guarantees that all signals in the closed-loop systems are 4-moment (or 2-moment) semi-globally uniformly bounded. Finally, two simulation examples are given to demonstrate the effectiveness and the applicability of the proposed control design.     

Adaptive output feedback formation tracking for a class of multiagent systems with quantized input signals

A novel adaptive output feedback control approach is presented for formation tracking of a multiagent system with uncertainties and quantized input signals. The agents are described by nonlinear dynamics models with unknown parameters and immeasurable states. A high-gain dynamic state observer is established to estimate the immeasurable states. With a proper design parameter choice, an adaptive output feedback control method is developed employing a hysteretic quantizer and the designed dynamic state observer. Stability analysis shows that the control strategy can guarantee that the agents can maintain the formation shape while tracking the reference trajectory. In addition, all the signals in the closed-loop system are bounded. The effectiveness of the control strategy is validated by simulation.     

非线性主动悬架系统自适应最优控制

针对非线性主动悬架系统多性能指标综合优化问题,提出一类自适应最优控制方法.首先,通过引入一阶低通滤波操作,利用系统输入输出构建结构简单且调节参数少的一类未知非线性动态估计器,在线估计系统未知非线性动态;其次,构建包含乘驾舒适度、悬架行程空间及输入能耗的性能指标函数,采用单层神经网络对最优性能指标函数进行在线逼近,并得到新的哈密尔顿函数;为实现在线求解,构建一类新的基于参数估计误差信息的自适应律,在线更新神经网络权值并计算最优控制律;最后,理论分析闭环系统稳定性和收敛性,并通过专业软件Carsim与Matlab/Simulink搭建的联合仿真平台给出的对比仿真结果,验证所提出方法可有效解决主动悬架系统多目标性能优化控制问题,提升主动悬架系统综合性能.     

Online Adaptive Approximate Optimal Tracking Control with Simplified Dual Approximation Structure for Continuous-time Unknown Nonlinear Systems

This paper proposes an online adaptive approximate solution for the infinite-horizon optimal tracking control problem of continuous-time nonlinear systems with unknown dynamics. The requirement of the complete knowledge of system dynamics is avoided by employing an adaptive identifier in conjunction with a novel adaptive law, such that the estimated identifier weights converge to a small neighborhood of their ideal values. An adaptive steady-state controller is developed to maintain the desired tracking performance at the steady-state, and an adaptive optimal controller is designed to stabilize the tracking error dynamics in an optimal manner. For this purpose, a critic neural network (NN) is utilized to approximate the optimal value function of the Hamilton-Jacobi-Bellman (HJB) equation, which is used in the construction of the optimal controller. The learning of two NNs, i.e., the identifier NN and the critic NN, is continuous and simultaneous by means of a novel adaptive law design methodology based on the parameter estimation error. Stability of the whole system consisting of the identifier NN, the critic NN and the optimal tracking control is guaranteed using Lyapunov theory; convergence to a near-optimal control law is proved. Simulation results exemplify the effectiveness of the proposed method.      

Adaptive NN prescribed performance control for nonlinear systems with output dead zone

This paper investigates adaptive neural network (NN) prescribed performance output tracking control problem for a class of strict-feedback nonlinear systems with output dead zone. By introducing a Nussbaum function, the problem of unknown virtual control coefficient is resolved, which is caused by the nonlinearity in the output dead zone. By designing the state observer and utilizing backstepping recursive design technique, a new adaptive NN control method is proposed. It is shown that all the signals of the resulting closed-loop system are bounded and the tracking error remains an adjustable neighborhood of the origin with the predefined performance under the effect of output dead zone. Finally, a simulation example is given at the simulation part, which further demonstrate the effectiveness of proposed control method.

     

Online optimal control of nonlinear discrete-time systems using approximate dynamic programming

In this paper,the optimal control of a class of general affine nonlinear discrete-time(DT) systems is undertaken by solving the Hamilton Jacobi-Bellman(HJB) equation online and forward in time.The proposed approach,referred normally as adaptive or approximate dynamic programming(ADP),uses online approximators(OLAs) to solve the infinite horizon optimal regulation and tracking control problems for affine nonlinear DT systems in the presence of unknown internal dynamics.Both the regulation and tracking contro...     

Observer-based adaptive neural dynamic surface control for a class of non-strict-feedback stochastic nonlinear systems

The problem of adaptive output feedback stabilisation is addressed for a more general class of non-strict-feedback stochastic nonlinear systems in this paper. The neural network (NN) approximation and the variable separation technique are utilised to deal with the unknown subsystem functions with the whole states. Based on the design of a simple input-driven observer, an adaptive NN output feedback controller which contains only one parameter to be updated is developed for such systems by using the dynamic surface control method. The proposed control scheme ensures that all signals in the closed-loop systems are bounded in probability and the error signals remain semi-globally uniformly ultimately bounded in fourth moment (or mean square). Two simulation examples are given to illustrate the effectiveness of the proposed control design.     

Adaptive neural control for a class of uncertain nonlinear systems with unknown time delay

A neural network (NN)‐based robust adaptive control design scheme is developed for a class of nonlinear systems represented by input–output models with an unknown nonlinear function and unknown time delay. By approximating on‐line the unknown nonlinear functions with a three‐layer feedforward NN, the proposed approach does not require the unknown parameters to satisfy the linear dependence condition. The control law is delay independent and possible controller singularity problem is avoided. It is proved that with the proposed neural control law, all the signals in the closed‐loop system are semiglobally bounded in the presence of unknown time delay and unknown nonlinearity. A simulation example is presented to demonstrate the method. Copyright © 2008 John Wiley & Sons, Ltd.     

Adaptive neural network output feedback control of stochastic nonlinear systems with dynamical uncertainties

In this paper, a robust adaptive neural network (NN) backstepping output feedback control approach is proposed for a class of uncertain stochastic nonlinear systems with unknown nonlinear functions, unmodeled dynamics, dynamical uncertainties and without requiring the measurements of the states. The NNs are used to approximate the unknown nonlinear functions, and a filter observer is designed for estimating the unmeasured states. To solve the problem of the dynamical uncertainties, the changing supply function is incorporated into the backstepping recursive design technique, and a new robust adaptive NN output feedback control approach is constructed. It is mathematically proved that the proposed control approach can guarantee that all the signals of the resulting closed-loop system are semi-globally uniformly ultimately bounded in probability, and the observer errors and the output of the system converge to a small neighborhood of the origin by choosing design parameters appropriately. The simulation example and comparison results further justify the effectiveness of the proposed approach.     

Adaptive NN control for a class of strict-feedback discrete-time nonlinear systems

In this paper, both full state and output feedback adaptive neural network (NN) controllers are presented for a class of strict-feedback discrete-time nonlinear systems. Firstly, Lyapunov-based full-state adaptive NN control is presented via backstepping, which avoids the possible controller singularity problem in adaptive nonlinear control and solves the noncausal problem in the discrete-time backstepping design procedure. After the strict-feedback form is transformed into a cascade form, another relatively simple Lyapunov-based direct output feedback control is developed. The closed-loop systems for both control schemes are proven to be semi-globally uniformly ultimately bounded.     

Neural-network-observer-based optimal control for unknown nonlinear systems using adaptive dynamic programming

In this paper, an observer-based optimal control scheme is developed for unknown nonlinear systems using adaptive dynamic programming (ADP) algorithm. First, a neural-network (NN) observer is designed to estimate system states. Then, based on the observed states, a neuro-controller is constructed via ADP method to obtain the optimal control. In this design, two NN structures are used: a three-layer NN is used to construct the observer which can be applied to systems with higher degrees of nonlinearity and without a priori knowledge of system dynamics, and a critic NN is employed to approximate the value function. The optimal control law is computed using the critic NN and the observer NN. Uniform ultimate boundedness of the closed-loop system is guaranteed. The actor, critic, and observer structures are all implemented in real-time, continuously and simultaneously. Finally, simulation results are presented to demonstrate the effectiveness of the proposed control scheme.     

Online adaptive optimal control for continuous-time nonlinear systems with completely unknown dynamics

An online adaptive optimal control is proposed for continuous-time nonlinear systems with completely unknown dynamics, which is achieved by developing a novel identifier-critic-based approximate dynamic programming algorithm with a dual neural network (NN) approximation structure. First, an adaptive NN identifier is designed to obviate the requirement of complete knowledge of system dynamics, and a critic NN is employed to approximate the optimal value function. Then, the optimal control law is computed based on the information from the identifier NN and the critic NN, so that the actor NN is not needed. In particular, a novel adaptive law design method with the parameter estimation error is proposed to online update the weights of both identifier NN and critic NN simultaneously, which converge to small neighbourhoods around their ideal values. The closed-loop system stability and the convergence to small vicinity around the optimal solution are all proved by means of the Lyapunov theory. The proposed adaptation algorithm is also improved to achieve finite-time convergence of the NN weights. Finally, simulation results are provided to exemplify the efficacy of the proposed methods.     

Output Feedback Control of a Quadrotor UAV Using Neural Networks

In this paper, a new nonlinear controller for a quadrotor unmanned aerial vehicle (UAV) is proposed using neural networks (NNs) and output feedback. The assumption on the availability of UAV dynamics is not always practical, especially in an outdoor environment. Therefore, in this work, an NN is introduced to learn the complete dynamics of the UAV online, including uncertain nonlinear terms like aerodynamic friction and blade flapping. Although a quadrotor UAV is underactuated, a novel NN virtual control input scheme is proposed which allows all six degrees of freedom (DOF) of the UAV to be controlled using only four control inputs. Furthermore, an NN observer is introduced to estimate the translational and angular velocities of the UAV, and an output feedback control law is developed in which only the position and the attitude of the UAV are considered measurable. It is shown using Lyapunov theory that the position, orientation, and velocity tracking errors, the virtual control and observer estimation errors, and the NN weight estimation errors for each NN are all semiglobally uniformly ultimately bounded (SGUUB) in the presence of bounded disturbances and NN functional reconstruction errors while simultaneously relaxing the separation principle. The effectiveness of proposed output feedback control scheme is then demonstrated in the presence of unknown nonlinear dynamics and disturbances, and simulation results are included to demonstrate the theoretical conjecture.      

Adaptive Neural Network-Based Control for a Class of Nonlinear Pure-Feedback Systems With Time-Varying Full State Constraints

In this paper, an adaptive neural network (NN) control approach is proposed for nonlinear pure-feedback systems with time-varying full state constraints. The pure-feedback systems of this paper are assumed to possess nonlinear function uncertainties. By using the mean value theorem, pure-feedback systems can be transformed into strict feedback forms. For the newly generated systems, NNs are employed to approximate unknown items. Based on the adaptive control scheme and backstepping algorithm, an intelligent controller is designed. At the same time, time-varying Barrier Lyapunov functions (BLFs) with error variables are adopted to avoid violating full state constraints in every step of the backstepping design. All closedloop signals are uniformly ultimately bounded and the output tracking error converges to the neighborhood of zero, which can be verified by using the Lyapunov stability theorem. Two simulation examples reveal the performance of the adaptive NN control approach.      

含未知信息的轮式移动机器人编队确定学习控制

本文研究含未知信息的轮式移动机器人(wheeled mobile robots,WMR)的编队控制问题.首先,基于领航–跟随法和虚拟结构法,将WMR编队控制问题转化为跟随机器人对参考虚拟机器人的跟踪控制问题.然后,利用径向基函数神经网络(radial basis function neural networks,RBF NN)对WMR的未知系统动态进行学习,以及根据李雅普诺夫稳定性理论设计了稳定的自适应RBF NN控制器和RBF NN权值估计的学习率.依据确定学习理论,闭环系统内部信号在对回归轨迹实现跟踪控制的过程中满足部分持续激励(persistent excitation,PE)条件.随着PE条件的满足,RBF NN权值估计收敛到其理想权值,实现了对未知闭环系统动态的准确学习.最后,利用学习结果设计了RBF NN学习控制器,保证了控制系统的稳定与收敛,实现了闭环稳定性和改进了控制性能,并通过仿真验证了所提控制方法的正确性和有效性.     

Approximation-based control of nonlinear MIMO time-delay systems

Approximation-based control is presented for a class of multi-input multi-output (MIMO) nonlinear systems in block-triangular form with unknown state delays. Neural networks (NNs) are utilized to approximate and compensate for unknown functions in the system dynamics, including the unknown bounds of the functions of delayed states. The use of a separation technique removes the need for any assumption on the function of delayed states, and allows the handling of multiple delays in each function of delayed states. By combining the use of Lyapunov-Krasovskii functionals and adaptive NN backstepping, the proposed control guarantees that all closed-loop signals remain bounded, while the outputs converge to a neighborhood of the desired trajectories. Simulation results demonstrate the effectiveness of the proposed scheme.     

Adaptive NN output‐feedback decentralized stabilization for a class of large‐scale stochastic nonlinear strict‐feedback systems

In this paper, the decentralized adaptive neural network (NN) output‐feedback stabilization problem is investigated for a class of large‐scale stochastic nonlinear strict‐feedback systems, which interact through their outputs. The nonlinear interconnections are assumed to be bounded by some unknown nonlinear functions of the system outputs. In each subsystem, only a NN is employed to compensate for all unknown upper bounding functions, which depend on its own output. Therefore, the controller design for each subsystem only need its own information and is more simplified than the existing results. It is shown that, based on the backstepping method and the technique of nonlinear observer design, the whole closed‐loop system can be proved to be stable in probability by constructing an overall state‐quartic and parameter‐quadratic Lyapunov function. The simulation results demonstrate the effectiveness of the proposed control scheme. Copyright © 2010 John Wiley & Sons, Ltd.     

Projection-Based Adaptive Neurocontrol With Switching Logic Deadzone Tuning

In this brief, an adaptive neural network (NN) controller is proposed for multiple-input-multiple-output (MIMO) nonlinear systems with triangular control structure and unknown control directions. Deadzones are employed in the projection-based NN weight learning laws and the Nussbaum parameter update laws with levels tuned by an innovative switching logic tuning mechanism. Detailed analysis using a family of Lyapunov-like integral functions and the function approximation capability of NNs proves that all the tracking errors are semiglobal uniform ultimate bounded in small neighborhoods of the origin while the closed-loop system variables (state vector, NN weights, Nussbaum parameters) and the control law remain bounded. A simulation study confirms the theoretical results and verifies the effectiveness of the proposed design.