基于迭代神经动态规划的数据驱动非线性近似最优调节

利用数据驱动控制思想,建立一种设计离散时间非线性系统近似最优调节器的迭代神经动态规划方法.提出针对离散时间一般非线性系统的迭代自适应动态规划算法并且证明其收敛性与最优性.通过构建三种神经网络,给出全局二次启发式动态规划技术及其详细的实现过程,其中执行网络是在神经动态规划的框架下进行训练.这种新颖的结构可以近似代价函数及其导函数,同时在不依赖系统动态的情况下自适应地学习近似最优控制律.值得注意的是,这在降低对于控制矩阵或者其神经网络表示的要求方面,明显地改进了迭代自适应动态规划算法的现有结果,能够促进复杂非线性系统基于数据的优化与控制设计的发展.通过两个仿真实验,验证本文提出的数据驱动最优调节方法的有效性.     

采样非线性系统的神经网络稳定自适应控制

针对一类动力学未知或难以建模的采样非线性系统,提出了一种基于神经网络的跟随控制器稳定自适应控制方法.控制器采用径向基函数神经网络近似对象的动力学非线性,神经网络参数的自适应规律由稳定理论得到.文中给出了系统稳定性和跟随误差收敛性的证明,并通过仿真实例揭示了所提方法的性能.     

基于LabVIEW的神经网络自适应逆控制系统

目前基于人工神经网络的非线性自适应逆控制研究主要集中在Matlab仿真研究方面,无法直接推广为实际应用。为此,采用基于LabVIEW的动态神经网络非线性自适应逆控制方法,首先在LabVIEW中建立动态神经网络结构及在线学习算法,并依此建立非线性对象的辨识器和逆控制器等模型;然后构建完整的非线性对象自适应逆控制系统,并在LabVIEW环境中通过仿真验证了系统性能。通过配置相应的数据采集设备,该系统可以直接推广为实际应用。     

确定学习与基于数据的建模及控制

确定学习运用自适应控制和动力学系统的概念与方法, 研究未知动态环境下的知识获取、表达、存储和利用等问题. 针对产生周期或回归轨迹的连续 非线性动态系统, 确定学习可以对其未知系统动态进行局部准确建模, 其基本要 素包括: 1)使用径向基函数(Radial basis function, RBF)神经网络; 2)对于周期(或回归)状态轨迹 满足部分持续激励条件; 3)在周期(或回归)轨迹的邻域内实现对非线性系统动态的局部准确神经网络逼近(局部准确建模); 4)所学的知识以时不变且空间分布的方式表达、以常值神经网络权值的方式存储, 并可在动态环境下用于动态模式的快速识别或者闭环神经网络控制. 本文针对离散动态系统, 扩展了确定学习理论, 提出一个根据时态数据序列对离散动态系统进行建模与控制的框架. 首先, 运用确定学习原理和离散系统的自适应辨识方法, 实现对产生时态数据的离散非线性系统的未知动态进行局部准确的神经网络建模, 并利用此建模结果对时态数据序列进行时不变表达. 其次, 提出时态数据序列的基于动力学的相似性定义, 以及对离散动态系统产生的时态数据序列(亦可称为动态模式)进行快速识别方法. 最后, 针对离散非线性控制系统, 实现了基于时态数据序列对控制系统动态的闭环辨识(局部准确建模). 所学关于闭环动态的知识可用于基于模式的智能控制. 本文表明确定学习可以为时态数据挖掘的研究提供新的途径, 并为基于数据的建模与控制等问题提供新的研究思路.     

路径规划; 态势评估; 模糊逻辑; 贝叶斯网络

针对非线性动态系统辨识和控制的特点，对4层模糊神经网络进行了优化和改进，形成了动态模糊神经网络，提高了网络的稳定性和对动态系统的辨识能力，同时给出了基于Lyapunov函数稳定收敛定理的各权向量以及权矩阵学习速率的自适应调整算法．应用于非线性动态系统的辨识和控制仿真试验表明，改进后的动态模糊神经网络与模糊神经网络相比，可取得更好的辨识精度和跟踪控制效果。     

变结构神经网络自适应鲁棒控制

针对一类不确定非线性系统, 提出一种变结构神经网络自适应鲁棒控制(Variable structure neural network adaptive robust control, VSNNARC)方法. 其中变结构神经网络用于在线辨识系统未知非线性函数, 该网络利用节点激活与催眠技术进行动态调节, 减小网络规模与计算量; 自适应鲁棒控制用于网络权值学习与系统建模误差及外部扰动补偿. 采用Lyapunov稳定性分析法, 给出网络权值自适应律的形式以及鲁棒控制项的设计方法. 该方法不仅能保证系统的稳定性, 也能保证系统具有很好的瞬态性能. 将该方法应用到转台伺服系统的位置跟踪控制中, 实际运行结果表明, 该方法使系统具有很强的鲁棒性及良好的跟踪效果.     

基于神经网络与多模型的非线性自适应广义预测解耦控制

针对一类非线性多变量离散时间动态系统,提出了基于神经网络与多模型的非线性自适应广义预测解耦控制方法.该控制方法由线性鲁棒广义预测解耦控制器和神经网络非线性广义预测解耦控制器以及切换机构组成.线性鲁棒广义预测解耦控制器用于保证闭环系统输入输出信号有界,神经网络非线性广义预测解耦控制器能够改善系统性能.切换策略通过对上述两种控制器的切换,保证系统稳定的同时,改善系统性能.同时本文给出了所提自适应解耦控制方法的稳定性和收敛性分析.最后,通过仿真实例验证了该方法的有效性.     

自适应神经变结构的机器人轨迹跟踪控制

提出一种神经网络与变结构融合的控制策略用于非线性机器人控制,该方案利用神经网络来自适应补偿不确定模型,并通过变结构控制器消除逼近误差.考虑到局部泛化网络的不足,根据其状态空间的划分,分别对3个区间采用神经网络与变结构的分级与集成控制.该方案能在控制阶段初期及网络逼近区域外使两种控制器共同起作用以保持系统的强鲁棒性,基于Lyapunov理论证明了闭环系统的全局稳定性.仿真结果进一步表明了该方法的优越性.     

基于动态神经网的理棒直接自适应控制

基于动态神经网络，研究了一类具有未建模动态的未知多变量非线性系统的鲁棒直接自适应控制。基于Ｌｙａｐｕｎｏｖ理论得出一种理棒稳定的权学习算法，该算法不需要知道理想权矩阵的先验知识，并保证设计的控制器的稳定性，仿真结果表明提出的鲁棒控制算法的有效性。     

基于动态神经网的鲁棒直接自适应控制

基于动态神经网络，研究了一类具有未建模动态的未知多变量非线性系统的鲁棒直接自适应控制．基于Ｌｙａｐｕｎｏｖ理论得出一种鲁棒稳定的权学习算法，该算法不需要知道理想权矩阵的先验知识，并保证设计的控制器的稳定性．仿真结果表明提出的鲁棒控制算法的有效性     

Stable adaptive controller design of robotic manipulators via neuro‐fuzzy dynamic inversion

In this paper, a stable adaptive control approach is developed for the trajectory tracking of a robotic manipulator via neuro‐fuzzy (NF) dynamic inversion, an inverse model constructed by the dynamic neuro‐fuzzy (DNF) model with desired dynamics. The robot neuro‐fuzzy model is initially built in the Takagi‐Sugeno (TS) fuzzy framework with both structure and parameters identified through input/output (I/O) data from the robot control process, and then employed to dynamically approximate the whole robot dynamics rather than its nonlinear components as is done by static neural networks (NNs) through parameter learning algorithm. Since the NF dynamic inversion comprises a cluster of reference trajectories connecting the initial state to the desired state of the robot, the dynamic performance in the initial control stage of robot trajectory tracking can be guaranteed by choosing the optimum reference trajectory. Furthermore, the assumption that the robot states should be on a compact set can be excluded by NF dynamic inversion design. The system stability and the convergence of tracking errors are guaranteed by Lyapunov stability theory, and the learning algorithm for the DNF system is obtained thereby. Finally, the viability and effectiveness of the proposed control approach are illustrated through comparing with the dynamic NN (DNN) based control approach. © 2005 Wiley Periodicals, Inc.     

Robot discrete adaptive control based on dynamic inversion using dynamical neural networks

A stable discrete time adaptive control approach using dynamic neural networks (DNNs) is developed in this paper for the trajectory tracking of a robotic manipulator with unknown nonlinear dynamics. By using dynamic inversion constructed by a DNN, the assumption under which the system state should be on a compact set can be removed. This assumption is usually required in neuro-adaptive control. The NN-based variable structure control is designed to guarantee the stability and improve the dynamic performance of the closed-loop system. The proposed control scheme ensures the global stability and desired tracking as well.     

Adaptive Feedback Control by Constrained Approximate Dynamic Programming

A constrained approximate dynamic programming (ADP) approach is presented for designing adaptive neural network (NN) controllers with closed-loop stability and performance guarantees. Prior knowledge of the linearized equations of motion is used to guarantee that the closed-loop system meets performance and stability objectives when the plant operates in a linear parameter-varying (LPV) regime. In the presence of unmodeled dynamics or failures, the NN controller adapts to optimize its performance online, whereas constrained ADP guarantees that the LPV baseline performance is preserved at all times. The effectiveness of an adaptive NN flight controller is demonstrated for simulated control failures, parameter variations, and near-stall dynamics.      

机械手的神经网络稳定自适应控制

本文针对机械手轨迹跟随控制问题，提出了一种稳定的神经网络自适应控制器设计方法，这里机械的非线性动力学假设是未知的，提出方法是神经网络方法和扇区自适应变结构控制方法的集成，扇区变结构控制的作用有两个，其一是在系统神经网络控制失灵的情形下提供闭环系统的全局稳定性；其二是在神经网络的近似域内改进系统的跟随性能，本文采用李雅普诺夫稳定理论给出了的稳定性和跟随误差收敛性的证明，并且通过数字仿真验证了提出方法     

Adaptive backstepping control for a class of semistrict feedback nonlinear systems using neural networks

This paper addresses a neural adaptive backstepping control with dynamic surface control technique for a class of semistrict feedback nonlinear systems with bounded external disturbances.Neural networks (NNs) are introduced as approximators for uncertain nonlinearities and the dynamic surface control (DSC) technique is involved to solve the so-called "explosion of terms" problem.In addition,the NN is used to approximate the transformed unknown functions but not the original nonlinear functions to overcome the possible singularity problem.The stability of closed-loop system is proven by using Lyapunov function method,and adaptation laws of NN weights are derived from the stability analysis.Finally,a numeric simulation validates the results of theoretical analysis.     

动态规划最优控制在非线性系统中的应用

应用一种新的自适应动态最优化方法(ADP),在线实现对非线性连续系统的最优控制。首先应用汉密尔顿函数（Hamilton-Jacobi-Bellman, HJB）求解系统的最优控制,并应用神经网络BP算法对汉密尔顿函数中的性能指标进行估计,进而得到非线性连续系统的最优控制。同时引进一种新的自适应算法,基于参数误差,在线实现对系统进行动态最优求解,而且通过李亚普诺夫方法对参数收敛情况也进行详细的分析。最后,用仿真结果来验证所提出的方法的可行性。     

Observer-based Adaptive Optimal Control for Unknown Singularly Perturbed Nonlinear Systems With Input Constraints

This paper introduces an observer-based adaptive optimal control method for unknown singularly perturbed nonlinear systems with input constraints. First, a multi-time scales dynamic neural network (MTSDNN) observer with a novel updating law derived from a properly designed Lyapunov function is proposed to estimate the system states. Then, an adaptive learning rule driven by the critic NN weight error is presented for the critic NN, which is used to approximate the optimal cost function. Finally, the optimal control action is calculated by online solving the Hamilton-Jacobi-Bellman (HJB) equation associated with the MTSDNN observer and critic NN. The stability of the overall closed-loop system consisting of the MTSDNN observer, the critic NN and the optimal control action is proved. The proposed observer-based optimal control approach has an essential advantage that the system dynamics are not needed for implementation, and only the measured input/output data is needed. Moreover, the proposed optimal control design takes the input constraints into consideration and thus can overcome the restriction of actuator saturation. Simulation results are presented to confirm the validity of the investigated approach.      

Adaptive neural control and learning of affine nonlinear systems

This paper presents deterministic learning from adaptive neural network control of affine nonlinear systems with completely unknown system dynamics. Thanks to the learning capability of radial basis function, neural network (NN), stable adaptive NN controller is designed for the unknown affine nonlinear systems. The designed adaptive NN controller is rigorously shown that learning of the unknown closed-loop system dynamics can be achieved during the stable control process because partial persistent excitation condition of some internal signals in the closed-loop system is satisfied. Subsequently, neural learning controller using the knowledge obtained from deterministic learning is constructed to achieve closed-loop stability and improve control performance. Numerical simulation is provided to show the effectiveness of the proposed control scheme.     

Stable neural-network-based adaptive control for sampled-datanonlinear systems

For a class of MIMO sampled-data nonlinear systems with unknown dynamic nonlinearities, a stable neural-network (NN)-based adaptive control approach which is an integration of an NN approach and the adaptive implementation of the variable structure control with a sector, is developed. The sampled-data nonlinear system is assumed to be controllable and its state vector is available for measurement. The variable structure control with a sector serves two purposes. One is to force the system state to be within the state region in which the NN's are used when the system goes out of neural control; and the other is to provide an additional control until the system tracking error metric is controlled inside the sector within the network approximation region. The proof of a complete stability and a tracking error convergence is given and the setting of the sector and the NN parameters is discussed. It is demonstrated that the asymptotic error of the system can be made dependent only on inherent network approximation errors and the frequency range of unmodeled dynamics. Simulation studies of a two-link manipulator show the effectiveness of the proposed control approach.     

Adaptive Neural Network-Based Control for a Class of Nonlinear Pure-Feedback Systems With Time-Varying Full State Constraints

In this paper, an adaptive neural network (NN) control approach is proposed for nonlinear pure-feedback systems with time-varying full state constraints. The pure-feedback systems of this paper are assumed to possess nonlinear function uncertainties. By using the mean value theorem, pure-feedback systems can be transformed into strict feedback forms. For the newly generated systems, NNs are employed to approximate unknown items. Based on the adaptive control scheme and backstepping algorithm, an intelligent controller is designed. At the same time, time-varying Barrier Lyapunov functions (BLFs) with error variables are adopted to avoid violating full state constraints in every step of the backstepping design. All closedloop signals are uniformly ultimately bounded and the output tracking error converges to the neighborhood of zero, which can be verified by using the Lyapunov stability theorem. Two simulation examples reveal the performance of the adaptive NN control approach.