A Neural Net Predictive Control for Telerobots with Time Delay

This paper extends the Smith Predictor feedback control structure to unknown robotic systems in a rigorous fashion. A new recurrent neural net predictive control (RNNPC) strategy is proposed to deal with input and feedback time delays in telerobotic systems. The proposed control structure consists of a local linearized subsystem and a remote predictive controller. In the local linearized subsystem, a recurrent neural network (RNN) with on-line weight tuning algorithm is employed to approximate the dynamics of the time-delay-free nonlinear plant. The remote controller is a modified Smith predictor for the local linearized subsystem which provides prediction and maintains the desirable tracking performance. Stability analysis is given in the sense of Lyapunov. The result is an adaptive compensation scheme for unknown telerobotic systems with time delays, uncertainties, and external disturbances. A simulation of a two-link robotic manipulator is provided to illustrate the effectiveness of the proposed control strategy.     

Neural‐network‐based predictive controller design: An application to temperature control of a plastic injection molding process

This paper presents a neural‐network‐based predictive control (NPC) method for a class of discrete‐time multi‐input multi‐output (MIMO) systems. A discrete‐time mathematical model using a recurrent neural network (RNN) is constructed and a learning algorithm adopting an adaptive learning rate (ALR) approach is employed to identify the unknown parameters in the recurrent neural network model (RNNM). The NPC controller is derived based on a modified predictive performance criterion, and its convergence is guaranteed by adopting an optimal algorithm with an adaptive optimal rate (AOR) approach. The stability analysis of the overall MIMO control system is well proven by the Lyapunov stability theory. A real‐time control algorithm is proposed which has been implemented using a digital signal processor, TMS320C31 from Texas Instruments. Two examples, including the control of a MIMO nonlinear system and the control of a plastic injection molding process, are used to demonstrate the effectiveness of the proposed strategy. Results from both numerical simulations and experiments show that the proposed method is capable of controlling MIMO systems with satisfactory tracking performance under setpoint and load changes. Copyright © 2010 John Wiley and Sons Asia Pte Ltd and Chinese Automatic Control Society     

基于单网络ADP的一类未知非线性系统的近似最优控制

针对一类未知的连续非线性系统,提出一个基于单网络近似动态规划(ADP)的近似最优控制方案。该方案通过设计一个新型的递归神经网络(RNN)辨识器放松了系统模型需已知或部分已知的要求,并利用一个神经网络(NN)近似系统的性能指标函数消除了常规ADP方法中的控制网络。通过Lyapunov理论分析严格证明了闭环系统内所有信号一致最终有界,并且所获得的性能指标函数和控制输入分别收敛到最优性能指标函数和最优控制输入的小邻域内。仿真结果验证了所提出控制方案的有效性。     

Design of Adaptive Robot Control System Using Recurrent Neural Network

The use of a new Recurrent Neural Network (RNN) for controlling a robot manipulator is presented in this paper. The RNN is a modification of Elman network. In order to solve load uncertainties, a fast-load adaptive identification is also employed in a control system. The weight parameters of the network are updated using the standard Back-Propagation (BP) learning algorithm. The proposed control system is consisted of a NN controller, fast-load adaptation and PID-Robust controller. A general feedforward neural network (FNN) and a Diagonal Recurrent Network (DRN) are utilised for comparison with the proposed RNN. A two-link planar robot manipulator is used to evaluate and compare performance of the proposed NN and the control scheme. The convergence and accuracy of the proposed control scheme is proved.     

一种基于PSO的自适应神经网络预测控制

针对非线性系统,提出了一种基于微粒群优化(PSO)的自适应神经网络预测控制方法.采用对角递归网络(DRNN)对非线性系统进行建模,并利用扩展卡尔曼滤波(EKF)递推估计算法在线计算网络模型参数的Jacobian矩阵以实现模型参数的自适应.利用PSO算法在线优化求解非线性系统的预测控制律,以克服传统基于梯度法的非线性规划方法求解预测控制律时对初始条件非常敏感的缺点.生化发酵过程的仿真结果表明,所提出的控制方法具有良好的跟踪能力和抗干扰能力.     

An on-line learning neural controller for helicopters performing highly nonlinear maneuvers

This paper presents an on-line learning adaptive neural control scheme for helicopters performing highly nonlinear maneuvers. The online learning adaptive neural controller compensates the nonlinearities in the system and uncertainties in the modeling of the dynamics to provide the desired performance. The control strategy uses a neural controller aiding an existing conventional controller. The neural controller is based on a online learning dynamic radial basis function network, which uses a Lyapunov based on-line parameter update rule integrated with a neuron growth and pruning criteria. The online learning dynamic radial basis function network does not require a priori training and also it develops a compact network for implementation. The proposed adaptive law provides necessary global stability and better tracking performance. Simulation studies have been carried-out using a nonlinear (desktop) simulation model similar to that of a BO105 helicopter. The performances of the proposed adaptive controller clearly shows that it is very effective when the helicopter is performing highly nonlinear maneuvers. Finally, the robustness of the controller has been evaluated using the attitude quickness parameters (handling quality index) at different speed and flight conditions. The results indicate that the proposed online learning neural controller adapts faster and provides the necessary tracking performance for the helicopter executing highly nonlinear maneuvers.     

基于平衡学习的CMAC神经网络非线性滑模容错控制

以一改进的信度分配CMAC(cerebellar model articulation controllers)神经网络为在线故障诊断的手段,将变结构滑模摔制技术引入容错控制器设计之中,提出一种动态非线性系统主动容错控制方法.在常规CMAC学习算法中,误差被平均地分配给所有被激活的存储单元,不管各存储单元存储数据(权值)的可信程度.改进的CMAC中,利用激活单元先前学习次数作为可信度,其误差校正值与激活单元先前学习次数的-p次方成比例,从而提高神经网络的在线学习速度和精度;在此基础上利用滑模控制算法进行容错控制律的在线重构,实现动态非线性系统在线故障诊断与容错控制的集成.分析了系统的稳定性,仿真结果表明改进故障学习算法及容错控制的有效性.     

基于确定学习的机器人任务空间自适应神经网络控制

针对产生回归轨迹的连续非线性动态系统, 确定学习可实现未知闭环系统动态的局部准确逼近. 基于确定学习理论, 本文使用径向基函数(Radial basis function, RBF)神经网络为机器人任务空间跟踪控制设计了一种新的自适应神经网络控制算法, 不仅实现了闭环系统所有信号的最终一致有界, 而且在稳定的控制过程中, 沿着回归跟踪轨迹实现了部分神经网络权值收敛到最优值以及未知闭环系统动态的局部准确逼近. 学过的知识以时不变且空间分布的方式表达、以常值神经网络权值的方式存储, 可以用来改进系统的控制性能, 也可以应用到后续相同或相似的控制任务中, 节约时间和能量. 最后, 用仿真说明了所设计控制算法的正确性和有效性.     

基于自适应神经网络的不确定非线性系统的模糊跟踪控制

提出了一种基于模糊模型和自适应神经网络的跟踪控制方法.在系统具有未知不确定非线性特性的情况下,首先利用T＿S模糊模型对系统的已知特性进行近似建模,对基于模糊模型的模糊H∞跟踪控制律进行输出跟踪控制.并在此基础上,进一步采用RBF神经网络完全自适应控制,通过在线自适应调整RBF神经网络的权重、函数中心和宽度,从而有效地消除系统的未知不确定性和模糊建模误差的影响,保证了非线性闭环系统的稳定性和系统的H∞跟踪性能,而不要求系统的不确定项和模糊建模误差满足任何匹配条件或约束.最后,将所提出的方法应用到一非线性混沌系统,仿真结果表明了所提出的方案不仅能够有效地稳定该混沌系统,而且能使系统输出跟踪期望输出.     

Neural-network predictive control for nonlinear dynamic systems with time-delay

A new recurrent neural-network predictive feedback control structure for a class of uncertain nonlinear dynamic time-delay systems in canonical form is developed and analyzed. The dynamic system has constant input and feedback time delays due to a communications channel. The proposed control structure consists of a linearized subsystem local to the controlled plant and a remote predictive controller located at the master command station. In the local linearized subsystem, a recurrent neural network with on-line weight tuning algorithm is employed to approximate the dynamics of the time-delay-free nonlinear plant. No linearity in the unknown parameters is required. No preliminary off-line weight learning is needed. The remote controller is a modified Smith predictor that provides prediction and maintains the desired tracking performance; an extra robustifying term is needed to guarantee stability. Rigorous stability proofs are given using Lyapunov analysis. The result is an adaptive neural net compensation scheme for unknown nonlinear systems with time delays. A simulation example is provided to demonstrate the effectiveness of the proposed control strategy.     

一种回归神经网络的快速在线学习算法

针对回归神经网络BP学习算法收敛慢的缺陷,提出了一种新的快速在线递推学习算法.本算法在目标函数中引入了遗忘因子,并借助于非线性系统的最大似然估计原理成功地解决了动态非线性系统回归神经网络模型权系数学习的实时性和快速性问题.仿真结果表明,该算法比传统的回归BP学习算法具有更快的收敛速度.     

A Wiener-type recurrent neural network and its control strategy for nonlinear dynamic applications

This paper presents a Wiener-type recurrent neural network with a systematic identification algorithm and a control strategy for the identification and control of unknown dynamic nonlinear systems. The proposed Wiener-type recurrent network resembles the conventional Wiener model that consists of a dynamic linear subsystem cascaded with a static nonlinear subsystem. The novelties of our network include: (1) the two subsystems are integrated into a single network whose output is expressed by a nonlinear transformation of a linear state-space equation; (2) the characteristics of the trained network can be analyzed by its associated state-space equation using the well-developed theory of linear systems; and (3) the size of the network structure is determined by the number of state variables (or the system order) of the unknown systems to be identified. To effectively identify a given unknown system from its input–output data, we have developed a systematic identification algorithm that consists of an order determination procedure, a parameterization procedure, and an online learning procedure. The false nearest neighbors algorithm was adopted to acquire a minimal embedding dimension from the input–output data as the system order, and then the eigensystem realization algorithm (ERA) was used to initialize a best-fit state-space representation according to the acquired system order. To improve the overall identification performance, we have derived an online parameter learning algorithm based on an ordered derivatives and momentum terms. Subsequently, a simple feedback linear controller was designed to control the unknown dynamic nonlinear systems without much complexity. Computer simulations and comparisons with some existing recurrent networks have conducted to confirm the effectiveness and superiority of the proposed Wiener-type network, identification algorithm and control strategy.     

Pipelined Chebyshev Functional Link Artificial Recurrent Neural Network for Nonlinear Adaptive Filter

A novel nonlinear adaptive filter with pipelined Chebyshev functional link artificial recurrent neural network (PCFLARNN) is presented in this paper, which uses a modification real-time recurrent learning algorithm. The PCFLARNN consists of a number of simple small-scale Chebyshev functional link artificial recurrent neural network (CFLARNN) modules. Compared to the standard recurrent neural network (RNN), those modules of PCFLARNN can simultaneously be performed in a pipelined parallelism fashion, and this would lead to a significant improvement in its total computational efficiency. Furthermore, contrasted with the architecture of a pipelined RNN (PRNN), each module of PCFLARNN is a CFLARNN whose nonlinearity is introduced by enhancing the input pattern with Chebyshev functional expansion, whereas the RNN of each module in PRNN utilizing linear input and first-order recurrent term only fails to utilize the high-order terms of inputs. Therefore, the performance of PCFLARNN can further be improved at the cost of a slightly increased computational complexity. In addition, due to the introduced nonlinear functional expansion of each module in PRNN, the number of input signals can be reduced. Computer simulations have demonstrated that the proposed filter performs better than PRNN and RNN for nonlinear colored signal prediction, nonstationary speech signal prediction, and chaotic time series prediction.      

A robust training algorithm of discrete-time MIMO RNN and application in fault tolerant control of robotic system

In this paper, a novel robust training algorithm of multi-input multi-output recurrent neural network and its application in the fault tolerant control of a robotic system are investigated. The proposed scheme optimizes the gradient type training on basis of three new adaptive parameters, namely, dead-zone learning rate, hybrid learning rate, and normalization factor. The adaptive dead-zone learning rate is employed to improve the steady state response. The normalization factor is used to maximize the gradient depth in the training, so as to improve the transient response. The hybrid learning rate switches the training between the back-propagation and the real-time recurrent learning mode, such that the training is robust stable. The weight convergence and L ₂ stability of the algorithm are proved via Lyapunov function and the Cluett’s law, respectively. Based upon the theoretical results, we carry out simulation studies of a two-link robot arm position tracking control system. A computed torque controller is designed to provide a specified closed-loop performance in a fault-free condition, and then the RNN compensator and the robust training algorithm are employed to recover the performance in case that fault occurs. Comparisons are given to demonstrate the advantages of the control method and the proposed training algorithm.     

Robust Recurrent Neural Network Control of Biped Robot

In this paper, a recurrent neural network (RNN) control scheme is proposed for a biped robot trajectory tracking system. An adaptive online training algorithm is optimized to improve the transient response of the network via so-called conic sector theorem. Furthermore, L ₂-stability of weight estimation error of RNN is guaranteed such that the robustness of the controller is ensured in the presence of uncertainties. In consideration of practical applications, the algorithm is developed in the discrete-time domain. Simulations for a seven-link robot model are presented to justify the advantage of the proposed approach. We give comparisons between the standard PD control and the proposed RNN compensation method.     

Stable fuzzy neural tracking control of a class of unknown nonlinear systems based on fuzzy hierarchy error approach

In this paper, a stable fuzzy neural tracking control of a class of unknown nonlinear systems based on the fuzzy hierarchy approach is proposed. The adaptive fuzzy neural controller is constructed from the fuzzy neural network with a set of fuzzy rules. The corresponding network parameters are adjusted online according to the control law and update law for the purpose of controlling the plant to track a given trajectory. A stability analysis of the unknown nonlinear system is discussed based on the Lyapunov principle. In order to improve the convergence of the nonlinear dynamical systems, a fuzzy hierarchy error approach (FHEA) algorithm is incorporated into the adaptive update and control scheme. The simulation results for an unstable nonlinear plant demonstrate the control effectiveness of the proposed adaptive fuzzy neural controller and are consistent with the theoretical analysis.     

Adaptive neural control and learning of affine nonlinear systems

This paper presents deterministic learning from adaptive neural network control of affine nonlinear systems with completely unknown system dynamics. Thanks to the learning capability of radial basis function, neural network (NN), stable adaptive NN controller is designed for the unknown affine nonlinear systems. The designed adaptive NN controller is rigorously shown that learning of the unknown closed-loop system dynamics can be achieved during the stable control process because partial persistent excitation condition of some internal signals in the closed-loop system is satisfied. Subsequently, neural learning controller using the knowledge obtained from deterministic learning is constructed to achieve closed-loop stability and improve control performance. Numerical simulation is provided to show the effectiveness of the proposed control scheme.     

Open-end human–robot interaction from the dynamical systems perspective: mutual adaptation and incremental learning

In this paper, we experimentally investigated the open-end interaction generated by the mutual adaptation between humans and robot. Its essential characteristic, incremental learning, is examined using the dynamical systems approach. Our research concentrated on the navigation system of a specially developed humanoid robot called Robovie and seven human subjects whose eyes were covered, making them dependent on the robot for directions. We used the usual feed-forward neural network (FFNN) without recursive connections and the recurrent neural network (RNN) for the robot control. Although the performances obtained with both the RNN and the FFNN improved in the early stages of learning, as the subject changed the operation by learning on its own, all performances gradually became unstable and failed. Next, we used a 'consolidation-learning algorithm' as a model of the hippocampus in the brain. In this method, the RNN was trained by both new data and the rehearsal outputs of the RNN not to damage the contents of current memory. The proposed method enabled the robot to improve performance even when learning continued for a long time (open-end). The dynamical systems analysis of RNNs supports these differences and also showed that the collaboration scheme was developed dynamically along with succeeding phase transitions.     

Adaptive recurrent neural network control using a structure adaptation algorithm

This paper proposes an adaptive recurrent neural network control (ARNNC) system with structure adaptation algorithm for the uncertain nonlinear systems. The developed ARNNC system is composed of a neural controller and a robust controller. The neural controller which uses a self-structuring recurrent neural network (SRNN) is the principal controller, and the robust controller is designed to achieve L ² tracking performance with desired attenuation level. The SRNN approximator is used to online estimate an ideal tracking controller with the online structuring and parameter learning algorithms. The structure learning possesses the ability of both adding and pruning hidden neurons, and the parameter learning adjusts the interconnection weights of neural network to achieve favorable approximation performance. And, by the L ² control design technique, the worst effect of approximation error on the tracking error can be attenuated to be less or equal to a specified level. Finally, the proposed ARNNC system with structure adaptation algorithm is applied to control two nonlinear dynamic systems. Simulation results prove that the proposed ARNNC system with structure adaptation algorithm can achieve favorable tracking performance even unknown the control system dynamics function.     

Synthesis of optimal control using neural network with mixed structure

This paper proposes firstly to use a neural network with a mixed structure for learning the system dynamics of a nonlinear plant, which consists of multilayer and recurrent structure. Since a neural network with a mixed structure can learn time series, it can learn the dynamics of a plant without knowing the plant order. Secondly, a novel method of synthesizing the optimal control is developed using the proposed neural network. Procedures are as follows: (1) Let a neural network with a mixed structure learn the unknown dynamics of a nonlinear plant with arbitrary order, (2) after the learning is completed, the network is expanded into an equivalent feedforward multilayer network, (3) it is shown that the gradient of a criterion functional to be optimized can be easily obtained from this multilayer network, and then (4) the optimal control is generated by applying any of the existing non-linear programming algorithm based on this gradient information. The proposed method is successfully applied to the optimal control synthesis problem of a nonlinear coupled vibratory plant with a linear quadratic criterion functional.