含执行机构未知动态的液压伺服系统输出反馈控制

针对含有未知动态(如:执行机构、负载等)液压伺服系统,提出一种基于未知系统动态估计器的输出反馈控制方法.该方法不依赖于函数逼近器和传统反步控制设计,且无需难以测量的系统内部状态.首先,为避免反步控制和系统全部状态,引入等价变换,将含液压执行机构的伺服系统高阶严格反馈模型转化为Brunovsky标准型,进而运用高阶滑模微分器观测转化后的系统未知状态.控制器设计中引入描述收敛速率、最大超调量和稳态误差的性能函数,保证预设控制系统稳态和瞬态控制性能.为补偿系统集总未知动态影响,设计一种仅含一个调节参数并保证指数收敛的未知系统动态估计器.该输出反馈控制器可以实现对系统输出的精确跟踪控制.最后,通过数值仿真结果表明了所提出算法的有效性.     

Finite-horizon neuro-optimal tracking control for a class of discrete-time nonlinear systems using adaptive dynamic programming approach

In this paper, a finite-horizon neuro-optimal tracking control strategy for a class of discrete-time nonlinear systems is proposed. Through system transformation, the optimal tracking problem is converted into designing a finite-horizon optimal regulator for the tracking error dynamics. Then, with convergence analysis in terms of cost function and control law, the iterative adaptive dynamic programming (ADP) algorithm via heuristic dynamic programming (HDP) technique is introduced to obtain the finite-horizon optimal tracking controller which makes the cost function close to its optimal value within an ?-error bound. Three neural networks are used as parametric structures to implement the algorithm, which aims at approximating the cost function, the control law, and the error dynamics, respectively. Two simulation examples are included to complement the theoretical discussions.     

Parallel Control for Optimal Tracking via Adaptive Dynamic Programming

This paper studies the problem of optimal parallel tracking control for continuous-time general nonlinear systems. Unlike existing optimal state feedback control, the control input of the optimal parallel control is introduced into the feedback system. However, due to the introduction of control input into the feedback system, the optimal state feedback control methods can not be applied directly. To address this problem, an augmented system and an augmented performance index function are proposed firstly. Thus, the general nonlinear system is transformed into an affine nonlinear system. The difference between the optimal parallel control and the optimal state feedback control is analyzed theoretically. It is proven that the optimal parallel control with the augmented performance index function can be seen as the suboptimal state feedback control with the traditional performance index function. Moreover, an adaptive dynamic programming (ADP) technique is utilized to implement the optimal parallel tracking control using a critic neural network (NN) to approximate the value function online. The stability analysis of the closed-loop system is performed using the Lyapunov theory, and the tracking error and NN weights errors are uniformly ultimately bounded (UUB). Also, the optimal parallel controller guarantees the continuity of the control input under the circumstance that there are finite jump discontinuities in the reference signals. Finally, the effectiveness of the developed optimal parallel control method is verified in two cases.      

Adaptive neural output feedback tracking control for a class of nonlinear systems

In this paper, an adaptive neural output feedback control scheme based on backstepping technique and dynamic surface control (DSC) approach is developed to solve the tracking control problem for a class of nonlinear systems with unmeasurable states. Firstly, a nonlinear state observer is designed to estimate the unmeasurable states. Secondly, in the controller design process, radial basis function neural networks (RBFNNs) are utilised to approximate the unknown nonlinear functions, and then a novel adaptive neural output feedback tracking control scheme is developed via backstepping technique and DSC approach. It is shown that the proposed controller ensures that all signals of the closed-loop system remain bounded and the tracking error converges to a small neighbourhood around the origin. Finally, two numerical examples and one realistic example are given to illustrate the effectiveness of the proposed design approach.     

Online optimal control of nonlinear discrete-time systems using approximate dynamic programming

In this paper,the optimal control of a class of general affine nonlinear discrete-time(DT) systems is undertaken by solving the Hamilton Jacobi-Bellman(HJB) equation online and forward in time.The proposed approach,referred normally as adaptive or approximate dynamic programming(ADP),uses online approximators(OLAs) to solve the infinite horizon optimal regulation and tracking control problems for affine nonlinear DT systems in the presence of unknown internal dynamics.Both the regulation and tracking contro...     

Optimal tracking control of a class of nonlinear discrete-time switched systems using adaptive dynamic programming

In this paper, an infinite-horizon optimal tracking control scheme is proposed for a class of nonlinear discrete-time switched systems. First, via system transformation, the optimal tracking problem is converted into designing an optimal regulator for the tracking error dynamics. And then, with convergence analysis in terms of value function and control policy, the iterative adaptive dynamic programming (ADP) algorithm is introduced to obtain the infinite-horizon optimal tracking controller which makes the value function close to its optimal value function. Next, two neural networks are used as parametric structures to implement the ADP algorithm, which aim at approximating the value function and the control policy, respectively. Finally, a simulation example is included to complement the theoretical discussions.     

基于自适应动态规划的一类带有时滞的离散时间非线性系统的最优控制策略

针对一类状态和控制变量均带有时滞的非线性系统的带有二次性能指标函数最优控制问题, 本文提出了一种基于新的迭代自适应动态规划算法的最优控制方案. 通过引进时滞矩阵函数, 应用动态规划理论, 本文获得了最优控制的显式表达式, 然后通过自适应评判技术获得最优控制量. 本文给出了收敛性证明以保证性能指标函数收敛到最优. 为了实现所提出的算法, 本文采用神经网络近似性能指标函数、计算最优控制策略、求解时滞矩阵函数、以及给非线性系统建模. 最后本文给出了两个仿真例子说明所提出的最优策略的有效性.     

Adaptive dynamic surface asymptotic tracking for a class of uncertain nonlinear systems

This paper contributes to dynamic surface asymptotic tracking for a class of uncertain nonlinear systems in strict‐feedback form. By utilizing the nonlinear filters with a positive time‐varying integral function, an adaptive state feedback controller is explicitly designed via a dynamic surface approach, where the compensating term with the estimate of an unknown bound is introduced to eliminate the effect raised by the boundary layer error at each step. Compared with the existing results in the literature, the proposed control scheme not only avoids the issue of “explosion of complexity” inherent in the backstepping procedure but also holds the asymptotic output tracking. Finally, simulation results are presented to verify the effectiveness of the proposed methodology.     

Online Adaptive Approximate Optimal Tracking Control with Simplified Dual Approximation Structure for Continuous-time Unknown Nonlinear Systems

This paper proposes an online adaptive approximate solution for the infinite-horizon optimal tracking control problem of continuous-time nonlinear systems with unknown dynamics. The requirement of the complete knowledge of system dynamics is avoided by employing an adaptive identifier in conjunction with a novel adaptive law, such that the estimated identifier weights converge to a small neighborhood of their ideal values. An adaptive steady-state controller is developed to maintain the desired tracking performance at the steady-state, and an adaptive optimal controller is designed to stabilize the tracking error dynamics in an optimal manner. For this purpose, a critic neural network (NN) is utilized to approximate the optimal value function of the Hamilton-Jacobi-Bellman (HJB) equation, which is used in the construction of the optimal controller. The learning of two NNs, i.e., the identifier NN and the critic NN, is continuous and simultaneous by means of a novel adaptive law design methodology based on the parameter estimation error. Stability of the whole system consisting of the identifier NN, the critic NN and the optimal tracking control is guaranteed using Lyapunov theory; convergence to a near-optimal control law is proved. Simulation results exemplify the effectiveness of the proposed method.      

含未建模动态的非线性系统输出反馈DSC设计

针对一类含有未建模动态和未知控制增益符号的非线性系统,提出了一种输出反馈自适应跟踪控制方案.首先利用Kreisselmeier观测器实现了不可测状态的估计,在此基础上以回归设计方式设计了输出反馈动态面控制系统,通过引入Nussbaum函数解决了控制方向未知问题.该方案解克服了传统反推控制方法中的微分爆炸现象,并且所有未...     

Adaptive tracking control of nonlinear systems with dynamic uncertainties using neural network

In this paper, an adaptive neural tracking control approach is proposed for a class of nonlinear systems with dynamic uncertainties. The radial basis function neural networks (RBFNNs) are used to estimate the unknown nonlinear uncertainties, and then a novel adaptive neural scheme is developed, via backstepping technique. In the controller design, instead of using RBFNN to approximate each unknown function, we lump all unknown functions into a suitable unknown function that is approximated by only a RBFNN in each step of the backstepping. It is shown that the designed controller can guarantee that all signals in the closed-loop system are semi-globally bounded and the tracking error finally converges to a small domain around the origin. Two examples are given to demonstrate the effectiveness of the proposed control scheme.     

Neural-network-observer-based optimal control for unknown nonlinear systems using adaptive dynamic programming

In this paper, an observer-based optimal control scheme is developed for unknown nonlinear systems using adaptive dynamic programming (ADP) algorithm. First, a neural-network (NN) observer is designed to estimate system states. Then, based on the observed states, a neuro-controller is constructed via ADP method to obtain the optimal control. In this design, two NN structures are used: a three-layer NN is used to construct the observer which can be applied to systems with higher degrees of nonlinearity and without a priori knowledge of system dynamics, and a critic NN is employed to approximate the value function. The optimal control law is computed using the critic NN and the observer NN. Uniform ultimate boundedness of the closed-loop system is guaranteed. The actor, critic, and observer structures are all implemented in real-time, continuously and simultaneously. Finally, simulation results are presented to demonstrate the effectiveness of the proposed control scheme.     

基于数据ADP算法的一类带有执行器饱和的未知离散时间系统最优跟踪控制

针对一类带有执行器饱和的未知动态离散时间非线性系统, 提出了一种新的最优跟踪控制方案. 该方案基于迭代自适应动态规划算法, 为了实现最优控制, 首先建立了未知系统动态的数据辨识器. 通过引入M网络, 获得了稳态控制的精确表达式. 为了消除执行器饱和的影响, 提出了一个非二次的性能指标函数. 然后提出了一种迭代自适应动态规划算法获得最优跟踪控制的解, 并给出了收敛性分析. 为了实现最优控制方案, 神经网络被用来构建数据辨识器、计算性能指标函数、近似最优控制策略和求解稳态控制. 仿真结果验证了本文所提出的最优跟踪控制方法的有效性.     

Prescribed performance adaptive neural output feedback dynamic surface control for a class of strict‐feedback uncertain nonlinear systems with full state constraints and unmodeled dynamics

This paper studies the output feedback tracking control problem for a class of strict‐feedback uncertain nonlinear systems with full state constraints and unmodeled dynamics using a prescribed performance adaptive neural dynamic surface control design approach. A nonlinear mapping technique is employed to address the state constraints. Radial basis function neural networks are utilized to approximate the unknown nonlinear functions. The unmodeled dynamics is addressed by introducing an available dynamic signal. Subsequently, we construct the controller and parameter adaptive laws using a backstepping technique. Based on Lyapunov stability theory, it is shown that all signals in the closed‐loop system are semiglobally uniformly ultimately bounded and that the tracking error always remains within the prescribed performance bound. Simulation results are presented to demonstrate the effectiveness of the proposed control scheme.     

基于性能指标约束的一类输入死区非线性系统最优控制

针对一类考虑指定性能和带有输入死区约束的严格反馈非线性系统,本文提出了一种自适应模糊最优控制方法.采用模糊逻辑系统逼近系统的未知非线性函数及代价函数,利用backstepping方法及命令滤波技术,设计前馈控制器.针对仿射形式的误差系统,结合自适应动态规划技术,设计最优反馈控制器.采用指定性能控制方法,将系统跟踪误差约束在指定范围内.利用死区斜率信息解决具有死区输入的非线性系统的控制问题.基于Lyapunov稳定性理论,证明闭环系统内所有信号是一致最终有界的.最后仿真结果验证了本文方法的可行性和有效性.     

Adaptive dynamic programming and optimal control of nonlinear nonaffine systems

In this paper, a novel optimal control design scheme is proposed for continuous-time nonaffine nonlinear dynamic systems with unknown dynamics by adaptive dynamic programming (ADP). The proposed methodology iteratively updates the control policy online by using the state and input information without identifying the system dynamics. An ADP algorithm is developed, and can be applied to a general class of nonlinear control design problems. The convergence analysis for the designed control scheme is presented, along with rigorous stability analysis for the closed-loop system. The effectiveness of this new algorithm is illustrated by two simulation examples.     

Finite horizon optimal control of discrete-time nonlinear systems with unfixed initial state using adaptive dynamic programming

In this paper, we aim to solve the finite horizon optimal control problem for a class of discrete-time nonlinear systems with unfixed initial state using adaptive dynamic programming (ADP) approach. A new ε-optimal control algorithm based on the iterative ADP approach is proposed which makes the performance index function converge iteratively to the greatest lower bound of all performance indices within an error according to ε within finite time. The optimal number of control steps can also be obtained by the proposed ε-optimal control algorithm for the situation where the initial state of the system is unfixed. Neural networks are used to approximate the performance index function and compute the optimal control policy, respectively, for facilitating the implementation of the ε-optimal control algorithm. Finally, a simulation example is given to show the results of the proposed method.     

An adaptive dynamic programming method for observer-based sliding mode control of connected vehicles subject to deception attacks

This article investigates the problem of optimal observer-based sliding mode control (SMC) of connected vehicles subject to deception attacks and disturbances with adaptive dynamic programming (ADP) method. For a group of vehicles with unknown nonlinear dynamics term and disturbance, this article aims to give a control methodology to achieve secure tracking of the desired spacing, velocity and acceleration. A neural network (NN) and an observer are constructed to estimate the unknown nonlinear term and the states, respectively. Then, a SMC scheme incorporating NN approximation is developed and an off-policy ADP method is used to implement the optimal control of sliding mode dynamics. The proposed method can ensure individual stability and string stability of the set of vehicles. Numerical simulations are conducted to demonstrate the validity of the proposed controller.     

Neural-network-based stochastic linear quadratic optimal tracking control scheme for unknown discrete-time systems using adaptive dynamic programming

In this paper, a stochastic linear quadratic optimal tracking scheme is proposed for unknown linear discrete-time (DT) systems based on adaptive dynamic programming (ADP) algorithm. First, an augmented system composed of the original system and the command generator is constructed and then an augmented stochastic algebraic equation is derived based on the augmented system. Next, to obtain the optimal control strategy, the stochastic case is converted into the deterministic one by system transformation, and then an ADP algorithm is proposed with convergence analysis. For the purpose of realizing the ADP algorithm, three back propagation neural networks including model network, critic network and action network are devised to guarantee unknown system model, optimal value function and optimal control strategy, respectively. Finally, the obtained optimal control strategy is applied to the original stochastic system, and two simulations are provided to demonstrate the effectiveness of the proposed algorithm.     

面向控制性能的一类非线性关联系统输出反馈动态面控制

针对一类含有完全未知关联项的多输入/多输出非线性系统,提出了输出反馈动态面自适应控制方案,克服了反推控制中的微分爆炸问题;利用神经网络逼近系统中的未知关联项,对于每个子系统只需对一个参数设计自适应律;引入性能函数和输出误差变换,跟踪误差信号的收敛速率、最大超调量和稳态误差等控制性能指标均可得到保证.理论证明了闭环系统的所有信号半全局一致有界,仿真结果验证了所提方案的有效性.