基于增量式Q学习的固定翼无人机跟踪控制性能优化

针对固定翼无人机纵向控制的高性能需求,提出一种控制系统性能优化结构.该结构包括一个使系统稳定的标称控制器和一个参与性能优化的增量式控制器.控制系统增量式的实现不会改变原有的控制系统,而是仅对标称控制系统做控制输入的补偿与控制性能的优化.基于Q学习理论进行增量式控制器设计,针对状态信息完全可获得的系统,设计一种基于状态反馈的增量式Q学习算法.当状态信息不能完全获得时,利用系统输入、输出和参考信号数据,设计一种基于输出反馈的增量式Q学习算法.两种增量式控制器均是在数据驱动环境下自适应学习增量式控制律,无需提前知道系统动力学模型以及标称控制器的控制增益.此外,证明了增量式Q学习方法在满足持续激励条件的激励噪声下,对Q函数贝尔曼方程的求解没有偏差.最后,通过对F-16飞行器纵向模型实例的仿真验证该方法的有效性.     

多时滞线性连续系统的最优H∞容错控制

针对状态具有多个时滞的线性连续系统,基于Lyapunov稳定性理论和线性矩阵不等式方法(LMI),采用无时滞记忆的状态反馈控制律,研究了在执行器发生故障的情况下,连续多时滞系统的最优H∞容错控制问题.首先,给出了系统没有干扰输入时存在无记忆状态反馈容错控制器的一个充分条件;进一步,给出了在H∞扰动衰减指标约束下,系统存在无记忆状态反馈H∞容错控制器的一个充分条件;最后,给出了最优无时滞记忆状态反馈H∞容错控制器的设计方法.仿真实例证明了所得最优H∞容错控制嚣设计方法的正确性和有效性.     

状态和控制含多时滞的离散系统H∞容错控制

针对状态和控制输入同时具有多个时滞的线性离散时间系统,基于Lyapunov稳定性理论和线性矩阵不等式方法(LMI),采用无时滞记忆的状态反馈控制律,研究了执行器故障情况下,离散多时滞系统的H∞容错控制问题.在采用连续执行器故障模型条件下,给出了系统没有干扰输入时存在无时滞记忆的状态反馈容错控制器的充分条件;进一步,给出了在H∞扰动衰减指标约束下,系统存在无时滞记忆的状态反馈H∞容错控制器的充分条件,并将结论推广到离散故障模型的情况.仿真结果证明了所提H∞容错控制器设计方法的正确性和有效性.     

基于精确线性化的MIMO双线性系统预测函数控制

针对典型多输入多输出双线性系统, 提出了基于非线性过程精确反馈解耦线性化的预测函数控制方法这是一种分层的控制策略, 首先设计一个静态的非线性状态反馈, 使得闭环系统是输入输出解耦和线性的;然后设计一组单输入单输出预测函数控制器, 下层为上层预测函数控制提供一组单输入单输出模型, 而上层预测函数控制以其固有的鲁棒性来补偿参数变化和解耦线性化的近似性, 并以纸机加压网前箱为例进行了仿真实验, 结果是令人满意的.     

优先级多目标稳定化约束模型预测控制

针对目标函数的不同优先级问题, 提出一种约束多变量线性定常系统的稳定化多目标模型预测控制策略. 首先, 基于多目标优化理论给出多目标预测控制问题的字典序最优解结果, 并在此基础上考虑目标函数的优先级, 重 新将多目标预测控制问题定义为字典序多目标预测控制问题; 然后, 采用终端约束、终端罚函数和局部状态反馈律 等三要素, 证明多目标预测控制闭环系统是渐近稳定的; 最后, 通过一个仿真实例验证了所提出方法的有效性.

     

多输入多输出非线性不确定系统连续高阶滑模控制

针对一类MIMO非线性不确定系统,提出一种新的连续高阶滑模控制算法.引入状态反馈使得系统高阶滑模控制问题等效转换为多变量不确定积分链的有限时间稳定问题,首先针对标称系统设计有限时间到达连续控制律,实现系统状态快速收敛,然后采用多变量非解耦形式超螺旋算法克服系统不确定性,实现鲁棒性,最终使得系统控制作用连续、滑模抖振得以大大抑制.基于二次型Lyapunov函数证明系统的有限时间稳定性.针对三阶不确定系统有限时间稳定和气垫船圆形航迹跟踪问题分别进行了仿真,验证了所提算法的有效性、鲁棒性.     

基于仿射控制输入的输入状态稳定非线性预测控制

针对有扰动的约束非线性系统,提出了一种基于仿射控制输入的反馈预测控制策略.采用无穷范数定义有限时域代价函数,对其进行极大极小优化得到预测控制律,并应用输入状态稳定分析了闭环系统的鲁棒稳定性,同时还给出了确定容许扰动上界的方法.最后,数值仿真说明本文的预测控制策略是有效的.     

一类不确定线性系统的混杂状态反馈保成本控制

研究一类不确定线性系统的混杂状态反馈保成本控制问题．系统矩阵和输入矩阵中含有时变不确定性,假设存在有限个备选的控制增益已知的控制器,并且任何单一的状态反馈控制器都不能镇定系统,基于单Lyapunov函数的方法,给出了混杂状态反馈保成本控制的充分条件及切换律的设计方案．当切换系统的控制增益未知时,利用多Lyapunov函数法,给出混杂状态反馈保成本控制的充分条件,并通过仿真验证了该方法的有效性。     

一类多输入级联非线性切换系统的全局镇定

研究一类带有部分线性系统的多输入级联非线性切换系统的全局镇定问题. 首先, 给出保证线性部分有一致规范型的充分条件. 其次, 利用一致规范型及其零动态的共同二次Lyapunov函数设计状态反馈使得线性部分在任意切换律下镇定. 最后, 通过构造共同Lyapunov函数能实现闭环系统在任意切换律下的全局渐近稳定性.     

约束时变不确定离散系统的输出反馈预测控制综合

研究多包描述系统的离线型输出反馈预测控制．已有一方法首先综合状态反馈预测控制，满足输入/ 状态约束；而在设计观测器时，不再考虑输入/ 状态约束．本文则首先给出观测器，并给出一组不等式条件使得真实状态、观测状态和观测误差都保持在同一个椭圆内部，以便采用线性矩阵不等式处理输入/ 状态约束．基此，本文离线计算一椭圆序列，每个椭圆对应一控制律和一观测器，而在线的实时控制律和观测器则从该序列中选择，使得闭环系统具有稳定性保证．仿真例子说明了本文方法的有效性．     

网络控制系统补偿器设计及稳定性分析

为解决网络延时对网络化控制系统性能的影响, 从控制的角度提出基于系统模型的补偿器设计方案以解决网络延时问题. 通过对广义预测控制算法GPC状态空间形式的推导, 设计具有多步预测功能的网络控制器, 实现前向通道的延时补偿; 构造具有延时补偿功能的状态观测器以补偿反馈通道延时. 分析了使用上述延时补偿策略所构成的闭环网络控制系统的稳定性. 通过对不同网络延时补偿的仿真实验, 证实了该补偿算法能有效改善控制系统性能并保持系统的稳定.     

A robust model predictive control algorithm for incrementally conic uncertain/nonlinear systems

This paper presents a robustly stabilizing model predictive control algorithm for systems with incrementally conic uncertain/nonlinear terms and bounded disturbances. The resulting control input consists of feedforward and feedback components. The feedforward control generates a nominal trajectory from online solution of a finite‐horizon constrained optimal control problem for a nominal system model. The feedback control policy is designed off‐line by utilizing a model of the uncertainty/nonlinearity and establishes invariant ‘state tubes’ around the nominal system trajectories. The entire controller is shown to be robustly stabilizing with a region of attraction composed of the initial states for which the finite‐horizon constrained optimal control problem is feasible for the nominal system. Synthesis of the feedback control policy involves solution of linear matrix inequalities. An illustrative numerical example is provided to demonstrate the control design and the resulting closed‐loop system performance. Copyright © 2010 John Wiley & Sons, Ltd.     

Two‐stage stability control for strict‐feedback systems with input delays and input nonlinear uncertainties

In this paper, a two‐stage control procedure is proposed for stabilization of a class of strict‐feedback systems with unknown constant time delays and nonlinear uncertainties in the input. A nominal controller is first designed to compensate input time delays without considering input nonlinear uncertainties. Extended from backstepping algorithm, input delay compensation is realized by means of predicted states that are computed through integration of cascaded system dynamics, making the nominal closed‐loop system asymptotically stable. Based on the nominal controller presented for the input delay system, a multi‐timescale system is subsequently developed to estimate the unknown input nonlinearity and make the estimate approach the nominal control input as fast as possible. It is proved that the proposed control scheme can make states of the strict‐feedback systems converge to zero and all the signals of the closed‐loop systems are guaranteed to be bounded in the presence of input time delays and nonlinear uncertainties. Simulation verification is carried out to illuminate the effectiveness of the proposed control approach.     

Robust output feedback model predictive control of constrained linear systems

This paper provides a solution to the problem of robust output feedback model predictive control of constrained, linear, discrete-time systems in the presence of bounded state and output disturbances. The proposed output feedback controller consists of a simple, stable Luenberger state estimator and a recently developed, robustly stabilizing, tube-based, model predictive controller. The state estimation error is bounded by an invariant set. The tube-based controller ensures that all possible realizations of the state trajectory lie in a simple uncertainty tube the ‘center’ of which is the solution of a nominal (disturbance-free) system and the ‘cross-section’ of which is also invariant. Satisfaction of the state and input constraints for the original system is guaranteed by employing tighter constraint sets for the nominal system. The complexity of the resultant controller is similar to that required for nominal model predictive control.     

Two-step output feedback predictive control for Hammerstein systems with networked-induced time delays

This paper is mainly concerned with the design problem of two-step model predictive control (MPC) for nonlinear systems represented by Hammerstein model, where the network-induced time delays exist between sensor to controller (S2C) and controller to actuator (C2A) links. We assume that the system state is not measurable, so the state observer is employed to estimate the state. The intermediate variable for the linear part of the system is calculated by minimising the quadratic performance function. The time-delay compensation algorithm of two-step output feedback predictive control (TSOFPC) for Hammerstein systems is presented and validated by a numerical example.     

Further results on robustness of (possibly discontinuous) sample and hold feedback

We demonstrate that sample and hold state feedback control (possibly discontinuous with respect to the state) is robust when the closed loop system possesses an appropriate Lyapunov function. We first show that if a Lyapunov decrease over sampling periods exists for the nominal system, this decrease can be maintained with some degradation relative to a sufficiently small additive perturbation. We then proceed to catalog several applications of this robustness, e.g., robustness to measurement noise, computational delays, or fast actuator dynamics.     

变采样网络控制系统的建模与分析

在变采样网络控制系统中采用事件—时间驱动方式，同时在使用预测控制值和预测反馈值的情况下，给出了各种网络时延所对应的网络控制系统的状态转移矩阵，最后分析了变采样网络控制系统稳定需要的条件。     

一类不确定非线性系统的全局鲁棒有限时间镇定

对一类不确定非线性系统提出了一种连续的全局鲁棒有限时间控制律．首先,针对标称系统设计出了一种状态反馈控制律,应用Lyapunov直接稳定性理论和Lasalle不变性原理证明了闭环标称系统的全局渐近稳定性,同时具有负的齐次度;其次,引入辅助变量和采用有限时间收敛的二阶滑模Super—twisting算法,设计出了对不确定性和干扰进行抑制的补偿控制项,并根据有限时间Lyapunov函数给出了补偿控制项参数的取值范围;最后,综合得到一种连续的使实际闭环系统有限时间收敛到平衡点的鲁棒镇定控制律．仿真结果表明了所提控制律的有效性．     

Decentralized tube‐based model predictive control of uncertain nonlinear multiagent systems

This paper addresses the problem of decentralized tube‐based nonlinear model predictive control (NMPC) for a general class of uncertain nonlinear continuous‐time multiagent systems with additive and bounded disturbance. In particular, the problem of robust navigation of a multiagent system to predefined states of the workspace while using only local information is addressed under certain distance and control input constraints. We propose a decentralized feedback control protocol that consists of two terms: a nominal control input, which is computed online and is the outcome of a decentralized finite horizon optimal control problem that each agent solves at every sampling time, for its nominal system dynamics; and an additive state‐feedback law which is computed offline and guarantees that the real trajectories of each agent will belong to a hypertube centered along the nominal trajectory, for all times. The volume of the hypertube depends on the upper bound of the disturbances as well as the bounds of the derivatives of the dynamics. In addition, by introducing certain distance constraints, the proposed scheme guarantees that the initially connected agents remain connected for all times. Under standard assumptions that arise in nominal NMPC schemes, controllability assumptions, communication capabilities between the agents, it is guaranteed that the multiagent system is input‐to‐state stable with respect to the disturbances, for all initial conditions satisfying the state constraints. Simulation results verify the correctness of the proposed framework.