自由时间最优控制问题的一种控制向量参数化方法

针对自由时间最优控制问题,提出一种控制向量参数化（CVP）方法.通过引入时间尺度因子,将自由时间最优控制问题转化为固定时间问题,并将终端时刻作为优化参数.基于CVP方法,最优控制问题被转化为一个非线性规划（NLP）问题.建立目标和约束函数的Hamiltonian函数,通过求解伴随方程获得目标和约束函数的梯度,采用序列二次规划（SQP）方法获得问题的数值解.对于控制有切换结构的优化问题,给出了一种网格精细化策略,以提高控制质量.补料分批反应器最优控制问题的仿真实验验证了所提出方法的有效性.     

一类受限线性系统的最优控制

研究了一类受限线性系统的最优控制问题.对于输入和状态联合受限线性系统的最优控制,引入多参数二次规划方法进行求解;首先将控制问题转化为标准的多参数二次规划问题,然后应用多参数二次规划方法求得系统的可行状态空间及其子空间,并对每个子空间的求出其时变最优控制率,最后归纳上述过程得到一般性结论.方法不仅能使系统约束的处理更加系统化和透明化,还可以获得系统的显式分段仿射控制率.仿真结果表明了该方法的有效性.     

基于自适应动态规划的一类带有时滞的离散时间非线性系统的最优控制策略

针对一类状态和控制变量均带有时滞的非线性系统的带有二次性能指标函数最优控制问题, 本文提出了一种基于新的迭代自适应动态规划算法的最优控制方案. 通过引进时滞矩阵函数, 应用动态规划理论, 本文获得了最优控制的显式表达式, 然后通过自适应评判技术获得最优控制量. 本文给出了收敛性证明以保证性能指标函数收敛到最优. 为了实现所提出的算法, 本文采用神经网络近似性能指标函数、计算最优控制策略、求解时滞矩阵函数、以及给非线性系统建模. 最后本文给出了两个仿真例子说明所提出的最优策略的有效性.     

一种采用方块脉冲函数求解延时最优控制问题的算法

本文采用方块脉冲函数方法,将线性延时系统二次型最优控制问题转化为函数极值问题, 得到了最优控制规律的分段恒定解答,导出了一种不同迭代求解的简便算法.所提算法对小 延时和大延时系统均有效.     

非线性动力学系统最优控制问题的保辛求解方法

基于对偶变量变分原理提出了求解非线性动力学系统最优控制问题的一种保辛数值方法.以时间区段一端状态和另一端协态作为混合独立变量,在时间区段内采用拉格朗日插值近似状态变量与协态变量,然后利用对偶变量变分原理并将非线性最优控制问题转化为非线性方程组的求解,最终得到求解非线性动力学系统最优控制问题的保辛数值方法.数值实验验证了本文算法在求解精度与求解效率上的有效性.     

机械臂的自适应径向基函数神经网络双二次泛函最优控制

针对非线性机械臂系统中难以权衡控制能量与控制误差比重的最优控制问题,本文提出一种基于自适应径向基函数(RBF)神经网络二阶段叠加优化的双二次泛函最优求解模型,实现在非线性机械臂控制系统中用不大的控制能量来保持较小的控制误差的综合最优控制.在本文所提模型中,首先设计一种线性误差函数,作用于非线性控制方程,并采用自适应RBF网络逼近非线性控制方程中存在的不确定项,构成闭环反馈系统,实现对非线性系统的最优控制;其次,将待求参数复合成双二次泛函的解域,并设计一种新型的类递归神经网络求解该带约束条件的双二次型模型,实现模型求解的快速收敛并得其解.通过理论分析及数值仿真实例验证了所提模型能有效提高非线性系统的控制精度、稳定性、鲁棒性及自适应性,从而实现非线性系统的综合最优控制.     

最优控制问题的Legendre 伪谱法求解及其应用

伪谱法通过全局插值多项式参数化状态和控制变量,将最优控制问题(OCP)转化为非线性规划问题(NLP)进行求解,是一类具有更高求解效率的直接法。总结Legendre伪谱法转化Bolza型最优控制问题的基本框架,推导OCP伴随变量与NLP问题KKT乘子的映射关系,建立基于拟牛顿法的LGL配点数值计算方法,并针对非光滑系统,进一步研究分段伪谱逼近策略。基于上述理论开发通用OCP求解器,并对3个典型最优控制问题进行求解,结果表明了所提出方法和求解器的有效性。     

基于梯度估计的非线性系统最优控制及仿真

基于自适应动态规划（ADP）执行-评价结构,应用神经网络（NN）对非线性系统进行最优控制求解.首先提出所求解非线性系统的一般形式;其次给定二次正定性能指标,求其哈密尔顿函（HJB）函数;分别应用神经网络对执行-评价结构中的性能指标和最优控制进行逼近,神经网络权重参数应用梯度法求得,从而可以求得其最有控制策略.而且对执行机构和评价机构神经网络权重参数的收敛性以及系统总体的稳定性进行了详细的分析,证明所求控制策略可以使系统稳定;最后,用仿真结果来验证所提出的方法的可行性.     

非线性系统近似最优PD动态补偿控制

本文研究了一类基于动态补偿的非线性系统的近似最优PD控制的问题.用微分方程的逐次逼近理论将非线性系统的最优控制问题转化为求解线性非齐次两点边值序列问题,并提供了从时域最优状态反馈到频域最优PD控制器参数的优化方法,从而获取系统最优的动态补偿网络,设计出最优PD整定参数,给出其实现算法.最后仿真示例将所提出的方法与传统的线性二次型调节器（LQR）逐次逼近方法相比较,表明该方法具有良好的动态性能和鲁棒性.     

不确定拟哈密顿系统的随机最优控制

本文提出了不确定拟哈密顿系统、基于随机平均法、随机极大值原理和随机微分对策理论的一种随机极大极小最优控制策略.首先,运用拟哈密顿系统的随机平均法,将系统状态从速度和位移的快变量形式转化为能量的慢变量形式,得到部分平均的It随机微分方程;其次,给定控制性能指标,对于不确定拟哈密顿系统的随机最优控制,根据随机微分对策理论,将其转化为一个极小极大控制问题;再根据随机极大值原理,建立关于系统与伴随过程的前向-后向随机微分方程,随机最优控制表达为哈密顿控制函数的极大极小条件,由此得到最坏情形下的扰动参数与极大极小最优控制;然后,将最坏扰动参数与最优控制代入部分平均的It随机微分方程并完成平均,求解与完全平均的It随机微分方程相应的Fokker-Planck-Kolmogorov(FPK)方程,可得受控系统的响应量并计算控制效果;最后,将上述不确定拟哈密顿系统的随机最优控制策略应用于一个两自由度非线性系统,通过数值结果说明该随机极大极小控制策略的控制效果.     

Combination of non-classical pseudospectral and direct methods for the solution of brachistochrone problem

In this paper, we propose a combination of non-classical pseudospectral and direct methods to find the solution of brachistochrone problem. The method converts the optimal control problem of brachistochrone, into a sequence of quadratic programming problems. To this end, the quasilinearization method is used to replace the nonlinear optimal control problem into a sequence of constrained linear-quadratic optimal control problems; then each of the state variables is approximated by a weighted interpolation function based on the non-classical orthogonal polynomials. The method gives the information of the quadratic programming problems explicitly (the Hessian and the gradient of the cost function). Using this method, the solution of the brachistochrone problem is compared with those in the literature.     

A quasilinearization algorithm and its application to a manipulator problem

A quasilinearization algorithm is proposed for the computation of optimal control of a class of constrained problem. The constraints are inequality constraints on functions of the state and control variables, and bounds on the values of the control variables. Necessary conditions for optimal control of the control problem are derived. In the iterative procedure, no prior information is required regarding the sequence of constrained and unconstrained arcs and the inequality constraints which are on their boundaries along a specific constrained arc of the optimal trajectory. All this information will be determined within the iterative procedure using some necessary conditions for optimal control. The ability of the proposed algorithm to solve practical problems is demonstrated by its application to several variations of two problems, one of which is a common manipulator problem in industry where transportation of open vessels of liquid is to be performed in a specified period of time. It is shown that the proposed quasilinearization algorithm is an effective tool in deriving optimal control policies for a common type of manipulator operation in industry.     

Construction of optimal feedback control for nonlinear systems via Chebyshev polynomials

A method is proposed to determine the optimal feedback control law of a class of nonlinear optimal control problems. The method is based on two steps. The first step is to determine the open-hop optimal control and trajectories, by using the quasilinearization and the state variables parametrization via Chebyshev polynomials of the first type. Therefore the nonlinear optimal control problem is replaced by a sequence of small quadratic programming problems which can easily be solved. The second step is to use the results of the last quasilinearization iteration, when an acceptable convergence error is achieved, to obtain the optimal feedback control law. To this end, the matrix Riccati equation and another n linear differential equations are solved using the Chebyshev polynomials of the first type. Moreover, the differentiation operational matrix of Chebyshev polynomials is introduced. To show the effectiveness of the proposed method, the simulation results of a nonlinear optimal control problem are shown.     

A Haar wavelet quasilinearization approach for numerical simulation of Burgers’ equation

In this paper, an efficient numerical scheme based on uniform Haar wavelets and the quasilinearization process is proposed for the numerical simulation of time dependent nonlinear Burgers’ equation. The equation has great importance in many physical problems such as fluid dynamics, turbulence, sound waves in a viscous medium etc. The Haar wavelet basis permits to enlarge the class of functions used so far in the collocation framework. More accurate solutions are obtained by wavelet decomposition in the form of a multi-resolution analysis of the function which represents a solution of boundary value problems. The accuracy of the proposed method is demonstrated by three test problems. The numerical results are compared with existing numerical solutions found in the literature. The use of the uniform Haar wavelet is found to be accurate, simple, fast, flexible, convenient and has small computation costs.     

The computation of optimal singular control

An algorithm for the solution of optimal control problems with singular subarcs is presented. The modified quasilinearization is extended to the solution of those problems where the initial conditions are updated successively. A major advantage of the quasilinearization method is its rapidity of convergence despite its simplicity in programming. It is not necessary to introduce penalty functions for the treatment of boundary conditions. An illustrative example is presented.     

Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach

The Hamilton-Jacobi-Bellman (HJB) equation corresponding to constrained control is formulated using a suitable nonquadratic functional. It is shown that the constrained optimal control law has the largest region of asymptotic stability (RAS). The value function of this HJB equation is solved for by solving for a sequence of cost functions satisfying a sequence of Lyapunov equations (LE). A neural network is used to approximate the cost function associated with each LE using the method of least-squares on a well-defined region of attraction of an initial stabilizing controller. As the order of the neural network is increased, the least-squares solution of the HJB equation converges uniformly to the exact solution of the inherently nonlinear HJB equation associated with the saturating control inputs. The result is a nearly optimal constrained state feedback controller that has been tuned a priori off-line.     

Trigonometric approximation of optimal periodic control problemsfor systems with inertial controllers

A constrained optimal periodic control (OPC) problem for nonlinear systems with inertial controllers is considered. A sequence of approximate problems containing trigonometric polynomials for approximation of the state, control, and functions in the state equations and in the optimality criterion is formulated. Sufficient conditions for a sequence of nearly optimal solutions of approximate problems to be norm-convergent to the basic problem optimal solution are derived. It is pointed out that the direct approximation approach in the space of state and control combined with the finite-dimensional optimization methods such as the space covering and gradient-type methods makes probable the finding of the global optimum for OPC problems     

Nonlinear Constrained Optimal Control Problems and Cardinal Hermite Interpolant Multiscaling Functions

In this paper, a numerical method for solving nonlinear quadratic optimal control problems with inequality constraints is presented. The method is based upon cardinal Hermite interpolant multiscaling function approximation. The properties of these multiscaling functions are presented first. These properties are then utilized to reduce the solution of the nonlinear constrained optimal control to a nonlinear programming one, to which existing algorithms may be applied. Illustrative examples are included to demonstrate the efficiency and applicability of the technique.     

A symplectic local pseudospectral method for solving nonlinear state‐delayed optimal control problems with inequality constraints

In this paper, a symplectic local pseudospectral (PS) method for solving nonlinear state‐delayed optimal control problems with inequality constraints is proposed. We first convert the original nonlinear problem into a sequence of linear quadratic optimal control problems using quasi‐linearization techniques. Then, based on local Legendre‐Gauss‐Lobatto PS methods and the dual variational principle, a PS method to solve these converted linear quadratic constrained optimal control problems is developed. The developed method transforms the converted problems into a coupling of a system of linear algebraic equations and a linear complementarity problem. The coefficient matrix involved is sparse and symmetric due to the benefit of the dual variational principle. Converged solutions can be obtained with few iterations because of the local PS method and quasi‐linearization techniques are used. The proposed method can be applied to problems with fixed terminal states or free terminal states, and the boundary conditions and constraints are strictly satisfied. Numerical simulations show that the developed method is highly efficient and accurate.     

基于PSO的预测控制及在聚丙烯中的应用

输入输出受限非线性系统的预测控制问题,可以看作是一个难以直接求解的约束非线性优化问题。针对预测控制在解决此类优化问题时,存在易收敛到局部极小或者非可行解,对初始值敏感等缺点,提出了一种基于微粒群优化方法的非线性预测控制算法。采用微粒群优化算法（PSO）作为模型预测控制的滚动优化方法,在线实时求解最优控制律。将PSO与序贯二次规划（SQP）算法进行对比仿真实验,求解两个标准函数优化问题,结果表明PSO能够快速有效地求得全局最小点,而SQP则很容易陷入局部极小点。将该算法应用于丙烯聚合反应过程的温度控制中,仿真结果显示了该方法的有效性。