Robust stability of nonlinear model predictive control with extended Kalman filter and target setting

This work deals with the closed‐loop robust stability of nonlinear model predictive control (NMPC) coupled with an extended Kalman filter (EKF). First, we point out the gaps between the practical formulations and theoretical research. Then, we show that the estimation error dynamics of an EKF are input‐to‐state stable (ISS) in the presence of nonvanishing perturbations. Moreover, a target setting optimization problem is proposed to solve the target state corresponding to the desired set points, which are used in the objective function in NMPC formulation. Thus, the objective function is a Lyapunov function candidate, and the input‐to‐state practical stability (ISpS) of the closed‐loop system can be established. Moreover, we see that the stability property deteriorates because of the estimation error. Simulation results of the proposed scheme are presented.Copyright © 2012 John Wiley & Sons, Ltd.     

State estimation and nonlinear predictive control of autonomous hybrid system using derivative free state estimators

In this work, we develop a state estimation scheme for nonlinear autonomous hybrid systems, which are subjected to stochastic state disturbances and measurement noise, using derivative free state estimators. In particular, we propose the use of ensemble Kalman filters (EnKF), which belong to the class of particle filters, and unscented Kalman filters (UKF) to carry out estimation of state variables of autonomous hybrid system. We then proceed to develop novel nonlinear model predictive control (NMPC) schemes using these derivative free estimators for better control of autonomous hybrid systems. A salient feature of the proposed NMPC schemes is that the future trajectory predictions are based on stochastic simulations, which explicitly account for the uncertainty in predictions arising from the uncertainties in the initial state and the unmeasured disturbances. The efficacy of the proposed state estimation based control scheme is demonstrated by conducting simulation studies on a benchmark three-tank hybrid system. Analysis of the simulation results reveals that EnKF and UKF based NMPC strategies is well suited for effective control of nonlinear autonomous three-tank hybrid system.     

Product property and production rate control of styrene polymerization

A multivariable multi-rate nonlinear model predictive control (NMPC) strategy is applied to styrene polymerization. The NMPC algorithm incorporates a multi-rate Extended Kalman Filter (EKF) to handle state variable and parameter estimation. A fundamental model is developed for the styrene polymerization CSTR, and control of polymer properties such as number average molecular weight (NAMW) and polydispersity is considered. These properties characterize the final polymer distribution and are strong indicators of the polymer qualities of interest. Production rate control is also demonstrated. Temperature measurements are available frequently while laboratory measurements of concentration and molecular weight distribution are available infrequently with substantial time delays between sampling and analysis. Observability analysis of the augmented system provides guidelines for the design of the augmented disturbance model for use in estimation using the multi-rate EKF. The observability analysis links measurement sets and corresponding observable disturbance models, and shows that measurements of moments of the polymer distribution are essential for good estimation and control. The CSTR is operated at an open-loop unstable steady state. Control simulations are performed under conditions of plant-model structural mismatch and in the presence of parameter uncertainty and disturbances, and the proposed multi-rate NMPC algorithm is shown to provide superior performance compared to linear multi-rate and nonlinear single-rate MPC algorithms. The major contributions of this work are the development of the multi-rate estimator and the measurement design study based on the observability analysis.     

Explicit output-feedback nonlinear predictive control based on black-box models

Nonlinear model predictive control (NMPC) algorithms are based on various nonlinear models. A number of on-line optimization approaches for output-feedback NMPC based on various black-box models can be found in the literature. However, NMPC involving on-line optimization is computationally very demanding. On the other hand, an explicit solution to the NMPC problem would allow efficient on-line computations as well as verifiability of the implementation. This paper applies an approximate multi-parametric nonlinear programming approach to explicitly solve output-feedback NMPC problems for constrained nonlinear systems described by black-box models. In particular, neural network models are used and the optimal regulation problem is considered. A dual-mode control strategy is employed in order to achieve an offset-free closed-loop response in the presence of bounded disturbances and/or model errors. The approach is applied to design an explicit NMPC for regulation of a pH maintaining system. The verification of the NMPC controller performance is based on simulation experiments.     

一类不确定非线性系统的鲁棒输出反馈控制*

本文考虑一类具有输出反馈标准形的非线性系统的输出反馈控制问题，为了给出其不同于自适应控制的解决办法，设计出了新的鲁棒输出反馈控制方案。该方案不需辨识系统未知参数，也不需知识未知参数向量的上界，就能保证所有控制系统信号的全局有界性，并且顺参数的适当选择，可以使系统跟踪误差达到任意小。仿真结果表明可以获得良好的跟踪效果。     

Robust stability of economically oriented infinite horizon NMPC that include cyclic processes

Nonlinear model predictive control (NMPC) with economic objective attracts growing interest. In our previous work [1], nominal stability of economically oriented NMPC for cyclic processes was proved by introducing a transformed system, and an infinite horizon NMPC formulation with discount factors was proposed. Moreover, the nominal stability property for economically oriented NMPC was analyzed in [2] for a class of systems satisfying strong duality. In this study, we extend the previous stability analysis in [1] to a general infinite horizon NMPC formulation with economic objectives. Instead of the strong duality assumption, we require the stage cost to be strongly convex, which is easier to check for a general nonlinear system. In addition, robust stability of this NMPC controller is also analyzed based on the Input-to-State Stability (ISS) framework. A simulated nonlinear double tank system subject to periodic change in electricity price is presented to illustrate the stability property. Finally, an industrial size air separation unit case study with periodic electricity cost is presented.     

Anti-windup via constrained regulation with observers

A method is presented for the output-feedback control of discrete-time linear systems with hard constraints on state and control variables. Prior work has shown that optimal controllers for constrained systems take the form of a nonlinear feedback law acting on a set-valued state estimate. In this paper, conventional state estimation schemes are used. A nonlinear control law is derived which views the state estimation error as a disturbance. The resulting control law is then used in conjunction with the conventional observer, rather than set-valued observer, to achieve the desired constrained regulation. The significantly reduced real-time computations come at the cost of restricting the controller structure and thereby introducing possible conservatism in the achievable performance. The results are specialized to the problem of anti-windup for systems with control saturations. A “measurement governor” scheme is introduced that alters plant measurements in such a way to improve performance in the presence of controller saturations.     

Robust adaptive output-feedback control for a class of nonlinear systems with general uncertainties

This paper investigates the robust adaptive output-feedback control for a class of nonlinear systems with general uncertainties and unknown parameters. First, a stable state observer is constructed and the system state is observed, and then the adaptive output-feedback controller is constructively designed for tracking the given reference signal. It is proven that the constructed controller is robust to the uncertainties of both the unknown parameters and the system states. These results show that the global stability of the resulting closed-loop systems has been guaranteed and the ε-tracking problem has been solved. Meanwhile, it is also proven that the tracking error tends to a ‘steady state’ at the negative exponential attenuating rate. Simulation examples show that the tracking effects of the designed adaptive control systems are good, and the control quantities used in the simulation examples are always within the range of the admissible control.     

非线性离散随机时变系统比例微分滤波

扩展卡尔曼滤波（EKF）是从极小化状态估计误差的方差得到的，没有考虑状态误差的变化率，因而对非线性时变系统EKF估计方法惯性作用 较大，从而产生估计滞后，提出了非线性离散随机系统比例微分滤波（PDF），PDF联合考虑极小化状态估计误差和状态误差变化率的方差，克服了EKF对非线性时变系统估计滞后的缺点，估计具有适时性，提出了高估计的精度，仿真例子证明了所提出的估计方法的有效性。     

Robust unscented Kalman filter with adaptation of process and measurement noise covariances

Unscented Kalman filter (UKF) has been extensively used for state estimation of nonlinear stochastic systems, which suffers from performance degradation and even divergence when the noise distribution used in the UKF and the truth in a real system are mismatched. For state estimation of nonlinear stochastic systems with non-Gaussian measurement noise, the Masreliez–Martin extended Kalman filter (EKF) gives better state estimates in relation to the standard EKF. However, the process noise and the measurement noise covariance matrices should be known, which is impractical in applications. This paper presents a robust Masreliez–Martin UKF which can provide reliable state estimates in the presence of both unknown process noise and measurement noise covariance matrices. Two numerical examples involving relative navigation of spacecrafts demonstrate that the proposed filter can provide improved state estimation performance over existing robust filtering approaches. Vision-aided robot arm tracking experiments are also provided to show the effectiveness of the proposed approach.     

Advanced-step multistage nonlinear model predictive control: Robustness and stability

Nonlinear model predictive control (NMPC) has been popular in many applications, especially when constraint satisfaction is critical. However, due to plant-model mismatch and disturbances, robust NMPC generally faces three challenges: robust performance, real-time implementation, and stability. In this paper, we propose a parallelizable advanced-step multistage NMPC (as-msNMPC), which provides a non-conservative robust control solution that explicitly addresses two types of uncertainty: model parameters and unmeasured noise. The first type is attended to by incorporating scenario trees and the second by applying nonlinear programming (NLP) sensitivity. In addition, robust stability concepts have been discussed for both ideal multistage NMPC (ideal-msNMPC) and as-msNMPC. Under suitable assumptions, as-msNMPC has demonstrated input-to-state practical stability properties with the presence of two types of uncertainty. Lastly, the as-msNMPC framework has been applied to continuous stirred tank reactor (CSTR) and quad-tank case studies for tracking setpoints to demonstrate its performance in robustness and efficiency.     

非线性动态系统中迭代的同步数据协调与显著误差检测的支持向量回归方法

化工厂中过程数据的质量严重影响到来自例如性能监控, 在线优化和控制等活动所获得的效益和性能. 由于许多化工过程通常表现为非线性动态特性, 例如扩展卡尔曼滤波(EKF)和非线性动态数据协调(NDDR)等技术已经被发展出来改进数据的质量. 近期, 迭代非线性动态数据协调(RNDDR)技术已被提出, 该技术结合了EKF和NDDR技术的优点. 但是, RNDDR技术不能够处理具有显著误差的测量值. 本文中, 一种非线性动态系统中迭代的同步数据协调与显著误差检测的支持向量(SV)回归方法被提出. SV回归是一种经验风险和结构风险间的妥协, 并且对于数据协调来说, 其对随机误差和显著误差是鲁棒的．通过将结构风险取代RNDDR中的极大似然估计并使其最小化, 我们的方法不仅可以实现迭代非线性动态数据协调, 还可以同时实现显著误差检测. 本文中的非线性动态系统仿真结果显示出, 所提出的方法在迭代实时估计框架下, 对于非线性动态系统的同步数据协调和显著误差检测是鲁棒、稳定并且精确的. 该方法也可以提供更好的控制性能.     

Intelligent state estimation for fault tolerant nonlinear predictive control

There is growing realization that on-line model maintenance is the key to realizing long term benefits of a predictive control scheme. In this work, a novel intelligent nonlinear state estimation strategy is proposed, which keeps diagnosing the root cause(s) of the plant model mismatch by isolating the subset of active faults (abrupt changes in parameters/disturbances, biases in sensors/actuators, actuator/sensor failures) and auto-corrects the model on-line so as to accommodate the isolated faults/failures. To carry out the task of fault diagnosis in multivariate nonlinear time varying systems, we propose a nonlinear version of the generalized likelihood ratio (GLR) based fault diagnosis and identification (FDI) scheme (NL-GLR). An active fault tolerant NMPC (FTNMPC) scheme is developed that makes use of the fault/failure location and magnitude estimates generated by NL-GLR to correct the state estimator and prediction model used in NMPC formulation. This facilitates application of the fault tolerant scheme to nonlinear and time varying processes including batch and semi-batch processes. The advantages of the proposed intelligent state estimation and FTNMPC schemes are demonstrated by conducting simulation studies on a benchmark CSTR system, which exhibits input multiplicity and change in the sign of steady state gain, and a fed batch bioreactor, which exhibits strongly nonlinear dynamics. By simulating a regulatory control problem associated with an unstable nonlinear system given by Chen and Allgower [H. Chen, F. Allgower, A quasi infinite horizon nonlinear model predictive control scheme with guaranteed stability, Automatica 34(10) (1998) 1205–1217], we also demonstrate that the proposed intelligent state estimation strategy can be used to maintain asymptotic closed loop stability in the face of abrupt changes in model parameters. Analysis of the simulation results reveals that the proposed approach provides a comprehensive method for treating both faults (biases/drifts in sensors/actuators/model parameters) and failures (sensor/ actuator failures) under the unified framework of fault tolerant nonlinear predictive control.     

Decentralized nonlinear output-feedback stabilization withdisturbance attenuation

As a continuation of our recent work (1999), this paper addresses the problem of decentralized robust output-feedback stabilization with disturbance attenuation for large-scale systems with strong nonlinear interconnections. We focuses on a constructive solution to this decentralized control problem without requiring common matching and growth conditions appearing in the past literature. The decentralized output-feedback laws proposed achieve internal global asymptotic stability in the sense of Lyapunov and external stability in the sense of Sontag (1995, 1998)     

Multirate sliding mode disturbance compensation for model predictive control

In this paper, a novel hierarchical multirate control scheme for nonlinear discrete‐time systems is presented, consisting of a robust nonlinear model predictive controller (NMPC) and a multirate sliding mode disturbance compensator (MSMDC). The proposed MSMDC acts at a faster rate than the NMPC in order to keep the system as close as possible to the nominal trajectory predicted by NMPC despite model uncertainties and external disturbances. The a priori disturbance compensation turns out to be very useful in order to improve the robustness of the NMPC controller. A dynamic input allocation between MSMDC and NMPC allows to maximize the benefits of the proposed scheme that unites the advantages of sliding mode control (strong reduction of matched disturbances, low computational burden) to those of NMPC (optimality, constraints handling). Sufficient conditions required to guarantee input‐to‐state stability and constraints satisfaction by the overall scheme are also provided. Copyright © 2014 John Wiley & Sons, Ltd.     

A convex approach for NMPC based on second order Volterra series models

In model predictive control (MPC), the input sequence is computed, minimizing a usually quadratic cost function based on the predicted evolution of the system output. In the case of nonlinear MPC (NMPC), the use of nonlinear prediction models frequently leads to non‐convex optimization problems with several minimums. This paper proposes a new NMPC strategy based on second order Volterra series models where the original performance index is approximated by quadratic functions, which represent a lower bound of the original performance index. Convexity of the approximating quadratic cost functions can be achieved easily by a suitable choice of the weighting of the control increments in the performance index. The approximating cost functions can be globally minimized by convex optimization techniques in order to compute the input sequence. The minimization of the performance index is carried out by an iterative optimization procedure, which guarantees convergence to the solution. Furthermore, for a nominal prediction model, asymptotic stability for the proposed NMPC strategy can be shown. In the case of considering an estimation error in the prediction model, input‐to‐state practical stability is assured. The control performance of the NMPC strategy is illustrated by experimental results. Copyright © 2014 John Wiley & Sons, Ltd.     

A note on stability, robustness and performance of output feedback nonlinear model predictive control

In recent years, nonlinear model predictive control (NMPC) schemes have been derived that guarantee stability of the closed loop under the assumption of full state information. However, only limited advances have been made with respect to output feedback in the framework of nonlinear predictive control. This paper combines stabilizing instantaneous state feedback NMPC schemes with high-gain observers to achieve output feedback stabilization. For a uniformly observable MIMO system class it is shown that the resulting closed loop is asymptotically stable. Furthermore, the output feedback NMPC scheme recovers the performance of the state feedback in the sense that the region of attraction and the trajectories of the state feedback scheme can be recovered to any degree of accuracy for large enough observer gains, thus leading to semi-regional results. Additionally, it is shown that the output feedback controller is robust with respect to static sector bounded nonlinear input uncertainties.     

Robust and reliable estimation via Unscented Recursive Nonlinear Dynamic Data Reconciliation

The quality of process data in a chemical plant significantly affects the performance and benefits gained from activities like performance monitoring, online optimization and control. Since many chemical processes often exhibit nonlinear dynamics, techniques like Extended Kalman Filter (EKF) and Nonlinear Dynamic Data Reconciliation (NDDR) have been developed to improve the data quality. There are various issues that arise with the use of either of these techniques: EKF cannot handle inequality or equality constraints, while the NDDR has high computational cost. Recently a recursive estimation technique for nonlinear dynamic processes has been proposed which combines the merits of EKF and NDDR techniques. This technique, named as Recursive Nonlinear Dynamic Data Reconciliation (RNDDR), provides state and parameter estimates that satisfy bounds and other constraints imposed on them. However, the estimate error covariance matrix in RNDDR is computed in the same manner as in EKF, that is, the effects of both nonlinearity and constraints are neglected in the computation of the estimate error covariance matrix.

A relatively new method known as the Unscented Kalman Filter has been developed for nonlinear processes, in which the statistical properties of the estimates are computed without resorting to linearization of the nonlinear equations. This leads to improved accuracy of the estimates. In this paper, we combine the merits of the Unscented Kalman Filter and the RNDDR to obtain the Unscented Recursive Nonlinear Dynamic Data Reconciliation (URNDDR) technique. This technique addresses all concerns arising due to the presence of nonlinearity and constraints within a recursive estimation framework, resulting in an efficient, accurate and stable method for real-time state and parameter estimation for nonlinear dynamic processes.     

Robust moving horizon estimation based output feedback economic model predictive control

In this work, we develop an economic model predictive control scheme for a class of nonlinear systems with bounded process and measurement noise. In order to achieve fast convergence of the state estimates to the actual system state as well as the robustness of the observer to measurement and process noise, a deterministic (high-gain) observer is first applied for a small time period with continuous output measurements to drive the estimation error to a small value; after this initial small time period, a robust moving horizon estimation scheme is used on-line to provide more accurate and smoother state estimates. In the design of the robust moving horizon estimation scheme, the deterministic observer is used to calculate reference estimates and confidence regions that contain the actual system state. Within the confidence regions, the moving horizon estimation scheme is allowed to optimize its estimates. The output feedback economic model predictive controller is designed via Lyapunov techniques based on state estimates provided by the deterministic observer and the moving horizon estimation scheme. The stability of the closed-loop system is analyzed rigorously and conditions that ensure the closed-loop stability are derived. Extensive simulations based on a chemical process example illustrate the effectiveness of the proposed approach.     

非线性系统模型预测控制若干基本特点与主题回顾

随着线性系统模型预测控制的大量成功应用,基于非线性模型的预测控制简称非线性预测控制(NMPC)在近20年来引起了广泛关注,并取得了丰富的研究成果.本文在阐述NMPC基本原理和特点的基础上,分别从优化可行性、稳定性、鲁棒性、优化求解、吸引域等主题出发,分析并总结NMPC的研究现状.最后,在指出NMPC有待进一步深入研究问题的同时,展望当前NMPC的一些研究方向.