Closed-loop dynamic real-time optimization with stabilizing model predictive control

Dynamic real-time optimization (DRTO) is a supervisory strategy at the upper level of the industrial process automation architecture that computes economically optimal set-point trajectories that are in turn passed on to the lower-level model predictive control (MPC) for tracking. The economically optimal solution, in several process industries, could lead to operating the plant at or around an unstable steady state. The present article accounts for this by developing a closed-loop DRTO (CL-DRTO) formulation that enables handling unstable operating points via an underlying MPC with stability constraints. To this end, a stabilizing MPC that handles trajectory tracking for unstable systems is embedded within the upper-level DRTO. The resulting CL-DRTO problem is reformulated by applying a simultaneous solution approach. The economic benefits realized by the proposed strategy are illustrated through applications to both linearized and nonlinear dynamic models for single-input single-output and multi-input multi-output continuous stirred tank reactor case studies.     

Composite fast‐slow MPC design for nonlinear singularly perturbed systems

The design of a composite control system for nonlinear singularly perturbed systems using model predictive control (MPC) is described. Specifically, a composite control system comprised of a “fast” MPC acting to regulate the fast dynamics and a “slow” MPC acting to regulate the slow dynamics is designed. The composite MPC system uses multirate sampling of the plant state measurements, i.e., fast sampling of the fast state variables is used in the fast MPC and slow‐sampling of the slow state variables is used in the slow MPC. Using singular perturbation theory, the stability and optimality of the closed‐loop nonlinear singularly perturbed system are analyzed. A chemical process example which exhibits two‐time‐scale behavior is used to demonstrate the structure and implementation of the proposed fast–slow MPC architecture in a practical setting. © 2012 American Institute of Chemical Engineers AIChE J, 58: 1802–1811, 2012     

Application of state estimation based NMPC to an unstable nonlinear process

Model predictive control (MPC) has become very popular both in process industry and academia due to its effectiveness in dealing with nonlinear, multivariable and/or hard-constrained plants.Although linear MPC can be applied for controlling nonlinear processes by obtaining a linearized model of the plant, this is only valid in a limited region. Therefore, a substantial improvement can be achieved by using the whole knowledge of the process dynamics, specially in the presence of marked nonlinearities. This effect can be strong if the process to control is open-loop unstable.The purpose of this paper is to introduce a nonlinear model predictive controller (NMPC) based on nonlinear state estimation, in order to exploit the knowledge of the nonlinear dynamics and to avoid modeling simplifications or linearization.A state-space formulation is proposed to achieve the control objective. To update the optimization involved in NMPC strategy, state estimation based on the measured outputs is proposed.As a particular application, we consider an open-loop unstable jacketed exothermic chemical reactor. This CSTR is widely recognized as a difficult problem for the purpose of control. In order to achieve the control goal, a NMPController coupled with a state observer are designed. The observer is also used to estimate some unmeasured disturbances. Finally, computer simulations are developed for showing the performance of both the nonlinear observer and the control strategy.     

Actuator stiction compensation via model predictive control for nonlinear processes

The problem of valve stiction is addressed, which is a nonlinear friction phenomenon that causes poor performance of control loops in the process industries. A model predictive control (MPC) stiction compensation formulation is developed including detailed dynamics for a sticky valve and additional constraints on the input rate of change and actuation magnitude to reduce control loop performance degradation and to prevent the MPC from requesting physically unrealistic control actions due to stiction. Although developed with a focus on stiction, the MPC‐based compensation method presented is general and has potential to compensate for other nonlinear valve dynamics which have some similarities to those caused by stiction. Feasibility and closed‐loop stability of the proposed MPC formulation are proven for a sufficiently small sampling period when Lyapunov‐based constraints are incorporated. Using a chemical process example with an economic model predictive controller (EMPC), the selection of appropriate constraints for the proposed method is demonstrated. The example verified the incorporation of the stiction dynamics and actuation magnitude constraints in the EMPC causes it to select set‐points that the valve output can reach and causes the operating constraints to be met. © 2016 American Institute of Chemical Engineers AIChE J, 62: 2004–2023, 2016     

Model predictive control of a second-order hyperbolic transport-reaction process

The model predictive controller (MPC) design is developed for a tubular chemical reactor, considering a second-order hyperbolic partial differential equation as the model of the transport-reaction process with boundary actuation. Without loss of generality, closed–closed boundary conditions and relaxed total flux are assumed. At the same time, the model is discretized in time by the Cayley–Tustin method, and, under the assumption that only the reactor's output is measurable, the observer design for the state reconstruction is addressed and integrated with the MPC design. The Luenberger observer gain is obtained by solving the operator Ricatti equation in the discrete-time setting, while the MPC accounts for constrained and optimal control. The simulations show that the output-based MPC design stabilizes the system under the input and output constraints satisfaction. In addition, to address the models' disparities, the results for both parabolic and hyperbolic equations are presented and discussed.     

Data‐driven model predictive quality control of batch processes

The problem of driving a batch process to a specified product quality using data‐driven model predictive control (MPC) is described. To address the problem of unavailability of online quality measurements, an inferential quality model, which relates the process conditions over the entire batch duration to the final quality, is required. The accuracy of this type of quality model, however, is sensitive to the prediction of the future batch behavior until batch termination. In this work, we handle this “missing data” problem by integrating a previously developed data‐driven modeling methodology, which combines multiple local linear models with an appropriate weighting function to describe nonlinearities, with the inferential model in a MPC framework. The key feature of this approach is that the causality and nonlinear relationships between the future inputs and outputs are accounted for in predicting the final quality and computing the manipulated input trajectory. The efficacy of the proposed predictive control design is illustrated via closed‐loop simulations of a nylon‐6,6 batch polymerization process with limited measurements. © 2013 American Institute of Chemical Engineers AIChE J, 59: 2852–2861, 2013     

Nonparametric nonlinear model predictive control

Model Predictive Control (MPC) has recently found wide acceptance in industrial applications, but its potential has been much impeded by linear models due to the lack of a similarly accepted nonlinear modeling or databased technique. Aimed at solving this problem, the paper addresses three issues: (i) extending second-order Volterra nonlinear MPC (NMPC) to higher-order for improved prediction and control; (ii) formulating NMPC directly with plant data without needing for parametric modeling, which has hindered the progress of NMPC; and (iii) incorporating an error estimator directly in the formulation and hence eliminating the need for a nonlinear state observer. Following analysis of NMPC objectives and existing solutions, nonparametric NMPC is derived in discrete-time using multidimensional convolution between plant data and Volterra kernel measurements. This approach is validated against the benchmark van de Vusse nonlinear process control problem and is applied to an industrial polymerization process by using Volterra kernels of up to the third order. Results show that the nonparametric approach is very efficient and effective and considerably outperforms existing methods, while retaining the original data-based spirit and characteristics of linear MPC. This paper is dedicated to Professor Hyun-Ku Rhee on the occasion of his retirement from Seoul National University.     

Economic model predictive control of nonlinear process systems using Lyapunov techniques

In this work, we develop model predictive control (MPC) designs, which are capable of optimizing closed‐loop performance with respect to general economic considerations for a broad class of nonlinear process systems. Specifically, in the proposed designs, the economic MPC optimizes a cost function, which is related directly to desired economic considerations and is not necessarily dependent on a steady‐state—unlike conventional MPC designs. First, we consider nonlinear systems with synchronous measurement sampling and uncertain variables. The proposed economic MPC is designed via Lyapunov‐based techniques and has two different operation modes. The first operation mode corresponds to the period in which the cost function should be optimized (e.g., normal production period); and in this operation mode, the MPC maintains the closed‐loop system state within a predefined stability region and optimizes the cost function to its maximum extent. The second operation mode corresponds to operation in which the system is driven by the economic MPC to an appropriate steady‐state. In this operation mode, suitable Lyapunov‐based constraints are incorporated in the economic MPC design to guarantee that the closed‐loop system state is always bounded in the predefined stability region and is ultimately bounded in a small region containing the origin. Subsequently, we extend the results to nonlinear systems subject to asynchronous and delayed measurements and uncertain variables. Under the assumptions that there exist an upper bound on the interval between two consecutive asynchronous measurements and an upper bound on the maximum measurement delay, an economic MPC design which takes explicitly into account asynchronous and delayed measurements and enforces closed‐loop stability is proposed. All the proposed economic MPC designs are illustrated through a chemical process example and their performance and robustness are evaluated through simulations. © 2011 American Institute of Chemical Engineers AIChE J, 2012     

Machine learning-based predictive control of nonlinear processes. Part I: Theory

This article focuses on the design of model predictive control (MPC) systems for nonlinear processes that utilize an ensemble of recurrent neural network (RNN) models to predict nonlinear dynamics. Specifically, RNN models are initially developed based on a data set generated from extensive open-loop simulations within a desired process operation region to capture process dynamics with a sufficiently small modeling error between the RNN model and the actual nonlinear process model. Subsequently, Lyapunov-based MPC (LMPC) that utilizes RNN models as the prediction model is developed to achieve closed-loop state boundedness and convergence to the origin. Additionally, machine learning ensemble regression modeling tools are employed in the formulation of LMPC to improve prediction accuracy of RNN models and overall closed-loop performance while parallel computing is utilized to reduce computation time. Computational implementation of the method and application to a chemical reactor example is discussed in the second article of this series.     

Some manifold learning considerations toward explicit model predictive control

Model predictive control (MPC) is a de facto standard control algorithm across the process industries. There remain, however, applications where MPC is impractical because an optimization problem is solved at each time step. We present a link between explicit MPC formulations and manifold learning to enable facilitated prediction of the MPC policy. Our method uses a similarity measure informed by control policies and system state variables, to “learn” an intrinsic parametrization of the MPC controller using a diffusion maps algorithm, which will also discover a low-dimensional control law when it exists as a smooth, nonlinear combination of the state variables. We use function approximation algorithms to project points from state space to the intrinsic space, and from the intrinsic space to policy space. The approach is illustrated first by “learning” the intrinsic variables for MPC control of constrained linear systems, and then by designing controllers for an unstable nonlinear reactor.     

Robust model predictive control and fault handling of batch processes

This work considers the control of batch processes subject to input constraints and model uncertainty with the objective of achieving a desired product quality. First, a computationally efficient nonlinear robust Model Predictive Control (MPC) is designed. The robust MPC scheme uses robust reverse‐time reachability regions (RTRRs), which we define as the set of process states that can be driven to a desired neighborhood of the target end‐point subject to input constraints and model uncertainty. A multilevel optimization‐based algorithm to generate robust RTRRs for specified uncertainty bounds is presented. We then consider the problem of uncertain batch processes subject to finite duration faults in the control actuators. Using the robust RTRR‐based MPC as the main tool, a robust safe‐steering framework is developed to address the problem of how to operate the functioning inputs during the fault repair period to ensure that the desired end‐point neighborhood can be reached upon recovery of the full control effort. The applicability of the proposed robust RTRR‐based controller and safe‐steering framework subject to limited availability of measurements and sensor noise are illustrated using a fed‐batch reactor system. © 2010 American Institute of Chemical Engineers AIChE J, 2011     

Model predictive control for the reactant concentration control of a reactor

The reactant concentration control of a reactor using Model Predictive Control (MPC) is presented in this paper. Two major difficulties in the control of reactant concentration are that the measurement of concentration is not available for the control point of view and it is not possible to control the concentration without considering the reactor temperature. Therefore, MIMO control techniques and state and parameter estimation are needed. One of the MIMO control techniques widely studied recently is MPC. The basic concept of MPC is that it computes a control trajectory for a whole horizon time minimising a cost function of a plant subject to a dynamic plant model and an end point constraint. However, only the initial value of controls is then applied. Feedback is incorporated by using the measurements/estimates to reconstruct the calculation for the next time step. Since MPC is a model based controller, it requires the measurement of the states of an appropriate process model. However, in most industrial processes, the state variables are not all measurable. Therefore, an extended Kalman filter (EKF), one of estimation techniques, is also utilised to estimate unknown/uncertain parameters of the system. Simulation results have demonstrated that without the reactor temperature constraint, the MPC with EKF can control the reactant concentration at a desired set point but the reactor temperator is raised over a maximum allowable value. On the other hand, when the maximun allowable value is added as a constraint, the MPC with EKF can control the reactant concentration at the desired set point with less drastic control action and within the reactor temperature constraint. This shows that the MPC with EKF is applicable to control the reactant concentration of chemical reactors.     

Reference Trajectory Optimization Under Constrained Predictive Control

Chemical process systems often need to respond to frequently changing product demands. This motivates the determination of optimal transitions, subject to specification and operational constraints. However, direct implementation of optimal input trajectories would, in general, result in offset in the presence of disturbances and plant/model mismatch. This paper considers reference trajectory optimization of processes controlled by constrained model predictive control (MPC). Consideration of the closed‐loop dynamics of the MPC‐controlled process in the reference trajectory optimization results in a multi‐level optimization problem. A solution strategy is applied in which the MPC quadratic programming subproblems are replaced by their Karush‐Kuhn‐Tucker optimality conditions, resulting in a single‐level mathematical program with complementarity constraints (MPCC). The performance of the method is illustrated through application to two case studies, the second of which considers economically optimal grade transitions in a polymerization process.     

Toward a low cost and high performance MPC: The role of system identification

The high cost of model predictive control (MPC) technology has hampered its wide application in process industries beyond the refining/petrochemical industry. This work strives to increase the efficiency of MPC deployment. First, a semi-automatic MPC system is introduced. It consists of three modules: an MPC module, an online identification module and a control monitor module. The goal of the MPC technology is twofold: (1) to considerably reduce the cost of MPC commissioning and maintenance and (2) to increase control performance. System identification plays important roles in all the three parts of the MPC system. In the identification module, the so-called ASYM method of identification is used. It is demonstrated with an industrial application. In the control module, adaptive disturbance model identification is developed for improving control performance; in the monitor module, a method of model error detection method is developed. Industrial applications and simulations are used to demonstrate the ideas. Finally, we comment on some industrial needs on MPC research and development.     

基于加权偏离度统计方法的预测控制性能评估算法

针对带区域约束条件的预测控制系统性能评估问题,在考虑过程输出变量约束类型的基础上,提出了基于加权偏离度统计方法的控制性能评估算法。该方法依据控制要求的不同,将输出变量分为质量变量和约束变量,并结合工程经验合理选择变量的权重。基于系统闭环运行数据和约束设置,通过计算变量的加权偏离度得到控制系统的性能评估指标,从而为预测控制器的参数调整和性能提升提供了决策依据。系统仿真实例和工程应用证明了该评估算法对区域预测控制系统性能评估的有效性。     

Lyapunov‐based MPC with robust moving horizon estimation and its triggered implementation

In this work, we consider moving horizon state estimation (MHE)‐based model predictive control (MPC) of nonlinear systems. Specifically, we consider the Lyapunov‐based MPC (LMPC) developed in (Mhaskar et al., IEEE Trans Autom Control. 2005;50:1670–1680; Syst Control Lett. 2006;55:650–659) and the robust MHE (RMHE) developed in (Liu J, Chem Eng Sci. 2013;93:376–386). First, we focus on the case that the RMHE and the LMPC are evaluated every sampling time. An estimate of the stability region of the output control system is first established; and then sufficient conditions under which the closed‐loop system is guaranteed to be stable are derived. Subsequently, we propose a triggered implementation strategy for the RMHE‐based LMPC to reduce its computational load. The triggering condition is designed based on measurements of the output and its time derivatives. To ensure the closed‐loop stability, the formulations of the RMHE and the LMPC are also modified accordingly to account for the potential open‐loop operation. A chemical process is used to illustrate the proposed approaches. © 2013 American Institute of Chemical Engineers AIChE J, 59: 4273–4286, 2013     

Repetitive model predictive control of a reverse flow reactor

This paper deals with the control of a catalytic reverse flow reactor (RFR) used for methane combustion. The periodic flow reversals effected on the system makes it both continuous and discrete in nature (i.e., a hybrid system). Control of this system is challenging due to the unsteady state behavior of the process along with its mixed discrete and continuous behavior. Although model predictive control (MPC) is proven to be a powerful technique for several processes it becomes less effective in systems such as the RFR where the model prediction errors and the effect of disturbances on the plant output repeat from time to time. In such cases, control can be improved if the repetitive error pattern is exploited. A novel repetitive model predictive control (RMPC) strategy, that combines the basic concepts of iterative learning control (ILC) and repetitive control (RC) along with the concepts of MPC, is proposed for such systems. In the proposed strategy, the state variables of the model are reset periodically along with predictive control action such that the process follows the reference trajectory as closely as possible. The results obtained prove that the RMPC approach provides an excellent performance for the control of the RFR.     

Distributed economic model predictive control for operational safety of nonlinear processes

Achieving operational safety of chemical processes while operating them in an economically‐optimal manner is a matter of great importance. Our recent work integrated process safety with process control by incorporating safety‐based constraints within model predictive control (MPC) design; however, the safety‐based MPC was developed with a centralized architecture, with the result that computation time limitations within a sampling period may reduce the effectiveness of such a controller design for promoting process safety. To address this potential practical limitation of the safety‐based control design, in this work, we propose the integration of a distributed model predictive control architecture with Lyapunov‐based economic model predictive control (LEMPC) formulated with safety‐based constraints. We consider both iterative and sequential distributed control architectures, and the partitioning of inputs between the various optimization problems in the distributed structure based on their impact on process operational safety. Moreover, sufficient conditions that ensure feasibility and closed‐loop stability of the iterative and sequential safety distributed LEMPC designs are given. A comparison between the proposed safety distributed EMPC controllers and the safety centralized EMPC is demonstrated via a chemical process example. © 2017 American Institute of Chemical Engineers AIChE J, 63: 3404–3418, 2017