NONLINEAR MODEL PREDICTIVE CONTROL

Nonlinear Model Predictive Control (NMPC), a strategy for constrained, feedback control of nonlinear processes, has been developed. The algorithm uses a simultaneous solution and optimization approach to determine the open-loop optimal manipulated variable trajectory at each sampling instant. Feedback is incorporated via an estimator, which uses process measurements to infer unmeasured state and disturbance values. These are used by the controller to determine the future optimal control policy. This scheme can be used to control processes described by different kinds of models, such as nonlinear ordinary differential/algebraic equations, partial differential/algebraic equations, integra-differential equations and delay equations. The advantages of the proposed NMPC scheme are demonstrated with the start-up of a non-isothermal, non-adiabatic CSTR with an irreversible, first-order reaction. The set-point corresponds to an open-loop unstable steady state. Comparisons have been made with controllers designed using (1) nonlinear variable transformations, (2) a linear controller tuned using the internal model control approach, and (3) open-loop optimal control. NMPC was able to bring the controlled variable to its set-point quickly and smoothly from a wide variety of initial conditions. Unlike the other controllers, NMPC dealt with constraints in an explicit manner without any degradation in the quality of control. NMPC also demonstrated superior performance in the presence of a moderate amount of error in the model parameters, and the process was brought to its set-point without steady-state offset.     

Machine learning-based predictive control of nonlinear processes. Part I: Theory

This article focuses on the design of model predictive control (MPC) systems for nonlinear processes that utilize an ensemble of recurrent neural network (RNN) models to predict nonlinear dynamics. Specifically, RNN models are initially developed based on a data set generated from extensive open-loop simulations within a desired process operation region to capture process dynamics with a sufficiently small modeling error between the RNN model and the actual nonlinear process model. Subsequently, Lyapunov-based MPC (LMPC) that utilizes RNN models as the prediction model is developed to achieve closed-loop state boundedness and convergence to the origin. Additionally, machine learning ensemble regression modeling tools are employed in the formulation of LMPC to improve prediction accuracy of RNN models and overall closed-loop performance while parallel computing is utilized to reduce computation time. Computational implementation of the method and application to a chemical reactor example is discussed in the second article of this series.     

Nonparametric nonlinear model predictive control

Model Predictive Control (MPC) has recently found wide acceptance in industrial applications, but its potential has been much impeded by linear models due to the lack of a similarly accepted nonlinear modeling or databased technique. Aimed at solving this problem, the paper addresses three issues: (i) extending second-order Volterra nonlinear MPC (NMPC) to higher-order for improved prediction and control; (ii) formulating NMPC directly with plant data without needing for parametric modeling, which has hindered the progress of NMPC; and (iii) incorporating an error estimator directly in the formulation and hence eliminating the need for a nonlinear state observer. Following analysis of NMPC objectives and existing solutions, nonparametric NMPC is derived in discrete-time using multidimensional convolution between plant data and Volterra kernel measurements. This approach is validated against the benchmark van de Vusse nonlinear process control problem and is applied to an industrial polymerization process by using Volterra kernels of up to the third order. Results show that the nonparametric approach is very efficient and effective and considerably outperforms existing methods, while retaining the original data-based spirit and characteristics of linear MPC. This paper is dedicated to Professor Hyun-Ku Rhee on the occasion of his retirement from Seoul National University.     

A multiple model,state feedback strategy for robust control of non-linear processes

The major limitation of reported multiple model approaches is that robustness against process/controller disturbances cannot be addressed for processes consisting of hybrid stable/unstable regimes, or with chaotic dynamics. In this paper, a significantly modified multiple model approach is developed to achieve robust control with global stability. The new advances include: (1) stabilization of open-loop unstable plants using a state feedback strategy, (2) incorporation of an adjustable pre-filter to achieve offset-free control, (3) implementation of a Kalman filter for state estimation, and (4) connection of the multiple model approach with non-linear model predictive control to achieve a precise control objective. The improved controller design method is successfully applied to two non-linear processes with different chaotic behaviour. Compared with conventional methods without model modifications, the new approach has achieved significant improvement in control performance and robustness with a dramatically reduced number of local models.     

A model predictive formulation for control of open-loop unstable cascade systems

Cascade control is commonly used in the operation of chemical processes to reject disturbances that have a rapid effect on a secondary measured state, before the primary measured variable is affected. In this paper, we develop a state estimation-based model predictive control approach that has the same general philosophy of cascade control (taking advantage of secondary measurements to aid disturbance rejection), with the additional advantage of the constraint handling capability of model predictive control (MPC). State estimation is achieved by using a Kalman filter and appending modeled disturbances as augmented states to the original system model. The example application is an open-loop unstable jacketed exothermic chemical reactor, where the jacket temperature is used as a secondary measurement in order to infer disturbances in jacket feed temperature and/or reactor feed flow rate. The MPC-based cascade strategy yields significantly better performance than classical cascade control when operating close to constraints on the jacket flow rate.     

MODEL PREDICTIVE CONTROL (MPC) AND ITS CURRENT ISSUES IN CHEMICAL ENGINEERING

Model predictive control (MPC) is one of the main process control techniques explored in the recent past; it is the amalgamation of different technologies used to predict future control action and future control trajectories knowing the current input and output variables and the future control signals. It can be said that the MPC scheme is based on the explicit use of a process model and process measurements to generate values for process input as a solution of an on-line (real-time) optimization problem to predict future process behavior. There have been a number of contributions in the field of nonlinear model–based predictive control dealing with issues like stability, efficient computation, optimization, constraints, and others. New developments in nonlinear MPC (NMPC) approaches come from resolving various issues, from faster optimization methods to different process models. This article specifically deals with chemical engineering systems ranging from reactors to distillation columns where MPC plays a role in the enhancement of the systems’ performance.     

Predictive control of transport-reaction processes

This work focuses on the development of computationally efficient predictive control algorithms for nonlinear parabolic and hyperbolic PDEs with state and control constraints arising in the context of transport-reaction processes. We first consider a diffusion-reaction process described by a nonlinear parabolic PDE and address the problem of stabilization of an unstable steady-state subject to input and state constraints. Galerkin’s method is used to derive finite-dimensional systems that capture the dominant dynamics of the parabolic PDE, which are subsequently used for controller design. Various model predictive control (MPC) formulations are constructed on the basis of the finite dimensional approximations and are demonstrated, through simulation, to achieve the control objectives. We then consider a convection-reaction process example described by a set of hyperbolic PDEs and address the problem of stabilization of the desired steady-state subject to input and state constraints, in the presence of disturbances. An easily implementable predictive controller based on a finite dimensional approximation of the PDE obtained by the finite difference method is derived and demonstrated, via simulation, to achieve the control objective.     

Model based control of a liquid swelling constrained batch reactor subject to recipe uncertainties

This work presents the application of nonlinear model predictive control (NMPC) to a simulated industrial batch reactor subject to safety constraint due to reactor level swelling, which can occur with relatively fast dynamics. Uncertainties in the implementation of recipes in batch process operation are of significant industrial relevance. The paper describes a novel control-relevant formulation of the excessive liquid rise problem for a two-phase batch reactor subject to recipe uncertainties. The control simulations are carried out using a dedicated NMPC and optimization software toolbox OptCon which implements efficient numerical algorithms. The open-loop optimal control problem is computed using the multiple-shooting technique and the arising nonlinear programming problem is solved using a sequential quadratic programming (SQP) algorithm tailored for large-scale problems, based on the freeware optimization environment HQP. The fast response of the NMPC controller is guaranteed by the initial value embedding and real-time iteration technologies. It is concluded that the OptCon implementation allows small sampling times and the controller is able to maintain safe and optimal operation conditions, with good control performance despite significant uncertainties in the implementation of the batch recipe.     

一种基于状态估计的间歇过程模型实时更新预测控制策略简

Nonlinear model predictive control （NMPC） is an appealing control technique for improving the per- formance of batch processes, but its implementation in industry is not always possible due to its heavy on-line computation. To facilitate the implementation of NMPC in batch processes, we propose a real-time updated model predictive control method based on state estimation. The method includes two strategies： a multiple model building strategy and a real-time model updated strategy. The multiple model building strategy is to produce a series of sim- plified models to reduce the on-line computational complexity of NMPC. The real-time model updated strategy is to update the simplified models to keep the accuracy of the models describing dynamic process behavior. The method is validated with a typical batch reactor. Simulation studies show that the new method is efficient and robust with respect to model mismatch and changes in process parameters.     

Predictive control of particle size distribution in particulate processes

In this work, we focus on the development and application of predictive-based strategies for control of particle size distribution (PSD) in continuous and batch particulate processes described by population balance models (PBMs). The control algorithms are designed on the basis of reduced-order models, utilize measurements of principle moments of the PSD, and are tailored to address different control objectives for the continuous and batch processes. For continuous particulate processes, we develop a hybrid predictive control strategy to stabilize a continuous crystallizer at an open-loop unstable steady-state. The hybrid predictive control strategy employs logic-based switching between model predictive control (MPC) and a fall-back bounded controller with a well-defined stability region. The strategy is shown to provide a safety net for the implementation of MPC algorithms with guaranteed stability closed-loop region. For batch particulate processes, the control objective is to achieve a final PSD with desired characteristics subject to both manipulated input and product quality constraints. An optimization-based predictive control strategy that incorporates these constraints explicitly in the controller design is formulated and applied to a seeded batch crystallizer. The strategy is shown to be able to reduce the total volume of the fines by 13.4% compared to a linear cooling strategy, and is shown to be robust with respect to modeling errors.     

Rotary Dryer Control Using a Grey-Box Neural Model Scheme

The application of a Grey-box Neural Model (GNM) in a nonlinear model predictive control scheme (NMPC) of a direct rotary dyer is presented in this work. The GNM, which is based on the combination of phenomenological models and empirical artificial neural network (ANN) models, was properly developed and validated by using experimental fish-meal rotary drying information. The GNM was created by combining the rotary dryer mass and energy balances and a feed forward neural network (FFNN), trained off-line to estimate the drying rate and the volumetric heat transfer coefficient. The GNM results allowed us to obtain the relation between the controlled variable (solid moisture content) and the manipulated variable (gas phase entrance temperature) used in the predictive control strategy. Two NMPC control strategies, one with a fixed extended prediction horizon and another with an extended range prediction horizon, were applied to a simulated industrial fish-meal drying process. The results showed that a correct rotary dryer representation can be obtained by using a GNM approach. Due to the representation capability of the GNM approach, excellent control performances of the NMPCs were observed when the process variables were subject to disturbances. As analyzed in this work, the fixed extended prediction horizon MPC surpassed recognized control methodologies (quadratic dynamic matrix control).     

Predictive control of transport-reaction processes

This work focuses on the development of computationally efficient predictive control algorithms for nonlinear parabolic and hyperbolic PDEs with state and control constraints arising in the context of transport-reaction processes. We first consider a diffusion-reaction process described by a nonlinear parabolic PDE and address the problem of stabilization of an unstable steady-state subject to input and state constraints. Galerkin’s method is used to derive finite-dimensional systems that capture the dominant dynamics of the parabolic PDE, which are subsequently used for controller design. Various model predictive control (MPC) formulations are constructed on the basis of the finite dimensional approximations and are demonstrated, through simulation, to achieve the control objectives. We then consider a convection-reaction process example described by a set of hyperbolic PDEs and address the problem of stabilization of the desired steady-state subject to input and state constraints, in the presence of disturbances. An easily implementable predictive controller based on a finite dimensional approximation of the PDE obtained by the finite difference method is derived and demonstrated, via simulation, to achieve the control objective.     

Machine learning-based distributed model predictive control of nonlinear processes

This work explores the design of distributed model predictive control (DMPC) systems for nonlinear processes using machine learning models to predict nonlinear dynamic behavior. Specifically, sequential and iterative DMPC systems are designed and analyzed with respect to closed-loop stability and performance properties. Extensive open-loop data within a desired operating region are used to develop long short-term memory (LSTM) recurrent neural network models with a sufficiently small modeling error from the actual nonlinear process model. Subsequently, these LSTM models are utilized in Lyapunov-based DMPC to achieve efficient real-time computation time while ensuring closed-loop state boundedness and convergence to the origin. Using a nonlinear chemical process network example, the simulation results demonstrate the improved computational efficiency when the process is operated under sequential and iterative DMPCs while the closed-loop performance is very close to the one of a centralized MPC system.     

Nonlinear model predictive control based on support vector machine and genetic algorithm

This paper presents a nonlinear model predictive control (NMPC) approach based on support vector machine (SVM) and genetic algorithm (GA) for multiple-input multiple-output (MIMO) nonlinear systems. Individual SVM is used to approximate each output of the controlled plant. Then the model is used in MPC control scheme to predict the outputs of the controlled plant. The optimal control sequence is calculated using GA with elite preserve strategy. Simulation results of a typical MIMO nonlinear system show that this method has a good ability of set points tracking and disturbance rejection.     

Closed-loop dynamic real-time optimization with stabilizing model predictive control

Dynamic real-time optimization (DRTO) is a supervisory strategy at the upper level of the industrial process automation architecture that computes economically optimal set-point trajectories that are in turn passed on to the lower-level model predictive control (MPC) for tracking. The economically optimal solution, in several process industries, could lead to operating the plant at or around an unstable steady state. The present article accounts for this by developing a closed-loop DRTO (CL-DRTO) formulation that enables handling unstable operating points via an underlying MPC with stability constraints. To this end, a stabilizing MPC that handles trajectory tracking for unstable systems is embedded within the upper-level DRTO. The resulting CL-DRTO problem is reformulated by applying a simultaneous solution approach. The economic benefits realized by the proposed strategy are illustrated through applications to both linearized and nonlinear dynamic models for single-input single-output and multi-input multi-output continuous stirred tank reactor case studies.     

Dynamic recurrent radial basis function network model predictive control of unstable nonlinear processes

A multistep model predictive control (MPC) strategy based on dynamically recurrent radial basis function networks (RBFNs) is proposed for single-input single-output (SISO) control of uncertain nonlinear processes. The control system consists of two automatically configured RBFNs, a trained network representing the plant model and a network with on-line learning to function as controller. The automatic configuration and learning of the networks is carried out by using a hierarchically self-organizing learning algorithm. This control strategy is structurally simple and computationally efficient since a single output node of each RBFN is configured to provide multistep predictions for plant output and controller. The performance of the proposed RBFNMPC strategy is evaluated by applying to two unstable nonlinear chemical processes, a chemical reactor and a biochemical reactor, and also a stable polymerization reactor. Further, the results of the RBFNMPC is compared with similar RBFN model based control strategies and also with well tuned PID/PI controller. The results show the better performance of the proposed RBFNMPC for the control of open-loop unstable nonlinear processes that exhibit multiple steady-state behavior.     

Some manifold learning considerations toward explicit model predictive control

Model predictive control (MPC) is a de facto standard control algorithm across the process industries. There remain, however, applications where MPC is impractical because an optimization problem is solved at each time step. We present a link between explicit MPC formulations and manifold learning to enable facilitated prediction of the MPC policy. Our method uses a similarity measure informed by control policies and system state variables, to “learn” an intrinsic parametrization of the MPC controller using a diffusion maps algorithm, which will also discover a low-dimensional control law when it exists as a smooth, nonlinear combination of the state variables. We use function approximation algorithms to project points from state space to the intrinsic space, and from the intrinsic space to policy space. The approach is illustrated first by “learning” the intrinsic variables for MPC control of constrained linear systems, and then by designing controllers for an unstable nonlinear reactor.     

MODELING AND PREDICTIVE CONTROL OF MIMO NONLINEAR SYSTEMS USING WIENER-LAGUERRE MODELS

In this work, a Weiner-type nonlinear black box model was developed for capturing dynamics of open loop stable MIMO nonlinear systems with deterministic inputs. The linear dynamic component of the model was parameterized using orthogonal Laguerre filters while the nonlinear state output map was constructed either using quadratic polynomial functions or artificial neural networks. The properties of the resulting model, such as open loop stability and steady-state behavior, are discussed in detail. The identified Weiner-Laguerre model was further used to formulate a nonlinear model predictive control (NMPC) scheme. The efficacy of the proposed modeling and control scheme was demonstrated using two benchmark control problems: (a) a simulation study involving control of a continuously operated fermenter at its optimum (singular) operating point and (b) experimental verification involving control of pH at the critical point of a neutralization process. It was observed that the proposed Weiner-Laguerre model is able to capture both the dynamic and steady-state characteristics of the continuous fermenter as well as the neutralization process reasonably accurately over wide operating ranges. The proposed NMPC scheme achieved a smooth transition from a suboptimal operating point to the optimum (singular) operating point of the fermenter without causing large variation in manipulated inputs. The proposed NMPC scheme was also found to be robust in the face of moderate perturbation in the unmeasured disturbances. In the case of experimental verification using the neutralization process, the proposed control scheme was found to achieve much faster transition to a set point close to the critical point when compared to a conventional gain-scheduled PID controller.     

MODELING AND PREDICTIVE CONTROL OF MIMO NONLINEAR SYSTEMS USING WIENER-LAGUERRE MODELS

In this work, a Weiner-type nonlinear black box model was developed for capturing dynamics of open loop stable MIMO nonlinear systems with deterministic inputs. The linear dynamic component of the model was parameterized using orthogonal Laguerre filters while the nonlinear state output map was constructed either using quadratic polynomial functions or artificial neural networks. The properties of the resulting model, such as open loop stability and steady-state behavior, are discussed in detail. The identified Weiner-Laguerre model was further used to formulate a nonlinear model predictive control (NMPC) scheme. The efficacy of the proposed modeling and control scheme was demonstrated using two benchmark control problems: (a) a simulation study involving control of a continuously operated fermenter at its optimum (singular) operating point and (b) experimental verification involving control of pH at the critical point of a neutralization process. It was observed that the proposed Weiner-Laguerre model is able to capture both the dynamic and steady-state characteristics of the continuous fermenter as well as the neutralization process reasonably accurately over wide operating ranges. The proposed NMPC scheme achieved a smooth transition from a suboptimal operating point to the optimum (singular) operating point of the fermenter without causing large variation in manipulated inputs. The proposed NMPC scheme was also found to be robust in the face of moderate perturbation in the unmeasured disturbances. In the case of experimental verification using the neutralization process, the proposed control scheme was found to achieve much faster transition to a set point close to the critical point when compared to a conventional gain-scheduled PID controller.     

Composite fast‐slow MPC design for nonlinear singularly perturbed systems

The design of a composite control system for nonlinear singularly perturbed systems using model predictive control (MPC) is described. Specifically, a composite control system comprised of a “fast” MPC acting to regulate the fast dynamics and a “slow” MPC acting to regulate the slow dynamics is designed. The composite MPC system uses multirate sampling of the plant state measurements, i.e., fast sampling of the fast state variables is used in the fast MPC and slow‐sampling of the slow state variables is used in the slow MPC. Using singular perturbation theory, the stability and optimality of the closed‐loop nonlinear singularly perturbed system are analyzed. A chemical process example which exhibits two‐time‐scale behavior is used to demonstrate the structure and implementation of the proposed fast–slow MPC architecture in a practical setting. © 2012 American Institute of Chemical Engineers AIChE J, 58: 1802–1811, 2012