A computational framework and solution algorithms for two‐stage adaptive robust scheduling of batch manufacturing processes under uncertainty

A novel two‐stage adaptive robust optimization (ARO) approach to production scheduling of batch processes under uncertainty is proposed. We first reformulate the deterministic mixed‐integer linear programming model of batch scheduling into a two‐stage optimization problem. Symmetric uncertainty sets are then introduced to confine the uncertain parameters, and budgets of uncertainty are used to adjust the degree of conservatism. We then apply both the Benders decomposition algorithm and the column‐and‐constraint generation (C&CG) algorithm to efficiently solve the resulting two‐stage ARO problem, which cannot be tackled directly by any existing optimization solvers. Two case studies are considered to demonstrate the applicability of the proposed modeling framework and solution algorithms. The results show that the C&CG algorithm is more computationally efficient than the Benders decomposition algorithm, and the proposed two‐stage ARO approach returns 9% higher profits than the conventional robust optimization approach for batch scheduling. © 2015 American Institute of Chemical Engineers AIChE J, 62: 687–703, 2016     

A data‐driven multistage adaptive robust optimization framework for planning and scheduling under uncertainty

A novel data‐driven approach for optimization under uncertainty based on multistage adaptive robust optimization (ARO) and nonparametric kernel density M‐estimation is proposed. Different from conventional robust optimization methods, the proposed framework incorporates distributional information to avoid over‐conservatism. Robust kernel density estimation with Hampel loss function is employed to extract probability distributions from uncertainty data via a kernelized iteratively reweighted least squares algorithm. A data‐driven uncertainty set is proposed, where bounds of uncertain parameters are defined by quantile functions, to organically integrate the multistage ARO framework with uncertainty data. Based on this uncertainty set, we further develop an exact robust counterpart in its general form for solving the resulting data‐driven multistage ARO problem. To illustrate the applicability of the proposed framework, two typical applications in process operations are presented: The first one is on strategic planning of process networks, and the other one on short‐term scheduling of multipurpose batch processes. The proposed approach returns 23.9% higher net present value and 31.5% more profits than the conventional robust optimization method in planning and scheduling applications, respectively. © 2017 American Institute of Chemical Engineers AIChE J, 63: 4343–4369, 2017     

Data‐driven adaptive nested robust optimization: General modeling framework and efficient computational algorithm for decision making under uncertainty

A novel data‐driven adaptive robust optimization framework that leverages big data in process industries is proposed. A Bayesian nonparametric model—the Dirichlet process mixture model—is adopted and combined with a variational inference algorithm to extract the information embedded within uncertainty data. Further a data‐driven approach for defining uncertainty set is proposed. This machine‐learning model is seamlessly integrated with adaptive robust optimization approach through a novel four‐level optimization framework. This framework explicitly accounts for the correlation, asymmetry and multimode of uncertainty data, so it generates less conservative solutions. Additionally, the proposed framework is robust not only to parameter variations, but also to anomalous measurements. Because the resulting multilevel optimization problem cannot be solved directly by any off‐the‐shelf solvers, an efficient column‐and‐constraint generation algorithm is proposed to address the computational challenge. Two industrial applications on batch process scheduling and on process network planning are presented to demonstrate the advantages of the proposed modeling framework and effectiveness of the solution algorithm. © 2017 American Institute of Chemical Engineers AIChE J, 63: 3790–3817, 2017     

Handling multi‐rate and missing data in variable duration economic model predictive control of batch processes

In the present work, we consider the problem of variable duration economic model predictive control of batch processes subject to multi‐rate and missing data. To this end, we first generalize a recently developed subspace‐based model identification approach for batch processes to handle multi‐rate and missing data by utilizing the incremental singular value decomposition technique. Exploiting the fact that the proposed identification approach is capable of handling inconsistent batch lengths, the resulting dynamic model is integrated into a tiered EMPC formulation that optimizes process economics (including batch duration). Simulation case studies involving application to the energy intensive electric arc furnace process demonstrate the efficacy of the proposed approach compared to a traditional trajectory tracking approach subject to limited availability of process measurements, missing data, measurement noise, and constraints. © 2017 American Institute of Chemical Engineers AIChE J, 63: 2705–2718, 2017     

Review of the important challenges and opportunities related to modeling of mammalian cell bioreactors

Industrialization of mammalian cell culture has been achieved by integrating knowledge from several applying core concepts of chemical engineering, cellular and molecular biology, and biochemistry. Modeling has been applied to biological and physical processes to gain additional insights into such processes. This article covers modeling of the bioreactor and metabolic processes as it applies to bioprocess. Hydrodynamics of a bioreactor is briefly described while additional focus is given to gas‐liquid mass transfer. Biological modeling is presented in the order of increasing complexity. First steady state models are presented followed by dynamic models, cybernetic models, and finally bioreactor integrated models. The closing discussion summarizes challenges of implementation of model‐based approaches in the biopharmaceutical industry. © 2016 American Institute of Chemical Engineers AIChE J, 63: 398–408, 2017     

A geometric framework for monitoring and fault detection for periodic processes

Although cyclical operation systems are relatively widespread in practice (notably in the realm of physical separations, for example, pressure‐swing adsorption and chromatography), the development of specific fault detection mechanisms has received little attention compared to the extensive efforts dedicated to continuous or batch processes. Here, a novel geometric approach for process fault detection is proposed. Specifically, a time‐explicit multivariable representation of data collected from the process, which provides a natural framework for defining “normal” operation and the corresponding confidence regions is developed. On this basis, a two‐step fault detection approach is proposed, based on detecting intercycle variations to locate a faulty cycle, and intracycle changes to determine the exact timing of a fault. The theoretical developments are illustrated with two simulation case studies. © 2017 American Institute of Chemical Engineers AIChE J, 63: 2719–2730, 2017     

Integrated B2B‐NMPC control strategy for batch/semibatch crystallization processes

The uncertainty in crystallization kinetics is of major concern in manufacturing processes, which can result in deterioration of most model‐based control strategies. In this study, uncertainties in crystallization kinetic parameters were characterized by Bayesian probability distributions. An integrated B2B‐NMPC control strategy was proposed to first update the kinetic parameters from batch to batch using a multiway partial least‐squares (MPLS) model, which described the variances of kinetic parameters from that of process variables and batch‐end product qualities. The process model with updated kinetic parameters was then incorporated into an NMPC design, the extended prediction self‐adaptive control (EPSAC), for online control of the final product qualities. Promising performance of the proposed integrated strategy was demonstrated in a simulated semibatch pH‐shift reactive crystallization process to handle major crystallization kinetic uncertainties of L‐glutamic acid, wherein smoother and faster convergences than the conventional B2B control were observed when process dynamics were shifted among three scenarios of kinetic uncertainties. © 2017 American Institute of Chemical Engineers AIChE J, 2017     

Data‐driven model predictive quality control of batch processes

The problem of driving a batch process to a specified product quality using data‐driven model predictive control (MPC) is described. To address the problem of unavailability of online quality measurements, an inferential quality model, which relates the process conditions over the entire batch duration to the final quality, is required. The accuracy of this type of quality model, however, is sensitive to the prediction of the future batch behavior until batch termination. In this work, we handle this “missing data” problem by integrating a previously developed data‐driven modeling methodology, which combines multiple local linear models with an appropriate weighting function to describe nonlinearities, with the inferential model in a MPC framework. The key feature of this approach is that the causality and nonlinear relationships between the future inputs and outputs are accounted for in predicting the final quality and computing the manipulated input trajectory. The efficacy of the proposed predictive control design is illustrated via closed‐loop simulations of a nylon‐6,6 batch polymerization process with limited measurements. © 2013 American Institute of Chemical Engineers AIChE J, 59: 2852–2861, 2013     

Integrated scheduling and dynamic optimization of batch processes using state equipment networks

A systematic framework for the integration of short‐term scheduling and dynamic optimization (DO) of batch processes is described. The state equipment network (SEN) is used to represent a process system, where it decomposes the process into two basic kinds of entities: process materials and process units. Mathematical modeling based on the SEN framework invokes both logical disjunctions and operational dynamics; thus the integrated formulation leads to a mixed‐logic dynamic optimization (MLDO) problem. The integrated approach seeks to benefit the overall process performance by incorporating process dynamics into scheduling considerations. The solution procedure of an MLDO problem is also addressed in this article, where MLDO problems are translated into mixed‐integer nonlinear programs using the Big M reformulation and the simultaneous collocation method. Finally, through two case studies, we show advantages of the integrated approach over the conventional recipe‐based scheduling method. © 2012 American Institute of Chemical Engineers AIChE J, 2012     

Optimal experiment design for nonlinear dynamic (bio)chemical systems using sequential semidefinite programming

Optimal experiment design (OED) for parameter estimation in nonlinear dynamic (bio)chemical processes is studied in this work. To reduce the uncertainty in an experiment, a suitable measure of the Fisher information matrix or variance–covariance matrix has to be optimized. In this work, novel optimization algorithms based on sequential semidefinite programming (SDP) are proposed. The sequential SDP approach has specific advantages over sequential quadratic programming in the context of OED. First of all, it guarantees on a matrix level a decrease of the uncertainty in the parameter estimation procedure by introducing a linear matrix inequality. Second, it allows an easy formulation of E‐optimal designs in a direct optimal control optimization scheme. Finally, a third advantage of SDP is that problems involving the inverse of a matrix can be easily reformulated. The proposed techniques are illustrated in the design of experiments for a fed‐batch bioreactor and a microbial kinetics case study. © 2014 American Institute of Chemical Engineers AIChE J, 60: 1728–1739, 2014     

A novel adaptive surrogate modeling‐based algorithm for simultaneous optimization of sequential batch process scheduling and dynamic operations

A novel adaptive surrogate modeling‐based algorithm is proposed to solve the integrated scheduling and dynamic optimization problem for sequential batch processes. The integrated optimization problem is formulated as a large scale mixed‐integer nonlinear programming (MINLP) problem. To overcome the computational challenge of solving the integrated MINLP problem, an efficient solution algorithm based on the bilevel structure of the integrated problem is proposed. Because processing times and costs of each batch are the only linking variables between the scheduling and dynamic optimization problems, surrogate models based on piece‐wise linear functions are built for the dynamic optimization problems of each batch. These surrogate models are then updated adaptively, either by adding a new sampling point based on the solution of the previous iteration, or by doubling the upper bound of total processing time for the current surrogate model. The performance of the proposed method is demonstrated through the optimization of a multiproduct sequential batch process with seven units and up to five tasks. The results show that the proposed algorithm leads to a 31% higher profit than the sequential method. The proposed method also outperforms the full space simultaneous method by reducing the computational time by more than four orders of magnitude and returning a 9.59% higher profit. © 2015 American Institute of Chemical Engineers AIChE J, 61: 4191–4209, 2015     

Industrial polyethylene melt index prediction using ensemble manifold learning–based local model

For online melt index prediction in multiple‐grade polyethylene polymerization processes, using only a fixed model is insufficient. Additionally, without enough process knowledge, it is difficult to select suitable input variables to accurately construct prediction models. A novel manifold learning based local probabilistic modeling method named ensemble just‐in‐time Gaussian process regression (EJGPR) is developed. By utilizing output variables, an optimization framework is proposed to preserve the local structure of both input and output variables. Then the output information is integrated into construction of a JGPR‐based local model. Additionally, some new extracted variables in the projection space can be obtained. Moreover, using the probabilistic prediction information, the uncertainty of each JGPR‐based local candidate model can be simply described. Consequently, using an efficient ensemble strategy, a more accurate EJGPR prediction model can be constructed online. The melt index prediction results in an industrial polyethylene process show it has better performance than conventional methods. © 2017 Wiley Periodicals, Inc. J. Appl. Polym. Sci. 2017 , 134, 45094.     

Equation‐oriented simulation and optimization of process flowsheets incorporating detailed spiral‐wound multistream heat exchanger models

Multiple chemical processes rely on multistream heat exchangers (MHEXs) for heat integration, particularly at cryogenic temperatures. Owing to their geometric complexity, the detailed design of MHEXs is typically iterative: the exchanger geometric parameters are selected to match process specifications resulting from a flowsheet optimization step; then, the flowsheet is reoptimized with the predictions of the MHEX model, and these steps are repeated until a convergence criterion is met. This paper presents a novel framework that allows—for the first time, to our knowledge—for the simultaneous optimization of the process flowsheet and the detailed MHEX design. Focusing on spiral‐wound MHEXs, we develop an equation‐oriented exchanger model using industry‐accepted heat transfer and pressure drop correlations for single‐phase and multiphase streams. We embed this model in our previously developed pseudo‐transient equation‐oriented process simulation and optimization framework. We demonstrate our approach on an industrial case study, the PRICO^® natural gas liquefaction process. © 2017 American Institute of Chemical Engineers AIChE J, 63: 3778–3789, 2017     

Subspace identification for data‐driven modeling and quality control of batch processes

In this work, we present a novel, data‐driven, quality modeling, and control approach for batch processes. Specifically, we adapt subspace identification methods for use with batch data to identify a state‐space model from available process measurements and input moves. We demonstrate that the resulting linear time‐invariant (LTI), dynamic, state‐space model is able to describe the transient behavior of finite duration batch processes. Next, we relate the terminal quality to the terminal value of the identified states. Finally, we apply the resulting model in a shrinking‐horizon, model predictive control scheme to directly control terminal product quality. The theoretical properties of the proposed approach are studied and compared to state‐of‐the‐art latent variable control approaches. The efficacy of the proposed approach is demonstrated through a simulation study of a batch polymethyl methacrylate polymerization reactor. Results for both disturbance rejection and set‐point changes (i.e., new quality grades) are demonstrated. © 2016 American Institute of Chemical Engineers AIChE J, 62: 1581–1601, 2016     

Steady‐state process optimization with guaranteed robust stability under parametric uncertainty

Interest in chemical processes that perform well in dynamic environments has led to the development of design methodologies that account for operational aspects of processes, including flexibility, operability, and controllability. In this article, we address the problem of identifying process designs that optimize an economic objective function and are guaranteed to be stable under parametric uncertainties. The underlying mathematical problem is difficult to solve as it involves infinitely many constraints, nonconvexities and multiple local optima. We develop a methodology that embeds robust stability constraints to steady‐state process optimization formulations without any a priori bifurcation analysis. We propose a successive row and column generation algorithm to solve the resulting generalized semi‐infinite programming problem to global optimality. The proposed methodology allows modeling different levels of robustness, handles uncertainty regions without overestimating them, and works for both unique and multiple steady states. We apply the proposed approach to a number of steady‐state optimization problems and obtain the least conservative solutions that guarantee robust stability. © 2011 American Institute of Chemical Engineers AIChE J, 2011     

OPTIMAL DESIGN AND OPERATION OF BATCH PROCESSES

The economical design of continuous chemical processes to produce commodity products has reached an advanced state of development. Modern computer tools are used routinely to simulate and optimize these processes. This is not the case, however, for the manufacture of speciality products which must be made in batch operations. The continuing shift towards the production of higher value-added specialty products by the CPI has stimulated efforts aimed at developing good computer assisted design strategies for batch processes.

This paper discusses the formulation of the problem for the optimal design and operation of batch processes. The batch problem differs from the continuous one in a number of important ways. First, batch plants do not operate at steady state. There are important trade-offs between the processing time and the severity (intensity) of processing in single units. Cycle time and performance trade-offs also exist among the various units in the process. Second, batch plants produce multiple products in many cases. There is often a competition for shared resources (labor, utilities, and equipment) among the various products. This paper presents a hierarchical solution approach for the design and optimization of a batch process. The approach is demonstrated by solving an example problem which illustrates the fundamental economic trade-offs.     

Stem cell biomanufacturing under uncertainty: A case study in optimizing red blood cell production

As breakthrough cellular therapy discoveries are translated into reliable, commercializable applications, effective stem cell biomanufacturing requires systematically developing and optimizing bioprocess design and operation. This article proposes a rigorous computational framework for stem cell biomanufacturing under uncertainty. Our mathematical tool kit incorporates: high‐fidelity modeling, single variate and multivariate sensitivity analysis, global topological superstructure optimization, and robust optimization. The advantages of the proposed bioprocess optimization framework using, as a case study, a dual hollow fiber bioreactor producing red blood cells from progenitor cells were quantitatively demonstrated. The optimization phase reduces the cost by a factor of 4, and the price of insuring process performance against uncertainty is approximately 15% over the nominal optimal solution. Mathematical modeling and optimization can guide decision making; the possible commercial impact of this cellular therapy using the disruptive technology paradigm was quantitatively evaluated. © 2017 American Institute of Chemical Engineers AIChE J, 64: 3011–3022, 2018     

A superstructure‐based model for multistream heat exchanger design within flow sheet optimization

Multistream heat exchangers (MHEXs) are often used in energy‐intensive cryogenic processes. Modeling them within a process optimization formulation has been a challenge due to the needs to accommodate phase changes and ensure temperature approach. In this work, we present a nonlinear model for MHEXs based on a novel single‐stage superstructure of two‐stream exchangers. Our formulation guarantees a minimum temperature approach for all heat exchanges, estimates heat exchange areas for individual stream matches, requires no prior knowledge of phase changes, uses no Boolean variables, and enables seamless optimization of a process with multiple MHEXs. Furthermore, it facilitates dedicated constant‐phase intervals that allow accurate estimation of heat‐transfer parameters for various stream matches. We optimize two natural gas liquefaction processes involving MHEXs, and report better solutions than the existing literature. © 2017 American Institute of Chemical Engineers AIChE J, 63: 3764–3777, 2017     

Uncertainty‐conscious methodology for process performance assessment in biopharmaceutical drug product manufacturing

This work presents an uncertainty‐conscious methodology for the assessment of process performance—for example, run time—in the manufacturing of biopharmaceutical drug products. The methodology is presented as an activity model using the type 0 integrated definition (IDEF0) functional modeling method, which systematically interconnects information, tools, and activities. In executing the methodology, a hybrid stochastic–deterministic model that can reflect operational uncertainty in the assessment result is developed using Monte Carlo simulation. This model is used in a stochastic global sensitivity analysis to identify tasks that had large impacts on process performance under the existing operational uncertainty. Other factors are considered, such as the feasibility of process modification based on Good Manufacturing Practice, and tasks to be improved is identified as the overall output. In a case study on cleaning and sterilization processes, suggestions were produced that could reduce the mean total run time of the processes by up to 40%. © 2017 American Institute of Chemical Engineers AIChE J, 64: 1272–1284, 2018