An E‐HOIM Based Data‐Driven Adaptive TILC of Nonlinear Discrete‐Time Systems for Non‐Repetitive Terminal Point Tracking

This work proposes a new adaptive terminal iterative learning control approach based on the extended concept of high‐order internal model, or E‐HOIM‐ATILC, for a nonlinear non‐affine discrete‐time system. The objective is to make the system state or output at the endpoint of each operation track a desired target value. The target value varies from one iteration to another. Before proceeding to the data‐driven design of the proposed approach, an iterative dynamical linearization is performed for the unknown nonlinear systems by using the gradient of the nonlinear system with regard to the control input as the iteration‐and‐time‐varying parameter vector of the equivalent linear I/O data model. By virtue of the basic idea of the internal model, the inverse of the parameter vector is approximated by a high‐order internal model. The proposed E‐HOIM‐ATILC does not use measurements of any intermediate points except for the control input and terminal output at the endpoint. Moreover, it is data‐driven and needs merely the terminal I/O measurements. By incorporating additional control knowledge from the known portion of the high order internal model into the learning control law, the control performance of the proposed E‐HOIM‐ATILC is improved. The convergence is shown by rigorous mathematical proof. Simulations through both a batch reactor and a coupled tank system demonstrate the effectiveness of the proposed method.     

Data‐Driven Adaptive Critic Approach for Nonlinear Optimal Control via Least Squares Support Vector Machine

This paper develops an online adaptive critic algorithm based on policy iteration for partially unknown nonlinear optimal control with infinite horizon cost function. In the proposed method, only a critic network is established, which eliminates the action network, to simplify its architecture. The online least squares support vector machine (LS‐SVM) is utilized to approximate the gradient of the associated cost function in the critic network by updating the input‐output data. Additionally, a data buffer memory is added to alleviate computational load. Finally, the feasibility of the online learning algorithm is demonstrated in simulation on two example systems.     

Synchronization of Heterogeneous Multi‐Agent Systems by Adaptive Iterative Learning Control

In this work, under a repeatable control environment, an adaptive iterative learning control method is applied to synchronize a group of uncertain heterogeneous agents. The agent dynamics are modeled by nonlinear equations, which contain both parametric and non‐parametric uncertainties. Furthermore, the uncertainties are assumed to be general nonlinear terms instead of the global Lipschitz functions. The communication among the followers is depicted by an undirected and connected graph, meanwhile, the virtual leader's trajectory is only accessible to a small portion of the followers. The proposed learning rules enable all the followers to learn and handle both parametric and non‐parametric uncertainties based on the local information such that the followers can synchronize their trajectories to the desired one. In comparison with the existing literature, most works assume first or second order nonlinear systems, and perfect initial conditions. In order to mitigate the identical initialization condition, the applicability of alignment condition and initial rectifying action are further explored. In addition, our developed algorithms can be applied to general high order nonlinear systems. Finally, synchronization examples of networked robotic manipulators are presented to demonstrate the effectiveness of the developed methods.     

H∞ Control of Linear Discrete‐Time Systems With Norm‐Bounded Nonlinear Uncertainties

In this paper, robust H_∞ control of a class of discrete‐time uncertain systems in state‐space form with linear nominal parts and norm‐bounded nonlinear uncertainties in both state and output equations is discussed. Such systems have a unique characterisic; that is, the two norm‐bounded nonlinear uncertainties have the equivalent representation by means of time‐varying and norm‐bounded linear uncertainties. To overcome the conservativenss of [5], the two nonlinear uncertainty sets are considered to be different. Then, by converting such systems into related discrete‐time linear systems with time‐varying and norm‐bounded linear uncertainties, we obtain that a sufficient condition for robust H_∞ control of such systems is equivalent to the solvability of the same problem of the related linear uncertain systems, which is solvable by means of a linear algebraic Riccati inequality.     

Iterative Learning Control for Linear Discrete‐Time Systems with Unknown High‐Order Internal Models: A Time‐Frequency Analysis Approach

This work focuses on the iterative learning control (ILC) for linear discrete‐time systems with unknown initial state and disturbances. First, multiple high‐order internal models (HOIMs) are introduced for the reference, initial state, and disturbances. Both the initial state and disturbance consist of two components, one strictly satisfies HOIM and the other is random bounded. Then, an ILC scheme is constructed according to an augmented HOIM that is the aggregation of all HOIMs. For all known HOIMs, an ILC design criterion is introduced to achieve satisfactory tracking performance based on the 2‐D theory. Next, the case with unknown HOIMs is discussed, where a time‐frequency‐analysis (TFA)‐based ILC algorithm is proposed. In this situation, it is shown that the tracking error inherits the unknown augmented HOIM that is an aggregation of all unknown HOIMs. Then, a TFA‐based method, e.g., the short‐time Fourier transformation (STFT), is employed to identify the unknown augmented HOIM, where the STFT could ignore the effect of the random bounded initial state and disturbances. A new ILC law is designed for the identified unknown augmented HOIM, which has the ability to reject the unknown the initial state and disturbances that strictly satisfy HOIMs. Finally, a gantry robot system with iteration‐invariant or slowly‐varying frequencies is given to illustrate the efficiency of the proposed TFA‐based ILC algorithm.     

Stability of a Trajectory‐Based Control Law for an Unknown Nonlinear Non‐Minimum Phase System

We investigate the stability of an unknown nonlinear discrete‐time non‐minimum phase system under a trajectory‐based control law. The system can be regarded as a first‐order approximation to a continuous‐time system. Hence, one of the parameters in the discrete‐time system equation can be regarded as the “sampling interval”. We show that, subject to certain conditions, as long as the sampling interval is neither too short nor too long, the closed‐loop system is stable in a certain sense.     

Data‐Driven Shape Analysis and Processing

Data‐driven methods serve an increasingly important role in discovering geometric, structural and semantic relationships between shapes. In contrast to traditional approaches that process shapes in isolation of each other, data‐driven methods aggregate information from 3D model collections to improve the analysis, modelling and editing of shapes. Data‐driven methods are also able to learn computational models that reason about properties and relationships of shapes without relying on hard‐coded rules or explicitly programmed instructions. Through reviewing the literature, we provide an overview of the main concepts and components of these methods, as well as discuss their application to classification, segmentation, matching, reconstruction, modelling and exploration, as well as scene analysis and synthesis. We conclude our report with ideas that can inspire future research in data‐driven shape analysis and processing.     

Iterative learning control design with high‐order internal model for discrete‐time nonlinear systems

In this paper, a high‐order internal model (HOIM)‐based iterative learning control (ILC) scheme is proposed for discrete‐time nonlinear systems to tackle the tracking problem under iteration‐varying desired trajectories. By incorporating the HOIM that is utilized to describe the variation of desired trajectories in the iteration domain into the ILC design, it is shown that the system output can converge to the desired trajectory along the iteration axis within arbitrarily small error. Furthermore, the learning property in the presence of state disturbances and output noise is discussed under HOIM‐based ILC with an integrator in the iteration axis. Two simulation examples are given to demonstrate the effectiveness of the proposed control method. Copyright © 2016 John Wiley & Sons, Ltd.     

基于有限时间跟踪微分器的迭代学习控制

针对迭代学习控制（Iterative learning control,ILC）中的初始状态问题,提出了采用有限时间跟踪微分器安排过渡过程方法,根据迭代学习控制中期望轨迹已知的特点,设计了其参数有明显物理意义并且调节方便的有限时间跟踪微分器. 在此基础上,针对一类具有不确定性的非线性时变系统的迭代学习控制问题,提出了具有对不确定项进行估计的迭代学习控制算法,并应用类Lyapunov方法给出了相关定理证明. 仿真结果表明所提出的方法是有效的.     

Data‐Driven Performance Monitoring for Model Predictive Control Using a mahalanobis distance based overall index

This paper proposes a data‐driven approach for model predictive control (MPC) performance monitoring. It explores the I/O data of the MPC system. First, to evaluate the MPC performance and capture the fluctuation of the process variables, we present an overall performance index based on Mahalanobis distance (MDBI) with its deduced benchmark. The Mahalanobis distance can better characterize the change of the process variable in both principal component space and residual space. As the proper vectors of the two spaces are orthogonal, the MDBI eliminates the correlation between the process variables while considering the variables’ characteristics in both spaces simultaneously, which helps evaluate the MPC performance more effectively with fewer monitoring parameters. Furthermore, for the MPC performance diagnosis, we use the MDBI as inputs and construct a support vector machine (SVM) pattern classifier. The classifier can achieve a higher accuracy when recognizing four common performance degradation patterns and determine the root cause of performance degradation. The results of simulations on the Wood‐Berry distillation column process and experiments on NIAT multifunctional experiment platform illustrate the effectiveness of the proposed performance assessment/diagnosis strategies.     

Iterative Learning Control for Nonlinear Systems: A Bounded‐Error Algorithm

This paper presents a nonlinear iterative learning control (NILC) for nonlinear time‐varying systems. An algorithm of a new strategy for the NILC implementation is proposed. This algorithm ensures that trajectory‐tracking errors of the proposed NILC, when implemented, are bounded by a given error norm bound. A special feature of the algorithm is that the trial‐time interval is finite but not fixed as it is for the other iterative learning algorithms. A sufficient condition for convergence and robustness of the bounded‐error learning procedure is derived. With respect to the bounded‐error and standard learning processes applied to a virtual robot, simulation results are presented in order to verify maximal tracking errors, convergence and applicability of the proposed learning control.     

Data‐driven high‐order terminal iterative learning control with a faster convergence speed

In this paper, a novel high‐order optimal terminal iterative learning control (high‐order OTILC) is proposed via a data‐driven approach for nonlinear discrete‐time systems with unknown orders in the input and output. The objective is to track the desired values at the endpoint of the operation cycle. The terminal tracking errors over more than one previous iterations are used to enhance the high‐order OTILC's performance with faster convergence. From rigor of the analysis, the monotonic convergence of the terminal tracking error is proved along the iteration direction. More importantly, the condition for a high‐order OTILC to outperform the low‐order ones is first established by this work. The learning gain is not fixed but iteratively updated by using the input and output (I/O) data, which enhances the flexibility of the proposed controller for modifications and expansions. The proposed method is data‐driven in which no explicit models are used except for the input and output data. The applications to a highly nonlinear continuous stirred tank reactor and a highly nonlinear fed‐batch fermentater demonstrate the effectiveness of the proposed high‐order OTILC design.     

An Lmi Approach To Non‐Fragile Guaranteed Cost Control Of Uncertain Discrete Time‐Delay Systems

This paper studies the non‐fragile Guaranteed Cost Control (GCC) problem via memoryless state‐feedback controllers for a class of uncertain discrete time‐delay linear systems. The systems are assumed to have norm‐bounded, time‐varying parameter uncertainties in the state, delay‐state, input, delay‐input and state‐feedback gain matrices. Existence of the guaranteed cost controllers are related to solutions of some linear matrix inequalities (LMIs). The non‐fragile GCC state‐feedback controllers are designed based on a convex optimization problem with LMI constraints to minimize the guaranteed cost of the resultant closed‐loop systems. Numerical examples are given to illustrate the design methods.     

Mixed Constrained Infinite Horizon Linear Quadratic Optimal Control

For a given initial state, a constrained infinite horizon linear quadratic optimal control problem can be reduced to a finite dimensional problem [12]. To find a conservative estimate of the size of the reduced problem, the existing algorithms require the on‐line solutions of quadratic programs [10] or a linear program [2]. In this paper, we first show based on the Lyapunov theorem that the closed‐loop system with a mixed constrained infinite horizon linear quadratic optimal control is exponentially stable on proper sets. Then the exponentially converging envelop of the closed‐loop trajectory that can be computed off‐line is employed to obtain a finite dimensional quadratic program equivalent to the mixed constrained infinite horizon linear quadratic optimal control problem without any on‐line optimization. The example considered in [2] showed that the proposed algorithm identifies less conservative size estimate of the reduced problem with much less computation.     

Optimistic Value Model of Indefinite LQ Optimal Control for Discrete‐Time Uncertain Systems

Uncertainty theory is a branch of mathematics which provides a new tool to deal with the human uncertainty. Based on uncertainty theory, this paper proposes an optimistic value model of discrete‐time linear quadratic (LQ) optimal control, whereas the state and control weighting matrices in the cost function are indefinite, the system dynamics are disturbed by uncertain noises. With the aid of the Bellman's principle of optimality in dynamic programming, we first present a recurrence equation. Then, a necessary condition for the state feedback control of the indefinite LQ problem is derived by using the recurrence equation. Moreover, a sufficient condition of well‐posedness for the indefinite LQ optimal control is given. Finally, a numerical example is presented by using the obtained results.     

Optimal disturbance rejection control for singularly perturbed composite systems with time‐delay

The optimal control problem for a class of singularly perturbed time‐delay composite systems affected by external disturbances is investigated. The system is decomposed into a fast linear subsystem and a slow time‐delay subsystem with disturbances. For the slow subsystem, the feedforward compensation technique is proposed to reject the disturbances, and the successive approximation approach (SAA) is applied to decompose it into decoupled subsystems and solve the two‐point boundary value (TPBV) problem. By combining with the optimal control law of the fast subsystem, the feedforward and feedback composite control (FFCC) law of the original composite system is obtained. The FFCC law consists of analytic state feedback and feedforward terms and a compensation term which is the limit of the adjoint vector sequence. The compensation term can be obtained from an iteration formula of adjoint vectors. Simulation results are employed to test the validity of the proposed design algorithm. Copyright © 2009 John Wiley and Sons Asia Pte Ltd and Chinese Automatic Control Society     

Stochastic Point‐to‐Point Iterative Learning Control Based on Stochastic Approximation

An iterative learning control algorithm with iteration decreasing gain is proposed for stochastic point‐to‐point tracking systems. The almost sure convergence and asymptotic properties of the proposed recursive algorithm are strictly proved. The selection of learning gain matrix is given. An illustrative example shows the effectiveness and asymptotic trajectory properties of the proposed approach.     

Optimal discrete higher‐order sliding mode control of uncertain LTI systems with partial state information

The concept of discrete higher‐order sliding mode has received increased attention in the recent literature. This paper presents an optimal discrete higher‐order sliding mode control for an uncertain discrete LTI system using partial state information, which has been missing in literature. A new technique is proposed to design an optimal time‐varying higher‐order sliding surface and control input through the minimization of a quadratic performance index. Moreover, disturbance estimation technique is utilized to modify the control algorithm to reduce the width of the discrete higher‐order sliding mode band. The proposed algorithm is experimentally validated on a rectilinear plant. Copyright © 2017 John Wiley & Sons, Ltd.     

非线性互联大系统的最优控制:逐次逼近法

The optimal control problem for nonlinear interconnected large-scale dynamic systems is considered. A successive approximation approach for designing the optimal controller is proposed with respect to quadratic performance indexes. By using the approach, the high order, coupling, nonlinear two-point boundary value (TPBV) problem is transformed into a sequence of linear decoupling TPBV problems. It is proven that the TPBV problem sequence uniformly converges to the optimal control for nonlinear interconnected large-scale systems. A suboptimal control law is obtained by using a finite iterative result of the optimal control sequence.     

Non‐uniform in time robust global asymptotic output stability for discrete‐time systems

In this paper the notions of non‐uniform in time robust global asymptotic output stability (RGAOS) and input‐to‐output stability (IOS) for discrete‐time systems are studied. Characterizations as well as links between these notions are provided. Particularly, it is shown that a discrete‐time system with continuous dynamics satisfies the non‐uniform in time IOS property if and only if the corresponding unforced system is non‐uniformly in time RGAOS. Necessary and sufficient conditions for the solvability of the robust output feedback stabilization (ROFS) problem are also given. Copyright © 2005 John Wiley & Sons, Ltd.