Iterative Path Tracking of an Omni-Directional Mobile Robot

We propose a path-tracking algorithm that is developed using an iterative learning control (ILC) technique and use the algorithm to control an omni-directional mobile robot. The proposed algorithm can be categorized as an open–closed PD-type ILC; it generates robot velocity commands by a PD-type ILC update rule using both previous and current information. When applied to the omni-directional mobile robot, it can decrease position errors and track the desired trajectory. Under the general problem setting that includes a mobile robot, we show that the proposed algorithm guarantees that the system states, outputs and control inputs converge to within small error bounds around the desired ones even under state disturbances, measurement noises and initial state errors. By using simulation and experimental tests, we demonstrate that the proposed algorithm converges fast to the desired path, and results in small root-mean-square (r.m.s.) position error under various surface conditions. The proposed algorithm shows better path-tracking performance than the conventional PID algorithm and achieves faster convergence and lower r.m.s. error than the existing two ILC algorithms.     

Iterative learning control for integrated system of robot and machine tool

This study is concerned with the integrated system of a robot and a machine tool. The major task of robot is loading the workpiece to the machine tool for contour cutting. An iterative learning control (ILC) algorithm is proposed to improve the accuracy of the finished product. The proposed ILC is to modify the input command of the next machining cycle for both robot and machine tool to iteratively enhance the output accuracy of the robot and machine tool. The modified command is computed based on the current tracking/contour error. For the ILC of the robot, tracking error is considered as the control objective to reduce the tracking error of motion path, in particular, the error at the endpoint. Meanwhile, for the ILC of the machine tool, contour error is considered as the control objective to improve the contouring accuracy, which determines the quality of machining. In view of the complicated contour error model, the equivalent contour error instead of the actual contour error is taken as the control objective in this study. One challenge for the integrated system is that there exists an initial state error for the machine tool dynamics, violating the basic assumption of ILC. It will be shown in this study that the effects of initial state error can be significantly reduced by the ILC of the robot. The proposed ILC algorithm is verified experimentally on an integrated system of commercial robot and machine tool. The experimental results show that the proposed ILC can achieve more than 90% of reduction on both the RMS tracking error of the robot and the RMS contour error of the machine tool within six learning iterations. The results clearly validate the effectiveness of the proposed ILC for the integrated system.     

Adaptive neural controller for cooperative multiple robot manipulator system manipulating a single rigid object

In this article, an adaptive neural controller is developed for cooperative multiple robot manipulator system carrying and manipulating a common rigid object. In coordinated manipulation of a single object using multiple robot manipulators simultaneous control of the object motion and the internal force exerted by manipulators on the object is required. Firstly, an integrated dynamic model of the manipulators and the object is derived in terms of object position and orientation as the states of the derived model. Based on this model, a controller is proposed that achieves required trajectory tracking of the object as well as tracking of the desired internal forces arising in the system. A feedforward neural network is employed to learn the unknown dynamics of robot manipulators and the object. It is shown that the neural network can cope with the unknown nonlinearities through the adaptive learning process and requires no preliminary offline learning. The adaptive learning algorithm is derived from Lyapunov stability analysis so that both error convergence and tracking stability are guaranteed in the closed loop system. Finally, simulation studies and analysis are carried out for two three-link planar manipulators moving a circular disc on specified trajectory.     

基于泰勒级数的迭代学习算法

针对存在不确定扰动的线性时变系统的轨迹跟踪控制问题,提出了基于泰勒级数的迭代学习算法．该算法利用泰勒级数将系统参数化,导出一种基于泰勒级数的线性时变系统的近似模型．在此模型的基础上,利用迭代学习方式修正输入量的泰勒展开系数,并用LMI方法求解学习增益矩阵．所提出算法在系统不满足正则性或无源性时,仍可用输出误差信号来构造学习律．仿真结果表明了该算法的有效性．     

Adaptive ILC algorithms of nonlinear continuous systems with non-parametric uncertainties for non-repetitive trajectory tracking

In this article, two adaptive iterative learning control (ILC) algorithms are presented for nonlinear continuous systems with non-parametric uncertainties. Unlike general ILC techniques, the proposed adaptive ILC algorithms allow that both the initial error at each iteration and the reference trajectory are iteration-varying in the ILC process, and can achieve non-repetitive trajectory tracking beyond a small initial time interval. Compared to the neural network or fuzzy system-based adaptive ILC schemes and the classical ILC methods, in which the number of iterative variables is generally larger than or equal to the number of control inputs, the first adaptive ILC algorithm proposed in this paper uses just two iterative variables, while the second even uses a single iterative variable provided that some bound information on system dynamics is known. As a result, the memory space in real-time ILC implementations is greatly reduced.     

An open-closed-loop iterative learning control approach for nonlinear switched systems with application to freeway traffic control

For nonlinear switched discrete-time systems with input constraints, this paper presents an open-closed-loop iterative learning control (ILC) approach, which includes a feedforward ILC part and a feedback control part. Under a given switching rule, the mathematical induction is used to prove the convergence of ILC tracking error in each subsystem. It is demonstrated that the convergence of ILC tracking error is dependent on the feedforward control gain, but the feedback control can speed up the convergence process of ILC by a suitable selection of feedback control gain. A switched freeway traffic system is used to illustrate the effectiveness of the proposed ILC law.     

Integrated predictive iterative learning control based on updating reference trajectory for point-to-point tracking

A novel control technique is proposed by combining iterative learning control (ILC) and model predictive control (MPC) with updating-reference trajectory for point-to-point tracking problem of batch process. In this paper, a batch-to-batch updating-reference trajectory, which passes through the desired points, is firstly designed as the tracking trajectory within a batch. The updating control law consists of P-type ILC part and MPC part, in which P-type ILC part can improve the performance by learning from previous executions and MPC part is used to suppress the model perturbations and external disturbances. Convergence properties of the integrated predictive iterative learning control (IPILC) are analyzed theoretically, and the sufficient convergence conditions of output tracking error are also derived for a class of linear systems. Comparing with other point-to-point tracking control algorithms, the proposed algorithm can perform better in robustness. Furthermore, updating-reference relaxes the constraints for system outputs, and it may lead to faster convergence and more extensive range of application than those of fixed-reference control algorithms. Simulation results on typical systems show the effectiveness of the proposed algorithm.     

A convex optimization approach to robust iterative learning control for linear systems with time-varying parametric uncertainties

In this paper, we present a new robust iterative learning control (ILC) design for a class of linear systems in the presence of time-varying parametric uncertainties and additive input/output disturbances. The system model is described by the Markov matrix as an affine function of parametric uncertainties. The robust ILC design is formulated as a min–max problem using a quadratic performance criterion subject to constraints of the control input update. Then, we propose a novel methodology to find a suboptimal solution of the min–max optimization problem. First, we derive an upper bound of the worst-case performance. As a result, the min–max problem is relaxed to become a minimization problem in the form of a quadratic program. Next, the robust ILC design is cast into a convex optimization over linear matrix inequalities (LMIs) which can be easily solved using off-the-shelf optimization solvers. The convergences of the control input and the error are proved. Finally, the robust ILC algorithm is applied to a physical model of a flexible link. The simulation results reveal the effectiveness of the proposed algorithm.     

On adaptive trajectory tracking of a robot manipulator usinginversion of its neural emulator

This paper is concerned with the design of a neuro-adaptive trajectory tracking controller. The paper presents a new control scheme based on inversion of a feedforward neural model of a robot arm. The proposed control scheme requires two modules. The first module consists of an appropriate feedforward neural model of forward dynamics of the robot arm that continuously accounts for the changes in the robot dynamics. The second module implements an efficient network inversion algorithm that computes the control action by inverting the neural model. In this paper, a new extended Kalman filter (EKF) based network inversion scheme is proposed. The scheme is evaluated through comparison with two other schemes of network inversion: gradient search in input space and Lyapunov function approach. Using these three inversion schemes the proposed controller was implemented for trajectory tracking control of a two-link manipulator. Simulation results in all cases confirm the efficacy of control input prediction using network inversion. Comparison of the inversion algorithms in terms of tracking accuracy showed the superior performance of the EKF based inversion scheme over others.     

基于强化迭代学习的四旋翼无人机轨迹控制

为进一步提升在未知环境下四旋翼无人机轨迹的跟踪精度,提出了一种在传统反馈控制架构上增加迭代学习前馈控制器的控制方法。针对迭代学习控制（ILC）中存在的学习参数整定困难的问题,提出了一种利用强化学习（RL）对迭代学习控制器的学习参数进行整定优化的方法。首先,利用RL对迭代学习控制器的学习参数进行优化,筛选出当前环境及任务下最优的学习参数以保证迭代学习控制器的控制效果最优;其次,利用迭代学习控制器的学习能力不断迭代优化前馈输入,直至实现完美跟踪;最后,在有随机噪声存在的仿真环境中把所提出的强化迭代学习控制（RL-ILC）算法与未经参数优化的ILC方法、滑模变结构控制（SMC）方法以及比例-积分-微分（PID）控制方法进行对比实验。实验结果表明,所提算法在经过2次迭代后,总误差缩减为初始误差的0.2%,实现了快速收敛;并且与SMC控制方法及PID控制方法相比,RL-ILC算法在算法收敛后不会受噪声影响产生轨迹波动。由此可见,所提算法能够有效提高无人机轨迹跟踪的准确性和鲁棒性。     

Impulsive observers with variable update intervals for Lipschitz nonlinear time-delay systems

This article is concerned with the design of impulsive observers with variable update intervals for Lipschitz nonlinear systems with delays in state. Discontinuous Lyapunov function/funtional approaches are developed to analyse the stability of error dynamics. Delay-independent sufficient conditions for uniform exponential stability of the error dynamics over variable update intervals are derived in terms of linear matrix inequalities (LMIs). When these LMIs are feasible, the observer gain matrix can be solved numerically with an LMI-based optimisation algorithm. Numerical examples are provided to show the efficiency of the proposed approach.     

Identification based adaptive iterative learning controller

In recent years, more research in the control field has been in the area of self‐learning and adaptable systems, such as a robot that can teach itself to improve its performance. One of the more promising algorithms for self‐learning control systems is Iterative Learning Control (ILC), which is an algorithm capable of tracking a desired trajectory within a specified error limit. Conventional ILC algorithms have the problem of relatively slow convergence rate and adaptability. This paper suggests a novel approach by combining system identification techniques with the proposed ILC approach to overcome the aforementioned problems. The ensuing design procedure is explained and results are accrued from a number of simulation examples. A key point in the proposed scheme is the computation of gain matrices using the steepest descent approach. It has been found that the learning rule can be guaranteed to converge if certain conditions are satisfied. Copyright © 2010 John Wiley and Sons Asia Pte Ltd and Chinese Automatic Control Society     

An algebraic approach to iterative learning control

In this paper discrete-time iterative learning control (ILC) systems are analysed from an algebraic point of view. The algebraic analysis shows that a linear-time invariant single-input–single-output model can always represented equivalently as a static multivariable plant due to the finiteness of the time-axis. Furthermore, in this framework the ILC synthesis problem becomes a tracking problem of a multi-channel step-function. The internal model principle states that for asymptotic tracking (i.e. convergent learning) it is required that an ILC algorithm has to contain an integrator along the iteration axis, but at the same time the resulting closed-loop system should be stable. The question of stability can then be answered by analysing the closed-loop poles along the iteration axis using standard results from multivariable polynomial systems theory. This convergence theory suggests that time-varying ILC control laws should be typically used instead of time-invariant control laws in order to guarantee good transient tracking behaviour. Based on this suggestion a new adaptive ILC algorithm is derived, which results in monotonic convergence for an arbitrary linear discrete-time plant. This adaptive algorithm also has important implications in terms of future research work—as a concrete example it demonstrates that ILC algorithms containing adaptive and time-varying components can result in enhanced convergence properties when compared to fixed parameter ILC algorithms. Hence it can be expected that further research on adaptive learning mechanisms will provide a new useful source of high-performance ILC algorithms.     

Monotonic convergence of iterative learning control systems with variable pass length

A growing number of researchers consider iterative learning control (ILC) a promising tool for numerous control problems in biomedical application systems. We will briefly discuss why classical ILC theory is technically too restrictive for some of these applications. Subsequently, we will extend the classical ILC design in the lifted systems framework to the class of repetitive trajectory tracking tasks with variable pass length. We will analyse the closed-loop dynamics for two standard learning laws, and we will discuss in which sense the tracking error can be reduced by which controller design strategies. Necessary and sufficient conditions for monotonic convergence will be derived. We then summarise all results in a set of practical controller design guidelines. Finally, a simulation study is presented, which demonstrates the usefulness of these guidelines and illustrates the special dynamics that occur in variable pass length learning.     

Set-point-related indirect iterative learning control for multi-input multi-output systems

A form of iterative learning control (ILC) is used to update the set-point for the local controller. It is referred to as set-point-related (SPR) indirect ILC. SPR indirect ILC has shown excellent performance: as a supervision module for the local controller, ILC can improve the tracking performance of the closed-loop system along the batch direction. In this study, an ILC-based P-type controller is proposed for multi-input multi-output (MIMO) linear batch processes, where a P-type controller is used to design the control signal directly and an ILC module is used to update the set-point for the P-type controller. Under the proposed ILC-based P-type controller, the closed-loop system can be transformed to a 2-dimensional (2D) Roesser s system. Based on the 2D system framework, a sufficient condition for asymptotic stability of the closed-loop system is derived in this paper. In terms of the average tracking error (ATE), the closed-loop control performance under the proposed algorithm can be improved from batch to batch, even though there are repetitive disturbances. A numerical example is used to validate the proposed results.     

Iterative Learning Control for Nonlinear Systems: A Bounded‐Error Algorithm

This paper presents a nonlinear iterative learning control (NILC) for nonlinear time‐varying systems. An algorithm of a new strategy for the NILC implementation is proposed. This algorithm ensures that trajectory‐tracking errors of the proposed NILC, when implemented, are bounded by a given error norm bound. A special feature of the algorithm is that the trial‐time interval is finite but not fixed as it is for the other iterative learning algorithms. A sufficient condition for convergence and robustness of the bounded‐error learning procedure is derived. With respect to the bounded‐error and standard learning processes applied to a virtual robot, simulation results are presented in order to verify maximal tracking errors, convergence and applicability of the proposed learning control.     

State Space Constrained Iterative Learning Control for Robotic Manipulators

Real‐life work operations of industrial robotic manipulators are performed within a constrained state space. Such operations most often require accurate planning and tracking a desired trajectory, where all the characteristics of the dynamic model are taken into consideration. This paper presents a general method and an efficient computational procedure for path planning with respect to state space constraints. Given a dynamic model of a robotic manipulator, the proposed solution takes into consideration the influence of all imprecisely measured model parameters, making use of iterative learning control (ILC). A major advantage of this solution is that it resolves the well‐known problem of interrupting the learning procedure due to a high transient tracking error or when the desired trajectory is planned closely to the state space boundaries. The numerical procedure elaborated here computes the robot arm motion to accurately track a desired trajectory in a constrained state space taking into consideration all the dynamic characteristics that influence the motion. Simulation results with a typical industrial robot arm demonstrate the robustness of the numerical procedure. In particular, the results extend the applicability of ILC in robot motion control and provide a means for improving the overall trajectory tracking performance of most robotic systems.     

Trajectory tracking control of port-controlled Hamiltonian systems via generalized canonical transformations

This paper addresses trajectory tracking control of port-controlled Hamiltonian systems via generalized canonical transformations and passivity-based control. The main strategy adopted in this paper is to construct an error system, which describes the dynamics of the tracking error, by a passive port-controlled Hamiltonian system. After obtaining the error system, tracking control of the original system can be achieved by stabilizing the error system via passivity-based approach. First, a fundamental framework is provided for constructing the error system via generalized canonical transformations. Then a concrete design procedure is derived for a class of electro-mechanical systems. Furthermore, the proposed method is applied to a magnetic levitation system and laboratory experiments demonstrate its effectiveness.     

Enhancing Iterative Learning Control With Fractional Power Update Law

The P-type update law has been the mainstream technique used in iterative learning control (ILC) systems, which resembles linear feedback control with asymptotical convergence. In recent years, finite-time control strategies such as terminal sliding mode control have been shown to be effective in ramping up convergence speed by introducing fractional power with feedback. In this paper, we show that such mechanism can equally ramp up the learning speed in ILC systems. We first propose a fractional power update rule for ILC of single-input-single-output linear systems. A nonlinear error dynamics is constructed along the iteration axis to illustrate the evolutionary converging process. Using the nonlinear mapping approach, fast convergence towards the limit cycles of tracking errors inherently existing in ILC systems is proven. The limit cycles are shown to be tunable to determine the steady states. Numerical simulations are provided to verify the theoretical results.      

Iterative learning control design with high‐order internal model for discrete‐time nonlinear systems

In this paper, a high‐order internal model (HOIM)‐based iterative learning control (ILC) scheme is proposed for discrete‐time nonlinear systems to tackle the tracking problem under iteration‐varying desired trajectories. By incorporating the HOIM that is utilized to describe the variation of desired trajectories in the iteration domain into the ILC design, it is shown that the system output can converge to the desired trajectory along the iteration axis within arbitrarily small error. Furthermore, the learning property in the presence of state disturbances and output noise is discussed under HOIM‐based ILC with an integrator in the iteration axis. Two simulation examples are given to demonstrate the effectiveness of the proposed control method. Copyright © 2016 John Wiley & Sons, Ltd.