Adaptive backstepping repetitive learning control design for nonlinear discrete‐time systems with periodic uncertainties

This paper addresses a tracking problem for uncertain nonlinear discrete‐time systems in which the uncertainties, including parametric uncertainty and external disturbance, are periodic with known periodicity. Repetitive learning control (RLC) is an effective tool to deal with periodic unknown components. By using the backstepping procedures, an adaptive RLC law with periodic parameter estimation is designed. The overparameterization problem is overcome by postponing the parameter estimation to the last backstepping step, which could not be easily solved in robust adaptive control. It is shown that the proposed adaptive RLC law without overparameterization can guarantee the perfect tracking and boundedness of the states of the whole closed‐loop systems in presence of periodic uncertainties. In addition, the effectiveness of the developed controller is demonstrated by an implementation example on a single‐link flexible‐joint robot. Copyright © 2014 John Wiley & Sons, Ltd.     

Hybrid make-to-stock and make-to-order systems: a taxonomic review

Production planning and control (PPC) systems that employ aspects from both make-to-order (MTO) and make-to-stock (MTS) production control are known as hybrid MTS/MTO systems. While both MTO and MTS separately have been studied extensively, their combined use has received less attention. However, the literature on this topic is growing and this paper shows that the review performed in this paper is an important addition to the field. We categorise relevant literature according to a novel taxonomy and show that hybrid MTS/MTO production control can be used in different contexts. In addition, an overview of the modelling techniques and methods used in these papers is provided. Based on the reviewed literature, relevant research questions and directions for future research are identified. Finally, it is shown that hybrid MTS/MTO production control is prevalent in practice by discussing research with industrial applications. The paper contains an overview of research on hybrid MTS/MTO production control to be used as reference for researchers active in the field, and provides managerial insights and directions for future research on this topic.     

Deposition of UF5 on the surface of steel material having oxide coating in contact with gaseous UF6

When UF6 is handled in leak tight system, the amount of uranium compound formed on the surface of containers, valves, and others in UF6 handling facilities is not so significant for a short term that special attention has not been given to this problem. The present work was done to throw some more light on this problem based on the recent experiment. We discuss the possibility that the intermolecular transfer of a fluorine atom from UF6 to UF5 may participate in the formation of uranium compound. The discussion includes also the unique features contained in the experimental result, the reaction processes assumed in this problem, and the derivation of a rate equation for expressing the deposition of uranium compound. Furthermore, we propose a new method for determining nonlinear parameters included in a governing differential equation having two variables for expressing the deposition of uranium compound from experimental raw data.     

When Does Communication Learning Need Hierarchical Multi-Agent Deep Reinforcement Learning

Abstract

Multi-agent systems need to communicate to coordinate a shared task. We show that a recurrent neural network (RNN) can learn a communication protocol for coordination, even if the actions to coordinate are performed steps after the communication phase. We show that a separation of tasks with different temporal scale is necessary for successful learning. We contribute a hierarchical deep reinforcement learning model for multi-agent systems that separates the communication and coordination task from the action picking through a hierarchical policy. We further on show, that a separation of concerns in communication is beneficial but not necessary. As a testbed, we propose the Dungeon Lever Game and we extend the Differentiable Inter-Agent Learning (DIAL) framework. We present and compare results from different model variations on the Dungeon Lever Game.     

On one boundary problem for nonlinear stationary controlled system

The object of study is nonlinear stationary controlled system of ordinary differential equations with constant disturbance in the right part. The problem of constructing the synthesising control function providing the transfer of this system from the initial state to the origin is considered. The sufficiently simple for numerical implementation algorithm of solution of the above-mentioned problem is obtained. It is shown that for local null controllability of the considered system, it is sufficient that the conditions of the Kalman's type were satisfied. In addition, the estimates restricting the choice of initial conditions and external disturbances under which the transfer is guaranteed are obtained. The main idea of the method of construction of the desired control function consists in reducing the original problem to stabilisation of a special kind linear non-stationary system and solving the Cauchy problem for an auxiliary system of ordinary differential equations closed by stabilising control. The simplicity of the realisation of this algorithm is determined by the construction of the auxiliary system and its stabilisation that could be obtained by analytical methods. The effectiveness of the method is illustrated by solving the problem of crane control and its numerical simulation.     

An energy-saving nonlinear position control strategy for electro-hydraulic servo systems

The electro-hydraulic servo system (EHSS) demonstrates numerous advantages in size and performance compared to other actuation methods. Oftentimes, its utilization in industrial and machinery settings is limited by its inferior efficiency. In this paper, a nonlinear backstepping control algorithm with an energy-saving approach is proposed for position control in the EHSS. To achieve improved efficiency, two control valves including a proportional directional valve (PDV) and a proportional relief valve (PRV) are used to achieve the control objectives. To design the control algorithm, the state space model equations of the system are transformed to their normal form and the control law through the PDV is designed using a backstepping approach for position tracking. Then, another nonlinear set of laws is derived to achieve energy-saving through the PRV input. This control design method, based on the normal form representation, imposes internal dynamics on the closed-loop system. The stability of the internal dynamics is analyzed in special cases of operation. Experimental results verify that both tracking and energy-saving objectives are satisfied for the closed-loop system.     

Delay compensated control of the Stefan problem and robustness to delay mismatch

This paper presents a control design for the one‐phase Stefan problem under actuator delay via a backstepping method. The Stefan problem represents a liquid‐solid phase change phenomenon which describes the time evolution of a material's temperature profile and the interface position. The actuator delay is modeled by a first‐order hyperbolic partial differential equation (PDE), resulting in a cascaded transport‐diffusion PDE system defined on a time‐varying spatial domain described by an ordinary differential equation (ODE). Two nonlinear backstepping transformations are utilized for the control design. The setpoint restriction is given to guarantee a physical constraint on the proposed controller for the melting process. This constraint ensures the exponential convergence of the moving interface to a setpoint and the exponential stability of the temperature equilibrium profile and the delayed controller in the norm. Furthermore, robustness analysis with respect to the delay mismatch between the plant and the controller is studied, which provides analogous results to the exact compensation by restricting the control gain.     

Improved Input and State Estimation for Linear Stochastic Systems with Direct Feedthrough

This paper is concerned with the problem of joint input and state estimation for linear stochastic systems with direct feedthrough. Based on the fact that each unknown input between any two time steps is always bounded, a novel improved algorithm is proposed. Compared with existing results, this algorithm can effectively enhance estimation accuracy. Moreover, the stability of the algorithm is also discussed. Finally, an illustrative example is given to demonstrate the effectiveness of the proposed approach.     

Filtered adaptive constrained sampled-data control for uncertain multivariable nonlinear systems

A filtered adaptive constrained sampled-data controller for uncertain multivariable nonlinear systems in the presence of various constraints is synthesized in this paper. A piecewise constant adaptive law drives that estimation error dynamics to zero at each sampling time instant yields adaptive parameters. The filtered control scheme consists of two components. Based on an estimation/cancellation strategy, a disturbance rejection control law is designed to compensate the nonlinear uncertainties within the bandwidth of low-pass filters, whereas a constraint violation avoidance control law is designed to solve an online constrained optimization problem. Although a reduced sampling time helps to minimize the estimation error caused by the neglect of unknowns, the resulting aggressive signals put more restrictions on the control law. Greater sacrifice of tracking performance is required to satisfy the constraints. The constraints violation avoidance control law is in favor of a larger sampling time. Sufficient conditions are given to guarantee the stability of the closed-loop system with the sampled-data controller, where the input/output signals are held constant over the sampling period. Numerical examples are provided to validate the theoretical results, comparisons between the constrained sampled-data controller and unconstrained adaptive controller with the implementation of different sampling times are carried out.