Semirigid inclusions in elastic bodies: Mechanical interplay and optimal control

The paper concerns an analysis of an equilibrium problem for 2D elastic body with two semirigid inclusions. It is assumed that inclusions have a joint point, and we investigate a junction problem for these inclusions. The existence of solutions is proved, and different equivalent formulations of the problem are proposed. We investigate a convergence to infinity of a rigidity parameter of the semirigid inclusion. It is proved that in the limit, we obtain an equilibrium problem for the elastic body with a rigid inclusion and a semirigid one. A parameter identification problem is investigated. In particular, the existence of a solution to a suitable optimal control problem is proved.     

When Does Communication Learning Need Hierarchical Multi-Agent Deep Reinforcement Learning

Abstract

Multi-agent systems need to communicate to coordinate a shared task. We show that a recurrent neural network (RNN) can learn a communication protocol for coordination, even if the actions to coordinate are performed steps after the communication phase. We show that a separation of tasks with different temporal scale is necessary for successful learning. We contribute a hierarchical deep reinforcement learning model for multi-agent systems that separates the communication and coordination task from the action picking through a hierarchical policy. We further on show, that a separation of concerns in communication is beneficial but not necessary. As a testbed, we propose the Dungeon Lever Game and we extend the Differentiable Inter-Agent Learning (DIAL) framework. We present and compare results from different model variations on the Dungeon Lever Game.     

On one boundary problem for nonlinear stationary controlled system

The object of study is nonlinear stationary controlled system of ordinary differential equations with constant disturbance in the right part. The problem of constructing the synthesising control function providing the transfer of this system from the initial state to the origin is considered. The sufficiently simple for numerical implementation algorithm of solution of the above-mentioned problem is obtained. It is shown that for local null controllability of the considered system, it is sufficient that the conditions of the Kalman's type were satisfied. In addition, the estimates restricting the choice of initial conditions and external disturbances under which the transfer is guaranteed are obtained. The main idea of the method of construction of the desired control function consists in reducing the original problem to stabilisation of a special kind linear non-stationary system and solving the Cauchy problem for an auxiliary system of ordinary differential equations closed by stabilising control. The simplicity of the realisation of this algorithm is determined by the construction of the auxiliary system and its stabilisation that could be obtained by analytical methods. The effectiveness of the method is illustrated by solving the problem of crane control and its numerical simulation.     

Integration of imitation learning using GAIL and reinforcement learning using task-achievement rewards via probabilistic graphical model

The integration of reinforcement learning (RL) and imitation learning (IL) is an important problem that has long been studied in the field of intelligent robotics. RL optimizes policies to maximize the cumulative reward, whereas IL attempts to extract general knowledge about the trajectories demonstrated by experts, i.e, demonstrators. Because each has its own drawbacks, many methods combining them and compensating for each set of drawbacks have been explored thus far. However, many of these methods are heuristic and do not have a solid theoretical basis. This paper presents a new theory for integrating RL and IL by extending the probabilistic graphical model (PGM) framework for RL, control as inference. We develop a new PGM for RL with multiple types of rewards, called probabilistic graphical model for Markov decision processes with multiple optimality emissions (pMDP-MO). Furthermore, we demonstrate that the integrated learning method of RL and IL can be formulated as a probabilistic inference of policies on pMDP-MO by considering the discriminator in generative adversarial imitation learning (GAIL) as an additional optimality emission. We adapt the GAIL and task-achievement reward to our proposed framework, achieving significantly better performance than policies trained with baseline methods.     

结合优化支持向量机与K-means++的工控系统入侵检测方法

针对工业控制系统传统单一检测算法模型对不同攻击类型检测率和检测速度不佳的问题，提出一种优化支持向量机和K-means++算法结合的入侵检测模型。首先利用主成分分析法（PCA）对原始数据集进行预处理，消除其相关性；其次在粒子群优化（PSO）算法的基础上加入自适应变异过程避免在训练的过程中陷入局部最优解；然后利用自适应变异粒子群优化（AMPSO）算法优化支持向量机的核函数和惩罚参数；最后利用密度中心法改进K-means算法与优化后的支持向量机组合成入侵检测模型，从而实现工业控制系统的异常检测。实验结果表明，所提方法在检测速度和对各类攻击的检测率上得到明显提升。     

An energy-saving nonlinear position control strategy for electro-hydraulic servo systems

The electro-hydraulic servo system (EHSS) demonstrates numerous advantages in size and performance compared to other actuation methods. Oftentimes, its utilization in industrial and machinery settings is limited by its inferior efficiency. In this paper, a nonlinear backstepping control algorithm with an energy-saving approach is proposed for position control in the EHSS. To achieve improved efficiency, two control valves including a proportional directional valve (PDV) and a proportional relief valve (PRV) are used to achieve the control objectives. To design the control algorithm, the state space model equations of the system are transformed to their normal form and the control law through the PDV is designed using a backstepping approach for position tracking. Then, another nonlinear set of laws is derived to achieve energy-saving through the PRV input. This control design method, based on the normal form representation, imposes internal dynamics on the closed-loop system. The stability of the internal dynamics is analyzed in special cases of operation. Experimental results verify that both tracking and energy-saving objectives are satisfied for the closed-loop system.     

Maneuverability modeling and trajectory tracking for fish robot

This study develops a 6-DOF mathematical model for a robotic fish that considers surge, sway, heave, roll, pitch, and yaw. The model considers the conditions of a fish swimming in ocean current perturbations similar to the ocean current perturbations of the slender-body autonomous underwater vehicles. For swimming and turning behaviors, a nonlinear, dynamic, carangiform locomotion model is derived by using a planar four-link model. A 2-DOF barycenter mechanism is proposed to provide body stabilization and to serve as an actuating device for active control design. A barycenter control scheme is developed to change the center of gravity of the robot fish body by moving balancing masses along two axes. The projected torque on x and y axes propel pitch and roll angles to the desired settings. A Stabilizing controller, fish-tail mechanism, rigid body dynamics, and kinematics are incorporated to enable the fish robot to move in three dimensional space. Simulation results have demonstrated maneuverability and control system performance of the developed controller which is proposed to conduct path tracking of the robot fish as it swims under current perturbations.     

Improved synergetic excitation control for transient stability enhancement and voltage regulation of power systems

This paper proposes decentralized improved synergetic excitation controllers (ISEC) for synchronous generators to enhance transient stability and obtain satisfactory voltage regulation performance of power systems. Each generator is considered as a subsystem, for which an ISEC is designed. According to the control objectives, a manifold, which is a linear combination of the deviation of generator terminal voltage, rotor speed and active power, is chosen for the design of ISEC. Compared with the conventional synergetic excitation controller (CSEC), a parameter adaptation scheme is proposed for updating the controller parameter online in order to improve the transient stability and voltage regulation performance simultaneously under various operating conditions. Case studies are undertaken on a single-machine infinite-bus power system and a two-area four-machine power system, respectively. Simulation results show the ISEC can provide better damping and voltage regulation performance, compared with the CSEC without parameter adaptation scheme and the conventional power system stabilizer.     

Delay compensated control of the Stefan problem and robustness to delay mismatch

This paper presents a control design for the one‐phase Stefan problem under actuator delay via a backstepping method. The Stefan problem represents a liquid‐solid phase change phenomenon which describes the time evolution of a material's temperature profile and the interface position. The actuator delay is modeled by a first‐order hyperbolic partial differential equation (PDE), resulting in a cascaded transport‐diffusion PDE system defined on a time‐varying spatial domain described by an ordinary differential equation (ODE). Two nonlinear backstepping transformations are utilized for the control design. The setpoint restriction is given to guarantee a physical constraint on the proposed controller for the melting process. This constraint ensures the exponential convergence of the moving interface to a setpoint and the exponential stability of the temperature equilibrium profile and the delayed controller in the norm. Furthermore, robustness analysis with respect to the delay mismatch between the plant and the controller is studied, which provides analogous results to the exact compensation by restricting the control gain.     

生姜主要病虫害及其防治技术分析

生姜的根状茎为使用部分,其中包含姜油酮、姜油醇、姜油酚、蛋白质、粗脂肪、糖,并且钙、铁的含量也较为丰富,是人们日常生活当中不可或缺的调味品,还能够加工成为姜片、糖姜片和盐姜片等诸多食品,其在医药方面的应用也较为广泛,备受人们的推崇与喜爱。我国在生姜栽培方面的历史较为悠久,技术也较为成熟,每年生姜出口贸易都能为我国带来非常可观的经济效益。