Lifelong Adaptation in Heterogeneous Multi-Robot Teams: Response to Continual Variation in Individual Robot Performance

Generating teams of robots that are able to perform their tasks over long periods of time requires the robots to be responsive to continual changes in robot team member capabilities and to changes in the state of the environment and mission. In this article, we describe the L-ALLIANCE architecture, which enables teams of heterogeneous robots to dynamically adapt their actions over time. This architecture, which is an extension of our earlier work on ALLIANCE, is a distributed, behavior-based architecture aimed for use in applications consisting of a collection of independent tasks. The key issue addressed in L-ALLIANCE is the determination of which tasks robots should select to perform during their mission, even when multiple robots with heterogeneous, continually changing capabilities are present on the team. In this approach, robots monitor the performance of their teammates performing common tasks, and evaluate their performance based upon the time of task completion. Robots then use this information throughout the lifetime of their mission to automatically update their control parameters. After describing the L-ALLIANCE architecture, we discuss the results of implementing this approach on a physical team of heterogeneous robots performing proof-of-concept box pushing experiments. The results illustrate the ability of L-ALLIANCE to enable lifelong adaptation of heterogeneous robot teams to continuing changes in the robot team member capabilities and in the environment.     

Fuzzy logic decision making for multi-robot security systems

The paper proposes a fuzzy logic decision making system for security robots that deals with multiple tasks with dynamically changing scene. The tasks consist of patrolling the environment, inspecting for missing items, chasing and disabling intruders, and guarding the area. The decision making considers robot limitations such as maximum floor coverage per robot and remaining robot battery energy, as well as cooperation among robots to complete the mission. Each robot agent makes its own decision based on its internal information as well as information broadcast to it by other robots about events such as intruder sighting. As a result the multi-robot security system is distributive without a central coordinator. The system has been implemented both in simulations and on actual robots and its performance has been verified under different scenarios.     

Effective landmark placement for accurate and reliable mobile robot navigation

Being able to navigate accurately is one of the fundamental capabilities of a mobile robot to effectively execute a variety of tasks including docking, transportation, and manipulation. As real-world environments often contain changing or ambiguous areas, existing features can be insufficient for mobile robots to establish a robust navigation behavior. A popular approach to overcome this problem and to achieve accurate localization is to use artificial landmarks. In this paper, we consider the problem of optimally placing such artificial landmarks for mobile robots that repeatedly have to carry out certain navigation tasks. Our method aims at finding the minimum number of landmarks for which a bound on the maximum deviation of the robot from its desired trajectory can be guaranteed with high confidence. The proposed approach incrementally places landmarks utilizing linearized versions of the system dynamics of the robot, thus allowing for an efficient computation of the deviation guarantee. We evaluate our approach in extensive experiments carried out both in simulations and with real robots. The experiments demonstrate that our method outperforms other approaches and is suitable for long-term operation of mobile robots.     

Design of a modular assembly of four-footed robots with multiple functions

Modern industries use many types of robots. In addition to general robotic arms, bipedal, tripedal, and quadrupedal robots, which were originally developed as toys, are gradually being used for multiple applications in manufacturing processes. This research begins with establishing the platform for four-footed robots with multiple functions, high sensitivity, and modular assembly and this is how a fundamental model of the industrial robots is constructed. Under additional loads, the four feet of the quadrupedal robot reinforce its carrying ability and reliability compared to bipedal or tripedal robots, which helps it to carry more objects and enhances functionality. Based on different requirements and demands from the manufacturing processes, the highly sensitive four-footed robot provides an expandable interface to add different sensing components. In addition, when combined with a wireless communication module or independent 1.2 GHz radio frequency CCD wireless image transmission system, the user can control the robot remotely and instantly. The design helps the four-footed robot to expand its applications. By assembling and disassembling modules and changing the sensing components, the highly sensitive four-footed robot can be used for different tasks. Moreover, the remote control function of the robot will increase interaction with human beings, so it can become highly become involved in people's lives. The platform of the four-footed robot will become a design reference for the commercialization of different industrial robots, and it will provide the design of industrial robots with more options and useful applications.     

自重构机器人的自组织变形

本文深入研究了自重构机器人实现自组织变形的基本方法．首先根据自重构机器人 系统结构的基本特征提出一种描述模型，可以对各类模块化自重构机器人的拓扑结构进行统 一描述．然后提出一种建立在全离散的局部智能基础上的自重构机器人的自组织变形策略， 通过建立适当的模块运动规则和规则进化使机器人由局部自主运动产生全局系统自组织的结 果．     

CONRO: Towards Deployable Robots with Inter-Robots Metamorphic Capabilities

Metamorphic robots are modular robots that can reconfigure their shape. Such capability is desirable in tasks such as earthquake search and rescue and battlefield surveillance and scouting, where robots must go through unexpected situations and obstacles and perform tasks that are difficult for fixed-shape robots. The capabilities of the robots are determined by the design specification of their modules. In this paper, we present the design specification of a CONRO module, a small, self-sufficient and relatively homogeneous module that can be connected to other modules to form complex robots. These robots have not only the capability of changing their shape (intra-robot metamorphing) but also can split into smaller robots or merge with other robots to create a single larger robot (inter-robot metamorphing), i.e., CONRO robots can alter their shape and their size. Thus, heterogeneous robot teams can be built with homogeneous components. Furthermore, the CONRO robots can separate the reconfiguration stage from the locomotion stage, allowing the selection of configuration-dependent gaits. The locomotion and automatic inter-module docking capabilities of such robots were tested using tethered prototypes that can be reconfigured manually. We conclude the paper discussing the future work needed to fully realize the construction of these robots.     

Optimized Stochastic Policies for Task Allocation in Swarms of Robots

We present a scalable approach to dynamically allocating a swarm of homogeneous robots to multiple tasks, which are to be performed in parallel, following a desired distribution. We employ a decentralized strategy that requires no communication among robots. It is based on the development of a continuous abstraction of the swarm obtained by modeling population fractions and defining the task allocation problem as the selection of rates of robot ingress and egress to and from each task. These rates are used to determine probabilities that define stochastic control policies for individual robots, which, in turn, produce the desired collective behavior. We address the problem of computing rates to achieve fast redistribution of the swarm subject to constraint(s) on switching between tasks at equilibrium. We present several formulations of this optimization problem that vary in the precedence constraints between tasks and in their dependence on the initial robot distribution. We use each formulation to optimize the rates for a scenario with four tasks and compare the resulting control policies using a simulation in which 250 robots redistribute themselves among four buildings to survey the perimeters.      

IAda: A language for robot programming based on Ada

We present a programming language for robots which we have implemented based on the Ada language. It is an interpreted language which permits dynamic configuration of software. It manipulates Ada tasks and subroutines. One of the Ada tasks is an inference engine of a logic programming language adapted to real-time constraints. We show how the conjunction of Ada tasks, to perform perception and action functions on the robot, to logic programs, for the control of these tasks, both manipulated by the IAda language, gives a powerful environment for robot programming.     

基于变胞机构的移动机器人构型设计研究综述

基于传统机构设计的移动机器人,由于机构运动关系相对固定、配置形式单一,难以在复杂地形中快速通行。变胞机构是一种全新的机构组合形式,在瞬时能使某些构件发生合并和分离,使机构有效构件数或自由度数发生变化,具有较强的环境适应性。变胞机构设计的移动机器人可以将速度、灵活性和稳定性集于一体,实现移动机器人在复杂环境中的快速移动。本文针对变胞机构及其移动机器人的构型设计、运动原理、驱动方式及空间配置进行了综述,归纳了现有基于变胞机构的移动机器人所面临的关键问题和技术进展,并对变胞机器人的未来发展方向进行了展望,为变胞移动机器人的发展提供参考。     

A closed-loop approach for tracking a humanoid robot using particle filtering and depth data

Humanoid robots introduce instabilities during biped march that complicate the process of estimating their position and orientation along time. Tracking humanoid robots may be useful not only in typical applications such as navigation, but in tasks that require benchmarking the multiple processes that involve registering measures about the performance of the humanoid during walking. Small robots represent an additional challenge due to their size and mechanic limitations which may generate unstable swinging while walking. This paper presents a strategy for the active localization of a humanoid robot in environments that are monitored by external devices. The problem is faced using a particle filter method over depth images captured by an RGB-D sensor in order to effectively track the position and orientation of the robot during its march. The tracking stage is coupled with a locomotion system controlling the stepping of the robot toward a given oriented target. We present an integral communication framework between the tracking and the locomotion control of the robot based on the robot operating system, which is capable of achieving real-time locomotion tasks using a NAO humanoid robot.     

Repeated auctions for robust task execution by a robot team

We present empirical results of an auction-based algorithm for dynamic allocation of tasks to robots. The results have been obtained both in simulation and using real robots. A distinctive feature of our algorithm is its robustness to uncertainties and to robot malfunctions that happen during task execution, when unexpected obstacles, loss of communication, and other delays may prevent a robot from completing its allocated tasks. Therefore tasks not yet achieved are resubmitted for bids every time a task has been completed. This provides an opportunity to improve the allocation of the remaining tasks, enabling the robots to recover from failures and reducing the overall time for task completion.     

An anatomy of industrial robots and their controls

In the United States, commercially available industrial robots perform very well in limited areas of industrial tasks such as arc welding, paint spraying, etc. These tasks mainly involve synchronization but no task interaction. A close examination of the basic structure and controls of the robots reveals their resulting limitations which lead to unnatural specifications and inefficient performance of task interactions. It is our opinion that, to expand the range of robot tasks to include labor intensive jobs such as product assembly, sensors of multiple purposes must be added onto the robots and integrated into their control systems. Computer command language must be developed to enable nonexpert users to operate the robots, and a work-method must be available for analyzing robot time-motion so that the robots can be programmed to achieve best efficiency with least production cost.     

A visual path-following learning approach for industrial robots using DRL

Manufacturing companies are in constant need for improved agility. An adequate combination of speed, responsiveness, and business agility to cope with fluctuating raw material costs is essential for today’s increasingly demanding markets. Agility in robots is key in operations requiring on-demand control of a robot’s tool position and orientation, reducing or eliminating extra programming efforts. Vision-based perception using full-state or partial-state observations and learning techniques are useful to create truly adaptive industrial robots. We propose using a Deep Reinforcement Learning (DRL) approach to solve path-following tasks using a simplified virtual environment with domain randomisation to provide the agent with enough exploration and observation variability during the training to generate useful policies to be transferred to an industrial robot. We validated our approach using a KUKA KR16HW robot equipped with a Fronius GMAW welding machine. The path was manually drawn on two workpieces so the robot was able to perceive, learn and follow it during welding experiments. It was also found that small processing times due to motion prediction (3.5 ms) did not slow down the process, which resulted in smooth robot operations. The novel approach can be implemented onto different industrial robots to carry out different tasks requiring material deposition.     

模块化机器人拓扑重构规划研究

模块化可重构机器人由若干个相同的机器人模块组合装配而成,能够重构成不同的几何形态和结构,从而适应不同的作业任务要求。本论文主要对树状拓扑结构的模块化机器人的重构规划问题进行了研究,定义了构型重构的基本概念,提出了分支重构规划算法。这类模块化可重构机器人可以用树状拓扑结构图来描述。机器人的拓扑结构从自由树转化为有根树,然后分解为若干个分支结构,并按一定顺序排列,通过对各个分支结构的逐步比较和操作,完成重构过程。最后选定模块数目,进行了重构规划过程的仿真计算。结果表明,文中所述算法对于树状拓扑结构的模块化机器人的重构规划问题是有效的。     

Describing Upper-Body Motions Based on Labanotation for Learning-from-Observation Robots

We have been developing a paradigm that we call learning-from-observation for a robot to automatically acquire a robot program to conduct a series of operations, or for a robot to understand what to do, through observing humans performing the same operations. Since a simple mimicking method to repeat exact joint angles or exact end-effector trajectories does not work well because of the kinematic and dynamic differences between a human and a robot, the proposed method employs intermediate symbolic representations, tasks, for conceptually representing what-to-do through observation. These tasks are subsequently mapped to appropriate robot operations depending on the robot hardware. In the present work, task models for upper-body operations of humanoid robots are presented, which are designed on the basis of Labanotation. Given a series of human operations, we first analyze the upper-body motions and extract certain fixed poses from key frames. These key poses are translated into tasks represented by Labanotation symbols. Then, a robot performs the operations corresponding to those task models. Because tasks based on Labanotation are independent of robot hardware, different robots can share the same observation module, and only different task-mapping modules specific to robot hardware are required. The system was implemented and demonstrated that three different robots can automatically mimic human upper-body operations with a satisfactory level of resemblance.     

Smooth continuous transition between tasks on a kinematic control level: Obstacle avoidance as a control problem

Kinematically redundant robots allow simultaneous execution of several tasks with different priorities. Beside the main task, obstacle avoidance is one commonly used subtask. The ability to avoid obstacles is especially important when the robot is working in a human environment. In this paper, we propose a novel control method for kinematically redundant robots, where we focus on a smooth, continuous transition between different tasks. The method is based on a new and very simple null-space formulation. Sufficient conditions for the tasks design are given using the Lyapunov-based stability discussion. The effectiveness of the proposed control method is demonstrated by simulation and on a real robot. Pros and cons of the proposed method and the comparison with other control methods are also discussed.     

Global behavior via cooperative local control

The purpose of this paper is twofold. First, we outline important issues in designing real-time controllers for robots with numerous sensors, actuators, and behaviors. We address these issues by implementing a behavior based controller on a sophisticated autonomous robot. Hence, this work provides a point of reference for the scalability, ease of design, and effectiveness of the behavior based control for complex robots. Second, we explore the viability of using cooperation among local controllers to achieve coherent global behavior. Our approach is to decompose a difficult control task for a complex robot into a multitude of simpler control tasks for robotic subsystems. We illustrate and examine the effectiveness of this approach via rough terrain locomotion using an autonomous hexapod robot. Traversing rough terrain is a good task to test the viability of this approach because it requires a considerable amount of leg coordination. We found that implementing a complicated global control task with cooperating local controllers can effectively control complex robots.Support for this research was provided in part by a NASA Graduate Student Researcher Program Fellowship administered through the Jet Propulsion Laboratory, by Jet Propulsion Laboratory grant 959333, and by the Advanced Research Projects Agency under Office of Naval Research contract N00014-91-J-4038.     

无人仓多搬运机器人协同作业轨迹自动控制研究

由于无人仓多搬运机器人协同作业线路较为复杂,导致协同作业轨迹控制难度增加,为了保证多搬运机器人能够按照规划路线执行搬运作业,提出了无人仓多搬运机器人协同作业轨迹自动控制方法。采用栅格图建模法,结合无人仓内货架的实际分布情况,建立无人仓环境场景。从组成结构、运动学以及动力学三个方面,构建搬运机器人的数学模型。遵循就近原则分配多机器人搬运任务,规划多搬运机器人的协同作业轨迹,根据多搬运机器人实时位姿的自动检测结果计算控制量,利用作业轨迹自动控制器的安装与运行,完成无人仓多搬运机器人协同作业轨迹的自动控制任务。实验结果表明,在该方法应用后,多搬运机器人在无人仓中的作业轨迹与规划轨迹基本相同,计算得出的平均位置控制误差和姿态角控制误差分别为2.27cm和0.05°,搬运机器人的碰撞次数能被控制在规定范围内,实际应用效果好。     

Research into the application of AI robots in community home leisure interaction

This paper focuses on comprehensive application of artificial intelligence robots for community-based leisure interaction. We propose a multiple-layer perceptron network to design and implement the intelligent interactive home robot system, which includes establishment of an environment map, autonomous navigation, obstacle-avoidance control and human–machine interaction, to complete the positioning and perception functions required by the robot in the home environment. With this system, community residents use an interactive interface to manipulate robots remotely and create an environmental map. In order for the robot to adapt in this changing environment, the robot needs to have a completely autonomous navigation and obstacle-avoidance-control system. In this study, a long-distance obstacle-avoidance fuzzy system and a short-distance anti-fall obstacle-avoidance fuzzy system were used to enable the robot to accommodate unforeseen changes. This technology proved itself capable of navigating a home environment, ensuring that the robot could instantaneously dodge nearby obstacles and correcting the robot’s path of travel. At the same time, it could prevent the robot from falling off a high dropping point and thereby effectively control the robot’s movement trajectory. After combining the above-mentioned multi-sensor and image recognition functions, the intelligent interactive home robot showed that it clearly has the ability to integrate vision, perception and interaction, and we were able to verify that the robot has the necessary adaptability in changing environments and that the design of such interactive robots can be an asset in the home.

     

Centralized sensing and control of multiple mobile robots

We discuss the development ideas and merits of a single centralized station to provide supervision, sensing, control, intelligence and perhaps power to a colony of robots, organized for the performance of specific tasks. The consequence of such an approach is that each robot can be much simpler, smaller and less expensive, since no on-board sensing, control and intelligence are required. The issues to be studied concern tradeoffs in control (bandwidth, accuracy, channel capacity); relations between numbers of controllable robots and task suitability and representation for control.