CAMPOUT: a control architecture for tightly coupled coordination of multirobot systems for planetary surface exploration

Exploration of high risk terrain areas such as cliff faces and site construction operations by autonomous robotic systems on Mars requires a control architecture that is able to autonomously adapt to uncertainties in knowledge of the environment. We report on the development of a software/hardware framework for cooperating multiple robots performing such tightly coordinated tasks. This work builds on our earlier research into autonomous planetary rovers and robot arms. Here, we seek to closely coordinate the mobility and manipulation of multiple robots to perform examples of a cliff traverse for science data acquisition, and site construction operations including grasping, hoisting, and transport of extended objects such as large array sensors over natural, unpredictable terrain. In support of this work we have developed an enabling distributed control architecture called control architecture for multirobot planetary outposts (CAMPOUT) wherein integrated multirobot mobility and control mechanisms are derived as group compositions and coordination of more basic behaviors under a task-level multiagent planner. CAMPOUT includes the necessary group behaviors and communication mechanisms for coordinated/cooperative control of heterogeneous robotic platforms. In this paper, we describe CAMPOUT, and its application to ongoing physical experiments with multirobot systems at the Jet Propulsion Laboratory in Pasadena, CA, for exploration of cliff faces and deployment of extended payloads.     

Experimental Testbed for Large Multirobot Teams

Experimental validation is particularly important in multi-robot systems research. The differences between models and real-world conditions that may not be apparent in single robot experiments are amplified because of the large number of robots, interactions between robots, and the effects of asynchronous and distributed control, sensing, and actuation. Over the last two years, we have developed an experimental testbed to support research in multirobot systems with the goal of making it easy for users to model, design, benchmark, and validate algorithms. In this article, we describe our approach to the design of a large-scale multirobot system for the experimental verification and validation of a variety of distributed robotic applications in an indoor environment.     

Current research in multirobot systems

As research progresses in distributed robotic systems, more and more aspects of multirobot systems are being explored. This article describes advances in multirobot systems, and surveys the current state of the art. The focus is principally on research that has been demonstrated in physical robot implementations. I have identified eight primary research topics within multirobot systems—biological inspirations, communication, architectures, localization/mapping/exploration, object transport and manipulation, motion coordination, reconfigurable robots, and learning—and discuss the current state of research in these areas. As I describe each research area, I identify some key open issues in multirobot team research, and conclude by identifying several additional open research issues in distributed mobile robotic systems. This work was presented, in part, at the Seventh International Symposium on Artificial Life and Robotics, Oita, Japan, January 16–18, 2002     

A flooding algorithm for multirobot exploration

In this paper, we present a multirobot exploration algorithm that aims at reducing the exploration time and to minimize the overall traverse distance of the robots by coordinating the movement of the robots performing the exploration. Modeling the environment as a tree, we consider a coordination model that restricts the number of robots allowed to traverse an edge and to enter a vertex during each step. This coordination is achieved in a decentralized manner by the robots using a set of active landmarks that are dropped by them at explored vertices. We mathematically analyze the algorithm on trees, obtaining its main properties and specifying its bounds on the exploration time. We also define three metrics of performance for multirobot algorithms. We simulate and compare the performance of this new algorithm with those of our multirobot depth first search (MR-DFS) approach presented in our recent paper and classic single-robot DFS.     

Stability Analysis for Prioritized Closed-Loop Inverse Kinematic Algorithms for Redundant Robotic Systems

Stability analysis of priority-based kinematic control algorithms for redundant robotic systems is approached in this paper. Starting from the classical applications in position control of manipulators, the kinematic-based approaches have lately been applied to, e.g., visual servoing and quadruped or multirobot coordination control. A common approach consists in the definition of several tasks properly combined in priority. In this paper, by resorting to a Lyapunov-based stability discussion for several prioritized inverse kinematics algorithms, sufficient conditions for the control gains and the tasks' design are given for the regulation problem. Two case studies show the practical implementation of the results.     

一种多机器人任务规划算法及其系统实现

针对多机器人任务规划问题,提出了一种蚁群集中式规划方法,建立了任务分配和路由规划的蚁群算法描述模型,并利用局部搜索策略改进了蚁群算法分配效果,实现了多机器人集中任务规划系统.利用该系统平台,进行了大量的实验分析.结果表明,蚁群算法能有效解决多机器人任务规划问题,为多机器人协作机制提供了新思路.     

动态环境下分布式异构多机器人避障方法研究

多机器人系统在联合搜救、智慧车间、智能交通等领域得到了日益广泛的应用。目前,多个机器人之间、机器人与动态环境之间的路径规划和导航避障仍需依赖精确的环境地图,给多机器人系统在非结构环境下的协调与协作带来了挑战。针对上述问题,本文提出了不依赖精确地图的分布式异构多机器人导航避障方法,建立了基于深度强化学习的多特征策略梯度优化算法,并考虑了人机协同环境下的社会范式,使分布式机器人能够通过与环境的试错交互,学习最优的导航避障策略;并在Gazebo仿真环境下进行了最优策略的训练学习,同时将模型移植到多个异构实体机器人上,将机器人控制信号解码,进行真实环境测试。实验结果表明:本文提出的多特征策略梯度优化算法能够通过自学习获得最优的导航避障策略,为分布式异构多机器人在动态环境下的应用提供了一种技术参考。     

Team NimbRo at MBZIRC 2017: Fast landing on a moving target and treasure hunting with a team of micro aerial vehicles

The Mohamed Bin Zayed International Robotics Challenge (MBZIRC) 2017 has defined ambitious new benchmarks to advance the state‐of‐the‐art in autonomous operation of ground‐based and flying robots. This study covers our approaches to solve the two challenges that involved micro aerial vehicles (MAV). Challenge 1 required reliable target perception, fast trajectory planning, and stable control of an MAV to land on a moving vehicle. Challenge 3 demanded a team of MAVs to perform a search and transportation task, coined “Treasure Hunt,” which required mission planning and multirobot coordination as well as adaptive control to account for the additional object weight. We describe our base MAV setup and the challenge‐specific extensions, cover the camera‐based perception, explain control and trajectory‐planning in detail, and elaborate on mission planning and team coordination. We evaluated our systems in simulation as well as with real‐robot experiments during the competition in Abu Dhabi. With our system, we—as part of the larger team NimbRo—won the MBZIRC Grand Challenge and achieved a third place in both subchallenges involving flying robots.     

Robot Teams for Intervention in Confined and Structured Environments

Safety, security, and rescue robotics can be extremely useful in emergency scenarios such as mining accidents or tunnel collapses where robot teams can be used to carry out cooperative exploration, intervention, or logistic missions. Deploying a multirobot team in such confined environments poses multiple challenges that involve task planning, motion planning, localization and mapping, safe navigation, coordination, and communications among all the robots. To complete their mission, robots have to be able to move in the environment with full autonomy while at the same time maintaining communication among themselves and with their human operators to accomplish team collaboration. Guaranteeing connectivity enables robots to explicitly exchange information needed in the execution of collaborative tasks and allows operators to monitor and teleoperate the robots and receive information about the environment. In this work, we present a system that integrates several research aspects to achieve a real exploration exercise in a tunnel using a robot team. These aspects are as follows: deployment planning, semantic feature recognition, multirobot navigation, localization, map building, and real‐time communications. Two experimental scenarios have been used for the assessment of the system. The first is the Spanish Santa Marta mine, a large mazelike environment selected for its complexity for all the tasks involved. The second is the Spanish‐French Somport tunnel, an old railway between Spain and France through the Central Pyrenees, used to carry out the real‐world experiments. The latter is a simpler scenario, but it serves to highlight the real communication issues.     

A bounded controller for multirobot navigation while maintaining network connectivity in the presence of obstacles

Maintaining the connectivity of networked robots is a challenge in multirobot applications. In this paper, this challenging problem is addressed through the development of a novel controller that can guarantee that robots will approach their individual desired positions while maintaining existing network topology and avoiding obstacles. A new concept of connectivity constraint, along with a continuous modeling approach to obstacle avoidance, is utilized in building the navigation function. The designed potential field integrates the navigation requirement, connectivity constraint, and obstacle avoidance simultaneously, based on which a bounded control input is generated for multirobot control. It is shown that if the initial configurations of the robots are connected and the desired configuration is reachable, the proposed controller is capable of driving multirobots to their individual goal positions conditionally while keeping the underlying network connected. Simulations and experiments are finally performed using a group of mobile robots to demonstrate the effectiveness of the proposed controller.     

多机器人编队离散模型及队形控制稳定性分析

针对包含绕心运动情况下的多机器人编队进行离散建模,并利用该模型解决保持队形期望前端始终朝着编队前进方向的控制问题.以控制多机器人编队收敛到期望的队形并镇定到预设运动规律上为目标,定义了一类通信拓扑图,基于该类图提出了一种分布式协同控制算法.给出了该控制算法下编队系统渐进稳定的充分必要条件及反馈控制参数的收敛域.证明了在该充分必要条件下可实现编队收敛到期望的队形和预设运动规律上的目标.仿真实验表明,在该算法控制下多机器人编队较好地收敛到期望队形并按预设规律运动,且过程中始终保持队形期望前端朝着编队前进方向,进而验证了该算法的有效性和正确性.     

Local communication of multiple mobile robots: Design of optimal communication area for cooperative tasks

This paper presents an optimal design for local communication between multiple mobile robots. In previous studies of local communication in multirobot systems, the area of communication was not designed using mathematical analysis, but only time-consuming simulations of multirobot communications. We analyzed the information transmission efficiency and created an optimal communication area that minimizes the information transmission time to multiple robots. This optimization comprises two steps. First, we derive the “information transmission probability” for various task models. Next, the derived information transmission probability is used to minimize the information transmission time. The optimal communication design is tested for various tasks, using system parameters. The analytical results are further verified by using computer simulations of multirobot communications and experiments with local communication. © 1998 John Wiley & Sons, Inc.     

Applying a path planner based on RRT to cooperative multirobot box-pushing

Considering robot systems in the real world, a multirobot system where multiple robots work simultaneously without colliding with each other is more practical than a single-robot system where only one robot works. Therefore, solving the path-planning problem in a multirobot system is very important. In this study, we developed a path-planner based on the rapidly exploring random tree (RRT), which is a data structure and algorithm designed for efficiently searching for multirobot box-pushing, and made experiments in real environments. A path planner must construct a plan which avoids the robot colliding with obstacles or with other robots. Moreover, in some cases, a robot must collaborate with other robots to transport the box without colliding with any obstacles. Our proposed path planner constructs a box-transportation plan and the path plans of each robot bearing the above considerations in mind. Experimental results showed that our proposed planner can construct a multirobot box-pushing plan without colliding with obstacles, and that the robots can execute tasks according to the plan in real environments. We also checked that multiple robots can perform problem tasks when only one robot could not transport the box to the goal. This work was presented in part at the 13th International Symposium on Articifial Life and Robotics, Oita, Japan, January 31–February 2, 2008     

Cooperative control through objective achievement

Cooperative control is a key issue for multirobot systems in many practical applications. In this paper, we address the problem of coordinating a set of mobile robots in the RoboCup soccer middle-size league. We show how the coordination problem that we face can be cast as a specific coalition formation problem, and we propose a distributed algorithm to efficiently solve it. Our approach is based on the distributed computation of a measure of satisfaction (called Agent Satisfaction) that each agent computes for each task. We detail how each agent computes the Agent Satisfaction by acquiring sensor perceptions through an omnidirectional vision system, extracting aggregated information from the acquired perception, and integrating such information with that communicated by the teammates. We empirically validate our approach in a simulated scenario and within RoboCup competitions. The experiments in the simulated scenario allow us to analyse the behaviour of the algorithm in different situations, while the use of the algorithm in real competitions validates the applicability of our approach to robotic platforms involved in a dynamic and complex scenario.     

Challenges in cooperative coevolution of physically heterogeneous robot teams

Heterogeneous multirobot systems have shown significant potential in many applications. Cooperative coevolutionary algorithms (CCEAs) represent a promising approach to synthesise controllers for such systems, as they can evolve multiple co-adapted components. Although CCEAs allow for an arbitrary level of team heterogeneity, in previous works heterogeneity is typically only addressed at the behavioural level. In this paper, we study the use of CCEAs to evolve control for a heterogeneous multirobot system where the robots have disparate morphologies and capabilities. Our experiments rely on a simulated task where a simple ground robot must cooperate with a complex aerial robot to find and collect items. We first show that CCEAs can evolve successful controllers for physically heterogeneous teams, but find that differences in the complexity of the skills the robots need to learn can impair CCEAs’ effectiveness. We then study how different populations can use different evolutionary algorithms and parameters tuned to the agents’ complexity. Finally, we demonstrate how CCEAs’ effectiveness can be improved using incremental evolution or novelty-driven coevolution. Our study shows that, despite its limitations, coevolution is a viable approach for synthesising control for morphologically heterogeneous systems.

     

Coordinated Kinematic Control of Compliantly Coupled Multirobot Systems in an Array Format

This paper presents coordinated kinematic control of compliantly coupled multirobot systems for payload transportation. In the robot, unicycle-type axles are connected to a moving platform in an array format using compliant frames. A coordinate system is attached to an ideal center point on the platform to establish robot kinematics. In order to drive the system along a reference trajectory, we coordinate axle velocity commands, while considering frame compliance, nonholonomic constraints, and rigid body kinematics, respectively. These commands are further coordinated to consider configuration stability and physical limitations. Simulation and experimental results evaluate the coordination algorithms for various trajectories.      

Multirobot Object Localization: A Fuzzy Fusion Approach

In this paper, we address the problem of fusing information about object positions in multirobot systems. Our approach is novel in two main respects. First, it addresses the multirobot object localization problem using fuzzy logic. It uses fuzzy sets to represent uncertain position information and fuzzy intersection to fuse this information. The result of this fusion is a consensus among sources, as opposed to the compromise achieved by many other approaches. Second, our method fully propagates self-localization uncertainty to object-position estimates. We evaluate our method using systematic experiments, which describe an input-error landscape for the performance of our approach. This landscape characterizes how well our method performs when faced with various types and amounts of input errors.      

Decentralized Traffic Control for Non-Holonomic Flexible Automated Guided Vehicles in Industrial Environments

This paper deals with the problem of coordinating flexible automated guided vehicles (AGVs) in real manufacturing systems. The problem consists of ensuring safe and successful task execution while several AGVs operate as a distributed transportation system in real industrial environments. The proposed solution combines different decentralized techniques to increase the flexibility and scalability of the multirobot system. The coordination is addressed by dividing the problem into path planning, obstacle avoidance and traffic control problems. The path planning method takes into account the location of mates for replanning the routes. The obstacle avoidance technique considers the kinematic constraints of the platform for reactive motion control. The traffic control approach makes use of a decentralized control policy that takes into account the capabilities of vehicles. By combining all these techniques and configuring the system properly, we present the successful development of a distributed transportation system composed of a team of flexible AGVs. The proposed solution has been validated using both a set of custom-modified AGVs operating in a real factory and a simulation of several AGVs operating in a virtual scenario.     

Validating human-robot interaction schemes in multitasking environments

The ability of robots to autonomously perform tasks is increasing. More autonomy in robots means that the human managing the robot may have available free time. It is desirable to use this free time productively, and a current trend is to use this available free time to manage multiple robots. We present the notion of neglect tolerance as a means for determining how robot autonomy and interface design determine how free time can be used to support multitasking, in general, and multirobot teams, in particular. We use neglect tolerance to 1) identify the maximum number of robots that can be managed; 2) identify feasible configurations of multirobot teams; and 3) predict performance of multirobot teams under certain independence assumptions. We present a measurement methodology, based on a secondary task paradigm, for obtaining neglect tolerance values that allow a human to balance workload with robot performance.     

Map focus: A way to reconcile reactivity and deliberation in multirobot systems

Cooperative multirobot systems require both real-time responsiveness and some form of coordination to get the desired overall behavior. This can be obtained with a combined use of reactive and deliberative subsystems. In this paper, we illustrate an effective technique for putting together these two components. The method is based on the idea that every robot maintains a local map and then dynamically focuses its attention on the part which is relevant in the current context. The framework, which is fully distributed and scalable, is enriched with cooperative behaviors, i.e. behaviors pursued by more than one robot. We provide the details of how the proposed idea has been studied in a simulated cooperative foraging task and proved to be effective.