CONRO: Towards Deployable Robots with Inter-Robots Metamorphic Capabilities

Metamorphic robots are modular robots that can reconfigure their shape. Such capability is desirable in tasks such as earthquake search and rescue and battlefield surveillance and scouting, where robots must go through unexpected situations and obstacles and perform tasks that are difficult for fixed-shape robots. The capabilities of the robots are determined by the design specification of their modules. In this paper, we present the design specification of a CONRO module, a small, self-sufficient and relatively homogeneous module that can be connected to other modules to form complex robots. These robots have not only the capability of changing their shape (intra-robot metamorphing) but also can split into smaller robots or merge with other robots to create a single larger robot (inter-robot metamorphing), i.e., CONRO robots can alter their shape and their size. Thus, heterogeneous robot teams can be built with homogeneous components. Furthermore, the CONRO robots can separate the reconfiguration stage from the locomotion stage, allowing the selection of configuration-dependent gaits. The locomotion and automatic inter-module docking capabilities of such robots were tested using tethered prototypes that can be reconfigured manually. We conclude the paper discussing the future work needed to fully realize the construction of these robots.     

Real-time-based control system for a group of autonomous walking robots

The design target of complex control systems for novel robots with advanced motion abilities is to produce controllers (hardware and software) which are easy to program, re-program and debug. Those systems must be enabled to implement different motion principles with different hardware extensions (actuators, sensors, etc.). This paper introduces the problem of evaluation of hardware architecture together with the hardware type. We use the experience collected during realization of several prototypes of walking machines. The dedicated communication scheme elaborated for an embedded system is addressed in detail. The communication scheme can be used in every other system controlling the walking machine or controlling other robotic device. The navigation principles applied for a group of hexapods are briefly discussed for a better explanation of the functional structure of the implemented control system. The system actions are introduced. The system structure can be used for the control not only of a single mobile robot, but also a robot as a member of a group.     

Probabilistic Road Map sampling strategies for multi-robot motion planning

This paper presents a Probabilistic Road Map (PRM) motion planning algorithm to be queried within Dynamic Robot Networks—a multi-robot coordination platform for robots operating with limited sensing and inter-robot communication.

First, the Dynamic Robot Networks (DRN) coordination platform is introduced that facilitates centralized robot coordination across ad hoc networks, allowing safe navigation in dynamic, unknown environments. As robots move about their environment, they dynamically form communication networks. Within these networks, robots can share local sensing information and coordinate the actions of all robots in the network.

Second, a fast single-query Probabilistic Road Map (PRM) to be called within the DRN platform is presented that has been augmented with new sampling strategies. Traditional PRM strategies have shown success in searching large configuration spaces. Considered here is their application to on-line, centralized, multiple mobile robot planning problems. New sampling strategies that exploit the kinematics of non-holonomic mobile robots have been developed and implemented. First, an appropriate method of selecting milestones in a PRM is identified to enable fast coverage of the configuration space. Second, a new method of generating PRM milestones is described that decreases the planning time over traditional methods. Finally, a new endgame region for multi-robot PRMs is presented that increases the likelihood of finding solutions given difficult goal configurations.

Combining the DRN platform with these new sampling strategies, on-line centralized multi-robot planning is enabled. This allows robots to navigate safely in environments that are both dynamic and unknown. Simulations and real robot experiments are presented that demonstrate: (1) speed improvements accomplished by the sampling strategies, (2) centralized robot coordination across Dynamic Robot Networks, (3) on-the-fly motion planning to avoid moving and previously unknown obstacles and (4) autonomous robot navigation towards individual goal locations.     

Decentralized multi-robot encirclement of a 3D target with guaranteed collision avoidance

We present a control framework for achieving encirclement of a target moving in 3D using a multi-robot system. Three variations of a basic control strategy are proposed for different versions of the encirclement problem, and their effectiveness is formally established. An extension ensuring maintenance of a safe inter-robot distance is also discussed. The proposed framework is fully decentralized and only requires local communication among robots; in particular, each robot locally estimates all the relevant global quantities. We validate the proposed strategy through simulations on kinematic point robots and quadrotor UAVs, as well as experiments on differential-drive wheeled mobile robots.     

A framework for the collective movement of mobile robots based on distributed decisions

A novel framework for the control of the collective movement of mobile robots is presented and analyzed in this article. It allows a group of robots to move as a unique entity performing the following functions: obstacle avoidance at group level, speed control and modification of the inter-robot distance. Its flocking controller is distributed among the robots, allowing them to move in the desired common direction and maintain a desired inter-robot distance. The framework is made up of different modules that modify the behavior of the group thus allowing different functions. They are based on consensus algorithms that allow the robots to agree on different parameters, taking into account which robot has more relevant information. New modules can be easily designed and incorporated into the framework in order to augment its capabilities. It can be easily implemented on any mobile robot capable of measuring the relative positions of neighboring robots and communicating with them. It has been successfully tested using 8 real robots and in simulation with up to 40 robots, demonstrating experimentally its scalability with an increasing number of robots.     

基于多模式交互的多移动机器人分布式合作系统

本文研究合作型多移动机器人系统的分布式控制方法.为了保证多机器人间合作的实 时性和高效率,采用了一种分组策略,并提出了将局部感知和组内通信相集成的多模式机器人 间交互方法.考虑到任务的复杂性和真实环境的非结构化特点,构建了将递阶规划技术与基于 行为的反应式控制相结合的递阶混合式协调结构,并采用有限状态机模型实现了规划层与行为 层的协调机制.合作垃圾清运的实验结果证明了上述方法的有效性.     

Toward a user-guided manipulation framework for high-DOF robots with limited communication

This paper presents our progress toward a user-guided manipulation framework for high degree-of-freedom robots operating in environments with limited communication. The system we propose consists of three components: (1) a user-guided perception interface that assists the user in providing task-level commands to the robot, (2) planning algorithms that autonomously generate robot motion while obeying relevant constraints, and (3) a trajectory execution and monitoring system which detects errors in execution. We report quantitative experiments performed on these three components and qualitative experiments of the entire pipeline with the PR2 robot turning a valve for the DARPA robotics challenge. We also describe how the framework was ported to the Hubo2+ robot with minimal changes which demonstrates its applicability to different types of robots.     

Hybrid mission planning with coalition formation

The increase in robotic capabilities and the number of such systems being used has resulted in opportunities for robots to work alongside humans in an increasing number of domains. The current robot control paradigm of one or multiple humans controlling a single robot is not scalable to domains that require large numbers of robots and is infeasible in communications constrained environments. Robots must autonomously plan how to accomplish missions composed of many tasks in complex and dynamic domains; however, mission planning with a large number of robots for such complex missions and domains is intractable. Coalition formation can manage planning problem complexity by allocating the best possible team of robots for each task. A limitation is that simply allocating the best possible team does not guarantee an executable plan can be formulated. However, coupling coalition formation with planning creates novel, domain-independent tools resulting in the best possible teams executing the best possible plans for robots acting in complex domains.     

The NEXUS open system for integrating robotic software

In this paper a framework for constructing flexible, robust and efficient software applications for robots is described. The basic concepts needed to integrate complex, multidisciplinary robot software architectures are identified, and the methods to achieve them are taken from different areas of research (programming languages, network communication systems, real-time systems, etc.). The result is an open software system called NEXUS which includes the basic characteristics needed for the integration of very different software modules, minimizing the effort of integration and maximizing the reusability, efficiency and robustness of the resulting software applications. This software has proven to be a basis for more sophisticated tools that help in reducing the cost of modifications to and the complexity of multidisciplinary projects, allowing highly structured and reusable designs to be implemented. Although it has been currently implemented for mobile robots, it is a sufficiently generic framework suitable for use in other control systems.     

Nonlinear formation control of unicycle-type mobile robots

We investigate formation control of a group of unicycle-type mobile robots at the dynamics level with a little amount of inter-robot communication. A combination of the virtual structure and path-tracking approaches is used to derive the formation architecture. Each individual robot has only position and orientation available for feedback. For each robot, a coordinate transformation is first derived to cancel the velocity quadratic terms. An observer is then designed to globally exponentially/asymptotically estimate the unmeasured velocities. An output feedback controller is designed for each robot. The controller is designed in such a way that the path derivative is left as a free input to synchronize the robots’ motion. Simulations illustrate the soundness of the proposed controller.     

A closed-loop approach for tracking a humanoid robot using particle filtering and depth data

Humanoid robots introduce instabilities during biped march that complicate the process of estimating their position and orientation along time. Tracking humanoid robots may be useful not only in typical applications such as navigation, but in tasks that require benchmarking the multiple processes that involve registering measures about the performance of the humanoid during walking. Small robots represent an additional challenge due to their size and mechanic limitations which may generate unstable swinging while walking. This paper presents a strategy for the active localization of a humanoid robot in environments that are monitored by external devices. The problem is faced using a particle filter method over depth images captured by an RGB-D sensor in order to effectively track the position and orientation of the robot during its march. The tracking stage is coupled with a locomotion system controlling the stepping of the robot toward a given oriented target. We present an integral communication framework between the tracking and the locomotion control of the robot based on the robot operating system, which is capable of achieving real-time locomotion tasks using a NAO humanoid robot.     

Multi-Robot Graph Exploration and Map Building with Collision Avoidance: A Decentralized Approach

This paper proposes a decentralized multi-robot graph exploration approach in which each robot takes independent decision for efficient exploration avoiding inter-robot collision without direct communication between them. The information exchange between the robots is possible through the beacons available at visited vertices of the graph. The proposed decentralized technique guarantees completion of exploration of an unknown environment in finite number of edge traversals where graph structure of the environment is incrementally constructed. New condition for declaring completion of exploration is obtained. The paper also proposes a modification in incidence matrix so that it can be used as a data structure for information exchange. The modified incidence matrix after completion represents map of the environment. The proposed technique requires either lesser or equal number of edge traversals compared to the existing strategy for a tree exploration. A predefined constant speed change approach is proposed to address the inter-robot collision avoidance using local sensor on a robot. Simulation results verify the performance of the algorithm on various trees and graphs. Experiments with multiple robots show multi-robot exploration avoiding inter-robot collision.     

基于达芬奇的移动机器人开发平台设计

针对传统移动机器人的实时性差和扩展性差的局限性,在达芬奇技术的基础上,通过裁减定制,去除冗余的功能,设计了一种移动机器人的开发平台。该机器人系统包括移动机器人需要的视觉系统,并有丰富的运动控制接口以及驱动模块。同时,设计了多传感器融合、无线网络通信、路径规划、运动控制、人机界面等移动机器人的测试软件和应用模块。该移动机器人平台也具有模块化、硬件体积小、功耗低、可移植、可扩展、实时性强等优点。     

Editorial

The navigation capability of a group of robots can be improved by sensing of relative inter-robot positions and intercommunication of position estimates and planned trajectories. The cooperative navigation system (CNS) algorithm described here is based on a Kalman filter which uses inter-robot position sensing to update the collective position estimates of the group. Assuming independence of sensing and positioning errors, the CNS algorithm always improves individual robot estimates and the collective navigation performance improves as the number of robots increases. The CNS algorithm computation may be distributed among the robot group. Simulation results and experimental measurements on two Yamabico robots are described.     

System for augmented human–robot interaction through mixed reality and robot training by non-experts in customer service environments

Human–robot interaction during general service tasks in home or retail environment has been proven challenging, partly because (1) robots lack high-level context-based cognition and (2) humans cannot intuit the perception state of robots as they can for other humans. To solve these two problems, we present a complete robot system that has been given the highest evaluation score at the Customer Interaction Task of the Future Convenience Store Challenge at the World Robot Summit 2018, which implements several key technologies: (1) a hierarchical spatial concepts formation for general robot task planning and (2) a mixed reality interface to enable users to intuitively visualize the current state of the robot perception and naturally interact with it. The results obtained during the competition indicate that the proposed system allows both non-expert operators and end users to achieve human–robot interactions in customer service environments. Furthermore, we describe a detailed scenario including employee operation and customer interaction which serves as a set of requirements for service robots and a road map for development. The system integration and task scenario described in this paper should be helpful for groups facing customer interaction challenges and looking for a successfully deployed base to build on.     

基于KQML语言的多自主移动机器人仿真系统

用JAVA语言开发了栅格环境下的多自主移动机器人仿真系统,通过KQML语言通信模拟了多个自主的移动机器人,机器人的自主性主要体现在自主感知环境和自主进行路径规划、任务执行和安全导航等工作．该仿真系统具有平台无关性、地图无关性、算法无关性以及机器人配置的无关性,为多自主机器人系统的研究提供了一个可借鉴的平台．     

Cooperative exploration and protection of a workspace assisted by information networks

We develop strategies that enable multiple robots to cooperatively explore an unknown workspace while building information networks. Every robot deploys information nodes with sensing and communication capabilities while constructing the Voronoi diagram as the topological map of the workspace. The resulting information networks constructed by individual robots will eventually meet, allowing for inter-robot information sharing. The constructed information network is then employed by the mobile robots to protect the workspace against intruders. We introduce the intruder capturing strategy on the Voronoi diagram assisted by information networks.     

一个面向复杂任务的多机器人分布式协调系统

基于多智能体系统理论, 研究在非结构、不确定环境下面向复杂任务的多机器人分布式协调系统的实现原理、方法和技术. 提出的递阶混合式协调结构、基于网络的通讯模式和基于有限状态机的规划与控制集成方法, 充分考虑了复杂任务和真实自然环境的特点. 通过构建一个全实物的多移动机器人实验平台, 对规划、控制、传感、通讯、协调与合作的各关键技术进行了开发和集成, 使多机器人分布式协调技术的研究直接面向实际应用, 编队和物料搬运的演示实验结果展示了多机器人协调技术的广阔应用前景.     

A Real-Time Hybrid Architecture for Biped Humanoids with Active Vision Mechanisms

A real-time hybrid control architecture for biped humanoid robots is proposed. The architecture is modular and hierarchical. The main robot’s functionalities are organized in four parallel modules: perception, actuation, world-modeling, and hybrid control. Hybrid control is divided in three behavior-based hierarchical layers: the planning layer, the deliberative layer, and the reactive layer, which work in parallel and have very different response speeds and planning capabilities. The architecture allows: (1) the coordination of multiple robots and the execution of group behaviors without disturbing the robot’s reactivity and responsivity, which is very relevant for biped humanoid robots whose gait control requires real-time processing. (2) The straightforward management of the robot’s resources using resource multiplexers. (3) The integration of active vision mechanisms in the reactive layer under control of behavior-dependant value functions from the deliberative layer. This adds flexibility in the implementation of complex functionalities, such as the ones required for playing soccer in robot teams. The architecture is validated using simulated and real Nao humanoid robots. Passive and active behaviors are tested in simulated and real robot soccer setups. In addition, the ability to execute group behaviors in real- time is tested in international robot soccer competitions.     

基于深度学习的巡检机器人避障轨迹自动控制系统设计

为了提高巡检机器人在复杂环境下的避障能力,使机器人能够安全地完成巡检任务,设计基于深度学习的巡检机器人避障轨迹自动控制系统。设计由CCD传感器、信号处理芯片等设备组成的工业智能视觉CCD相机,基于FPGA和USB2.0的视频采集卡传输采集数据,完成硬件部分的设计。在软件设计中,对采集的图像实施目标分割、双目目标匹配等预处理,通过对摄像头实施双目视觉标定获取障碍物空间位置三维信息,基于深度学习中的CRNN设计机器人自主避障规划网络模型,并设计模糊轨迹控制器,实现避障中的轨迹自动控制。系统测试结果表明,设计系统最终成功避开了三个动态障碍物,最大轨迹控制误差的最大值为1.45°,最小轨迹控制误差的最大值为0.62°,动态避障巡检速度始终在3.5m/s左右,表现出了精准而稳定的轨迹控制效果。