Conflict free coordinated path planning for multiple robots using a dynamic path modification sequence

In this paper, a practically viable approach for conflict free, coordinated motion planning of multiple robots is proposed. The presented approach is a two phase decoupled method that can provide the desired coordination among the participating robots in offline mode. In the first phase, the collision free path with respect to stationary obstacles for each robot is obtained by employing an A* algorithm. In the second phase, the coordination among multiple robots is achieved by resolving conflicts based on a path modification approach. The paths of conflicting robots are modified based on their position in a dynamically computed path modification sequence (PMS). To assess the effectiveness of the developed methodology, the coordination among robots is also achieved by different strategies such as fixed priority sequence allotment for motion of each robot, reduction in the velocities of joints of the robot, and introduction of delay in starting of each robot. The performance is assessed in terms of the length of path traversed by each robot, time taken by the robot to realize the task and computational time. The effectiveness of the proposed approach for multi-robot motion planning is demonstrated with two case studies that considered the tasks with three and four robots. The results obtained from realistic simulation of multi-robot environment demonstrate that the proposed approach assures rapid, concurrent and conflict free coordinated path planning for multiple robots.     

Virtual target tracking of mobile robot and its application to formation control

A virtual target tracking approach is proposed for kinematic control of mobile robot. In the controller, linear and angular velocity inputs are generated by using the local data of robot position and orientation along with the estimated velocity of target object. Applying the proposed approach to a cooperative robot group with arbitrary number of multiple mobile robots, it is possible to create various robot formations for cooperative navigation and tracking of moving object. The developed controller is shown to be stable and convergent through theoretical proof and a series of experiments.     

Kinematic calibration for collaborative robots on a mobile platform using motion capture system

For modern robotic applications that go beyond the typical industrial environment, absolute accuracy is one of the key properties that make this possible. There are several approaches in the literature to improve robot accuracy for a typical industrial robot mounted on a fixed frame. In contrast, there is no method to improve robot accuracy when the robot is mounted on a mobile base, which is typical for collaborative robots. Therefore, in this work, we proposed and analyzed two approaches to improve the absolute accuracy of the robot mounted on a mobile platform using an optical measurement system. The first approach is based on geometric operations used to calculate the rotation axes of each joint. This approach identifies all rotational axes, which allows the calculation of the Denavit–Hartenberg (DH) parameters and thus the complete kinematic model, including the position and orientation errors of the robot end-effector and the robot base. The second approach to parameter estimation is based on optimization using a set of joint positions and end-effector poses to find the optimal DH parameters. Since the robot is mounted on a mobile base that is not fixed, an optical measurement system was used to dynamically and simultaneously measure the position of the robot base and the end-effector. The performance of the two proposed methods was analyzed and validated on a 7-DoF Franka Emika Panda robot mounted on a mobile platform PAL Tiago-base. The results show a significant improvement in absolute accuracy for both proposed approaches. By using the proposed approach with the optical measurement system, we can easily automate the estimation of robot kinematic parameters with the aim of improving absolute accuracy, especially in applications that require high positioning accuracy.     

On cooperative manipulation of dynamic objects

This paper proposes a decentralized position/internal force hybrid control approach for multiple robot manipulators to cooperatively manipulate an unknown dynamic object. In this approach, each autonomous robot has its own controller and uses its own sensor information in performing the fast cooperation. This approach eliminates a lot of information communications between each robot and reduces numerous computations. The influences of the position and the internal force estimation errors to the overall control system is analyzed. A cooperative identification method for each autonomous robot to identify the object's complex dynamics, cooperatively, is presented. In addition, the trade-off between the unilateral force constraint and the robots' position response is studied. Experiments show the effectiveness of this control approach.     

Teaching Robots Style: Designing and Evaluating Style-by-Demonstration for Interactive Robotic Locomotion

In this article we present a multipart formal design and evaluation of the style-by-demonstration (SBD) approach to creating interactive robot behaviors: enabling people to design the style of interactive robot behaviors by providing an exemplar. We first introduce our Puppet Master SBD algorithm that enables the creation of interactive robot behaviors with a focus on style: Users provide an example demonstration of human–robot interaction and Puppet Master uses this to generate real-time interactive robot output that matches the demonstrated style. We further designed and implemented original interfaces for demonstrating interactive robot style and for interacting with the resulting robot behaviors. Following, we detail a set of studies we performed to appraise users' reactions to and acceptance of the SBD interaction design approach, the effectiveness of the underlying Puppet Master algorithm, and the usability of the demonstration interfaces. Fundamentally, this article investigates the broad questions of how people respond to SBD interaction, how they engage SBD interfaces, how SBD can be practically realized, and how the SBD approach to social human–robot interaction can be employed in future interaction design.     

Simulations of the dynamic behavior of a bipedal robot with trunk and arms subjected to 3D external disturbances in a vertical posture, during walking and during object handling

This paper provides a new approach to the bipedal robot stability problems in presence of external disturbances in vertical posture of the robot, during walking and during object handling. This approach is based on synergy between the dynamic motions of balancing masses and arms to reject large perturbations applied to the upper part of ROBIAN robot. In these cases, the stabilization is carried out in the first time with a trunk having 4 degrees of freedom (dof): one rotational and three translational movements. In the second time, the stabilization is performed with a system with arms and having 10 dof. During the walk, the trunk elements of ROBIAN reproduce necessary movements to perform the dynamic walking gait of the robot. The compensation of external three-dimensional efforts applied to the robot is achieved firstly by the trunk and secondly with the arms. This study allows us to determine on-line the required movements and accelerations of the trunk elements in order to maintain the robot stability and shows the importance of the arms for the robot stability.     

Following control approach based on model predictive control for wheeled inverted pendulum robot

Personal robots, which are seen as tools that will be needed to support our aging society, will be expected to support the comfortable lifestyles of healthy young people as well as the elderly. However, excessive and premature robot support may adversely impact the physical abilities of their human owner/operators. In this paper, the authors propose a personal robot equipped with wheeled inverted pendulum control that can carry baggage and follow the human being. Since such robots could remove the drudgery associated with carrying luggage, their use could also encourage people to go outside and walk briskly, which could contribute to improved health management. This paper proposes a novel control approach for a robot following the human being. The proposed approach employs a model predictive control that facilitates consideration of several types of upper and lower level constraints a personal robot would require. The effectiveness of our proposed approach was then verified in experiments using a prototype personal robot.     

Methodology of Concept Control Synthesis to Avoid Unmoving and Moving Obstacles (II)

Dynamic path generation problem of robot in environment with other unmoving and moving objects is considered. Generally, the problem is known in literature as find path or robot motion planning. In this paper we apply the behavioral cloning approach to design the robot controller. In behavioral cloning, the system learns from control traces of a human operator. The task for the given problem is to find a controller not only in the form of the explicit mathematical expression. So RBF neural network is used also. The goal is to apply controller for the mobile robot motion planning in situation with infinite number of obstacles. The advantage of this approach lies in the fact that a complete path can be defined off-line, without using sophisticated symbolical models of obstacles.     

机器人操作技能学习方法综述

结合人工智能技术和机器人技术,研究具备一定自主决策和学习能力的机器人操作技能学习系统,已逐渐成为机器人研究领域的重要分支.本文介绍了机器人操作技能学习的主要方法及最新的研究成果.依据对训练数据的使用方式将机器人操作技能学习方法分为基于强化学习的方法、基于示教学习的方法和基于小数据学习的方法,并基于此对近些年的研究成果进行了综述和分析,最后列举了机器人操作技能学习的未来发展方向.     

Output feedback tracking control of robot manipulators with model uncertainty via adaptive fuzzy logic

Many robot controllers require not only joint position measurements but also joint velocity measurements; however, most robotic systems are only equipped with joint position measurement devices. In this paper, a new output feedback tracking control approach is developed for the robot manipulators with model uncertainty. The approach suggested herein does not require velocity measurements and employs the adaptive fuzzy logic. The adaptive fuzzy logic allows us to approximate uncertain and nonlinear robot dynamics. Only one fuzzy system is used to implement the observer-controller structure of the output feedback robot system. It is shown in a rigorous manner that all the signals in a closed loop composed of a robot, an observer, and a controller are uniformly ultimately bounded. Finally, computer simulation results on three-link robot manipulators are presented to show the results which indicate good position tracking performance and robustness against payload uncertainty and external disturbances.     

一种基于多组传感器信息移动机器人的避障方法

提出了一种基于多组传感器信息的移动机器人避障的新方法.该方法把多组传感 器信息作为ART-2神经网络的输入,实现移动机器人对当前感知环境的快速识别和分类.在 此基础上,设计了用于移动机器人在未知环境下避障的模糊控制器.试验证明了这一方法的 有效性和实时性.     

Task-space neuro-sliding mode control of robot manipulators under Jacobian uncertainties

Cartesian robot control is an appealing scheme because it avoids the computation of inverse kinematics, in contrast to joint robot control approach. For tracking, high computational load is typically required to obtain Cartesian robot dynamics. In this paper, an alternative approach for Cartesian tracking is proposed under assumption that robot dynamics is unknown and the Jacobian are uncertain. A neuro-sliding second order mode controller delivers a low dimensional neural network, which roughly estimates inverse robot dynamics, and an inner smooth control loop guarantees exponential tracking. Experimental results are presented to confirm the performance in a real time environment.     

Supervised semantic labeling of places using information extracted from sensor data

Indoor environments can typically be divided into places with different functionalities like corridors, rooms or doorways. The ability to learn such semantic categories from sensor data enables a mobile robot to extend the representation of the environment facilitating interaction with humans. As an example, natural language terms like “corridor” or “room” can be used to communicate the position of the robot in a map in a more intuitive way. In this work, we first propose an approach based on supervised learning to classify the pose of a mobile robot into semantic classes. Our method uses AdaBoost to boost simple features extracted from sensor range data into a strong classifier. We present two main applications of this approach. Firstly, we show how our approach can be utilized by a moving robot for an online classification of the poses traversed along its path using a hidden Markov model. In this case we additionally use as features objects extracted from images. Secondly, we introduce an approach to learn topological maps from geometric maps by applying our semantic classification procedure in combination with a probabilistic relaxation method. Alternatively, we apply associative Markov networks to classify geometric maps and compare the results with a relaxation approach. Experimental results obtained in simulation and with real robots demonstrate the effectiveness of our approach in various indoor environments.     

Robot docking based on omnidirectional vision and reinforcement learning

We present a system for visual robotic docking using an omnidirectional camera coupled with the actor critic reinforcement learning algorithm. The system enables a PeopleBot robot to locate and approach a table so that it can pick an object from it using the pan-tilt camera mounted on the robot. We use a staged approach to solve this problem as there are distinct subtasks and different sensors used. Starting with random wandering of the robot until the table is located via a landmark, then a network trained via reinforcement allows the robot to turn to and approach the table. Once at the table the robot is to pick the object from it. We argue that our approach has a lot of potential allowing the learning of robot control for navigation and remove the need for internal maps of the environment. This is achieved by allowing the robot to learn couplings between motor actions and the position of a landmark.     

Developmental word grounding through a growing neural network with a humanoid robot.

This paper presents an unsupervised approach of integrating speech and visual information without using any prepared data. The approach enables a humanoid robot, Incremental Knowledge Robot 1 (IKR1), to learn word meanings. The approach is different from most existing approaches in that the robot learns online from audio-visual input, rather than from stationary data provided in advance. In addition, the robot is capable of learning incrementally, which is considered to be indispensable to lifelong learning. A noise-robust self-organized growing neural network is developed to represent the topological structure of unsupervised online data. We are also developing an active-learning mechanism, called "desire for knowledge," to let the robot select the object for which it possesses the least information for subsequent learning. Experimental results show that the approach raises the efficiency of the learning process. Based on audio and visual data, they construct a mental model for the robot, which forms a basis for constructing IKRI's inner world and builds a bridge connecting the learned concepts with current and past scenes.     

Bridging the gap between feature- and grid-based SLAM

One important design decision for the development of autonomously navigating mobile robots is the choice of the representation of the environment. This includes the question of which type of features should be used, or whether a dense representation such as occupancy grid maps is more appropriate. In this paper, we present an approach which performs SLAM using multiple representations of the environment simultaneously. It uses reinforcement to learn when to switch to an alternative representation method depending on the current observation. This allows the robot to update its pose and map estimate based on the representation that models the surrounding of the robot in the best way. The approach has been implemented on a real robot and evaluated in scenarios, in which a robot has to navigate in- and outdoors and therefore switches between a landmark-based representation and a dense grid map. In practical experiments, we demonstrate that our approach allows a robot to robustly map environments which cannot be adequately modeled by either of the individual representations.     

Comparison of RBF and MLP neural networks to solve inverse kinematic problem for 6R serial robot by a fusion approach

In this paper, a fusion approach to determine inverse kinematics solutions of a six degree of freedom serial robot is proposed. The proposed approach makes use of radial basis function neural network for prediction of incremental joint angles which in turn are transformed into absolute joint angles with the assistance of forward kinematics relations. In this approach, forward kinematics relations of robot are used to obtain the data for training of neural network as well to estimate the deviation of predicted inverse kinematics solution from the desired solution. The effectiveness of the fusion process is shown by comparing the inverse kinematics solutions obtained for an end-effector of industrial robot moving along a specified path with the solutions obtained from conventional neural network approaches as well as iterative technique. The prominent features of the fusion process include the accurate prediction of inverse kinematics solutions with less computational time apart from the generation of training data for neural network with forward kinematics relations of the robot.     

一种多模型融合的仿猎豹四足机器人复杂运动控制方法

针对具有2自由度主动脊柱关节的仿猎豹四足机器人,基于任务分解思想和生物神经系统机理,提出多模型融合的控制方法。该方法以弹簧负载倒立摆模型实现单腿跳跃控制,通过中枢模式发生器（CPG）实现4条腿之间以及脊柱―腿之间的协调控制,利用虚拟模型控制实现机器人与环境交互,采用基于CPG输出的有限状态机来融合3个控制模型,构建仿猎豹四足机器人的多模型分层运动控制器。参考猎豹脊柱运动特征,设计了机器人脊柱关节运动模式,给出脊柱与腿的协调控制策略。最后,在Webots仿真环境中搭建了仿猎豹四足机器人虚拟样机,实现了不同步态下的脊柱―腿的协调控制、在崎岖地形上稳定奔跑,以及平滑的对角―疾驰―对角步态转换,仿真结果验证了所提出的多模型融合的四足机器人运动控制方法的有效性。     

Probabilistic structure matching for visual SLAM with a multi-camera rig

We propose to use a multi-camera rig for simultaneous localization and mapping (SLAM), providing flexibility in sensor placement on mobile robot platforms while exploiting the stronger localization constraints provided by omni-directional sensors. In this context, we present a novel probabilistic approach to data association, that takes into account that features can also move between cameras under robot motion. Our approach circumvents the combinatorial data association problem by using an incremental expectation maximization algorithm. In the expectation step we determine a distribution over correspondences by sampling. In the maximization step, we find optimal parameters of a density over the robot motion and environment structure. By summarizing the sampling results in so-called virtual measurements, the resulting optimization simplifies to the equivalent optimization problem for known correspondences. We present results for simulated data, as well as for data obtained by a mobile robot equipped with a multi-camera rig.     

Velocity planning for a mobile robot to track a moving target — a potential field approach

Potential field method has been widely used for mobile robot path planning, but mostly in a static environment where the target and the obstacles are stationary. The path planning result is normally the direction of the robot motion. In this paper, the potential field method is applied for both path and speed planning, or the velocity planning, for a mobile robot in a dynamic environment where the target and the obstacles are moving. The robot’s planned velocity is determined by relative velocities as well as relative positions among robot, obstacles and targets. The implementation factors such as maximum linear and angular speed of the robot are also considered. The proposed approach guarantees that the robot tracks the moving target while avoiding moving obstacles. Simulation studies are provided to verify the effectiveness of the proposed approach.