表征空间中的机器人分层运动规划

由于对机器人的任务要求日趋复杂和多变,如何使机器人具备灵活的配置和运动规划能力,以适应复杂任务的需求,成为了目前运动规划领域所研究的核心问题.传统的基于任务空间和配置空间的建模方法虽然在机器人运动规划领域得到了非常广泛的应用,但在用于解决复杂规划任务时无法对不可行任务进行进一步地处理.本文在表征空间模型的基础上,提出了一种分层的运动规划算法,一方面借助于表征空间维度的扩展,使对运动规划任务的描述更为灵活;另一方面通过任务层与运动层的循环交互,使生成的路径满足更高层次和更丰富的任务要求.在仿人机器人和多机器人系统上的应用结果表明了本文所提算法的有效性.     

Bilateral remote teaching and autonomous task execution with task progress feedback

This paper describes an approach to estimating the progress in a task executed by a humanoid robot and to synthesizing motion based on the current progress so that the robot can achieve the task. The robot observes a human performing whole body motion for a specific task, and encodes these motions into a hidden Markov model (HMM). The current observation is compared with the motion generated by the HMM, and the task progress can be estimated during the robot performing the motion. The robot subsequently uses the estimate of the task progress to generate a motion appropriate to the current situation with the feedback rule. We constructed a bilateral remote control system with humanoid robot HRP-4 and haptic device Novint Falcon, and we made the humanoid robot push a button. Ten trial motions of pushing a button were recorded for the training data. We tested our proposed approach on the autonomous execution of the pushing motion by the humanoid robot, and confirmed the effectiveness of our task progress feedback method.     

Motion planning of skillful motions in assembly process through human demonstration

ABSTRACT

Skillful motions in the actual assembly process are challenging for the robot to generate with conventional motion planning approaches because some states during the human assembly can be too skillful to realize automatically due to the narrow passage. To deal with this problem, this paper develops a motion planning method using the human demonstration, which can be applied to complete skillful motions in the robotic assembly process. To demonstrate conveniently without redundant third-party devices, we attach augmented reality (AR) markers to the manipulated object to track and capture its poses during the human demonstration. To overcome the problem brought by the coarse resolution of the vision system, we extract the most important key poses from the demonstration data and employ them as clues to execute motion planning to suit the target precise task. As for the selection of key poses, two policies are compared, where the first and the second derivative of the main changing parameter of every key pose serve as criteria to determine the priority of utilizing key poses. Besides, a solution to deal with colliding key poses is also proposed. The effectiveness of the presented method is verified through some simulation examples and actual robot experiments.     

Fuzzy Logic Based Behavior Fusion for Navigation of an Intelligent Mobile Robot

This paper presents a new method for behavior fusion control of a mobile robot in uncertain environments.Using behavior fusion by fuzzy logic,a mobile robot is able to directly execute its motion according to range information about environments,acquired by ultrasonic sensors,without the need for trajectory planning.Based on low-level behavior control,an efficient strategy for integrating high-level global planning for robot motion can be formulated,since,in most applications,some information on environments is prior knowledge.A global planner,therefore,only to generate some subgoal positions rather than exact geometric paths.Because such subgoals can be easily removed from or added into the plannes,this strategy reduces computational time for global planning and is flexible for replanning in dynamic environments.Simulation results demonstrate that the proposed strategy can be applied to robot motion in complex and dynamic environments.     

Stepping over obstacles with humanoid robots

The wide potential applications of humanoid robots require that the robots can walk in complex environments and overcome various obstacles. To this end, we address the problem of humanoid robots stepping over obstacles in this paper. We focus on two aspects, which are feasibility analysis and motion planning. The former determines whether a robot can step over a given obstacle, and the latter discusses how to step over, if feasible, by planning appropriate motions for the robot. We systematically examine both of these aspects. In the feasibility analysis, using an optimization technique, we cast the problem into global optimization models with nonlinear constraints, including collision-free and balance constraints. The solutions to the optimization models yield answers to the possibility of stepping over obstacles under some assumptions. The presented approach for feasibility provides not only a priori knowledge and a database to implement stepping over obstacles, but also a tool to evaluate and compare the mobility of humanoid robots. In motion planning, we present an algorithm to generate suitable trajectories of the feet and the waist of the robot using heuristic methodology, based on the results of the feasibility analysis. We decompose the body motion of the robot into two parts, corresponding to the lower body and upper body of the robot, to meet the collision-free and balance constraints. This novel planning method is adaptive to obstacle sizes, and is, hence, oriented to autonomous stepping over by humanoid robots guided by vision or other range finders. Its effectiveness is verified by simulations and experiments on our humanoid platform HRP-2.     

A unified motion planning method for a multifunctional underwater robot

This article deals with motion planning for a multifunctional underwater robot that can perform various tasks such as swimming, walking, and grasping objects. We have developed a unified motion planning method that can generate motion planning for a variety of movements using a single algorithm. With this method, motion planning problems are modeled as finite-horizon Markov decision processes, and optimum motion planning is achieved by dynamic programming. However, conventional dynamic programming is sometimes considered to have limited applicability because of “the curse of dimensionality.” To avoid this issue, we applied a random network as a state transition network to suppress the explosion in the number of states. The effectiveness of the proposed method is demonstrated through numerical simulations involving two types of task for multifunctional robots. One is a reaching task, and the other is a thrust force generation task.     

Executing optimized throwing motion on robot arm with free joint

We address the throwing motion optimization for robot. In order to pursue the best throwing motion, we may need heuristics/intuition free methods. We propose a throwing method that is composed of rapid semi-optimal motion-planning and output zeroing method. So as to execute the optimized trajectories in real rigid body systems, we need some compensations for the noises around the optimized trajectories. We introduce a compensation method for the optimized throwing motions of a robot arm with a free joint. To validate the effectiveness of the proposed method, we conducted a throwing experiment using a two-link arm. As a result of the experiment, the robot arm threw a ball with 63.7 km/h, which was the best record through the past experiments of this arm.     

On-line motion synthesis and adaptation using a trajectory database

Autonomous robots cannot be programmed in advance for all possible situations. Instead, they should be able to generalize the previously acquired knowledge to operate in new situations as they arise. A possible solution to the problem of generalization is to apply statistical methods that can generate useful robot responses in situations for which the robot has not been specifically instructed how to respond. In this paper we propose a methodology for the statistical generalization of the available sensorimotor knowledge in real-time. Example trajectories are generalized by applying Gaussian process regression, using the parameters describing a task as query points into the trajectory database. We show on real-world tasks that the proposed methodology can be integrated into a sensory feedback loop, where the generalization algorithm is applied in real-time to adapt robot motion to the perceived changes of the external world.     

Self-organization of Dynamic Object Features Based on Bidirectional Training

This paper presents a method to self-organize object features that describe object dynamics using bidirectional training. The model is composed of a dynamics learning module and a feature extraction module. Recurrent Neural Network with Parametric Bias (RNNPB) is utilized for the dynamics learning module, learning and self-organizing the sequences of robot and object motions. A hierarchical neural network is linked to the input of RNNPB as the feature extraction module for self-organizing object features that describe the object motions. The two modules are simultaneously trained through bidirectional training using image and motion sequences acquired from the robot's active sensing with objects. Experiments are performed with the robot's pushing motion with a variety of objects to generate sliding, falling over, bouncing and rolling motions. The results have shown that the model is capable of self-organizing object dynamics based on the self-organized features.     

基于聚类分析和运动描述语言的扑翼飞行机器人行为规划

为了解决扑翼飞行机器人实时控制过程中操作者工作量大、操作较为复杂的难题,实现扑翼飞行机器人的分布式智能控制,提出了基于聚类分析和运动描述语言的扑翼飞行机器人行为规划方法.利用扑翼飞行机器人飞行数据聚类分析的结果,将机器人运动行为进行合理分类.在保证了运动描述语言的基元关系的同时,合理提取了扑翼飞行机器人的行为特征,并针对扑翼飞行机器人绕杆任务定义了4类运动基元.以扑翼飞行机器人和机载陀螺仪搭建了扑翼飞行机器人实验系统.通过直接控制方法和基于运动描述语言的机器人行为规划方法进行了实物实验和仿真实验,实验结果验证了所提方法的可行性和有效性.     

Real-time arm motion imitation for human–robot tangible interface

In this paper we deal with a remote meeting system with tangible interface, in which a robot is used as tangible avatar instead of a remote meeting partner. For realizing such system, it is a critical issue how the robot imitates human motions with natural and exact. So, we suggested a new method that human arm motion is captured with a stereo vision system and transferred to the robotic avatar with real-time. For capturing 3D arm motions based on markerless method, we proposed a new metaball-based method which was designed in order to have some robust and efficient properties: a modified iso-surface equation of metaball for overcoming local minima and a downsizing method of 3D point cloud for improving time complexity. With our meeting system, we have implemented our new algorithm and run at approximately 12–16 Hz. Also, its accuracy in motion capturing could be acceptable for robot motion generation.     

Methodology of Concept Control Synthesis to Avoid Unmoving and Moving Obstacles (II)

Dynamic path generation problem of robot in environment with other unmoving and moving objects is considered. Generally, the problem is known in literature as find path or robot motion planning. In this paper we apply the behavioral cloning approach to design the robot controller. In behavioral cloning, the system learns from control traces of a human operator. The task for the given problem is to find a controller not only in the form of the explicit mathematical expression. So RBF neural network is used also. The goal is to apply controller for the mobile robot motion planning in situation with infinite number of obstacles. The advantage of this approach lies in the fact that a complete path can be defined off-line, without using sophisticated symbolical models of obstacles.     

多智能体专家型策略梯度的目标跟踪与清障

为适应复杂环境下目标跟踪机器人高效运动规划需求,本文提出一种基于多智能体强化学习的专家型策略梯度(ML-DDPG) 方法。为此首先构建了基于最小化任务单元的分布式多Actor-Critic网络架构;随后针对机器人主动障碍清除和目标跟踪任务建立了强化学习运动学模型和视觉样本预处理机制,由此提出一种专家型策略引导的最优目标价值估计方法;进一步通过并行化训练与集中式经验共享,提升了算法的训练效率;最后在不同任务环境下测试了ML-DDPG 算法的目标跟踪与清障性能表现,和其它算法对比验证了其在陌生环境中良好的迁移与泛化能力。     

Experience-based imitation using RNNPB

Robot imitation is a useful and promising alternative to robot programming. Robot imitation involves two crucial issues. The first is how a robot can imitate a human whose physical structure and properties differ greatly from its own. The second is how the robot can generate various motions from finite programmable patterns (generalization). This paper describes a novel approach to robot imitation based on its own physical experiences. We considered the target task of moving an object on a table. For imitation, we focused on an active sensing process in which the robot acquires the relation between the object's motion and its own arm motion. For generalization, we applied the RNNPB (recurrent neural network with parametric bias) model to enable recognition/generation of imitation motions. The robot associates the arm motion which reproduces the observed object's motion presented by a human operator. Experimental results proved the generalization capability of our method, which enables the robot to imitate not only motion it has experienced, but also unknown motion through nonlinear combination of the experienced motions.     

A Study on Error Recovery Search Strategies of Electronic Connector Mating for Robotic Fault-Tolerant Assembly

In this paper, a CAD-based trajectory planning scheme for parallel machining robots is introduced using the parametric Non-uniform rational basis spline (NURBS) curves. First, a trajectory is designed via a NURBS curve then, a motion scheduling architecture consisting of time-dependent and constant feedrate profiles is advised to generate the position commands on the represented NURBS curve as the tool path. Using the generated commands, the inverse kinematics is elaborated to obtain the joints motions of the parallel machining robot. This paper investigates the NURBS trajectory generation for a parallel robot with 4(UPS)-PU mechanism as the case study. In order to evaluate the effectiveness of the proposed method, the inverse kinematic results for the parallel machining robot of 4(UPS)-PU is compared with the simulation results obtained from the CATIA software. The results confirmed that the proposed trajectory planning scheme along with the advised motion planning architecture is not only feasible for the parallel machining robots but also yields a smooth trajectory with a satisfactory performance for all the joints.     

Human motion database with a binary tree and node transition graphs

Database of human motion has been widely used for recognizing human motion and synthesizing humanoid motions. In this paper, we propose a data structure for storing and extracting human motion data and demonstrate that the database can be applied to the recognition and motion synthesis problems in robotics. We develop an efficient method for building a human motion database from a collection of continuous, multi-dimensional motion clips. The database consists of a binary tree representing the hierarchical clustering of the states observed in the motion clips, as well as node transition graphs representing the possible transitions among the nodes in the binary tree. Using databases constructed from real human motion data, we demonstrate that the proposed data structure can be used for human motion recognition, state estimation and prediction, and robot motion planning.     

基于约束轨迹重构的运动编辑

提出了一种运动数据重用的方法.采用偏移映射技术构建模型末端的位姿约束轨迹,该轨迹较好地保留了原始运动的特征;利用Unscented卡尔曼滤波方法求解约束,可以实时地生成与原始运动相似的新运动.实验结果表明,该方法可以生成满足不同模型和场景要求的多种运动,扩展了捕获数据的应用范围.     

Acquisition of obstacle motion patterns to improve mobile robot motion planning

Mobile robots for advanced applications have to act in environments which contain moving obstacles (humans). Even though the motions of such obstacles are not precisely predictable, usually they are not completely random; long-term observation of obstacle behavior may thus yield valuable knowledge about prevailing motion patterns. By incorporating such knowledge as statistical data, a new approach called statistical motion planning yields robot motions which are better adapted to the dynamic environment. To put these ideas into practice, an experimental system has been developed. Cameras observe the workspace in order to detect obstacle motion. Statistical data is derived and represented as a set of stochastic trajectories. This data can be directly employed in order to calculate collision probability, i.e. the probability of encountering an obstacle during the robot's motion. Further aspects of motion planning are addressed: path planning which minimizes collision probability, estimation of expected time to reach the goal and reactive planning.     

Robot motion design using bunraku emotional expressions – focusing on Jo-Ha-Kyū in sounds and movements*

One of the UNESCO intangible cultural heritages Bunraku puppets can play one of the most beautiful puppet motions in the world. The Bunraku puppet motions can express emotions without the so-called ‘Uncanny Valley.’ We try to convert these emotional motions into robot affective motions so that robots can interact with human beings more comfortable. In so doing, in the present paper, we present a robot motion design framework using Bunraku affective motions that are based on the so-called ‘Jo-Ha-Kyū,’ and convert a few simple Bunraku motions into a robot motions using one of deep learning methods. Our primitive experiments show that Jo-Ha-Kyū can be incorporated into robot motion design smoothly, and some simple affective robot motions can be designed using our proposed framework.