Generating human-like soccer primitives from human data

Recently, interest in analysis and generation of human and human-like motion has increased in various areas. In robotics, in order to operate a humanoid robot, it is necessary to generate motions that have strictly dynamic consistency. Furthermore, human-like motion for robots will bring advantages such as energy optimization.This paper presents a mechanism to generate two human-like motions, walking and kicking, for a biped robot using a simple model based on observation and analysis of human motion. Our ultimate goal is to establish a design principle of a controller in order to achieve natural human-like motions. The approach presented here rests on the principle that in most biological motor learning scenarios some form of optimization with respect to a physical criterion is taking place. In a similar way, the equations of motion for the humanoid robot systems are formulated in such a way that the resulting optimization problems can be solved reliably and efficiently.The simulation results show that faster and more accurate searching can be achieved to generate an efficient human-like gait. Comparison is made with methods that do not include observation of human gait. The gait has been successfully used to control Robo-Erectus, a soccer-playing humanoid robot, which is one of the foremost leading soccer-playing humanoid robots in the RoboCup Humanoid League.     

仿人机器人复杂动态动作设计及相似性研究

提出了一种基于人体运动的考虑节奏相似性的仿人机器人复杂动态动作设计方法. 首先, 把人体的运动分割成基本动作段, 给出了运动学约束, 讨论了复杂动态动作的稳定性调节方法. 然后, 提出了考虑运动节奏的仿人机器人模仿人体动作的相似性函数, 并给出了满足运动学约束和动力学稳定性、具有高相似性的运动轨迹求解方法. 最后, 通过在仿人机器人 BHR-2 上进行中国功夫``刀术'实验验证了该方法的有效性.     

仿人机器人复杂动作设计中人体运动数据提取及分析方法

提出了仿人机器人复杂动作设计中人体运动数据提取及分析方法. 首先, 通过运动捕捉系统获取人体运动数据, 并采用运动重定向技术, 输出人--机简化模型的数据; 然后, 对运动数据进行分析和运动学解算, 给出基于人体运动数据的仿人机器人逆运动学求解方法, 得到仿人机器人模型的关节角数据; 再经过运动学约束和稳定性调节后, 生成能够应用于仿人机器人的运动轨迹. 最终, 通过在仿人机器人BHR-2上进行刀术实验验证了该方法的有效性.     

Motion planning for humanoid robots based on virtual constraints extracted from recorded human movements

In the field of robotics there is a great interest in developing strategies and algorithms to reproduce human-like behavior. In this paper, we consider motion planning for humanoid robots based on the concept of virtual holonomic constraints. At first, recorded kinematic data of particular human motions are analyzed in order to extract consistent geometric relations among various joint angles defining the instantaneous postures. Second, a simplified human body representation leads to dynamics of an underactuated mechanical system with parameters based on anthropometric data. Motion planning for humanoid robots of similar structure can be carried out by considering solutions of reduced dynamics obtained by imposing the virtual holonomic constraints that are found in human movements. The relevance of such a reduced mathematical model in accordance with the real human motions under study is shown. Since the virtual constraints must be imposed on the robot dynamics by feedback control, the design procedure for a suitable controller is briefly discussed.     

Analysis of Humanoid Appearances in Human–Robot Interaction

Identifying the extent to which the appearance of a humanoid robot affects human behavior toward it is important. We compared participant impressions of and behaviors toward two real humanoid robots in simple human-robot interactions. These two robots, which have different appearances but are controlled to perform the same recorded utterances and motions, are adjusted by a motion-capturing system. We conducted an experiment with 48 human participants who individually interacted with the two robots and also with a human for reference. The results revealed that different appearances did not affect participant verbal behaviors, but they did affect such nonverbal behaviors as distance and delay of response. These differences are explained by two factors: impressions and attributions.     

Stepping over obstacles with humanoid robots

The wide potential applications of humanoid robots require that the robots can walk in complex environments and overcome various obstacles. To this end, we address the problem of humanoid robots stepping over obstacles in this paper. We focus on two aspects, which are feasibility analysis and motion planning. The former determines whether a robot can step over a given obstacle, and the latter discusses how to step over, if feasible, by planning appropriate motions for the robot. We systematically examine both of these aspects. In the feasibility analysis, using an optimization technique, we cast the problem into global optimization models with nonlinear constraints, including collision-free and balance constraints. The solutions to the optimization models yield answers to the possibility of stepping over obstacles under some assumptions. The presented approach for feasibility provides not only a priori knowledge and a database to implement stepping over obstacles, but also a tool to evaluate and compare the mobility of humanoid robots. In motion planning, we present an algorithm to generate suitable trajectories of the feet and the waist of the robot using heuristic methodology, based on the results of the feasibility analysis. We decompose the body motion of the robot into two parts, corresponding to the lower body and upper body of the robot, to meet the collision-free and balance constraints. This novel planning method is adaptive to obstacle sizes, and is, hence, oriented to autonomous stepping over by humanoid robots guided by vision or other range finders. Its effectiveness is verified by simulations and experiments on our humanoid platform HRP-2.     

Constructive understanding and reproduction of functions of gluteus medius by using a musculoskeletal walking robot

Several factors affect the performance of humanoid walking. One factor is the complex nature of lower limbs, especially the muscles around the pelvis that contribute significantly to the stability and adaptivity of humanoid locomotion. The significance of this muscle group assures a impact on the facility of walking robots once the nature of its contribution is understood, and it can be replicated on robots. To propose a mechanical structure that facilitates walking in robots, we realized a muscle by modeling its pelvis region like that of a humanoid and developing a musculoskeletal humanoid robot. Especially, we focused on the gluteus medius, which is important for the general stability against frontal movements of the hip. Furthermore, it passively changes its influence on such motions; this is helpful during the different phases of locomotion. These changes depend on the alignment of the pelvis and femur. We confirmed the viability of the robotic gluteus medius, which was simplified to a model of two partial muscles by accomplishing the walking using this robot. This accomplishment verifies our hypothesis that using this model, the supporting functionality for the locomotion of the muscle can be reproduced and enhances the biological plausibility.     

A new paradigm of humanoid robot motion programming based on touch interpretation

Most humanoid soccer robot teams design the basic movements of their robots, like walking and kicking, off-line and manually. Once these motions are considered satisfactory, they are stored in the robot’s memory and played according to a high level behavioral strategy. Much time is spent in the development of the movements, and despite the significant progress made in humanoid soccer robots, the interfaces employed for the development of motions are still quite primitive. In order to accelerate development, an intuitive instruction method is desired. We propose the development of robot motions through physical interaction. In this paper we propose a ”teaching by touching” approach; the human operator teaches a motion by directly touching the robot’s body parts like a dance instructor. Teaching by directly touching is intuitive for instructors. However, the robot needs to interpret the instructor’s intention since tactile communication can be ambiguous. This paper presents a method to learn the interpretation of the touch meaning and investigates, through experiments, a general (shared among different users) and intuitive touch manner.     

Towards cooperation of heterogeneous,autonomous robots: A case study of humanoid and wheeled robots

In this paper a case study of the cooperation of a strongly heterogeneous autonomous robot team, composed of a highly articulated humanoid robot and a wheeled robot with largely complementing and some redundant abilities is presented. By combining strongly heterogeneous robots the diversity of achievable tasks increases as the variety of sensing and motion abilities of the robot system is extended, compared to a usually considered team of homogeneous robots. A number of methodologies and technologies required in order to achieve the long-term goal of cooperation of heterogeneous autonomous robots are discussed, including modeling tasks and robot abilities, task assignment and redistribution, robot behavior modeling and programming, robot middleware and robot simulation. Example solutions and their application to the cooperation of autonomous wheeled and humanoid robots are presented in this case study. The scenario describes a tightly coupled cooperative task, where the humanoid robot and the wheeled robot track a moving ball, which is to be approached and kicked by the humanoid robot into a goal. The task can be fulfilled successfully by combining the abilities of both robots.     

人体步行规律与仿人机器人步态规划

从仿生学角度分析了人体的步行运动规律,提出了一种基于人体运动规律的仿人机器人步态参数设定方法.首先对人体步行运动数据进行捕捉并分析,得出人体各步态参数间的函数关系,以人体步行相似性作为评价指标,提出仿人机器人步态参数的设定方法.其次,通过分析人体在步行过程中的补偿支撑脚偏航力矩的基本原理,提出了基于双臂及腰关节协调运动的仿人机器人偏航力矩补偿算法,以提高仿人机器人行走的稳定性.最后通过仿真及实验验证了所提出的步态规划方法的正确性及有效性.     

Real-time Unsupervised Segmentation of human whole-body motion and its application to humanoid robot acquisition of motion symbols

An interactive loop between motion recognition and motion generation is a fundamental mechanism for humans and humanoid robots. We have been developing an intelligent framework for motion recognition and generation based on symbolizing motion primitives. The motion primitives are encoded into Hidden Markov Models (HMMs), which we call “motion symbols”. However, to determine the motion primitives to use as training data for the HMMs, this framework requires a manual segmentation of human motions. Essentially, a humanoid robot is expected to participate in daily life and must learn many motion symbols to adapt to various situations. For this use, manual segmentation is cumbersome and impractical for humanoid robots. In this study, we propose a novel approach to segmentation, the Real-time Unsupervised Segmentation (RUS) method, which comprises three phases. In the first phase, short human movements are encoded into feature HMMs. Seamless human motion can be converted to a sequence of these feature HMMs. In the second phase, the causality between the feature HMMs is extracted. The causality data make it possible to predict movement from observation. In the third phase, movements having a large prediction uncertainty are designated as the boundaries of motion primitives. In this way, human whole-body motion can be segmented into a sequence of motion primitives. This paper also describes an application of RUS to AUtonomous Symbolization of motion primitives (AUS). Each derived motion primitive is classified into an HMM for a motion symbol, and parameters of the HMMs are optimized by using the motion primitives as training data in competitive learning. The HMMs are gradually optimized in such a way that the HMMs can abstract similar motion primitives. We tested the RUS and AUS frameworks on captured human whole-body motions and demonstrated the validity of the proposed framework.     

Inverse Kinematics Based Human Mimicking System using Skeletal Tracking Technology

Humanoid robots needs to have human-like motions and appearance in order to be well-accepted by humans. Mimicking is a fast and user-friendly way to teach them human-like motions. However, direct assignment of observed human motions to robot’s joints is not possible due to their physical differences. This paper presents a real-time inverse kinematics based human mimicking system to map human upper limbs motions to robot’s joints safely and smoothly. It considers both main definitions of motion similarity, between end-effector motions and between angular configurations. Microsoft Kinect sensor is used for natural perceiving of human motions. Additional constraints are proposed and solved in the projected null space of the Jacobian matrix. They consider not only the workspace and the valid motion ranges of the robot’s joints to avoid self-collisions, but also the similarity between the end-effector motions and the angular configurations to bring highly human-like motions to the robot. Performance of the proposed human mimicking system is quantitatively and qualitatively assessed and compared with the state-of-the-art methods in a human-robot interaction task using Nao humanoid robot. The results confirm applicability and ability of the proposed human mimicking system to properly mimic various human motions.     

Motion teaching method for complex robot links using motor current

Conventional robot motion teaching methods use a teaching pendant or a motion capture device and are not the most convenient or intuitive ways to teach a robot sophisticated and fluid movements such as martial arts motions. Ideally, a robot could be set up as if it were a clothing mannequin that has light limbs and flexible yet frictional joints which can be positioned at desirable shape and hold all the positions. To do the same with a robot, an operator could pull or push the links with minor forces until the desired robot posture is attained. For this, a robot should measure the applied external force by using torque sensors at the robot joints. However, torque sensors are bulky and expensive to install in every DOF joints while keeping a compact design, which is essential to humanoid robots. In this paper, we use only motor current readings to acquire joint torques. The equations used to compensate for the effect of gravity on the joint torques and the self-calibration method to earn link parameters are presented. Additionally, kinematic restrictions can be imposed on the robot’s arms to simplify the motion teaching. Here, we teach the Kendo training robot with this method and the robot’s learnt martial art motions are demonstrated.     

Adequate motion simulation and collision detection for soccer playing humanoid robots

In this paper a humanoid robot simulator based on the multi-robot simulation framework (MuRoSimF) is presented. Among the unique features of this simulator is the scalability in the level of physical detail in both the robot’s motion and sensing systems. It facilitates the development of control software for humanoid robots which is demonstrated for several scenarios from the RoboCup Humanoid Robot League.Different requirements exist for a humanoid robot simulator. E.g., testing of algorithms for motion control and postural stability require high fidelity of physical motion properties whereas testing of behavior control and role distribution for a robot team requires only a moderate level of detail for real-time simulation of multiple robots. To meet such very different requirements often different simulators are used which makes it necessary to model a robot multiple times and to integrate different simulations with high-level robot control software.MuRoSimF provides the capability of exchanging the simulation algorithms used for each robot transparently, thus allowing a trade-off between computational performance and fidelity of the simulation. It is therefore possible to choose different simulation algorithms which are adequate for the needs of a given simulation experiment, for example, motion simulation of humanoid robots based on kinematical, simplified dynamics or full multi-body system dynamics algorithms. In this paper also the sensor simulation capabilities of MuRoSimF are revised. The methods for motion simulation and collision detection and handling are presented in detail including an algorithm which allows the real-time simulation of the full dynamics of a 21 DOF humanoid robot. Merits and drawbacks of the different algorithms are discussed in the light of different simulation purposes. The simulator performance is measured and illustrated in various examples, including comparison with experiments of a physical humanoid robot.     

Humanoids skill learning based on real-time human motion imitation using Kinect

In this paper, a novel framework which enables humanoid robots to learn new skills from demonstration is proposed. The proposed framework makes use of real-time human motion imitation module as a demonstration interface for providing the desired motion to the learning module in an efficient and user-friendly way. This interface overcomes many problems of the currently used interfaces like direct motion recording, kinesthetic teaching, and immersive teleoperation. This method gives the human demonstrator the ability to control almost all body parts of the humanoid robot in real time (including hand shape and orientation which are essential to perform object grasping). The humanoid robot is controlled remotely and without using any sophisticated haptic devices, where it depends only on an inexpensive Kinect sensor and two additional force sensors. To the best of our knowledge, this is the first time for Kinect sensor to be used in estimating hand shape and orientation for object grasping within the field of real-time human motion imitation. Then, the observed motions are projected onto a latent space using Gaussian process latent variable model to extract the relevant features. These relevant features are then used to train regression models through the variational heteroscedastic Gaussian process regression algorithm which is proved to be a very accurate and very fast regression algorithm. Our proposed framework is validated using different activities concerned with both human upper and lower body parts and object grasping also.     

Posture/Walking Control for Humanoid Robot Based on Kinematic Resolution of CoM Jacobian With Embedded Motion

This paper proposes the walking pattern generation method, the kinematic resolution method of center of mass (CoM) Jacobian with embedded motions, and the design method of posture/walking controller for humanoid robots. First, the walking pattern is generated using the simplified model for bipedal robot. Second, the kinematic resolution of CoM Jacobian with embedded motions makes a humanoid robot balanced automatically during movement of all other limbs. Actually, it offers an ability of whole body coordination to humanoid robot. Third, the posture/walking controller is completed by adding the CoM controller minus the zero moment point controller to the suggested kinematic resolution method. We prove that the proposed posture/walking controller brings the disturbance input-to-state stability for the simplified bipedal walking robot model. Finally, the effectiveness of the suggested posture/walking control method is shown through experiments with regard to the arm dancing and walking of humanoid robot.     

Clock-turning gait synthesis for humanoid robots

Turning gait is a basic motion for humanoid robots. This paper presents a method for humanoid tuming, i.e. clock-turning. The objective of clock-turning is to change robot direction at a stationary spot. The clock-turning planning consists of four steps： ankle trajectory generation, hip trajectory generation, knee trajectory generation, and inverse kinematics calculation. Our proposed method is based on a typical humanoid structure with 12 DOFs （degrees of freedom）. The final output of clock-turning planning is 12 reference trajectories, which are used to control a humanoid robot with 12 DOFs. ZMP （zero moment point） is used as stability criterion for the planning. Simulation experiments are conducted to verify the effectiveness of our proposed clock-turuing method.     

Can a humanoid robot continue to draw attention in an office environment?

This study focuses on the use of humanoid robots in office environments, and investigates whether a robot can maintain the attention of passersby after initiation of face-to-face contact. Drawing attention can be considered as a first step in improving the continuity of use of robots; such continuity is one factor in validating their social acceptance, which must be considered when disseminating robots in offices. In this study, we assume that the robot approaches and greets users in order to make the users aware of its presence and encourage them to use it. In particular, the robots used in this study convey various greetings along with three nonverbal indicators (no motion, random motion, and face-to-face contact) when a passerby at the office is close to the robot. For a one-week period, we validated the social acceptance of the robot by examining how these robot motions influenced the rate and continuity of a passerby's attention. The results revealed that face-to-face contact can draw a high degree of attention, and that the presence of the robot affects the continuity with which attention is drawn. Finally, the paper discusses implications for future robot design, in terms of drawing and maintaining high rates of attention from users.     

Construction of a space of motion labels from their mapping to full-body motion symbols

Language is an indispensable for humanoid robot to be integrated into daily life. This paper proposes a novel approach to construct a space of motion labels from their mapping to human whole body motions. The motions are abstracted by Hidden Markov Models, which are referred to as motion symbols. The human motions are automatically partitioned into motion segments, and recognized as sequences of the motion symbols. Sequences of motion labels are also assigned to these motions. The referential relationship between the motion symbols and the motion labels is extracted by stochastic translation model, and distances among the labels are calculated from the association probability of the motion symbols being generated by the labels. The labels are located in a multidimensional space so that the distances are satisfied, and it results in a label space. The label space encapsulates relations among the motion labels such as their similarities. The label space also allows motion recognition. The validity of the constructed label space is demonstrated on a motion capture data-set.     

Bilateral remote teaching and autonomous task execution with task progress feedback

This paper describes an approach to estimating the progress in a task executed by a humanoid robot and to synthesizing motion based on the current progress so that the robot can achieve the task. The robot observes a human performing whole body motion for a specific task, and encodes these motions into a hidden Markov model (HMM). The current observation is compared with the motion generated by the HMM, and the task progress can be estimated during the robot performing the motion. The robot subsequently uses the estimate of the task progress to generate a motion appropriate to the current situation with the feedback rule. We constructed a bilateral remote control system with humanoid robot HRP-4 and haptic device Novint Falcon, and we made the humanoid robot push a button. Ten trial motions of pushing a button were recorded for the training data. We tested our proposed approach on the autonomous execution of the pushing motion by the humanoid robot, and confirmed the effectiveness of our task progress feedback method.