Progress and prospects of the human–robot collaboration

Recent technological advances in hardware design of the robotic platforms enabled the implementation of various control modalities for improved interactions with humans and unstructured environments. An important application area for the integration of robots with such advanced interaction capabilities is human–robot collaboration. This aspect represents high socio-economic impacts and maintains the sense of purpose of the involved people, as the robots do not completely replace the humans from the work process. The research community’s recent surge of interest in this area has been devoted to the implementation of various methodologies to achieve intuitive and seamless human–robot-environment interactions by incorporating the collaborative partners’ superior capabilities, e.g. human’s cognitive and robot’s physical power generation capacity. In fact, the main purpose of this paper is to review the state-of-the-art on intermediate human–robot interfaces (bi-directional), robot control modalities, system stability, benchmarking and relevant use cases, and to extend views on the required future developments in the realm of human–robot collaboration.     

Robot adaptation to human physical fatigue in human–robot co-manipulation

In this paper, we propose a novel method for human–robot collaboration, where the robot physical behaviour is adapted online to the human motor fatigue. The robot starts as a follower and imitates the human. As the collaborative task is performed under the human lead, the robot gradually learns the parameters and trajectories related to the task execution. In the meantime, the robot monitors the human fatigue during the task production. When a predefined level of fatigue is indicated, the robot uses the learnt skill to take over physically demanding aspects of the task and lets the human recover some of the strength. The human remains present to perform aspects of collaborative task that the robot cannot fully take over and maintains the overall supervision. The robot adaptation system is based on the Dynamical Movement Primitives, Locally Weighted Regression and Adaptive Frequency Oscillators. The estimation of the human motor fatigue is carried out using a proposed online model, which is based on the human muscle activity measured by the electromyography. We demonstrate the proposed approach with experiments on real-world co-manipulation tasks: material sawing and surface polishing.     

A Neuro-Sliding-Mode Control With Adaptive Modeling of Uncertainty for Control of Movement in Paralyzed Limbs Using Functional Electrical Stimulation

During the past several years, several strategies have been proposed for control of joint movement in paraplegic subjects using functional electrical stimulation (FES), but developing a control strategy that provides satisfactory tracking performance, to be robust against time-varying properties of muscle-joint dynamics, day-to-day variations, subject-to-subject variations, muscle fatigue, and external disturbances, and to be easy to apply without any re-identification of plant dynamics during different experiment sessions is still an open problem. In this paper, we propose a novel control methodology that is based on synergistic combination of neural networks with sliding-mode control (SMC) for controlling FES. The main advantage of SMC derives from the property of robustness to system uncertainties and external disturbances. However, the main drawback of the standard sliding modes is mostly related to the so-called chattering caused by the high-frequency control switching. To eliminate the chattering, we couple two neural networks with online learning without any offline training into the SMC. A recurrent neural network is used to model the uncertainties and provide an auxiliary equivalent control to keep the uncertainties to low values, and consequently, to use an SMC with lower switching gain. The second neural network consists of a single neuron and is used as an auxiliary controller. The control law will be switched from the SMC to neural control, when the state trajectory of system enters in some boundary layer around the sliding surface. Extensive simulations and experiments on healthy and paraplegic subjects are provided to demonstrate the robustness, stability, and tracking accuracy of the proposed neuroadaptive SMC. The results show that the neuro-SMC provides accurate tracking control with fast convergence for different reference trajectories and could generate control signals to compensate the muscle fatigue and reject the external disturbance.     

WALK‐MAN: A High‐Performance Humanoid Platform for Realistic Environments

In this work, we present WALK‐MAN, a humanoid platform that has been developed to operate in realistic unstructured environment, and demonstrate new skills including powerful manipulation, robust balanced locomotion, high‐strength capabilities, and physical sturdiness. To enable these capabilities, WALK‐MAN design and actuation are based on the most recent advancements of series elastic actuator drives with unique performance features that differentiate the robot from previous state‐of‐the‐art compliant actuated robots. Physical interaction performance is benefited by both active and passive adaptation, thanks to WALK‐MAN actuation that combines customized high‐performance modules with tuned torque/velocity curves and transmission elasticity for high‐speed adaptation response and motion reactions to disturbances. WALK‐MAN design also includes innovative design optimization features that consider the selection of kinematic structure and the placement of the actuators with the body structure to maximize the robot performance. Physical robustness is ensured with the integration of elastic transmission, proprioceptive sensing, and control. The WALK‐MAN hardware was designed and built in 11 months, and the prototype of the robot was ready four months before DARPA Robotics Challenge (DRC) Finals. The motion generation of WALK‐MAN is based on the unified motion‐generation framework of whole‐body locomotion and manipulation (termed loco‐manipulation). WALK‐MAN is able to execute simple loco‐manipulation behaviors synthesized by combining different primitives defining the behavior of the center of gravity, the motion of the hands, legs, and head, the body attitude and posture, and the constrained body parts such as joint limits and contacts. The motion‐generation framework including the specific motion modules and software architecture is discussed in detail. A rich perception system allows the robot to perceive and generate 3D representations of the environment as well as detect contacts and sense physical interaction force and moments. The operator station that pilots use to control the robot provides a rich pilot interface with different control modes and a number of teleoperated or semiautonomous command features. The capability of the robot and the performance of the individual motion control and perception modules were validated during the DRC in which the robot was able to demonstrate exceptional physical resilience and execute some of the tasks during the competition.