Semi-Autonomous Bilateral Teleoperation of Hexapod Robot Based on Haptic Force Feedback

With the widespread use of multi-legged robots in various applications, new challenges have arisen in terms of designing their control systems, one of which is posed by the multiple degrees of freedom of the robotic legs. This paper proposes a novel method for the bilateral teleoperation control of a hexapod robot by using a semi-autonomous strategy. In this teleoperation system, the body velocities of the slave robot and the displacements of the master robot are mapped to each other. The angular velocities of the joints of the legs rely on independent planning to achieve a horizontal movement. A controller is designed based on the difference between the expected velocity and the actual velocity of the body, and the difference is fed back to the operator in the form of haptic force. Therefore, the transparency of the control system is guaranteed by increasing the damping compensation both in the master and slave robots. In addition, the stability of the bilateral teleoperation control system of the hexapod robot is guaranteed by passivity theory, and the proposed method is verified by conducting semi-physical simulation experiments.     

基于时域无源性控制的六足机器人双边触觉遥操作

随着六足机器人研究工作的深入,针对其遥操作系统的开发面临诸多挑战.为了弥补松软接触条件对系统可控性及稳定性的影响,提出一种基于时域无源性控制(time-domain passivity control,TDPC)的六足机器人双边触觉遥操作方法.其主从两端采取位置-速度的交互模式,通过分析足-地柔性接触的作用机理,构建无源观测器和无源控制律以补偿足底滑移所导致环境系统的潜在有源性,采用速度跟踪模式设计基于触觉力反馈的系统控制架构,并利用Llewellyn准则确定控制律参数的稳定范围.最后,搭建半物理仿真实验平台并验证所提出的双边触觉遥操作方法在松软地形条件下能够保证六足机器人遥操作系统的稳定,且兼具较好的持续跟踪能力.     

Introduction to the special issue on Advances in intelligent nonlinear control for robotic systems

In the last two decades, robotic systems have achieved wide applications in every aspect of human society, including industrial manufacturing, automotive production, medical devices, and social lives. With the     

面向双操作者的六足机器人共享遥操作

随着六足机器人遥操作系统研究工作的日趋深入,针对其操控系统的开发也将面临诸多挑战.为了实现双人操控条件下各操作者的控制权重实时分配,设计一种基于透明性及控制状态(TCS)的六足机器人双用户控制权重分配方法.其双主端与单从端采取位置-速度的交互模式,通过分析系统实时透明性与当前控制状态,构建三边遥操作控制律,实时计算共享因子,采用速度跟踪模式设计基于触觉力反馈的系统控制架构,并利用三端口绝对稳定定理确定控制律参数的稳定范围.最后,搭建半物理仿真实验平台并验证所设计的三边共享遥操作方法能够在兼顾系统安全性与透明性的同时以较高的效率与安全性实现六足机器人的双用户操控,并能充分考虑双用户的控制意图.     

Upper-body haptic system for snake robot teleoperation in pipelines

Snake robots have shown a great potential for operations in confined workplaces that are less accessible or dangerous to human workers, such as the in-pipe inspection. However, the snake robot teleoperation remains a nontrivial task due to the unique locomotion mechanism (e.g., helical motion) and the constraints of the workplaces including the low visibility and indistinguishable features. Most snake robot feedback systems are based on the live camera view only. It is hard for the human operator to develop a correct spatial understanding of the remote workplace, leading to problems such as disorientation and motion sickness in snake robot teleoperation. This study designs and evaluates an innovative haptic assistant system for snake robot teleoperation in the in-pipe inspection. An upper-body haptic suit with 40 vibrators on both the front and back sides of the human operator was developed to generate haptic feedback corresponding to the bottom and up sides of the snake robot, transferring the egocentric sensation of the snake robot to the human operator. A human-subject experiment (n = 31) was performed to evaluate the efficacy of the developed system. The results indicate that the proposed haptic assistant system outperformed other feedback systems in terms of both task performance and subjective workload and motion sickness evaluations. It inspires new control and feedback designs for the future snake robot in industrial operations.     

A design of bilateral teleoperation systems using composite adaptive controller

This paper presents a synchronization scheme of bilateral teleoperation systems using composite adaptive controller. To design a controller for bilateral teleoperation systems, all the parameters of the master and the slave robots need to be known. However, there exist parameter uncertainties in the robot manipulators. A composite adaptive controller is designed for convergence of states and parameters of the master and the slave robots in the presence of parameter uncertainties. Consequently, position and force tracking problems in free and contact motion are solved in a synchronized manner. Through a number of simulations, the superiority of the proposed method over existing works is illustrated. Furthermore, for the validation of utility of the proposed method in an actual embedded system, the algorithms are implemented and tested in FPGA-based hardware controller.     

Robustly Stable Adaptive Control of a Tandem of Master–Slave Robotic Manipulators With Force Reflection by Using a Multiestimation Scheme

The problem of controlling a tandem of robotic manipulators composing a teleoperation system with force reflection is addressed in this paper. The final objective of this paper is twofold: 1) to design a robust control law capable of ensuring closed-loop stability for robots with uncertainties and 2) to use the so-obtained control law to improve the tracking of each robot to its corresponding reference model in comparison with previously existing controllers when the slave is interacting with the obstacle. In this way, a multiestimation-based adaptive controller is proposed. Thus, the master robot is able to follow more accurately the constrained motion defined by the slave when interacting with an obstacle than when a single-estimation-based controller is used, improving the transparency property of the teleoperation scheme. The closed-loop stability is guaranteed if a minimum residence time, which might be updated online when unknown, between different controller parameterizations is respected. Furthermore, the analysis of the teleoperation and stability capabilities of the overall scheme is carried out. Finally, some simulation examples showing the working of the multiestimation scheme complete this paper.     

Robustly stable adaptive control of a tandem of master-slave robotic manipulators with force reflection by using a multiestimation scheme.

The problem of controlling a tandem of robotic manipulators composing a teleoperation system with force reflection is addressed in this paper. The final objective of this paper is twofold: 1) to design a robust control law capable of ensuring closed-loop stability for robots with uncertainties and 2) to use the so-obtained control law to improve the tracking of each robot to its corresponding reference model in comparison with previously existing controllers when the slave is interacting with the obstacle. In this way, a multiestimation-based adaptive controller is proposed. Thus, the master robot is able to follow more accurately the constrained motion defined by the slave when interacting with an obstacle than when a single-estimation-based controller is used, improving the transparency property of the teleoperation scheme. The closed-loop stability is guaranteed if a minimum residence time, which might be updated online when unknown, between different controller parameterizations is respected. Furthermore, the analysis of the teleoperation and stability capabilities of the overall scheme is carried out. Finally, some simulation examples showing the working of the multiestimation scheme complete this paper.     

基于立体视觉的串联机器人跟踪检测系统

建立一种六自由度串联机器人视觉跟踪检测系统框架,包括图像采集、摄像机标定、机器臂跟踪检测、机器臂位姿建模与计算等。提出利用CamShift算法对机器人进行在线粗跟踪,搜寻和画定出机器臂操作器在当前窗口的区域位置。对跟踪到的机器臂按照SURF算法进行特征提取与立体匹配。该方法被用于对串联机器人位姿检测进行实验。实验结果表明,2种算法的结合适用于六自由度串联机器人在空间复杂运动的跟踪检测。     

Adaptive control of redundant multiple robots in cooperative motion

A redundant robot has more degrees of freedom than what is needed to uniquely position the robot end-effector. In practical applications the extra degrees of freedom increase the orientation and reach of the robot. Also the load carrying capacity of a single robot can be increased by cooperative manipulation of the load by two or more robots. In this paper, we develop an adaptive control scheme for kinematically redundant multiple robots in cooperative motion.In a usual robotic task, only the end-effector position trajectory is specified. The joint position trajectory will therefore be unknown for a redundant multi-robot system and it must be selected from a self-motion manifold for a specified end-effector or load motion. In this paper, it is shown that the adaptive control of cooperative multiple redundant robots can be addressed as a reference velocity tracking problem in the joint space. A stable adaptive velocity control law is derived. This controller ensures the bounded estimation of the unknown dynamic parameters of the robots and the load, the exponential convergence to zero of the velocity tracking errors, and the boundedness of the internal forces. The individual robot joint motions are shown to be stable by decomposing the joint coordinates into two variables, one which is homeomorphic to the load coordinates, the other to the coordinates of the self-motion manifold. The dynamics on the self-motion manifold are directly shown to be related to the concept of zero-dynamics. It is shown that if the reference joint trajectory is selected to optimize a certain type of objective functions, then stable dynamics on the self-motion manifold result. The overall stability of the joint positions is established from the stability of two cascaded dynamic systems involving the two decomposed coordinates.     

外骨骼式遥操作主手设计及主从异构映射算法研究

为了更好地促进机器人适应复杂的遥操作任务,开发了能够精确获取人体上肢运动信息的外骨骼式遥操作主手,并通过异构映射算法,实现对6自由度协作机械臂的遥操作．首先,基于人体仿生结构,设计了可穿戴式8自由度外骨骼主手（臂部7自由度和手部1自由度）;其次,通过改进的D-H（Denavit-Hartenberg）方法建立遥操作系统的运动学模型,基于Matlab的机器人工具箱进行了工作空间仿真,并设计主从异构映射算法;最后,实验验证外骨骼主手在遥操作系统中的可操作性,以及工作空间异构映射算法的可行性．实验表明,外骨骼主手能够控制从端机械手臂,且保证末端位置和姿态一致,可在大范围工作空间内复现人体上肢精细运动,主从跟随误差达2 mm,工作空间类似于直径1.08 m的半球形．因此,可穿戴式的外骨骼主手使操作者能更加直观地参与到遥操作系统当中,辅助操作者更加高效地完成精细复杂任务．     

Haptic teleoperation of a multirotor aerial robot using path planning with human intention estimation

Classical haptic teleoperation systems heavily rely on operators’ intelligence and efforts in aerial robot navigation tasks, thereby posing significantly users’ workloads. In this paper, a novel shared control scheme is presented facilitating a multirotor aerial robot haptic teleoperation system that exhibits autonomous navigation capability. A hidden Markov model filter is proposed to identify the intention state of operator based on human inputs from haptic master device, which is subsequently adopted to derive goal position for a heuristic sampling based local path planner. The human inputs are considered as commanded velocity for a trajectory servo controller to drive the robot along the planned path. In addition, vehicle velocity is perceived by the user via haptic feedback on master device to enhance situation awareness and navigation safety of the user. An experimental study was conducted in a simulated and a physical environment, and the results verify the effectiveness of the novel scheme in safe navigation of aerial robots. A user study was carried out between a classical haptic teleoperation system and the proposed approach in the identical simulated complex environment. The flight data and task load index (TLX) are acquired and analyzed. Compared with the conventional haptic teleoperation scheme, the proposed scheme exhibits superior performance in safe and fast navigation of the multirotor vehicle, and is also of low task and cognitive loads.

     

Dynamic Analysis of a Nonholonomic Two-Wheeled Inverted Pendulum Robot

As a result of the increase in robots in various fields, the mechanical stability of specific robots has become an important subject of research. This study is concerned with the development of a two-wheeled inverted pendulum robot that can be applied to an intelligent, mobile home robot. This kind of robotic mechanism has an innately clumsy motion for stabilizing the robot's body posture. To analyze and execute this robotic mechanism, we investigated the exact dynamics of the mechanism with the aid of 3-DOF modeling. By using the governing equations of motion, we analyzed important issues in the dynamics of a situation with an inclined surface and also the effect of the turning motion on the stability of the robot. For the experiments, the mechanical robot was constructed with various sensors. Its application to a two-dimensional floor environment was confirmed by experiments on factors such as balancing, rectilinear motion, and spinning motion.     

Nonlinear and Filtered Force/Position Mappings in Bilateral Teleoperation With Application to Enhanced Stiffness Discrimination

Motivated by applications involving soft-tissue manipulation such as robotic surgery, the transparency objectives in bilateral teleoperation are redefined to include monotonic nonlinear and linear-time-invariant filter mappings between the master/slave position and force signals. To demonstrate the utility of the new performance measures, a stiffness discrimination telemanipulation task of soft environments is considered. A nonlinear force mapping can enhance stiffness discrimination thresholds as shown through a set of psychophysics experiments. Lyapunov-based adaptive motion/force controllers are presented that can achieve the new transparency objectives in the presence of dynamic uncertainty in the master, slave, user, and environment and in the absence of time delay. Given a priori known bounds on unknown dynamic parameters, a framework for robust stability analysis is proposed that uses an off-axis circle criterion and the Nyquist envelope of interval plant systems. Nonlinear- and linear-filtered mappings are achieved in experiments with a two-axis teleoperation system.     

Teleoperation in the presence of varying time delays and sandwich linearity in actuators

In this paper, a novel control scheme is proposed to guarantee global asymptotic stability of bilateral teleoperation systems that are subjected to time-varying time delays in their communication channel and sandwich linearity in their actuators. This extends prior art concerning control of nonlinear bilateral teleoperation systems under time-varying time delays to the case where the local and the remote robots’ control signals pass through saturation or similar nonlinearities that belong to a class of systems we name sandwich linear systems. Our proposed controller is similar to the proportional plus damping (P+D) controller with the difference that it takes into account the actuator saturation at the outset of control design and alters the proportional term by passing it through a nonlinear function; thus, we call the proposed method as nonlinear proportional plus damping (nP+D). The asymptotic stability of the closed-loop system is established using a Lyapunov–Krasovskii functional under conditions on the controller parameters, the actuator saturation characteristics, and the maximum values of the time-varying time delays. To show the effectiveness of the proposed method, it is simulated on a variable-delay teleoperation system comprising a pair of planar 2-DOF robots subjected to actuator saturation. Furthermore, the controller is experimentally validated on a pair of 3-DOF PHANToM Premium 1.5A robots, which have limited actuation capacity, that form a teleoperation system with a varying-delay communication channel.     

Nonlinear adaptive control for dynamic and dead-zone uncertainties in robotic systems

Accurate position tracking performance of robotic systems with both dynamic and dead-zone uncertainties is difficult to achieve by traditional adaptive control. In this paper, for nonlinear robotic systems in the presence of uncertain dynamics and dead-zone, an adaptive control scheme is employed to guarantee accurate and stable position tracking. The dynamics of the robot and dead-zone parameters are concurrently estimated in the adaptation laws and the estimated values are subsequently applied in the control law. In order to demonstrate the practicability of this paper, an experimental setup composed of Phantom Omni robots are built. The experimental results show that even when the dynamic and dead-zone uncertainties simultaneously appear, the robot can well track any desired position trajectory.

     

工业机器人遥操作系统的空间映射与控制策略

针对工业机器人遥操作系统中存在的主从机器人工作空间差异以及运动控制精度与安全问题,提出了一种工作空间映射算法与位置—速度混合控制策略。首先,将遥操作划分为自由运动和交互两个阶段,在自由运动阶段采用映射算法使主从机器人的工作空间高度覆盖,使主机器人可操控的从机器人运动范围最大化。进一步,在交互阶段设计了一种位置—速度混合控制策略对工业机器人的运动进行准确的控制,使主从机器人的实际位置轨迹准确的跟随,并进一步引入反馈引导力以实现安全的控制。最后在Touch-ABB IRB120主从机器人遥操作实验平台上对所提控制方法进行验证,实验结果表明该方法使得主从机器人运动范围在高度覆盖的同时可以保证遥操作控制的精度。     

Stability and control aspects of flexible link robot manipulators during constrained motion tasks

The effect of robotic manipulator structural compliance on system stability and trajectory tracking performance and the compensation of this structural compliance has been the subject of a number of publications for the case of robotic manipulator noncontact task execution. The subject of this article is the examination of dynamics and stability issues of a robotic manipulator modeled with link structural flexibility during execution of a task that requires the robot tip to contact fixed rigid objects in the work environment. The dynamic behavior of a general n degree of freedom flexible link manipulator is investigated with a previously proposed nonlinear computed torque constrained motion control applied, computed based on the rigid link equations of motion. Through the use of techniques from the theory of singular perturbations, the analysis of the system stability is investigated by examining the stability of the “slow” and “fast” subsystem dynamics. The conditions under which the fast subsystem dynamics exhibit a stable response are examined. It is shown that if certain conditions are satisfied a control based on only the rigid link equations of motion will lead to asymptotic trajectory tracking of the desired generalized position and force trajectories during constrained motion. Experiments reported here have been carried out to investigate the performance of the nonlinear computed torque control law during constrained motion of the manipulator. While based only on the rigid link equations of motion, experimental results confirm that high-frequency structural link modes, exhibited in the response of the robot, are asymptotically stable and do not destabilize the slow subsystem dynamics, leading to asymptotic trajectory tracking of the overall system. © 1992 John Wiley & Sons, Inc.     

Teleoperation Control of a Position‐Based Impedance Force Controlled Mobile Robot by Neural Network Learning: Experimental Studies

Effective haptic performance in teleoperation control systems can be achieved by solving two major problems: the time‐delay in communication channels and the transparency of force control. The time‐delay in communication channels causes poor performance and even instability in a system. The transparency of force feedback is important for an operator to improve the performance of a given task. This article suggests a possible solution for these two problems through the implementation of a teleoperation control system between the master haptic device and the slave mobile robot. Regulation of the contact force in the slave mobile robot is achieved by introducing a position‐based impedance force control scheme in the slave robot. The time‐delay problem is addressed by forming a Smith predictor configuration in the teleoperation control environment. The configuration of the Smith predictor structure takes the time‐delay term out of the characteristic equation in order to make the system stable when the system model is given a priori. Since the Smith predictor is formulated from exact linear modeling, a neural network is employed to identify and model the slave robot system as a nonlinear model estimator. Simulation studies of several control schemes are performed. Experimental studies are conducted to verify the performance of the proposed control scheme by regulating the contact force of a mobile robot through the master haptic device.     

Nonlinear bilateral teleoperators under event‐driven communication with constant time delays

Bilateral teleoperation systems provide a platform for human operators to remotely manipulate slave robots in engaging various tasks in remote environments. Most of the previous studies in bilateral teleoperation were developed under continuous transmission or periodic communication with fixed data exchanging rates. This paper presents control schemes for bilateral teleoperation systems using nonperiodic event‐driven communication. By using P‐like and PD‐like controllers, this study proposes triggering conditions for teleoperators to reduce network access frequency so that robots only transmit output signals when necessary. Stability and position tracking of the control system are studied, and nonzero minimum interevent time is guaranteed. The proposed event‐driven teleoperation is studied with a velocity estimator to avoid the requirement of velocity information in the controller and triggering condition. Without velocity measurements, the boundedness of tracking errors and stability are ensured for teleoperation systems under event‐driven communication. Simulations and experiments are illustrated to validate the performance of the proposed event‐driven teleoperation systems.