Integrated adaptive robust control for multilateral teleoperation systems under arbitrary time delays

With the increasing industrial requirements such as bigger size object, stable operation, and complex task, multilateral teleoperation systems extended from traditional bilateral teleoperation are widely developed. In this paper, the integrated control design is developed for multilateral teleoperation systems, where n master manipulators are operated by human to remotely control n slave manipulators cooperatively handling a target object. For the first time, the control objectives of multilateral teleoperation including stability, synchronization, transparency, and internal force distribution are clarified systematically. A novel communication architecture is proposed to cope with communication delays, where the estimated environmental parameters are transmitted from the slave side to the master, to replace the traditional environmental force measurement in the communication channel. A kind of nonlinear adaptive robust control technique is used to deal with nonlinearities, unknown parameters, and modeling uncertainties existing in the master, slave, and environmental dynamics, so that the excellent tracking performance is achieved in both master and slave sides. The coordinated motion/force control is designed in the slave side by the optimal internal force distribution among n slave manipulators, and the impedance control is designed in the master side to realize the target transparency behavior. In summary, the proposed control algorithm can achieve the guaranteed robust stability, the excellent synchronization and transparency performance, and the optimal internal force distribution simultaneously for multilateral teleoperation systems under arbitrary time delays and various modeling uncertainties. The simulation is carried out on a 2‐master/2‐slave teleoperation system, and the results show the effectiveness of the proposed control design. Copyright © 2015 John Wiley & Sons, Ltd.     

Force Reflecting Bilateral Control of Master–Slave Systems in Teleoperation

In this paper, a simple structure design with arbitrary motion/force scaling to control teleoperation systems, with model mismatches is presented. The goal of this paper is to achieve transparency in presence of uncertainties. The master–slave systems are approximated by linear dynamic models with perturbed parameters, which is called the model mismatch. Moreover, the time delay in communication channel with uncertainties is considered. The stability analysis will be considered for two cases: (1) stability under time delay uncertainties and (2) stability under model mismatches. For the first case, two local controllers are designed. The first controller is responsible for tracking the master commands, while the second controller is in charge of force tracking as well as guaranteeing stability of the overall closed-loop system. In the second case, an additional term will be added to the control law to provide robustness to the closed-loop system. Moreover, in this case, the local slave controller guarantees the position tracking and the local master controller guarantees stability of the inner closed-loop system. The advantages of the proposed method are two folds: (1) robust stability of the system against model mismatches is guaranteed and (2) structured system uncertainties are well compensated by applying independent controllers to the master and the slave sites. Simulation results show good performance of the proposed method in motion tracking as well force tracking in presence of model mismatches and time delay uncertainties.     

Teleoperation Control of a Position‐Based Impedance Force Controlled Mobile Robot by Neural Network Learning: Experimental Studies

Effective haptic performance in teleoperation control systems can be achieved by solving two major problems: the time‐delay in communication channels and the transparency of force control. The time‐delay in communication channels causes poor performance and even instability in a system. The transparency of force feedback is important for an operator to improve the performance of a given task. This article suggests a possible solution for these two problems through the implementation of a teleoperation control system between the master haptic device and the slave mobile robot. Regulation of the contact force in the slave mobile robot is achieved by introducing a position‐based impedance force control scheme in the slave robot. The time‐delay problem is addressed by forming a Smith predictor configuration in the teleoperation control environment. The configuration of the Smith predictor structure takes the time‐delay term out of the characteristic equation in order to make the system stable when the system model is given a priori. Since the Smith predictor is formulated from exact linear modeling, a neural network is employed to identify and model the slave robot system as a nonlinear model estimator. Simulation studies of several control schemes are performed. Experimental studies are conducted to verify the performance of the proposed control scheme by regulating the contact force of a mobile robot through the master haptic device.     

A novel adaptive robust control architecture for bilateral teleoperation systems under time‐varying delays

Bilateral teleoperation technology has caused wide attentions due to its applications in various remote operation systems. The communication delay becomes one of the main challenging issues in the teleoperation control design. Meanwhile, various nonlinearities, parameter variations, and modeling uncertainties existing in manipulator and environment dynamics need to be considered carefully in order to achieve good control performance. In this paper, a globally stable nonlinear adaptive robust control algorithm is developed for bilateral teleoperation systems to deal with these control issues. Namely, the unknown dynamical parameters of the environmental force are estimated online by the improved least square adaptation law. A novel communication structure is proposed where only the master position signal is transmitted to the slave side for the tracking design, and the online estimators of the environmental parameters are transmitted from the slave to the master to replace the traditional environmental force measurement. Because the estimated environmental parameters are not power signals, the passivity problem of the communication channel and the trade‐off limitation between the transparency performance and robust stability in traditional teleoperation control are essentially avoided. The nonlinear adaptive robust control is subsequently developed to deal with nonlinearities, unknown parameters, and modeling uncertainties of the master, slave, and environmental dynamics, so that the guaranteed transient and steady‐state transparency performance can be achieved. The experiments on two voice‐coil motor‐driven manipulators are carried out, and the comparative results verify that the proposed control algorithm achieves the excellent control performance and the guaranteed robust stability simultaneously under time delays. Copyright © 2014 John Wiley & Sons, Ltd.     

Neural Network Force Control for Industrial Robots

In this paper, we present a hierarchical force control framework consisting of a high level control system based on neural network and the existing motion control system of a manipulator in the low level. Inputs of the neural network are the contact force error and estimated stiffness of the contacted environment. The output of the neural network is the position command for the position controller of industrial robots. A MITSUBISHI MELFA RV-M1 industrial robot equipped with a BL Force/Torque sensor is utilized for implementing the hierarchical neural network force control system. Successful experiments for various contact motions are carried out. Additionally, the proposed neural network force controller together with the master/slave control method are used in dual-industrial robot systems. Successful experiments are carried out for the dual-robot system handling an object.     

A delayed force-reflecting haptic controller for master–slave neurosurgical robots

This paper presents a new force-reflecting control system for master–slave haptic devices. This controller has been implemented and tested on the robotic systems for minimally invasive neurosurgery developed by our Research Group. Robot-assisted surgery is a very valuable treatment, since it allows benefits of high precision, accuracy, and repeatability of robotic devices. The proposed controller is meant to be used for master–slave haptic robotic surgery, but it can be used for any device that provides haptic feedback. The new controller merges the paradigms of force reflection (FR) control and delayed reference control. Unlike the FR control, the proposed solution enhances the safety since it does not allow an unwanted motion of the slave device once the operator releases the haptic controller. Experimental tests are provided to show the capabilities and the performance of the controller. Closed-loop stability is investigated both theoretically and experimentally. The analytic results on stability impose a limit on the ratio between the measured contact force and the sampling frequency of the closed-loop controller.     

Position-Based Fuzzy Force Control for Dual Industrial Robots

In this paper, a fuzzy force control framework is proposed for dual-industrial robot systems. The master/slave control method is used in dual-robot systems. Two MITSUBISHI MELFA RV-M1 industrial robots, one is equipped with an BL Force/Torque sensor and the other is not, are utilized for implementing the dual-arm system. In order to adapt various stiffness of the holding object, an adaptable fuzzy force control scheme has been proposed to improve the performance. The ability of the adaptable force control system is achieved by tuning the scaling factor of the fuzzy logic controller. Successful experiments are carried out for the dual-robot system handling an object.     

A teleoperation system for micro positioning with haptic feedback

This paper presents the research work on a 1 Degree of Freedom (DOF) macro-micro teleoperation system which enables human operator to perform complex task in micro environment such as cell insertion with the capability of haptic feedback. To reach submicron resolution, a nano-motion piezo actuator was used as the slave robot and a servo DC motor was used as the master robot. Force sensors were implemented at both ends for haptic feedback and a microscope equipped with camera was employed for real-time visual feedback. The hysteresis nonlinearity of the piezo motor was modeled using LuGre friction model and compensated for. A Sliding Mode Based Impedance Controller (SMBIC) was designed at the slave side to ensure position tracking while an impedance force controller was designed at the master side to ascertain tracking of the force. Control parameters were chosen based on Llewellyn stability criteria such that the entire system stays stable against parameter uncertainties and constant time delay. The experimental results demonstrated capability of the proposed control frameworks in desirable tracking of the position and force signals while the entire system remained stable. The results of this study can be used for complex tasks in micron environment such as cell insertion.     

A Lyapunov controller for stable haptic manipulation of hydraulic actuators

A scheme for bilateral control of hydraulic actuators is developed and experimentally evaluated in this paper. The control laws are derived based on Lyapunov's feedback control design technique. Owing to the discontinuity originating from a sign function in the control laws, the control system is non‐smooth. First, the existence, continuation, and uniqueness of Filippov's solution to the system are proven. Next, the extensions of Lyapunov's stability theory to non‐smooth systems and LaSalle's invariant set theorems are employed to prove the asymptotic stability of the control system. Effectiveness of the proposed controller is verified by simulation and experimental studies. It is shown that beside stability, the system has good transparency in terms of position and force exchanges between the master and slave actuators. Copyright © 2011 John Wiley & Sons, Ltd.     

Nonlinear bilateral teleoperators under event‐driven communication with constant time delays

Bilateral teleoperation systems provide a platform for human operators to remotely manipulate slave robots in engaging various tasks in remote environments. Most of the previous studies in bilateral teleoperation were developed under continuous transmission or periodic communication with fixed data exchanging rates. This paper presents control schemes for bilateral teleoperation systems using nonperiodic event‐driven communication. By using P‐like and PD‐like controllers, this study proposes triggering conditions for teleoperators to reduce network access frequency so that robots only transmit output signals when necessary. Stability and position tracking of the control system are studied, and nonzero minimum interevent time is guaranteed. The proposed event‐driven teleoperation is studied with a velocity estimator to avoid the requirement of velocity information in the controller and triggering condition. Without velocity measurements, the boundedness of tracking errors and stability are ensured for teleoperation systems under event‐driven communication. Simulations and experiments are illustrated to validate the performance of the proposed event‐driven teleoperation systems.     

Lyapunov stable displacement-mode haptic manipulation of hydraulic actuators: theory and experiment

In this article, a stable control scheme is designed and experimentally evaluated for haptic-enabled teleoperated control of hydraulic actuators. At the actuator (slave) side, the controller allows the hydraulic actuator to have a stable position tracking. At the master side, the haptic device provides a kind of ‘feel’ of telepresence to the operator by creating a force that acts like a virtual spring, coupling the displacement of the haptic device to the displacement of the hydraulic actuator. In free motion, this virtual spring restricts the operator's hand to move fast when the slave manipulator is behind/ahead in terms of tracking the master manipulator's displacement. On the other hand, when interacting with the environment, the constrained force imposed on the hydraulic actuator is indirectly reflected through this virtual spring force. Extension of Lyapunov's stability theory to non-smooth systems is first employed to prove the stability of the resulting control system. Effectiveness of the controller is then validated via experimental studies. It is shown that the control scheme performs well in terms of both positioning the hydraulic actuator and providing a haptic feel to the operator. The control scheme is easy to implement since very little knowledge about system parameters is needed and the required on-line measurements are actuator's supply and line pressures and displacement.     

High‐gain nonlinear observer‐based impedance control for deformable object cooperative teleoperation with nonlinear contact model

Unmeasurable object deformation and local communication time delays between the slave robots influence the manipulation effect for multirobot multioperator teleoperation. In this article, a distributed control method based on high‐gain nonlinear observer, interactive identification, and impedance control is proposed for this problem. First, we use Hunt‐Crossley contact model and deduce the desired synchronizing object state in cooperative teleoperation. Second, an impedance item expressed by the internal position errors is presented to decrease object position tracking errors. For the unmeasurable object deformation, an interactive identification method is proposed for estimating unknown variables. Third, we consider both varying communication time delays and local time delays in the slave side. Two mirror high‐gain nonlinear observers are designed for estimating other slave robots' real‐time state. Finally, we build the system controllers and prove the stability of the closed‐loop system and the boundless of estimating errors using Lyapunov functions. Comparable simulation results executed by the physical system present that the position and internal force tracking errors of the object decrease in the designated cooperative tasks.     

Real‐time hybrid control of electrohydraulic active suspension

Electrohydraulic actuators are an attractive choice for active suspension, because these systems provide a high power‐to‐weight ratio. However, their dynamics are highly nonlinear. In addition, the use of one simple controller for both position and force is complicated, because there is a compromise between them in the case of active suspension. Most existing controllers do not efficiently fulfill the requirements, because only one state variable is considered. In this paper, we address these problems by developing a new hybrid controller for both position and force and implementing it in a real‐time test bench. Our goal is to control the vertical position of the passenger seat while tracking the force transmitted to passengers and keeping it within tolerable and comfortable limits. Therefore, the proposed controller is a combination of two controllers. Its flexible structure redirects the control signal to control the proper controlled state variable. The real‐time results of the newly designed hybrid controller are compared with those obtained using a classical proportional integral derivative controller, because this is the most widely used controller in the industry. As expected, the proposed controller demonstrates better performance in real‐time operation. Copyright © 2017 John Wiley & Sons, Ltd.     

Synchronization of A Class of Uncertain Chaotic Systems with Lipschitz Nonlinearities Using State‐Feedback Control Design: A Matrix Inequality Approach

This paper proposes a new state‐feedback stabilization control technique for a class of uncertain chaotic systems with Lipschitz nonlinearity conditions. Based on Lyapunov stabilization theory and the linear matrix inequality (LMI) scheme, a new sufficient condition formulated in the form of LMIs is created for the chaos synchronization of chaotic systems with parametric uncertainties and external disturbances on the slave system. Using Barbalat's lemma, the suggested approach guarantees that the slave system synchronizes to the master system at an asymptotical convergence rate. Meanwhile, a criterion to find the proper feedback gain vector F is also provided. A new continuous‐bounded nonlinear function is introduced to cope with the disturbances and uncertainties and obtain a desired control performance, i.e. small steady‐state error and fast settling time. Several criteria are derived to guarantee the asymptotic and robust stability of the uncertain master–slave systems. Furthermore, the proposed controller is independent of the order of the system's model. Numerical simulation results are displayed with an expected satisfactory performance compared to the available methods.     

Position and force tracking of a two‐manipulator system manipulating a flexible beam

This article discusses the issue of hybrid position and force control of a two‐manipulator system manipulating a flexible beam in trajectory tracking. Unlike our previous approach of set‐point position control in the trajectory tracking, the system coordinates are hard to be regulated to the desired states with nonzero tracking velocities under continuous feedback control. In this study, we design a hybrid position and force tracking controller while using saturation control to compensate for the effect of beam vibration dynamics on the tracking performance. All parameters and states used in the controller are readily available so that the proposed method is feasible to implement. Under the proposed controller, the tracking error asymptotically converges to a predetermined boundary. Simulation results demonstrate the validity of the proposed approach. © 2001 John Wiley & Sons, Inc.     

Position referenced force augmentation in teleoperated hydraulic manipulators operating under delayed and lossy networks: A pilot study

Position error between motions of the master and slave end-effectors is inevitable as it originates from hard-to-avoid imperfections in controller design and model uncertainty. Moreover, when a slave manipulator is controlled through a delayed and lossy communication channel, the error between the desired motion originating from the master device and the actual movement of the slave manipulator end-effector is further exacerbated. This paper introduces a force feedback scheme to alleviate this problem by simply guiding the operator to slow down the haptic device motion and, in turn, allows the slave manipulator to follow the desired trajectory closely. Using this scheme, the master haptic device generates a force, which is proportional to the position error at the slave end-effector, and opposite to the operator’s intended motion at the master site. Indeed, this force is a signal or cue to the operator for reducing the hand speed when position error, due to delayed and lossy network, appears at the slave site. Effectiveness of the proposed scheme is validated by performing experiments on a hydraulic telemanipulator setup developed for performing live-line maintenance. Experiments are conducted when the system operates under both dedicated and wireless networks. Results show that the scheme performs well in reducing the position error between the haptic device and the slave end-effector. Specifically, by utilizing the proposed force, the mean position error, for the case presented here, reduces by at least 92% as compared to the condition without the proposed force augmentation scheme. The scheme is easy to implement, as the only required on-line measurement is the angular displacement of the slave manipulator joints.     

A design of bilateral teleoperation systems using composite adaptive controller

This paper presents a synchronization scheme of bilateral teleoperation systems using composite adaptive controller. To design a controller for bilateral teleoperation systems, all the parameters of the master and the slave robots need to be known. However, there exist parameter uncertainties in the robot manipulators. A composite adaptive controller is designed for convergence of states and parameters of the master and the slave robots in the presence of parameter uncertainties. Consequently, position and force tracking problems in free and contact motion are solved in a synchronized manner. Through a number of simulations, the superiority of the proposed method over existing works is illustrated. Furthermore, for the validation of utility of the proposed method in an actual embedded system, the algorithms are implemented and tested in FPGA-based hardware controller.     

On tracking performance in bilateral teleoperation

This paper addresses the problem of steady-state position and force tracking in bilateral teleoperation. Passivity-based control schemes for bilateral teleoperation provide robust stability against network delays in the feedback loop and velocity tracking, but do not guarantee steady-state position and force tracking in general. Position drift due to data loss and offset of initial conditions is a well-known problem in such systems. In this paper, we introduce a new architecture, which builds upon the traditional passivity-based configuration by using additional position control on both the master and slave robots, to solve the steady-state position and force-tracking problem. Lyapunov stability methods are used to establish the range of the position control gains on the master and slave sides. Experimental results using a single-degree-of-freedom master/slave system are presented, showing the performance of the resulting system.     

Stability guaranteed teleoperation: an adaptive motion/force control approach

An adaptive motion/force controller is developed for unilateral or bilateral teleoperation systems. The method can be applied in both position and rate control modes, with arbitrary motion or force scaling. No acceleration measurements are required. Nonlinear rigid-body dynamics of the master and the slave robots are considered. A model of the flexible or rigid environment is incorporated into the dynamics of the slave, while a model of the human operator is incorporated into the dynamics of the master. The master and the slave are subject to independent adaptive motion/force controllers that assume parameter uncertainty bounds. Each parameter is independently updated within its known lower and upper bounds. The states of the master (slave) are sent to the slave (master) as motion/force tracking commands instead of control actions (efforts and/or flows). Under the modeling assumptions for the human operator and the environment, the proposed teleoperation control scheme is L/sub 2/ and L/sub /spl infin// stable in both free motion and flexible or rigid contact motion and is robust against time delays. The controlled master-slave system behaves essentially as a linearly damped free-floating mass. If the parameter estimates converge, the environment impedance and the impedance transmitted to the master differ only by a control-parameter dependent mass/damper term. Asymptotic motion (velocity/position) tracking and force tracking with zero steady-state error are achieved. Experimental results are presented in support of the analysis.     

A novel adaptive bilateral control scheme using similar closed‐loop dynamic characteristics of master/slave manipulators

This article presents a novel adaptive bilateral control scheme for obtaining ideal responses for teleoperation systems with uncertainties. A condition that is equivalent to getting an ideal response in teleoperation has been found to be making the closed‐loop dynamics of master and slave manipulators a similar form. An adaptive approach is applied to achieve similarity for the uncertain master and slave manipulators. Using the similar closed‐loop dynamic characteristics of master/slave teleoperation systems, excellent position and force tracking performance has been obtained without estimating the impedance of human and environment. The validity of the theoretical results is verified by experiments. © 2001 John Wiley & Sons, Inc.