A biomimetic reach and grasp approach for mechanical hands

Reach and grasp are the two key functions of human prehension. The Central Nervous System controls these two functions in a separate but interdependent way. The choice between different solutions to reach and grasp an object–provided by multiple and redundant degrees of freedom (dof)–depends both on the properties and on the use (affordance) of the object to be manipulated. This same control paradigm, i.e. subdivision of prehension into reach and grasp as well as the corresponding multimodal (sensory/motor) information fusion schemes, can also be applied to a mechanical hand carried by a robotic arm. The robotic arm will then be responsible for positioning the hand with respect to the object, and the hand will then grasp and manipulate the object. In this article, we present a biomimetic sensory–motor control scheme in the aim of providing an object-dependent and intelligent reach and grasp ability to such systems. The proposed model is based on a multi-network architecture which incorporates multiple Matching Units trained by a statistical learning algorithm (LWPR). Matching Units perform a multimodal signal integration by correlating sensory and motor information analogous to that observed in cerebral neuronal networks. The simulated network of multiple Matching Units provided estimations of object-dependent 5-finger grasp configurations with endpoint positional errors in the order of a few millimeters. For validation, these estimations were then applied to the control of movement kinematics on an experimental robot composed of a 6 dof robot arm carrying a 16 dof mechanical 4-finger hand. Precision of the kinematics control was such that successful reach, grasp and lift was obtained in all the tests.     

Adaptive control of robot contact tasks with on-line learning of planar surfaces

In robot constrained motion problems on planar surfaces with frictional contacts, uncertainties on the contacted surface not only affect the control system performance but also distort control targets. The surface normal direction cosines are in this case uncertain parameters that are involved in both the control law and the control targets. This work proposes an adaptive learning controller that uses force and joint position/velocity measurements to simultaneously learn the surface orientation and achieve the desired goal. Simulation examples for a 6 dof robot are used to illustrate the theoretical results and the performance of the proposed controller in practical cases.     

Hybrid control of a pneumatic artificial muscle (PAM) robot arm using an inverse NARX fuzzy model

We investigated the possibility of applying a hybrid feed-forward inverse nonlinear autoregressive with exogenous input (NARX) fuzzy model-PID controller to a nonlinear pneumatic artificial muscle (PAM) robot arm to improve its joint angle position output performance. The proposed hybrid inverse NARX fuzzy-PID controller is implemented to control a PAM robot arm that is subjected to nonlinear systematic features and load variations in real time. First the inverse NARX fuzzy model is modeled and identified by a modified genetic algorithm (MGA) based on input/output training data gathered experimentally from the PAM system. Second the performance of the optimized inverse NARX fuzzy model is experimentally demonstrated in a novel hybrid inverse NARX fuzzy-PID position controller of the PAM robot arm. The results of these experiments demonstrate the feasibility and benefits of the proposed control approach compared to traditional PID control strategies. Consequently, the good performance of the MGA-based inverse NARX fuzzy model in the proposed hybrid inverse NARX fuzzy-PID position control of the PAM robot arm is demonstrated. These results are also applied to model and to control other highly nonlinear systems.     

A Markov Game-Adaptive Fuzzy Controller for Robot Manipulators

This paper develops an adaptive fuzzy controller for robot manipulators using a Markov game formulation. The Markov game framework offers a promising platform for robust control of robot manipulators in the presence of bounded external disturbances and unknown parameter variations. We propose fuzzy Markov games as an adaptation of fuzzy Q-learning (FQL) to a continuous-action variation of Markov games, wherein the reinforcement signal is used to tune online the conclusion part of a fuzzy Markov game controller. The proposed Markov game-adaptive fuzzy controller uses a simple fuzzy inference system (FIS), is computationally efficient, generates a swift control, and requires no exact dynamics of the robot system. To illustrate the superiority of Markov game-adaptive fuzzy control, we compare the performance of the controller against a) the Markov game-based robust neural controller, b) the reinforcement learning (RL)-adaptive fuzzy controller, c) the FQL controller, d) the H_infin theory-based robust neural game controller, and e) a standard RL-based robust neural controller, on two highly nonlinear robot arm control problems of i) a standard two-link rigid robot arm and ii) a 2-DOF SCARA robot manipulator. The proposed Markov game-adaptive fuzzy controller outperformed other controllers in terms of tracking errors and control torque requirements, over different desired trajectories. The results also demonstrate the viability of FISs for accelerating learning in Markov games and extending Markov game-based control to continuous state-action space problems.     

On adaptive trajectory tracking of a robot manipulator usinginversion of its neural emulator

This paper is concerned with the design of a neuro-adaptive trajectory tracking controller. The paper presents a new control scheme based on inversion of a feedforward neural model of a robot arm. The proposed control scheme requires two modules. The first module consists of an appropriate feedforward neural model of forward dynamics of the robot arm that continuously accounts for the changes in the robot dynamics. The second module implements an efficient network inversion algorithm that computes the control action by inverting the neural model. In this paper, a new extended Kalman filter (EKF) based network inversion scheme is proposed. The scheme is evaluated through comparison with two other schemes of network inversion: gradient search in input space and Lyapunov function approach. Using these three inversion schemes the proposed controller was implemented for trajectory tracking control of a two-link manipulator. Simulation results in all cases confirm the efficacy of control input prediction using network inversion. Comparison of the inversion algorithms in terms of tracking accuracy showed the superior performance of the EKF based inversion scheme over others.     

Fuzzy sliding mode control of a finger of a humanoid robot hand

Abstract: The motion control problem for the finger of a humanoid robot hand is investigated. First, the index finger of the human hand is dynamically modelled as a kinematic chain of cylindrical links. During construction of the model, special attention is given to determining bone dimensions and masses that are similar to the real human hand. After the kinematic and dynamic analysis of the model, in order to ensure that the finger model tracks its desired trajectory during a closing motion, a fuzzy sliding mode controller is applied to the finger model. In this controller, a fuzzy logic algorithm is used in order to tune the control gain of the sliding mode controller; thus, an adaptive controller is obtained. Finally, numerical results, which include a performance comparison of the proposed fuzzy sliding mode controller and a conventional sliding mode controller, are presented. The results demonstrate that the proposed control method can be used to perform the desired motion task for humanoid robot hands efficiently.     

A minimally invasive surgery robotic assistant for HALS–SILS techniques

This paper is focused in the design and implementation of a robotic surgical motion controller. The proposed control scheme addresses the issues related to the application of a robot assistant in novel surgical scenario, which combines hand assisted laparoscopic surgery (HALS) with the single incision laparoscopic surgery (SILS) techniques. It is designed for collaborating with the surgeon in a natural way, by performing autonomous movements, in order to assist the surgeon during a surgical maneuver. In this way, it is implemented a hierarchical architecture which includes an upper auto-guide velocity planner connected to a low-level force feedback controller. The first one, based on a behavior approach, computes a collision free trajectory of the surgical instrument tip, held by the robot, for reaching a goal location inside of the abdominal cavity. On the other hand, the force feedback controller uses this trajectory for performing the instrument displacement by taking into account the holonomic movement constraints introduced by the fulcrum point. The aim of this controller is positioning the surgical instrument by minimizing the forces exerted over the abdominal wall due to the fulcrum location uncertainty. The overall system has been integrated in the control architecture of the surgical assistant CISOBOT, designed and developed at the University of Malaga. The whole architecture performance has been tested by means of in vitro trials.     

Model predictive control for fast reaching in clutter

A key challenge for haptically reaching in dense clutter is the frequent contact that can occur between the robot’s arm and the environment. We have previously used single-time-step model predictive control (MPC) to enable a robot to slowly reach into dense clutter using a quasistatic mechanical model. Rapid reaching in clutter would be desirable, but entails additional challenges due to dynamic phenomena that can lead to higher forces from impacts and other types of contact. In this paper, we present a multi-time-step MPC formulation that enables a robot to rapidly reach a target position in dense clutter, while regulating whole-body contact forces to be below a given threshold. Our controller models the dynamics of the arm in contact with the environment in order to predict how contact forces will change and how the robot’s end effector will move. It also models how joint velocities will influence potential impact forces. At each time step, our controller uses linear models to generate a convex optimization problem that it can solve efficiently. Through tens of thousands of trials in simulation, we show that with our dynamic MPC a simulated robot can, on average, reach goals 1.4 to 2 times faster than our previous controller, while attaining comparable success rates and fewer occurrences of high forces. We also conducted trials using a real 7 degree-of-freedom (DoF) humanoid robot arm with whole-arm tactile sensing. Our controller enabled the robot to rapidly reach target positions in dense artificial foliage while keeping contact forces low.     

Adaptive control of free-floating space robots in Cartesian coordinates

An adaptive control scheme is proposed for the end-effector trajectory tracking control of free-floating space robots. In order to cope with the nonlinear parameterization problem of the dynamic model of the free-floating space robot system, the system is modeled as an extended robot which is composed of a pseudo-arm representing the base motions and a real robot arm. An on-line estimation of the unknown parameters along with a computed-torque controller is used to track the desired trajectory. The proposed control scheme does not require measurement of the accelerations of the base and the real robot arm. A two-link planar space robot system is simulated to illustrate the validity and effectiveness of the proposed control scheme.     

Fuzzy and Recurrent Neural Network Motion Control among Dynamic Obstacles for Robot Manipulators

An integration of fuzzy controller and modified Elman neural networks (NN) approximation-based computed-torque controller is proposed for motion control of autonomous manipulators in dynamic and partially known environments containing moving obstacles. The fuzzy controller is based on artificial potential fields using analytic harmonic functions, a navigation technique common used in robot control. The NN controller can deal with unmodeled bounded disturbances and/or unstructured unmodeled dynamics of the robot arm. The NN weights are tuned on-line, with no off-line learning phase required. The stability of the closed-loop system is guaranteed by the Lyapunov theory. The purpose of the controller, which is designed as a neuro-fuzzy controller, is to generate the commands for the servo-systems of the robot so it may choose its way to its goal autonomously, while reacting in real-time to unexpected events. The proposed scheme has been successfully tested. The controller also demonstrates remarkable performance in adaptation to changes in manipulator dynamics. Sensor-based motion control is an essential feature for dealing with model uncertainties and unexpected obstacles in real-time world systems.     

Model-free robot joint position regulation and tracking with prescribed performance guarantees

The problem of robot joint position control with prescribed performance guarantees is considered; the control objective is the error evolution within prescribed performance bounds in both problems of regulation and tracking. The proposed controllers do not utilize either the robot dynamic model or any approximation structures and are composed by simple PID or PD controllers enhanced by a proportional term of a transformed error through a transformation related gain. Under a sufficient condition for the damping gain, the proposed controllers are able to guarantee (i) predefined minimum speed of convergence, maximum steady state error and overshoot concerning the position error and (ii) uniformly ultimate boundedness (UUB) of the velocity error. The use of the integral term reduces residual errors allowing the proof of asymptotic convergence of both velocity and position errors to zero for the regulation problem under constant disturbances. Performance is a priori guaranteed irrespective of the selection of the control gain values. Simulation results of a three dof spatial robotic manipulator and experimental results of one dof manipulator are given to confirm the theoretical findings.     

Assistant force compensation for hand movement of patients by using exogenous signals and/or neurophysiological signals

Because functional diseases of the brain can cause disabilities related to human movement control, a compensation method was developed for improving the performance of hand movements. The compensation for human hand movements can be carried out by adding an assistant force that is generated from artificial equipment attached to a human arm. From the experiment on visual target tracking, it was found that the tracking trajectory was adequately represented by a dynamic model of the motion of an articulated industrial robot arm, and the different abilities for movement control among healthy people and patients were classified by different model parameters as position loop gain, velocity loop gain, and response delay. Dynamic force compensation was approached by considering the different control features of the patients. The effectiveness of the proposed compensation method was verified in a simulation study on an actual industrial robot arm. A human-machine interface, e.g., a brain-computer interface (BCI), for realizing the control of artificial equipment to compensate for human hand movements is also presented and discussed.     

Robot Control Optimization Using Reinforcement Learning

Conventional robot control schemes are basically model-based methods. However, exact modeling of robot dynamics poses considerable problems and faces various uncertainties in task execution. This paper proposes a reinforcement learning control approach for overcoming such drawbacks. An artificial neural network (ANN) serves as the learning structure, and an applied stochastic real-valued (SRV) unit as the learning method. Initially, force tracking control of a two-link robot arm is simulated to verify the control design. The simulation results confirm that even without information related to the robot dynamic model and environment states, operation rules for simultaneous controlling force and velocity are achievable by repetitive exploration. Hitherto, however, an acceptable performance has demanded many learning iterations and the learning speed proved too slow for practical applications. The approach herein, therefore, improves the tracking performance by combining a conventional controller with a reinforcement learning strategy. Experimental results demonstrate improved trajectory tracking performance of a two-link direct-drive robot manipulator using the proposed method.     

Sliding mode variable structure control for visual servoing system

A visual servoing tracking controller is proposed based on the sliding mode control theory in order to achieve strong robustness against parameter variations and external disturbances. A sliding plane with time delay compensation is presented by the pre-estimate of states. To reduce the chattering of the sliding mode controller, a modified exponential reaching law and hyperbolic tangent function are applied to the design of visual controller and robot joint controller. Simulation results show that the visual servoing control scheme is robust and has good tracking performance.     

Design and control of a novel variable stiffness soft arm

Soft robot arms possess such characteristics as light weight, simple structure and good adaptability to the environment, among others. On the other hand, robust control of soft robot arms presents many difficulties. Based on these reasons, this paper presents a novel design and modeling of a fuzzy active disturbance rejection control (FADRC) controller for a soft PAM arm. The soft arm comprises three contractile and one extensor PAMs, which can vary its stiffness independently of its position in space. Force analysis for the soft arm is conducted, and stiffness model of the arm is established based on the relational model of contractile and extensor PAM. The accuracy of stiffness model for the soft arm was verified through experiments. Associated to this, a controller based on the fuzzy adaptive theory and active disturbance rejection control (ADRC), FADRC, has been designed to control the arm. The fuzzy adaptive theory is used to adjust the parameters of the ADRC, the control algorithm has the ability to control stiffness and position of the soft arm. In this paper, FADRC was further verified through comparative experiments on the soft arm. This paper reinforces the hypothesis that FADRC control, as an algorithm, indeed possesses good robustness and adaptive abilities.     

An Adaptive Regulator of Robotic Manipulators in the Task Space

This note addresses the problem of position control of robotic manipulators both nonredundant and redundant in the task space. A computationally simple class of task space regulators consisting of a transpose adaptive Jacobian controller plus an adaptive term estimating generalized gravity forces is proposed. The Lyapunov stability theory is used to derive the control scheme. The conditions on controller gains ensuring asymptotic stability are obtained herein in a form of simple inequalities including some information extracted from both robot kinematic and dynamic equations. The performance of the proposed control strategy is illustrated through computer simulations for a direct-drive arm of a SCARA type redundant manipulator with the three revolute kinematic pairs operating in a two-dimensional task space.     

Modified PID Control of a Single-Link Flexible Robot

The use of flexible links in robots has become very common in different engineering fields. The issue of position control for flexible link manipulators has gained a lot of attention. Using the vibration signal originating from the motion of the flexible-link robot is one of the important methods used in controlling the tip position of the single-link arms. Compared with the common methods for controlling the base of the flexible arm, vibration feedback can improve the use of the flexible-link robot systems. In this paper a modified PID control (MPID) is proposed which depends only on vibration feedback to improve the response of the flexible arm without the massive need for measurements. The arm moves horizontally by a DC motor on its base while a tip payload is attached to the other end. A simulation for the system with both PD controller and the proposed MPID controller is performed. An experimental validation for the control of the single-link flexible arm is shown. The robustness of the proposed controller is examined by changing the loading condition at the tip of the flexible arm. The response results for the single-link flexible arm are presented with both the PI and MPID controller used. A study of the stability of the proposed MPID is carried out.     

Decoupling control for spatial six-degree-of-freedom electro-hydraulic parallel robot

This paper presents a decoupling controller equipped with cross-coupling pre-compensation for an electro-hydraulic parallel robot, in order to weaken system dynamic coupling effects usually ignored on the design of advanced controllers and improve system control performance. The mathematical model of the electro-hydraulic parallel robot is built using the Kane method and a hydromechanics approach, and the kinematical model is established with a closed-form solution and the Newton-Raphson method. The feedback linearization theory is applied to reduce coupling effects stemmed from system dynamics of the parallel robot via incorporating force-velocity control with cross-coupling pre-compensations. The control performance involving stability, accuracy, and robustness of the proposed controller for spatial 6-DOF parallel robot is analyzed in theory and experiment. The experimental results illustrate that the proposed controller can highly improve the control performance by weakening system dynamic coupling effects of the electro-hydraulic parallel robot, especially for trajectory tracking performance.     

Vision-based path following by using a neural network Guidance System

This article describes a neural network controller for guidance of a robot arm, used to model some aspects of autonomous vehicle technology. The controller uses video images with adaptive view-angles for the sensory input, and the system was configured to simulate an autonomous vehicle guidance system on a flat terrain using a high-contrast guiding path. To demonstrate the feasibility of using neural networks in this type of application, an Intelledex 405 robot fitted with a video camera and associated vision system was used. Phase I of the project consisted of a single-speed implementation and limited network training. Phase II featured a multi-speed implementation using adaptively varied view-angles based on robot arm velocity. It was shown that the neural network controller was able to control the robot arm along a path composed of path segments unlike those with which it was trained. In addition it was shown that a multi-speed implementation with adaptive view angles improved system performance. © 1994 John Wiley & Sons, Inc.