Visual motor control of a 7 DOF robot manipulator using a fuzzy SOM network

A fuzzy self-organizing map (SOM) network is proposed in this paper for visual motor control of a 7 degrees of freedom (DOF) robot manipulator. The inverse kinematic map from the image plane to joint angle space of a redundant manipulator is highly nonlinear and ill-posed in the sense that a typical end-effector position is associated with several joint angle vectors. In the proposed approach, the robot workspace in image plane is discretized into a number of fuzzy regions whose center locations and fuzzy membership values are determined using a Fuzzy C-Mean (FCM) clustering algorithm. SOM network then learns the inverse kinematics by on-line by associating a local linear map for each cluster. A novel learning algorithm has been proposed to make the robot manipulator to reach a target position. Any arbitrary level of accuracy can be achieved with a number of fine movements of the manipulator tip. These fine movements depend on the error between the target position and the current manipulator position. In particular, the fuzzy model is found to be better as compared to Kohonen self-organizing map (KSOM) based learning scheme proposed for visual motor control. Like existing KSOM learning schemes, the proposed scheme leads to a unique inverse kinematic solution even for a redundant manipulator. The proposed algorithms have been successfully implemented in real-time on a 7 DOF PowerCube robot manipulator, and results are found to concur with the theoretical findings.     

Visual Motor Control of a 7 DOF Robot Manipulator Using Function Decomposition and Sub-Clustering in Configuration Space

This paper deals with real-time implementation of visual-motor control of a 7 degree of freedom (DOF) robot manipulator using self-organized map (SOM) based learning approach. The robot manipulator considered here is a 7 DOF PowerCube manipulator from Amtec Robotics. The primary objective is to reach a target point in the task space using only a single step movement from any arbitrary initial configuration of the robot manipulator. A new clustering algorithm using Kohonen SOM lattice has been proposed that maintains the fidelity of training data. Two different approaches have been proposed to find an inverse kinematic solution without using any orientation feedback. In the first approach, the inverse Jacobian matrices are learnt from the training data using function decomposition. It is shown that function decomposition leads to significant improvement in accuracy of inverse kinematic solution. In the second approach, a concept called sub-clustering in configuration space is suggested to provide multiple solutions for the inverse kinematic problem. Redundancy is resolved at position level using several criteria. A redundant manipulator is dexterous owing to the availability of multiple configurations for a given end-effector position. However, existing visual motor coordination schemes provide only one inverse kinematic solution for every target position even when the manipulator is kinematically redundant. Thus, the second approach provides a learning architecture that can capture redundancy from the training data. The training data are generated using explicit kinematic model of the combined robot manipulator and camera configuration. The training is carried out off-line and the trained network is used on-line to compute the joint angle vector to reach a target position in a single step only. The accuracy attained is better than the current state of art.     

Kinematic control of a redundant manipulator using an inverse-forward adaptive scheme with a KSOM based hint generator

This paper proposes an online inverse-forward adaptive scheme with a KSOM based hint generator for solving the inverse kinematic problem of a redundant manipulator. In this approach, a feed-forward network such as a radial basis function (RBF) network is used to learn the forward kinematic map of the redundant manipulator. This network is inverted using an inverse-forward adaptive scheme until the network inversion solution guides the manipulator end-effector to reach a given target position with a specified accuracy. The positioning accuracy, attainable by a conventional network inversion scheme, depends on the approximation error present in the forward model. But, an accurate forward map would require a very large size of training data as well as network architecture. The proposed inverse-forward adaptive scheme effectively approximates the forward map around the joint angle vector provided by a hint generator. Thus the inverse kinematic solution obtained using the network inversion approach can take the end-effector to the target position within any arbitrary accuracy.In order to satisfy the joint angle constraints, it is necessary to provide the network inversion algorithm with an initial hint for the joint angle vector. Since a redundant manipulator can reach a given target end-effector position through several joint angle vectors, it is desirable that the hint generator is capable of providing multiple hints. This problem has been addressed by using a Kohonen self organizing map based sub-clustering (KSOM-SC) network architecture. The redundancy resolution process involves selecting a suitable joint angle configuration based on different task related criteria.The simulations and experiments are carried out on a 7 DOF PowerCube? manipulator. It is shown that one can obtain a positioning accuracy of 1 mm without violating joint angle constraints even when the forward approximation error is as large as 4 cm. An obstacle avoidance problem has also been solved to demonstrate the redundancy resolution process with the proposed scheme.     

Uncalibrated Eye-to-Hand Visual Servoing Using Inverse Fuzzy Models

A new uncalibrated eye-to-hand visual servoing based on inverse fuzzy modeling is proposed in this paper. In classical visual servoing, the Jacobian plays a decisive role in the convergence of the controller, as its analytical model depends on the selected image features. This Jacobian must also be inverted online. Fuzzy modeling is applied to obtain an inverse model of the mapping between image feature variations and joint velocities. This approach is independent from the robot's kinematic model or camera calibration and also avoids the necessity of inverting the Jacobian online. An inverse model is identified for the robot workspace, using measurement data of a robotic manipulator. This inverse model is directly used as a controller. The inverse fuzzy control scheme is applied to a robotic manipulator performing visual servoing for random positioning in the robot workspace. The obtained experimental results show the effectiveness of the proposed control scheme. The fuzzy controller can position the robotic manipulator at any point in the workspace with better accuracy than the classic visual servoing approach.     

A closed-loop jacobian transpose scheme for solving the inverse kinematics of nonredundant and redundant wrists

The solution of the inverse kinematic problem is of the utmost importance in robotic manipulator control. This article proposes a closed-loop scheme for solving the inverse kinematic problem for nonredundant and redundant wrists based on the computation of the Jacobian transpose. The manipulability measure is suitably introduced as a constraint for redundant wrists, by taking advantage of the null space of the Jacobian matrix. The resulting algorithm provides a computational tool to solve a specified orientation trajectory into a joint trajectory. Numerical results with two spherical wrists show the excellent performance of the scheme.     

Two-time scale visual servoing of eye-in-hand flexible manipulators

Visual servoing of eye-in-hand flexible manipulators is addressed in this paper. Dynamic effects of both the rigid and the flexible motion of the manipulator are fully taken into account in a control solution where the two-time scale nature of the problem is exploited. The visual information is used in the "slow" subsystem for a task-space-oriented control law, where computationally expensive operations, such as inverse and time derivative of the Jacobian, are avoided. A constructive proof of stability of this control scheme, based on Lyapunov theory, is also presented. The effectiveness of the proposed controller is shown by means of a numerical simulation concerning a trajectory tracking problem. Some experimental results finally demonstrate the precision enhancement achieved by the proposed algorithm on a single-link flexible manipulator.     

Fault-tolerant motion planning and control of redundant manipulator

One important issue in the motion planning of a kinematic redundant manipulator is fault tolerance. In general, if the motion planner is fault tolerant, the manipulator can achieve the required path of the end-effector even when its joint fails. In this situation, the contribution of the faulty joint to the end-effector is required to be compensated by the healthy joints to maintain the prescribed end-effector trajectory. To achieve this, this paper proposes a fault-tolerant motion planning scheme by adding a simple fault-tolerant equality constraint for the faulty joint. Such a scheme is then unified into a quadratic program (QP), which incorporates joint-physical constraints such as joint limits and joint-velocity limits. In addition, a numerical computing solver based on linear variational inequalities (LVI) is presented for the real-time QP solving. Simulative studies and experimental results based on a six degrees-of-freedom (DOF) redundant robot manipulator with variable joint-velocity limits substantiate the effectiveness of the proposed fault-tolerant scheme and its solution.     

Kinematics analysis of a hybrid manipulator for computer controlled ultra-precision freeform polishing

As one of the final processing steps of precision machining, polishing process is a very key decision for surface quality. This paper presents a novel hybrid manipulator for computer controlled ultra-precision (CCUP) freeform polishing. The hybrid manipulator is composed of a three degree-of-freedom (DOF) parallel module, a two DOF serial module and a turntable providing a redundant DOF. The parallel module gives the workpiece three translations without rotations. The serial module holds the polishing tool and gives it no translations on the polishing contact area due to its particular mechanical design. A detailed kinematics model is established for analyzing the kinematics of the parallel module and the serial module, respectively. For the parallel module, the inverse kinematics, the forward kinematics, the Jacobian matrix, the workspace and the dexterity distribution are analyzed systematically. Workspaces are also investigated for varying structural parameters. For the serial module, the inverse kinematics, the forward kinematics, the workspace and the precession motion analysis are carried out. An example of saddle surface finishing with this manipulator is given and the movement of actuators with respect to this shape is analyzed theoretically. These analysis results illustrate that the proposed hybrid manipulator is a very suitable machine structure for CCUP freeform polishing.     

基于图像矩与神经网络的机器人四自由度视觉伺服

针对传统的视觉伺服方法中图像几何特征的标记、提取与匹配过程复杂且通用性差等问题,本文提出了一种基于图像矩的机器人四自由度(4DOF)视觉伺服方法.首先建立了眼在手系统中图像矩与机器人位姿之间的非线性增量变换关系,为利用图像矩进行机器人视觉伺服控制提供了理论基础,然后在未对摄像机与手眼关系进行标定的情况下,利用反向传播(BP)神经网络的非线性映射特性设计了基于图像矩的机器人视觉伺服控制方案,最后用训练好的神经刚络进行了视觉伺服跟踪控制.实验结果表明基于本文算法可实现0.5 mm的位置与0.5°的姿态跟踪精度,验证了算法的的有效性与较好的伺服性能.     

Stable neurovisual servoing for robot manipulators

In this paper, we propose a stable neurovisual servoing algorithm for set-point control of planar robot manipulators in a fixed-camera configuration an show that all the closed-loop signals are uniformly ultimately bounded (UUB) and converge exponentially to a small compact set. We assume that the gravity term and Jacobian matrix are unknown. Radial basis function neural networks (RBFNNs) with online real-time learning are proposed for compensating both gravitational forces and errors in the robot Jacobian matrix. The learning rule for updating the neural network weights, similar to a back propagation algorithm, is obtained from a Lyapunov stability analysis. Experimental results on a two degrees of freedom manipulator are presented to evaluate the proposed controller.     

An Adaptive Regulator of Robotic Manipulators in the Task Space

This note addresses the problem of position control of robotic manipulators both nonredundant and redundant in the task space. A computationally simple class of task space regulators consisting of a transpose adaptive Jacobian controller plus an adaptive term estimating generalized gravity forces is proposed. The Lyapunov stability theory is used to derive the control scheme. The conditions on controller gains ensuring asymptotic stability are obtained herein in a form of simple inequalities including some information extracted from both robot kinematic and dynamic equations. The performance of the proposed control strategy is illustrated through computer simulations for a direct-drive arm of a SCARA type redundant manipulator with the three revolute kinematic pairs operating in a two-dimensional task space.     

Canonical parameterization of excess motor degrees of freedom withself-organizing maps

The problem of sensorimotor control is underdetermined due to excess (or "redundant") degrees of freedom when there are more joint variables than the minimum needed for positioning an end-effector. A method is presented for solving the nonlinear inverse kinematics problem for a redundant manipulator by learning a natural parameterization of the inverse solution manifolds with self-organizing maps. The parameterization approximates the topological structure of the joint space, which is that of a fiber bundle. The fibers represent the "self-motion manifolds" along which the manipulator can change configuration while keeping the end-effector at a fixed location. The method is demonstrated for the case of the redundant planar manipulator. Data samples along the self-motion manifolds are selected from a large set of measured input-output data. This is done by taking points in the joint space corresponding to end-effector locations near "query points", which define small neighborhoods in the end-effector work space. Self-organizing maps are used to construct an approximate parameterization of each manifold which is consistent for all of the query points. The resulting parameterization is used to augment the overall kinematics map so that it is locally invertible. Joint-angle and end-effector position data, along with the learned parameterizations, are used to train neural networks to approximate direct inverse functions.     

Kinematics analysis of a novel all-attitude flight simulator

To overcome the kinematic singularity limitation of simulator, which is unavoidable in a three-axis architecture, an all-attitude flight simulator in a four-axis architecture is proposed. The simulator can always provide 3DOF motion by applying redundant manipulator mechanism. For direct kinematics of the manipulator, a dual-Euler method is adopted to solve the expressions of attitude angles; thus computation singularity of all- attitude angles is overcome. For inverse kinematics of the manipulator, pseudo-...     

Robust adaptive control of redundant manipulators

This paper presents an adaptive scheme for the motion control of kinematically redundant manipulators. The proposed controller is very general and computationally efficient since it does not require knowledge of either the mathematical model or the parameter values of the robot dynamics, and is implemented without calculation of the robot inverse dynamics or inverse kinematic transformation. It is shown that the control strategy is globally stable in the presence of bounded disturbances, and that in the absence of disturbances the size of the residual tracking errors can be made arbitrarily small. The performance of the controller is illustrated through computer simulations with a nine degree-of-freedom (DOF) compound manipulator consisting of a relatively small, fast six-DOF manipulator mounted on a large three-DOF positioning device. These simulations demonstrate that the proposed scheme provides accurate and robust trajectory tracking and, moreover, permits the available redundancy to be utilized so that a high bandwidth response can be achieved over a large workspace.     

Trajectory Planning with Collision Avoidance for Redundant Robots Using Jacobian and Artificial Potential Field-based Real-time Inverse Kinematics

This study proposes an algorithm for combining the Jacobian-based numerical approach with a modified potential field to solve real-time inverse kinematics and path planning problems for redundant robots in unknown environments. With an increase in the degree of freedom (DOF) of the manipulator, however, the problems in realtime inverse kinematics become more difficult to solve. Although the analytical and geometrical inverse kinematics approach can obtain the exact solution, it is considerably difficult to solve as the DOF increases, and it necessitates recalculations whenever the robot arm DOF or Denavit-Hartenberg (D-H) parameters change. In contrast, the numerical method, particularly the Jacobian-based numerical method, can easily solve inverse kinematics irrespective of the aforementioned changes including those in the robot shape. The latter method, however, is not employed in path planning for collision avoidance, and it presents real-time calculation problems. This study accordingly proposes the Jacobian-based numerical approach with a modified potential field method that can realize real-time calculations of inverse kinematics and path planning with collision avoidance irrespective of whether the case is redundant or non-redundant. To achieve this goal, the use of a judgment matrix is proposed for obstacle condition identification based on the obstacle boundary definition; an approach for avoiding the local minimum is also proposed. After the obstacle avoidance path is generated, a trajectory plan that follows the path and avoids the obstacle is designed. Finally, the proposed method is evaluated by implementing a motion planning simulation of a 7-DOF manipulator, and an experiment is performed on a 7-DOF real robot.

     

Extended Jacobian inverse kinematics algorithms for mobile manipulators

We consider the inverse kinematic problem for mobile manipulators consisting of a nonholonomic mobile platform and a holonomic manipulator on board the platform. The kinematics of a mobile manipulator are represented by a driftless control system with outputs together with the associated variational control system. The output reachability map of the driftless control system determines the instantaneous kinematics, while the output reachability map of the variational system plays the role of the analytic Jacobian of the mobile manipulator. Relying on a formal analogy between the kinematics of stationary and mobile manipulators we exploit the extended Jacobian construction in order to design a collection of extended Jacobian inverse kinematics algorithms for mobile manipulators. It has been proved mathematically and confirmed in computer simulations that these algorithms are capable of efficiently solving the inverse kinematic problem. Moreover, a choice of the Jacobian extension may lay down some guidelines for the platform‐manipulator motion coordination. © 2002 Wiley Periodicals, Inc.     

Applications of neural networks for coordinate transformations in robotics

The use of artificial neural networks is investigated for application to trajectory control problems in robotics. The relative merits of position versus velocity control is considered and a control scheme is proposed in which neural networks are used as static maps (trained off-line) to compute the inverse of the manipulator Jacobian matrix. A proof of the stability of this approach is offered, assuming bounded errors in the static map. A representative two-link robot is investigated using an artificial neural network which has been trained to compute the components of the inverse of the Jacobian matrix. The controller is implemented in the laboratory and its performance compared to a similar controller with the analytical inverse Jacobian matrix.     

Model Predictive Control for Constrained Image‐Based Visual Servoing in Uncalibrated Environments

This paper presents a novel approach for image‐based visual servoing (IBVS) of a robotic system by considering the constraints in the case when the camera intrinsic and extrinsic parameters are uncalibrated and the position parameters of the features in 3‐D space are unknown. Based on the model predictive control method, the robotic system's input and output constraints, such as visibility constraints and actuators limitations, can be explicitly taken into account. Most of the constrained IBVS controllers use the traditional image Jacobian matrix, the proposed IBVS scheme is developed by using the depth‐independent interaction matrix. The unknown parameters can appear linearly in the prediction model and they can be estimated by the identification algorithm effectively. In addition, the model predictive control determines the optimal control input and updates the estimated parameters together with the prediction model. The proposed approach can simultaneously handle system constraints, unknown camera parameters and depth parameters. Both the visual positioning and tracking tasks can be achieved desired performances. Simulation results based on a 2‐DOF planar robot manipulator for both the eye‐in‐hand and eye‐to‐hand camera configurations are used to demonstrate the effectiveness of the proposed method.     

A Dual Neural Network for Kinematic Control of Redundant Manipulators Using Input Pattern Switching

This paper presents a dual neural network for kinematic control of a seven degrees of freedom robot manipulator. The first network is a static multilayer perceptron with two hidden layers which is trained to mimic the Jacobian of a seven DOF manipulator. The second network is a recurrent neural network which is used for determining the inverse kinematics solutions of the manipulator; The redundancy is used to minimize the joint velocities in the least squares sense. Simulation results show relatively good comparison between the outputs of the actual Jacobian matrix and multilayer neural network. The first network maps motions of the seven joints of the manipulator into 42 elements of the Jacobian matrix, with surprisingly smaller computations than the actual trigonometric function evaluations. A new technique, input-pattern-switching, is presented which improves the global training of the static network. The recurrent network was designed to work with the neural network approximation of the Jacobian matrix instead of the actual Jacobian. The combination of these two networks has resulted in a time-efficient procedure for kinematic control of robot manipulators which avoids most of the complexity present in the classical-trigonometric-based methods. Also, by electronic implementation of the networks, kinematic solutions can be obtained in a very timely manner (few nanoseconds).     

Criteria optimization using self-motion of a 9-R redundant robot

Using inverse kinematic solutions for self-motion of a class of 9-R redundant robots, a conjugate-gradient based constrained optimization scheme for incremental trajectory planning is formulated. The proposed scheme has been evaluated and proved to be an efficient optimization method for redundancy utilization. It can also be used for studying 7-R and 8-R manipulators by simply restricting to one-variable and two-variable optimization, respectively. In contrast with other approaches which are based on the Jacobian, our scheme exploits the availability of closed-form inverse kinematic solutions to give more effective and accurate results.