Intelligent robotic gripper with adaptive grasping force

The on-off control robot gripper is widely employed in pick-and-place operations in Cartesian space for handling hard objects between two positions. Without contact force monitoring, it can not be applied in fragile or soft objects handling. Although, an appropriate grasping force or gripper opening for each target could be searched by trial-and-error process, it needs expensive force/torque sensor or an accurate gripper position controller. It has too expensive and complex control strategy disadvantages for most of industrial applications. In addition, it can not overcome the target slip problem due to mass uncertainty and dynamic factor. Here, an intelligent gripper is designed with embedded distributed control structure for overcoming the uncertainty of object’s mass and soft/hard features. A communication signal is specified to integrate both robot arm and gripper control kernels for executing the robotic position control and gripper force control functions in sequence. An efficient model-free intelligent fuzzy sliding mode control strategy is employed to design the position and force controllers of gripper, respectively. Experimental results of pick-and-place soft and hard objects with grasping force auto-tuning and anti-slip control strategy are shown by pictures to verify the dynamic performance of this distributed control system. The position and force tracking errors are less than 1 mm and 0.1 N, respectively.

     

A system of robotic grasping with experience acquisition

Robotic grasping has played a fundamental role in the robotic manipulation, while grasping an unknown object is still a challenge. A successful grasp is largely determined by the object representation and the corresponding grasp planning strategy. With the help of RGBD camera, the point cloud of the object can be obtained conveniently. However, the large amount of point cloud is often unorganized with some inevitable noise. It may result in the geometry of the object imprecise and lead to some poor grasp planning. In this paper, a parametric model--superquadric is chosen to represent the shape of an object. We firstly recover the superquadric of an object from the raw point cloud in a single view with conjugate gradient method. Then a force-closure grasp planning strategy is applied to this object to obtain stable grasp configurations. Finally we store the grasp parameters as grasp experience in a grasp dataset which can be used for future grasping tasks. The performance of the proposed grasping system is represented both in simulation and actual experiment scenario successfully.     

Synergy-based affordance learning for robotic grasping

In this paper, we present an affordance learning system for robotic grasping. The system involves three important aspects: the affordance memory, synergy-based exploration, and a grasping control strategy using local sensor feedback. The affordance memory is modeled with a modified growing neural gas network that allows affordances to be learned quickly from a small dataset of human grasping and object features. After being trained offline, the affordance memory is used in the system to generate online motor commands for reaching and grasping control of the robot. When grasping new objects, the system can explore various grasp postures efficiently in the low dimensional synergy space because the synergies automatically avoid abnormal postures that are more likely to lead to failed grasps. Experimental results demonstrated that the affordance memory can generalize to grasp new objects and predict the effect of the grasp (i.e., the tactile patterns).     

Graspit! A versatile simulator for robotic grasping

A robotic grasping simulator, called Graspit!, is presented as versatile tool for the grasping community. The focus of the grasp analysis has been on force-closure grasps, which are useful for pick-and-place type tasks. This work discusses the different types of world elements and the general robot definition, and presented the robot library. The paper also describes the user interface of Graspit! and present the collision detection and contact determination system. The grasp analysis and visualization method were also presented that allow a user to evaluate a grasp and compute optimal grasping forces. A brief overview of the dynamic simulation system was provided.     

Semantic grasping: planning task-specific stable robotic grasps

We present an example-based planning framework to generate semantic grasps, stable grasps that are functionally suitable for specific object manipulation tasks. We propose to use partial object geometry, tactile contacts, and hand kinematic data as proxies to encode task-related constraints, which we call semantic constraints. We introduce a semantic affordance map, which relates local geometry to a set of predefined semantic grasps that are appropriate to different tasks. Using this map, the pose of a robot hand with respect to the object can be estimated so that the hand is adjusted to achieve the ideal approach direction required by a particular task. A grasp planner is then used to search along this approach direction and generate a set of final grasps which have appropriate stability, tactile contacts, and hand kinematics. We show experiments planning semantic grasps on everyday objects and applying these grasps with a physical robot.     

Tactile object recognition in early phases of grasping using underactuated robotic hands

Intelligent Service Robotics - Identifying objects during the early phases of robotic grasping in unstructured environments is a crucial step toward successful dexterous robotic manipulation....     

A modified image-based visual servo controller with hybrid camera configuration for robust robotic grasping

In order to develop an autonomous mobile manipulation system that works in an unstructured environment, a modified image-based visual servo (IBVS) controller using hybrid camera configuration is proposed in this paper. In particular, an eye-in-hand web camera is employed to visually track the target object while a stereo camera is used to measure the depth information online. A modified image-based controller is developed to utilize the information from the two cameras. In addition, a rule base is integrated into the visual servo controller to adaptively tune its gain based on the image deviation data so as to improve the response speed of the controller. A physical mobile manipulation system is developed and the developed IBVS controller is implemented. The experimental results obtained using the systems validate the developed approach.     

Extracting data from human manipulation of objects towards improving autonomous robotic grasping

Humans excel in manipulation tasks, a basic skill for our survival and a key feature in our manmade world of artefacts and devices. In this work, we study how humans manipulate simple daily objects, and construct a probabilistic representation model for the tasks and objects useful for autonomous grasping and manipulation by robotic hands. Human demonstrations of predefined object manipulation tasks are recorded from both the human hand and object points of view. The multimodal data acquisition system records human gaze, hand and fingers 6D pose, finger flexure, tactile forces distributed on the inside of the hand, colour images and stereo depth map, and also object 6D pose and object tactile forces using instrumented objects. From the acquired data, relevant features are detected concerning motion patterns, tactile forces and hand-object states. This will enable modelling a class of tasks from sets of repeated demonstrations of the same task, so that a generalised probabilistic representation is derived to be used for task planning in artificial systems. An object centred probabilistic volumetric model is proposed to fuse the multimodal data and map contact regions, gaze, and tactile forces during stable grasps. This model is refined by segmenting the volume into components approximated by superquadrics, and overlaying the contact points used taking into account the task context. Results show that the features extracted are sufficient to distinguish key patterns that characterise each stage of the manipulation tasks, ranging from simple object displacement, where the same grasp is employed during manipulation (homogeneous manipulation) to more complex interactions such as object reorientation, fine positioning, and sequential in-hand rotation (dexterous manipulation). The framework presented retains the relevant data from human demonstrations, concerning both the manipulation and object characteristics, to be used by future grasp planning in artificial systems performing autonomous grasping.     

Predictive reference shaping for constrained robotic systems using evolutionary algorithms

This paper proposes a method for reducing the trajectory tracking errors of robotic systems in presence of input saturation and state constraints. Basing on a finite horizon prediction of the future evolution of the robot dynamics, the proposed device online preshapes the reference trajectory, minimizing a multi-objective cost function. The shaped reference is updated at discrete time intervals and is generated taking into account the full nonlinear robot dynamics, input and state constraints. A specialized Evolutionary Algorithm is employed as search tool for the online computation of a sub-optimal reference trajectory in the discretized space of the control alternatives. The effectiveness of the proposed method and the online computational burden are analyzed numerically in two significant robotic control problems; furthermore a comparison of the performance provided by this method and an iterative gradient-based algorithms are discussed.     

Self-organizing adaptive penalty strategy in constrained genetic search

This research aims to develop an effective and robust self-organizing adaptive penalty strategy for genetic algorithms to handle constrained optimization problems without the need to search for appropriate values of penalty factors for the given optimization problem. The proposed strategy is based on the idea that the constrained optimal design is almost always located at the boundary between feasible and infeasible domains. This adaptive penalty strategy automatically adjusts the value of the penalty parameter used for each of the constraints according to the ratio between the number of designs violating the specific constraint and the number of designs satisfying the constraint. The goal is to maintain equal numbers of designs on each side of the constraint boundary so that the chance of locating their offspring designs around the boundary is maximized. The new penalty function is self-defining and no parameters need to be adjusted for objective and constraint functions in any given problem. This penalty strategy is tested and compared with other known penalty function methods in mathematical and structural optimization problems, with favorable results.     

A surrogate-assisted evolution strategy for constrained multi-objective optimization

In many real-world optimization problems, several conflicting objectives must be achieved and optimized simultaneously and the solutions are often required to satisfy certain restrictions or constraints. Moreover, in some applications, the numerical values of the objectives and constraints are obtained from computationally expensive simulations. Many multi-objective optimization algorithms for continuous optimization have been proposed in the literature and some have been incorporated or used in conjunction with expert and intelligent systems. However, relatively few of these multi-objective algorithms handle constraints, and even fewer, use surrogates to approximate the objective or constraint functions when these functions are computationally expensive. This paper proposes a surrogate-assisted evolution strategy (ES) that can be used for constrained multi-objective optimization of expensive black-box objective functions subject to expensive black-box inequality constraints. Such an algorithm can be incorporated into an intelligent system that finds approximate Pareto optimal solutions to simulation-based constrained multi-objective optimization problems in various applications including engineering design optimization, production management and manufacturing. The main idea in the proposed algorithm is to generate a large number of trial offspring in each generation and use the surrogates to predict the objective and constraint function values of these trial offspring. Then the algorithm performs an approximate non-dominated sort of the trial offspring based on the predicted objective and constraint function values, and then it selects the most promising offspring (those with the smallest predicted ranks from the non-dominated sort) to become the actual offspring for the current generation that will be evaluated using the expensive objective and constraint functions. The proposed method is implemented using cubic radial basis function (RBF) surrogate models to assist the ES. The resulting RBF-assisted ES is compared with the original ES and to NSGA-II on 20 test problems involving 2–15 decision variables, 2–5 objectives and up to 13 inequality constraints. These problems include well-known benchmark problems and application problems in manufacturing and robotics. The numerical results showed that the RBF-assisted ES generally outperformed the original ES and NSGA-II on the problems used when the computational budget is relatively limited. These results suggest that the proposed surrogate-assisted ES is promising for computationally expensive constrained multi-objective optimization.     

A bio-inspired pursuit strategy for optimal control with partially constrained final state

We discuss a biologically inspired cooperative control strategy which allows a group of autonomous systems to solve optimal control problems with free final time and partially constrained final state. The proposed strategy, termed “generalized sampled local pursuit” (GSLP), mimics the way in which ants optimize their foraging trails, and guides the group toward an optimal solution, starting from an initial feasible trajectory. Under GSLP, an optimal control problem is solved in many “short” segments, which are constructed by group members interacting locally with lower information, communication and storage requirements compared to when the problem is solved all at once. We include a series of simulations that illustrate our approach.     

穿刺手术机器人遥操作系统的控制策略研究

在分析穿刺机器人系统功能需求的基础上,搭建了主从遥操作系统的半实物仿真平台,并给出雅克比矩阵方法和PD控制律的联合控制方法。通过设计数字滤波器,以消除外科医生的手部低频抖动对穿刺手术机器人精度的影响。实验结果表明,从机器人末端执行器在笛卡尔空间坐标下能够精确、快速、安全地跟随主机器人末端执行器的位置变化,并且外科医生的手部抖动能够被有效消除。     

A strategy for grasping unknown objects based on co-planarity and colour information

In this work, we describe and evaluate a grasping mechanism that does not make use of any specific object prior knowledge. The mechanism makes use of second-order relations between visually extracted multi-modal 3D features provided by an early cognitive vision system. More specifically, the algorithm is based on two relations covering geometric information in terms of a co-planarity constraint as well as appearance based information in terms of co-occurrence of colour properties. We show that our algorithm, although making use of such rather simple constraints, is able to grasp objects with a reasonable success rate in rather complex environments (i.e., cluttered scenes with multiple objects).Moreover, we have embedded the algorithm within a cognitive system that allows for autonomous exploration and learning in different contexts. First, the system is able to perform long action sequences which, although the grasping attempts not being always successful, can recover from mistakes and more importantly, is able to evaluate the success of the grasps autonomously by haptic feedback (i.e., by a force torque sensor at the wrist and proprioceptive information about the distance of the gripper after a gasping attempt). Such labelled data is then used for improving the initially hard-wired algorithm by learning. Moreover, the grasping behaviour has been used in a cognitive system to trigger higher level processes such as object learning and learning of object specific grasping.     

Force-closed grasping with two hands

Two-handed grasping of rigid objects in two-dimensional space is studied. The hands considered in this article are either flat-surface palms or grippers with two angular-motion fingers. Presented in this article is a condition that establishes the existence of force-closed grasping without the knowledge of the shape of the grasped object and of the exact contact locations on the palms or fingers. Further, an algorithm is developed that determines force-closed grasping based on the position and orientation of the two hands.     

Unconstrained and constrained motion control of a planar two-link structurally flexible robotic manipulator

Unconstrained and constrained motion control of a planar two-link structurally-flexible robotic manipulator are considered in this study. The dynamic model is obtained by using the extended Hamilton's principle and the Galerkin criterion. A method is presented to obtain the linearized equations of motion in Cartesian space for use in designing the control system. The approach to solving the control problem is to use feedforward and feedback control torques. The feedforward torques maneuver the flexible manipulator along a nominal trajectory and the feedback torques minimize any deviations from the nominal trajectory. The feedforward and feedback torques are obtained by solving the inverse dynamics problem for the rigid manipulator and designing linear quadratic Gaussian with loop transfer recovery (LQG/LTR) compensators, respectively. The LQG/LTR design methodology is exploited to design a robust feedback control system that can handle modeling errors and sensor noise, and operate on Cartesian space trajectory errors. Computer simulated results are presented for an example planar, two-link, structurally flexible robotic manipulator. © 1994 John Wiley & Sons, Inc.