基于Adept机器人的视觉伺服控制系统

机器人视觉伺服控制在理论和应用等方面还有许多问题需要研究,例如特征选择、系统标定和伺服控制算法等.针对Adept机器人,提出了一种简单快速的不需要精确标定摄像机内外部参数的摄像机标定方法,完成了从被观测物体表面所在的视觉平面坐标系到机器人基坐标系的坐标变换.使用图像的全局特征,即图像矩特征进行伺服跟踪;利用所推导的图像雅可比矩阵,设计了由图像反馈与目标运动自适应补偿组成的视觉伺服控制器.将算法对静态目标的定位实验进行了验证,然后又将其应用到移动目标的跟踪上,通过调节和优选控制参数,实现了稳定的伺服跟踪和抓取.实验结果表明采用图像矩作为图像特征能够避免复杂的特征匹配过程,并且能够获得较好的跟踪精度.     

一种新的双环结构机器人无标定自抗扰视觉伺服控制方法

在研究基于自抗扰控制器的机器人无标定视觉伺服方法的基础上,提出了一种新的双环结构机器人无标定自抗扰视觉伺服控制方法．内环采用Kalman滤波算法进行图像雅可比矩阵的在线辨识,可较好地逼近真实模型;外环采用自抗扰控制器,利用非线性观测器实时估计系统相对于当前估计模型的总扰动,并在控制中加以动态补偿．针对六自由度工业机器人进行了二维运动目标的跟踪实验,实验结果表明了该方法的可行性和有效性．     

基于单目视觉的移动机器人测距方法

本文针对多机器人编队过程中的跟踪控制,提出了一种跟踪机器人采用单目视觉技术获取前方被跟踪机器人距离信息的方法.该方法首先对跟踪机器人摄像机进行内参数标定,并在目标机器人背部设置视觉标记.然后系统获取目标机器人的含有视觉标记的单帧图像,预处理此图像,并识别出图像中的视觉标记所在的目标区域,用Hu氏不变矩计算该区域形心.最后推导出单目测距算法,利用图像信息和其它参数可以计算出两机器人之间的距离.实验结果表明,所设计的单目测距系统能得到准确的距离,为跟踪控制提供了重要的反馈信息.     

机器人手臂混合控制器的设计

多数视觉伺服研究中,不考虑机器人的动力学特性,把机器人当作一个理想定位设备。本文考虑其动力学特性,采用基于FNN和CMAC控制器方法,实现了机器人对目标运动的跟踪。并对一个二连杆视觉伺服系统进行了仿真,仿真结果说明了算法的有效性。较好的解决视觉伺服控制中的定位精度难点,改进机器人的视觉控制算法,达到精确、非线性的鲁棒控制。     

基于神经网络的机器人手眼无标定平面视觉跟踪

在手眼关系及摄像机模型完全未知的情况下,建立了眼在手上机器人平面视觉跟踪 问题的非线性视觉映射模型,将图像特征空间和机器人工作空间紧密地联系起来.在此基础 上,设计了基于人工神经网络的视觉跟踪控制方案,将视觉跟踪问题转化为图像特征空间中 的定位问题.仿真结果表明该算法能完全消除稳态跟踪误差,具有很强的环境适应性和容错 能力,算法简单,易于实时实现.     

基于特征点密度峰值的视觉伺服目标选择方法

为避免机器人视觉伺服过程中因无法进行目标选择而导致视觉伺服失败的问题,提出一种基于特征点密度峰值的视觉伺服目标选择方法.采用(oriented fast and rotated brief,ORB)特征点检测与匹配算法识别视场中所有的目标物体,利用PROSAC算法剔除误匹配点,通过引入特征点密度峰值聚类算法分离图像中不同目标物体的特征点,提出基于位置优先决策方法选择最佳视觉伺服目标.实验结果表明,通过该方法机器人能够在多个相同目标物体中选择一个最佳视觉伺服目标,有效解决了移动机器人视觉伺服中出现的目标选择问题.     

基于CPLD的彩色视觉移动机器人路径跟踪系统

路径跟踪是机器人视觉导航控制基本技术之一,为使机器人沿地面彩色引导线自主运动,并能在适时离线执行任务后自动返航,提出了一种用可编程逻辑器件(CPLD)实现的视觉伺服PID控制方法.该方法利用图像特征反馈对其所跟踪的路经进行实时识别跟踪.仿真结果表明,该方法改善了控制算法的实时性,提高了移动机器人的路径跟踪精度与速度.     

一种无标定视觉伺服控制技术的研究

在视觉伺服控制过程中无法精确地标定摄像机和机器人运动学模型,而当前的无标定视觉伺服控制技术或者只能针对静态的目标,或者针对动态目标但无法摆脱大偏差的影响．针对此问题,提出一种动态无标定的视觉伺服控制方法：基于非线性方差最小化法控制机器人跟踪运动目标,利用动态拟牛顿法估计图像雅克比矩阵,采用迭代最小二乘法提高系统的稳定性并提出大偏差条件下的无标定控制策略．仿真实验证明了该方法的正确性和有效性．     

基于图像雅可比矩阵的智能机器人视觉跟踪

根据智能机器人视觉伺服的要求,建立了固定眼结构的MOTOMAN-SV3XL型工业机器人无标定视觉伺服系统.研究了目前在机器人视觉伺服研究领域中使用最为广泛的一类方法,即基于图像雅可比矩阵的方法.针对图像雅可比矩阵的特点,设计了一种基于简化Sage-Husa自适应滤波的图像雅可比矩阵在线估计算法,并将其应用于机器人视觉反馈控制任务中,实现了对二维平面上运动目标的跟踪,实验结果表明了该算法的有效性.     

基于无极卡尔曼滤波算法的雅可比矩阵估计

在基于图像的机器人视觉伺服中,采用在线估计图像雅可比的方法,不需事先知道系统的精确模型,可以避免复杂的系统标定过程。为了有效改善图像雅可比矩阵的在线估计精度,进而提高机器人的跟踪精度,针对机器人跟踪运动目标的应用背景,提出了利用无极卡尔曼滤波算法在线估计总雅可比矩阵。在二自由度的机器人视觉伺服仿真平台上,分别用卡尔曼滤波器（KF）、粒子滤波器（PF）和无极卡尔曼滤波器（UKF）三种算法进行总雅可比矩阵的在线估计。实验结果证明,使用UKF算法的跟踪精度优于其他两种算法,时间耗费仅次于KF算法。     

Visual servoing of redundant manipulator with Jacobian matrix estimation using self-organizing map

Vision based redundant manipulator control with a neural network based learning strategy is discussed in this paper. The manipulator is visually controlled with stereo vision in an eye-to-hand configuration. A novel Kohonen’s self-organizing map (KSOM) based visual servoing scheme has been proposed for a redundant manipulator with 7 degrees of freedom (DOF). The inverse kinematic relationship of the manipulator is learned using a Kohonen’s self-organizing map. This learned map is shown to be an approximate estimate of the inverse Jacobian, which can then be used in conjunction with the proportional controller to achieve closed loop servoing in real-time. It is shown through Lyapunov stability analysis that the proposed learning based servoing scheme ensures global stability. A generalized weight update law is proposed for KSOM based inverse kinematic control, to resolve the redundancy during the learning phase. Unlike the existing visual servoing schemes, the proposed KSOM based scheme eliminates the computation of the pseudo-inverse of the Jacobian matrix in real-time. This makes the proposed algorithm computationally more efficient. The proposed scheme has been implemented on a 7 DOF PowerCube? robot manipulator with visual feedback from two cameras.     

Image-based visual servoing using improved image moments in 6-DOF robot systems

This paper addresses the challenges of choosing proper image features for planar symmetric shape objects and designing visual servoing controller to enhance the tracking performance in image-based visual servoing (IBVS). Six image moments are chosen as the image features and the analytical image interaction matrix related to the image features are derived. A controller is designed to efficiently increase the robustness of the visual servoing system. Experimental results on a 6-DOF robot visual servoing system are provided to illustrate the effectiveness of the proposed method.     

基于LS–SVR的机器人空间4DOF无标定视觉定位

研究了基于智能算法的机器人无标定视觉伺服问题, 提出了一种新的基于最小二乘支持向量回归的机器人无标定视觉免疫控制方法. 利用最小二乘支持向量回归学习机器人位姿变化和观测到的图像特征变化之间的复杂非线性关系, 其中最小二乘支持向量回归的参数由自适应免疫算法加5折交叉检验优化确定, 在此基础上利用免疫控制原理设计了视觉控制器. 六自由度工业机器人空间4DOF 视觉定位实验结果表明了该方法的有效性.     

Predictive control architecture for real-time image moments based servoing of robot manipulators

This paper presents a real-time architecture for visual servoing of robot manipulators using nonlinear based predictive control. In order to increase the robustness of the control algorithm, image moments were chosen to be the visual features which describe the objects from the image. A visual predictive architecture is designed to solve tasks addressed to robot manipulators with an eye-in-hand configuration. An implementation of the proposed architecture is done so that the capabilities of a 6 d.o.f robot manipulator are extended. The results of different experiments conducted with two types of image moments based controllers (proportional and predictive with reference trajectory) are presented and discussed.     

Neural network Reinforcement Learning for visual control of robot manipulators

It is known that most of the key problems in visual servo control of robots are related to the performance analysis of the system considering measurement and modeling errors. In this paper, the development and performance evaluation of a novel intelligent visual servo controller for a robot manipulator using neural network Reinforcement Learning is presented. By implementing machine learning techniques into the vision based control scheme, the robot is enabled to improve its performance online and to adapt to the changing conditions in the environment. Two different temporal difference algorithms (Q-learning and SARSA) coupled with neural networks are developed and tested through different visual control scenarios. A database of representative learning samples is employed so as to speed up the convergence of the neural network and real-time learning of robot behavior. Moreover, the visual servoing task is divided into two steps in order to ensure the visibility of the features: in the first step centering behavior of the robot is conducted using neural network Reinforcement Learning controller, while the second step involves switching control between the traditional Image Based Visual Servoing and the neural network Reinforcement Learning for enabling approaching behavior of the manipulator. The correction in robot motion is achieved with the definition of the areas of interest for the image features independently in both control steps. Various simulations are developed in order to present the robustness of the developed system regarding calibration error, modeling error, and image noise. In addition, a comparison with the traditional Image Based Visual Servoing is presented. Real world experiments on a robot manipulator with the low cost vision system demonstrate the effectiveness of the proposed approach.     

机器人视觉伺服综述

系统论述了机器人视觉伺服发展的历史和现状。从不同角度对机器人视觉控制系统进行分类,重点介绍了基位置的视觉伺服系统和基于图像的视觉伺服系统。对人工神经网络在机器人视觉伺服方面的应用情况作了介绍。讨论了视觉伺服中图像特征的选择问题。对机器人视觉所涉及的前沿问题进行阐述,并指出了目前研究中所存在的问题及今后发展方向。