机器人视觉伺服系统的研究

机器人伺觉伺服系统及到多学科内容。针对机器人视觉伺服系统主要的三方面内容;系统的结构方式,图象处理,控制方法,介绍了该领域的研究现状及所取得的成就。最后分析了今后的发展趋势。     

机器人视觉伺服研究进展

介绍了机器人视觉伺服系统的结构和主要研究内容,比较了当前几种主要的视觉伺服方法,针对当前 机器人视觉伺服所面临的主要问题,详细阐述了近期提出的一些解决方法.     

软体机械臂水下自适应鲁棒视觉伺服

水下仿生软体机器人在水底环境勘测, 水下生物观测等方面具有极高的应用价值. 为进一步提升仿章鱼臂软体机器人在特殊水下环境中控制效果, 提出一种自适应鲁棒视觉伺服控制方法, 实现其在干扰无标定环境中的高精度镇定控制. 基于水底动力学模型, 设计保证动力学稳定的控制器; 针对柔性材料离线标定过程繁琐、成本高, 提出材料参数自适应估计算法; 针对水下特殊工作条件, 设计自适应鲁棒视觉伺服控制器, 实现折射效应的在线补偿, 并通过自适应未知环境干扰上界, 避免先验环境信息的求解. 所提算法在软体机器人样机中验证其镇定控制性能, 为仿生软体机器人的实际应用提供理论基础.     

基于图象差的平面大范围视觉伺服控制

为解决大范围偏差的控制问题,将期望图象按给定的角度间隔旋转,离线生成一系列子期望图象。比较实时采集图象与期望子图象间的差异程序可获取目标绕重心的旋转运动参数。纵使图象求重心方法给出的平动参数,实现了在大范围偏差时迅速将摄象机调整到期望位姿。在期望位姿附近结合直接图象反馈方式,实现了基于图象差的平面大范围视觉伺服控制。     

基于图像视觉伺服的二维运动优化控制

基于图像的视觉伺服方法,图像的变化直接解释为摄像机的运动,而不是直接对机械手末端实现笛卡尔速度控制,导致机械手的运动轨迹迂回,产生摄像机回退现象.针对这一问题,提出了将旋转和平移分离并先实现旋转的视觉伺服方案.该方案计算量小,系统响应时间短,解决了图像旋转和平移间的干扰,克服了传统基于图像视觉伺服产生的摄像机回退现象,实现了时间和路径的最优控制.并用传统IBVS的控制律和摄像机成像模型解释了回退现象的产生原因.二维运动仿真说明了提出方案的有效性.     

基于自适应动态规划的移动机器人视觉伺服跟踪控制

针对移动机器人视觉伺服跟踪控制问题, 提出一种基于自适应动态规划(Adaptive dynamic programming, ADP) 的控制方法. 通过移动机器人上的相机拍摄共面特征点的当前图像、期望图像以及参考图像, 利用单应性技术得到移动机器人当前的位姿信息与期望的位姿信息(即平移量与旋转角度), 从而通过当前与期望的平移旋转之间差值得到系统的开环误差模型. 进而, 针对此系统设计最优控制器, 同时做合适的控制输入变换. 在此基础上设计一个基于ADP的视觉伺服控制方法以保证移动机器人完成轨迹跟踪任务. 为求出最优控制输入, 采用一个评价神经网络近似值函数, 通过不断学习逼近哈密顿−雅可比−贝尔曼(Hamilton-Jacobi-Bellman, HJB)方程的解. 与以往不同的是, 由于系统存在时变项, 导致HJB方程也含有时变项, 因此需要设计具有时变权值结构的神经网络近似值函数. 最终证明在所设计的控制方法作用下, 闭环系统是一致最终有界的.     

Robotic Control with Partial Visual Information

We consider a robotic setting and a class of control tasks that rely on partial visual information. These tasks are difficult in the sense that at every given moment, the available information is insufficient for the control task. This implies that the image Jacobian, which relates the image space and the control space, is no longer of full rank. However, the amount of information collected throughout the control process is still large and thus seems sufficient for carrying out the task. Such situations commonly arise when the object is frequently occluded from one of the cameras in a stereo pair or when only one moving camera is available. We propose a generic control rule for such tasks and characterize the conditions required for the success of the task. The analysis is based on the observation that mathematically the behavior of such systems is related to a class of row-action optimization algorithms which are special cases of POCS (Projection On Convex Sets) algorithms. In the second part of the paper we focus on one particular task from this class: position and orientation control with a single rotating camera. We show that this task can be carried out, in principle, for any camera rotation and suggest efficient control and camera moving strategies. We substantiate our claims by simulations and experiments. Interestingly, it seems that the advisable control law is not consistent with simple intuition.     

Model Predictive Control for Constrained Image‐Based Visual Servoing in Uncalibrated Environments

This paper presents a novel approach for image‐based visual servoing (IBVS) of a robotic system by considering the constraints in the case when the camera intrinsic and extrinsic parameters are uncalibrated and the position parameters of the features in 3‐D space are unknown. Based on the model predictive control method, the robotic system's input and output constraints, such as visibility constraints and actuators limitations, can be explicitly taken into account. Most of the constrained IBVS controllers use the traditional image Jacobian matrix, the proposed IBVS scheme is developed by using the depth‐independent interaction matrix. The unknown parameters can appear linearly in the prediction model and they can be estimated by the identification algorithm effectively. In addition, the model predictive control determines the optimal control input and updates the estimated parameters together with the prediction model. The proposed approach can simultaneously handle system constraints, unknown camera parameters and depth parameters. Both the visual positioning and tracking tasks can be achieved desired performances. Simulation results based on a 2‐DOF planar robot manipulator for both the eye‐in‐hand and eye‐to‐hand camera configurations are used to demonstrate the effectiveness of the proposed method.     

一种拟人空间机械臂视觉伺服图像处理研究

针对四自由度串并混联拟人空间机械臂本体,构建了基于运动控制卡模式的机器人软件和硬件系统。采用基于位置的控制结构,利用所求得的机械臂逆运动学方程,设计了由图像反馈和末端运动组成的视觉伺服控制系统。提出了一种基于SURF特征的静态目标识别算法,算法首先对目标图像提取SURF特征,并利用欧氏距离实现模板图像与目标图像特征点匹配,然后计算已匹配特征点的质心来获得目标的位置信息,最终实现了稳定的伺服定位。实验结果证明了系统的可靠性,并且证明了四自由度串并混联机械臂本体在实际运动的精确性和稳定性。     

软体机器人手眼视觉/形状混合控制

当末端带有相机的连续型软体机器人进行作业时,由于避障、安全性等多方面因素,既需要末端相机－机器人系统的视觉伺服,也需要机器人的整体形状控制．针对这个问题,本文提出了一种软体机器人手眼视觉/形状混合控制方法．该方法无需知道空间特征点的3维坐标,只需给定特征点在末端相机像平面的期望像素坐标和软体机器人的期望形状就可达到控制目的．建立了软体机器人的运动学模型,利用该模型,结合深度无关交互矩阵自适应手眼视觉控制和软体机器人形状控制,提出了一种混合控制律,并用李亚普诺夫稳定性理论对该控制律进行证明．仿真和实验的结果均表明,末端相机特征点像素坐标和形状可以收敛到期望值．     

曲线焊缝跟踪的视觉伺服协调控制

为实现工业机器人自动跟踪曲线焊缝,提出了协调焊枪运动和视觉跟踪的视觉伺服控制方法．建立了特征点的数学模型,并在此基础上确定机器人运动的旋转轴．设计了一种双层结构的模糊视觉伺服控制器,通过动态确定控制量有效范围来保证图像特征存在于视场中．为准确确定有效范围,设计了带模型动态补偿的Kalman滤波器．曲线焊缝的自动跟踪实验验证了所提方法的有效性．     

机器人视觉伺服综述

系统论述了机器人视觉伺服发展的历史和现状。从不同角度对机器人视觉控制系统进行分类,重点介绍了基位置的视觉伺服系统和基于图像的视觉伺服系统。对人工神经网络在机器人视觉伺服方面的应用情况作了介绍。讨论了视觉伺服中图像特征的选择问题。对机器人视觉所涉及的前沿问题进行阐述,并指出了目前研究中所存在的问题及今后发展方向。     

Visual Object Tracking and Servoing Control of a Nano-Scale Quadrotor: System,Algorithms, and Experiments

There are two main trends in the development of unmanned aerial vehicle(UAV)technologies:miniaturization and intellectualization,in which realizing object tracking capabilities for a nano-scale UAV is one of the most challenging problems.In this paper,we present a visual object tracking and servoing control system utilizing a tailor-made 38 g nano-scale quadrotor.A lightweight visual module is integrated to enable object tracking capabilities,and a micro positioning deck is mounted to provide accurate pose estimation.In order to be robust against object appearance variations,a novel object tracking algorithm,denoted by RMCTer,is proposed,which integrates a powerful short-term tracking module and an efficient long-term processing module.In particular,the long-term processing module can provide additional object information and modify the short-term tracking model in a timely manner.Furthermore,a positionbased visual servoing control method is proposed for the quadrotor,where an adaptive tracking controller is designed by leveraging backstepping and adaptive techniques.Stable and accurate object tracking is achieved even under disturbances.Experimental results are presented to demonstrate the high accuracy and stability of the whole tracking system.     

一种基于混合视觉伺服的切换控制方法

为解决目标远离摄像机视野问题,本文提出了一种基于混合视觉伺服的切换控制方法,根据目标在图像平面的位置,通过在两种具有不同特性的控制策略之间进行切换完成视觉伺服任务.采用的混合视觉伺服方法实现了平动和转动自由度的解耦,当目标位于图像平面中心区域时,采用控制策略使转动自由度误差指数级减小;当目标位于边界区域时,切换到另一种控制策略,使目标重新回到中心区域,通过切换控制最终完成伺服任务.仿真实验验证了提出的基于混合视觉伺服切换控制方法的有效性.     

基于散焦图像特征的微装配机器人深度运动显微视觉伺服

为了描述微操作手深度运动,采用灰度方差聚焦评价算子计算机械手散焦图像特征．散焦特征曲线理论上为单峰分布,峰值点对应显微光学焦平面深度位置．实际提取的散焦特征含有大量随机噪声,利用非线性跟踪微分器抑制噪声实现对机械手散焦图像特征及其微分信号的无颤振光滑逼近．依据散焦微分信号设计粗—精两级自寻优视觉控制器,完成微操作手对装配平面深度的精确定位．微装配深度运动实验验证了本文方法的有效性,机械手深度伺服误差为75 μm．     

A Modular Scheme for Controller Design and Performance Evaluation in 3D Visual Servoing

In this paper we present a modular scheme for designing and evaluating different control systems for position based dynamic look and move visual servoing systems. This scheme is particularly applied to a 6 DOF industrial manipulator equipped with a camera mounted on its end effector. The manipulator with its actuators and its current feedback loops can be modeled as a Cartesian device commanded through a serial line. In this case the manipulator can be considered as a decoupled system with 6 independent loops. The use of computer vision as feedback transducer strongly affects the closed loop dynamics of the overall system, so that a visual controller is required for achieving fast response and high control accuracy. Due to the long delay in generating the control signal, it is necessary to carefully select the visual controller. In this paper we present a framework that allows the study of some conventional and new techniques to design this visual controller. Besides an experimental setup has been built and used to evaluate and compare the performance of the position based dynamic look and move system with different controllers. Some criterions for selecting the best strategy for each task are established. Quite a lot of results relative to different trajectory tracking control strategies are presented, showing both simulation and real platform responses.     

空间机械臂在轨维修的视觉伺服操控策略

首先分析了空间机械臂/机械手系统在轨旋拧螺钉任务的尺寸链误差．为修正微重力环境和机械臂、模拟维修单机在轨安装导致的位姿偏差,特别是消除机械手抓取电动工具导致的随机误差影响,提出了航天员在轨标定电动工具位姿/全局相机测量电动工具位姿并引入机械臂进行视觉伺服的控制策略．设计了视觉伺服控制器,给出了该控制算法的收敛证明和稳定性分析．通过在轨实施,该策略实现了机械臂/机械手系统拧松螺钉时位姿误差不超过3 mm/2°的任务要求．     

FCMAC控制在基于图像的机器人视觉伺服中的应用

以二自由度平面机器人为研究对象,将FCMAC控制方法应用到基于图像的机器人视觉伺服系统中.建立了系统的数学模型,并在Matlab平台上对该系统进行仿真实验.仿真结果表明,本文的控制系统对静态目标定位、对直线运动目标及曲线运动目标进行跟踪,可以获得较快的响应速度和较高的控制精度.     

Controlling the Execution of a Visual Servoing Task

This paper presents the application of the Visual Servoing approach to a mobile robot which must execute coordinate motions in a known indoor environment. In this work, we are interested in the execution and control of basic motions like Go to an object by using the mobile robot H^il are2Bis. We use a diagonal matrix for the gain to improve the visual servoing behaviour and the potential field formalism to avoid obstacles. Namely, the robot is controlled according to the position of some features in an image. Such a path will be executed by a nonholonomic mobile robot, which has only two degrees of freedom (two wheels), and three configuration parameters (X Y ); a camera is mounted on the robot close to the end effector of an arm, controlled to add at least a new degree of freedom (_pl).