机器人立体视觉中摄像机的标定

针对机器人立体视觉标定问题,提出一种介于传统标定法和自标定法之间的摄像机标定方法。与传统方法相比,将内参数、畸变参数与外参数分别标定。首先根据张氏平面标定法求出内参数;其次在考虑透镜径向畸变的基础上求出畸变参数;最后重点探讨在摄像机带有运动的情况下外参数的标定方法,避免了在原有标定环境下摄像机运动时需要重新标定的问题。实验依据传统标定的模板原理,结合双目立体视觉模型,验证了该种分离标定方法的可行性。     

简便高精度的机器人手眼视觉标定方法

对摄像机成像模型进行了分析,论述了机器人手眼系统标定原理。在此基础上,不改变机器人的外臂与基坐标系的旋转关系,设计了一种机器人手眼视觉的标定方法,与传统的方法比较,它不需要预先标定摄像机的内外参数。实验证明:该方法具有算法方便快捷、实验过程简单易行,且精度高等优点,可用于机器人进行运动目标定位与跟踪。     

一种基于拟全方位视觉的移动机器人自运动融合估计方法

基于地平面假设的移动机器人单路视觉运动估计存在鲁棒性和环境适应性较差、精度较低等缺 点,针对这一问题,本文首先介绍了拟全方位视觉系统的构成,并结合该视觉系统的特点给出了一种基于两 步运动的摄像头平行位姿参数标定方法．然后据此提出了一种基于拟全方位视觉的自主移动机器人自运动融 合估计方法．该方法能够借助机器人的非完整运动约束、地平面运行假设以及运动估计参数之间的相容性测 度等多种因素,对拟全方位视觉系统中的各路视觉估计进行性能综合评价;最终依据评价结果融合确定出具 有较高可信度和较强鲁棒性的运动估计参数．实验结果从鲁棒性、精度以及实时性等方面验证了本算法的有 效性．     

CCD摄像机标定

在基于单目视觉的农业轮式移动机器人自主导航系统中,CCD摄像机标定是农业轮式移动机器人正确和安全导航的前提和关键。摄像机标定确立了地面某点的三维空间坐标与计算机图像二维坐标之间的对应关系,机器人根据该关系计算出车体位姿值自主导航。因此,根据CCD摄像机针孔成像模型,利用大地坐标系中平面模板上已知的各点坐标,建立与计算机图像空间中各对应像素值之间的关系方程组,在Matlab环境下拟合出摄像机各内外参数。实验结果表明：该方法可以正确完成CCD摄像机标定。     

基于双目视觉的移动机器人空间测距研究

空间测距是移动机器人实时避障和路径规划的基础.研究了移动机器人双目摄像头由一般布置形式变换到标准布置形式进而实现空间测距的方法.首先对摄像头进行标定(对双目摄像头进行立体标定);然后基于标定结果对摄像头一般布置下所获得立体图像进行极线校正,并得到校正后新的摄像机相互位置参数;最后基于已校正图像和新的位置参数实现移动机器人移动过程中深度与特定目标空间尺寸测量.实验结果证实了本文方法能获得比较精确的测量结果.     

手眼立体视觉的算法与实现

传统的定位方法要求标定出摄像机的内外参数,本文基于直接将图像坐标映射到机器 人参考坐标的“黑箱”思想,提出了末端执行器到机器人参考坐标系的一个恒定旋转矩阵． 使用恒定旋转矩阵使得目标三维定位的算法与标定参数的过程大大简化,同时具有较高的定 位精度．本文提出的三维目标定位方法同样可应用于移动式装配机器人和移动式操作手臂中 ．     

基于一维标定物的多摄像机标定

一维标定物是由三个或三个以上彼此距离已知的共线点构成的. 现有文献指出只有当一维标定物做平面运动或者绕固定点转动时，才能实现摄像机的标定. 本文的研究结果表明，当多个摄像机同时观察作任意刚体运动的一维标定物时，则该摄像机组能被线性地标定. 本文给出一种线性标定算法，并使用最大似然准则对线性算法结果进行精化. 模拟实验和真实图像实验都表明本文的算法是有效可行的.     

A non-iterative and effective procedure for simultaneous odometry and camera calibration for a differential drive mobile robot based on the singular value decomposition

Differential-drive mobile robots are usually equipped with video cameras for navigation purposes. In order to ensure proper operational capabilities of such systems, several calibration steps are required to estimate the video-camera intrinsic and extrinsic parameters, the relative pose between the camera and the vehicle frame and the odometric parameters of the vehicle. In this paper, simultaneous estimation of the aforementioned quantities is achieved by a novel and effective calibration procedure. The proposed calibration procedure needs only a proper set of landmarks, on-board measurements given by the wheels encoders, and the camera (i.e., a number of properly taken camera snapshots of the set of landmarks). A major advantage of the proposed technique is that the robot is not required to follow a specific path: the vehicle is asked to roughly move around the landmarks and acquire at least three snapshots at some approximatively known configurations. Moreover, since the whole calibration procedure does not use external measurement devices, it can be used to calibrate, on-site, a team of mobile robots with respect to the same inertial frame, given by the position of the landmarks’ tool. Finally, the proposed algorithm is systematic and does not require any iterative step. Numerical simulations and experimental results, obtained by using a mobile robot Khepera III equipped with a low-cost camera, confirm the effectiveness of the proposed technique.     

一种全局指数收敛的摄像机内参数观测器

针对摄像机标定问题,本文从控制理论角度出发设计了一种具有指数收敛特性的摄像机内参数观测器.当摄像机随移动机器人等运动平台一起旋转时,该观测器使用其运动信息和实时拍摄得到的特征点图像信息,可以实现对摄像机内参数的在线估计.具体而言,论文分析了云台摄像机的运动约束,建立了特征点图像坐标变化的运动学模型,随后基于4个或4个以上特征点（其中任意3点不共线）,构造了一种内参数非线性观测器,并通过理论分析证明了其状态估计指数收敛于摄像机的相应内参数,仿真结果验证了这种非线性观测器的良好特性.     

An accurate and robust visual-compass algorithm for robot-mounted omnidirectional cameras

Due to their wide field of view, omnidirectional cameras are becoming ubiquitous in many mobile robotic applications.  A challenging problem consists of using these sensors, mounted on mobile robotic platforms, as visual compasses (VCs) to provide an estimate of the rotational motion of the camera/robot from the omnidirectional video stream. Existing VC algorithms suffer from some practical limitations, since they require a precise knowledge either of the camera-calibration parameters, or the 3-D geometry of the observed scene. In this paper we present a novel multiple-view geometry constraint for paracatadioptric views of lines in 3-D, that we use to design a VC algorithm that does not require either the knowledge of the camera calibration parameters, or the 3-D scene geometry. In addition, our algorithm runs in real time since it relies on a closed-form estimate of the camera/robot rotation, and can address the image-feature correspondence problem. Extensive simulations and experiments with real robots have been performed to show the accuracy and robustness of the proposed method.     

基于对偶四元数的机器人方位与手眼关系同时标定方法

针对相机姿态估计及机器人运动学正解存在测算偏差时,手眼标定及机器人坐标系-世界坐标系标定结果不能准确收敛到全局最优解的问题,提出了一种基于对偶四元数理论的机器人方位与手眼关系同时标定方法.该方法首先将标定方程中坐标系刚体变换关系用螺旋轴、旋转角度和平移量参数化表示,再结合全局优化算法对平移量进行优化.搭建了PUMA560机器人数值仿真系统和工业机器人实测实验平台,将该方法与经典的四元数和对偶四元数标定方法进行了比较分析.仿真和实测结果表明,在相机姿态估计及机器人运动学正解存在测量误差的情况下,该方法无需初值估计和数据筛选依然可以保证求解结果的最优性.     

基于Adept机器人的视觉伺服控制系统

机器人视觉伺服控制在理论和应用等方面还有许多问题需要研究,例如特征选择、系统标定和伺服控制算法等.针对Adept机器人,提出了一种简单快速的不需要精确标定摄像机内外部参数的摄像机标定方法,完成了从被观测物体表面所在的视觉平面坐标系到机器人基坐标系的坐标变换.使用图像的全局特征,即图像矩特征进行伺服跟踪;利用所推导的图像雅可比矩阵,设计了由图像反馈与目标运动自适应补偿组成的视觉伺服控制器.将算法对静态目标的定位实验进行了验证,然后又将其应用到移动目标的跟踪上,通过调节和优选控制参数,实现了稳定的伺服跟踪和抓取.实验结果表明采用图像矩作为图像特征能够避免复杂的特征匹配过程,并且能够获得较好的跟踪精度.     

Uncalibrated obstacle detection using normal flow

This paper addresses the problem of obstacle detection for mobile robots. The visual information provided by a single on-board camera is used as input. We assume that the robot is moving on a planar pavement, and any point lying outside this plane is treated as an obstacle. We address the problem of obstacle detection by exploiting the geometric arrangement between the robot, the camera, and the scene. During an initialization stage, we estimate an inverse perspective transformation that maps the image plane onto the horizontal plane. During normal operation, the normal flow is computed and inversely projected onto the horizontal plane. This simplifies the resultant flow pattern, and fast tests can be used to detect obstacles. A salient feature of our method is that only the normal flow information, or first order time-and-space image derivatives, is used, and thus we cope with the aperture problem. Another important issue is that, contrasting with other methods, the vehicle motion and intrinsic and extrinsic parameters of the camera need not be known or calibrated. Both translational and rotational motion can be dealt with. We present motion estimation results on synthetic and real-image data. A real-time version implemented on a mobile robot, is described.     

机场视觉移动服务机器人的设计与研究

民航事业迅猛发展,加上疫情突现,机场中迫切需要一种无人的机器人移动服务平台,以减少人力劳动和阻断病毒传播;依据机场环境和功能要求,对机场移动服务平台进行模块化设计与搭建;平台集成RGB-D相机系统Kinect 2.0,采用张正友标定原理确定相机内外参数;设计和实现移动平台的视觉SLAM整体架构,利用ORB算法进行图像特征点的提取与匹配,对邻帧图像进行估计与优化;将平台样机投入实验场地,设定粒子数为50,最小匹配得分为30,构建分辨率为每像素0.02m的二维栅格地图和三维点云图;该样机为机场提供一种以视觉传感器为基础的移动服务平台,结合实际需求,其他功能模块能快捷地集成于此,发挥各自的服务作用。     

基于正交平面的摄像机自定标

提出了一种基于正交平面摄像机定标的新算法。它利用场景中的正交平面,摄像机作五次以上的平移运动,根据每次运动关于平面的单应矩阵建立内参数的线性约束方程组,从而线性地确定内参数。与以往的定标方法相比,文章对摄像机的运动不苛刻,只需控制摄像机作平移运动,这在一般的实验平台上可以很容易地实现,并且线性地确定摄像机所有的五个内参数。模拟实验和真实图象实验表明,文章给出的方法在机器人视觉中具有一定的实用价值。     

Robot calibration using a 3D vision-based measurement system with a single camera

One of the problems that slows the development of off-line programming is the low static and dynamic positioning accuracy of robots. Robot calibration improves the positioning accuracy and can also be used as a diagnostic tool in robot production and maintenance. This work presents techniques for modeling and performing robot calibration processes with off-line programming using a 3D vision-based measurement system. The measurement system is portable, accurate and low cost, consisting of a single CCD camera mounted on the robot tool flange to measure the robot end-effector pose relative to a world coordinate system. Radial lens distortion is included in the photogrammetric model. Scale factors and image centers are obtained with innovative techniques, making use of a multiview approach. Results show that the achieved average accuracy using a common off-the-shelf CCD camera varies from 0.2 to 0.4 mm, at distances from 600 to 1000 mm from the target, respectively, with different camera orientations. Experimentation is performed on two industrial robots to test their position accuracy improvement using the calibration system proposed: an ABB IRB-2400 and a PUMA-500. The robots were calibrated at different regions and volumes within their workspace achieving accuracy from three to six times better when comparing errors before and after calibration, if measured locally. The proposed off-line robot calibration system is fast, accurate and easy to set up.     

Effective Self-calibration for Camera Parameters and Hand-eye Geometry Based on Two Feature Points Motions

A novel and effective self-calibration approach for robot vision is presented, which can effectively estimate both the camera intrinsic parameters and the hand-eye transformation at the same time. The proposed calibration procedure is based on two arbitrary feature points of the environment, and three pure translational motions and two rotational motions of robot endeffector are needed. New linear solution equations are deduced, and the calibration parameters are finally solved accurately and effectively. The proposed algorithm has been verified by simulated data with different noise and disturbance. Because of the need of fewer feature points and robot motions, the proposed method greatly improves the efficiency and practicality of the calibration procedure.      

A point and distance constraint based 6R robot calibration method through machine vision

This paper proposes a 6R robot closed-loop kinematic calibration method to improve absolute position accuracy with point and distance constraints though machine vision. In the calibration process, a camera attached to the mounting plate of the robot is used to capture a fixed reference sphere as a point constraint and to record robot joint angles and gauge block lengths that are used as a distance constraint. A first-order difference quotient is used to calculate the Jacobian matrix in the joint parameter identification process. The Staübli TX60 robot is successfully calibrated using the proposed method. After calibration, the average distance error of robot motion is decreased from 2.05 mm to 0.24 mm.     

利用平面单应分解实现服务机器人视觉伺服

智能空间中家庭服务机器人所需完成的主要任务是协助人完成物品的搜寻、定位与传递。而视觉伺服则是完成上述任务的有效手段。搭建了由移动机器人、机械臂、摄像头组成的家庭服务机器人视觉伺服系统,建立了此系统的运动学模型并对安装在机械臂末端执行器上的视觉系统进行了内外参数标定,通过分解世界平面的单应来获取目标物品的位姿参数,利用所获取的位姿参数设计了基于位置的视觉伺服控制律。实验结果表明,使用平面单应分解方法来设计控制律可简单有效地完成家庭物品的视觉伺服任务。     

一种高效的视觉导航摄像机标定方法

针对移动机器人视觉导航中的摄像机标定问题,提出一种高效的摄像机标定方法。考虑透镜畸变的影响,利用Hough变换提取矩形棋盘格的角点,求出摄像机参数初始值,运用Levenberg-Marquardt算法对初始解进行非线性迭代优化。通过重投影方法将求出的角点重新投影到矩形棋盘格像平面上,并与原提取的角点相比较,分析产生位置误差的原因。实验结果表明,该方法抗噪声能力强,对实验条件要求相对较低,标定精度满足移动机器人实际导航的要求。