一种自动、快速的Kinect标定方法

针对目前Kinect传感器人工标定方法误差大、速度慢等问题,提出一种自动、快速的Kinect传感器外参标定方法。首先,根据彩色图像提取的角点,生成彩色图像的角点集合;其次,为了实现角点点云的自动提取,对点云图像进行深度分割,提取棋盘格点云,采用三维哈夫(Hough)变换检测方法将棋盘格点云投影到深度图像的模板平面上,在深度图像模板中提取深度图像中的角点;然后,将深度图像中的角点映射到棋盘格点云中,形成角点点云;最后,将角点点云与彩色图像的角点集合进行配准,得到角点的3D空间坐标,进而计算出深度相机到彩色相机的姿态变换矩阵。实验结果表明,本文提出的算法在保证相机标定精度的前提下,将相机参数的计算时间从平均218ms降低到166ms,实现了自动、快速的Kinect相机标定。     

基于形状识别的X型棋盘格角点检测

棋盘格角点检测是相机标定的一个重要环节,其准确率直接影响相机标定的精度,常规角点检测存在对棋盘格图像质量要求较高、检测准确率不高的问题.对此,依据棋盘格图像灰度分布的对称性,利用双层增强滤波器将其角点区域增强为X形状,待检测角点即为X形状中两个分支的交点,将角点检测问题转换为X形状的识别.进行X形状识别时,首先提取待识别区域像素的极坐标作为形状识别的初始特征集合,经特征选择后依据角度特征进行X形状识别.最后在识别出的角点区域内通过直线拟合确定亚像素级角点.实验结果表明,所提出方法进行棋盘格角点检测的准确率较高,且抗干扰能力较强.     

3D靶标的摄像机三步标定算法与实现

摄像机标定是计算机视觉中的一个必不可少的重要环节,其标定精度影响着三维重建结果的精度。利用摄像机对一个三维正交的棋盘格拍摄一幅有效靶标图像,提取角点,第一步通过透视变换矩阵算法线性求解各内外参数;第二步引入径向和切向畸变,将第一步求得的内外参数作为初始值,求得畸变系数的解;第三步对内参数进行线性优化,得到更为精确的内参数值;最后求解反投影后图像坐标的绝对误差。实验结果表明,该方法具有较高的精度,且简单有效。     

3D靶标的摄像机三步标定算法与实现

摄像机标定是计算机视觉中的一个必不可少的重要环节,其标定精度影响着三维重建结果的精度。利用摄像机对一个三维正交的棋盘格拍摄一幅有效靶标图像,提取角点,第一步通过透视变换矩阵算法线性求解各内外参数;第二步引入径向和切向畸变,将第一步求得的内外参数作为初始值,求得畸变系数的解;第三步对内参数进行线性优化,得到更为精确的内参数值;最后求解反投影后图像坐标的绝对误差。实验结果表明,该方法具有较高的精度,且简单有效。     

基于二值几何编码图案的高精度结构光系统参数标定方法研究

该文提出了一种基于空间编码图案的结构光系统参数标定方法。与传统的基于棋盘格图案标 定策略不同的是,该文采用结构光编码图案实现了系统的高精度标定,具体实施步骤包括：(1)根据编码图案的几何分布特性提出了一种编码特征点检测算子,基于检测出的编码特征点构建拓扑结构,利 用仿射变换原理及双线性插值算法提取出编码几何元素图像;(2)将几何元素识别转化为监督分类问题,通过采集大量训练样本训练卷积神经网络,实现编码元素的准确识别和解码过程;(3)利用射影变 换原理建立相机像平面与投影机像平面之间的对应关系,利用此对应关系将标定板上棋盘格角点在相机像平面上的坐标转换至投影机像平面,最终实现了对相机和投影仪内外部参数的同时标定。标定结果显示,该方法对投影仪的标定重投影误差不超过 0.3 像素;三维重建实验结果显示,与传统标定方法相比,该文方法能够显著提升系统的标定和三维重建精度。     

一种大场景下的棋盘靶标角点自动定位算法

针对棋盘图案,提出一种亚像素精度的角点自动定位算法．该算法采用由粗到精的分层次检测策略,首先通过投影算法自动定位靶标图像中棋盘子图像的大致位置;其次在棋盘子图像中进行Hough变换,并根据角度投影图和幅值投影图进行棋盘角点的初步定位;最后在初步定位的角点邻域内通过高斯灰度插值和Harris算法得到最终的亚像素精度的角点位置．此外,本文还利用Hough变换提取的直线对角点进行自动排序．实验结果表明,该算法自动化程度较高,能够在大场景中自动定位靶标及其角点位置,而且精度较高,适用于大场景环境下畸变较小的摄像机的标定．     

针对棋盘格角点快速检测的一种新方法

棋盘格图像在摄像机标定及视觉检测中有着广泛的应用。针对目前棋盘格图像角点检测的局限性,提出了一种棋盘格图像角点快速检测方法。该方法是利用存在过渡区和角点处灰度分布的独特性质,设计了环形检测方法。仿真及实测实验结果表明：该方法实时性强,对棋盘格图像的旋转变换、亮度变换和边缘模糊具有良好的适应性;与经典Harris角点检测算法相比,易于实现、计算量小。     

一种结构光三维扫描仪系统自动标定法

针对棋盘格特点设计新的棋盘格角点提取算法,利用标定棋盘格的特点实现了亚像素级的角点坐标自动化提取。实验结果证明,方法实现标定自动化的同时也保证了较高的标定精度和鲁棒性。     

基于神经网络的不均匀光照下围棋识别方法

针对围棋机器人系统中光照不均匀造成的棋子识别误差问题,提出了基于神经网络的不均匀光照下围棋棋子识别方法。首先,利用边缘检测算法确定棋盘位置;其次,利用阈值分割法检测出棋盘四个标定点的坐标,并通过透视变换矩阵转换为标准棋盘图像;然后,基于多层感知器搭建神经网络模型,并训练出分类器;最后,将标准棋盘图像利用分类器进行棋子分类,并输出识别结果。所提方法在强光、室内灯光、暗光三种光照不均匀情况下对围棋棋子的平均识别准确率可达到98%以上,实验结果验证了该方法的有效性。     

基于双目视觉的物体尺寸测量系统

提出了一种基于双目视觉的物体尺寸测量系统,用于非接触式测量物体尺寸。该系统采用张正友棋盘标定法进行双目相机标定,并利用标定参数对采集的图像进行校正。通过采用图像分割技术和角点检测算法获取待测物体的特征点。通过立体匹配算法对校正图像进行处理,得到视差图。根据三角形相似性原理计算特征点的三维坐标,计算出物体尺寸的信息。实验结果表明,该系统具备较高的测量精度,具有一定的实用性和应用前景。     

棋盘格模板角点的自动识别与定位

棋盘格模板角点的识别与定位是摄像机定标过程中的关键环节,而自动识别与定位则是实现定标过程自动化的前提条件。为了实现定标过程自动化,提出了一种有效的方法,即利用棋盘格模板图像内部角点的局部灰度特征和由栅格线构成的结构特征,实现了内部角点的自动识别与定位。实验结果表明,该方法是有效和实用的,其能明显地加快定标速度,缩短定标时间,从而为基于多幅棋盘格模板图像的摄像机定标过程自动化创造了条件。     

一种基于TOF相机与CCD相机的联合标定算法研究

针对基于Time-of-Flight(TOF)相机的彩色目标三维重建需标定CCD相机与TOF相机联合系统的几何参数,在研究现有的基于彩色图像和TOF深度图像标定算法的基础上,提出了一种基于平面棋盘模板的标定方法。拍摄了固定在平面标定模板上的彩色棋盘图案在不同角度下的彩色图像和振幅图像,改进了Harris角点提取,根据棋盘格上角点与虚拟像点的共轭关系,建立了相机标定系统模型,利用Levenberg-Marquardt算法求解,进行了标定实验。获取了TOF与CCD相机内参数,并利用像平面之间的位姿关系估计两相机坐标系的相对姿态,最后进行联合优化,获取了相机之间的旋转矩阵与平移向量。实验结果表明,提出的算法优化了求解过程,提高了标定效率,能够获得较高的精度。     

Self-calibration from one circular motion sequence and two images

This paper describes a new method for self-calibration of camera with constant internal parameters under circular motion, using one sequence and two images captured with different camera orientations. Unlike the previous method, in which three circular motion sequences are needed with known motion, the new method computes the rotation angles and the projective reconstructions of the sequence and the images with circular constraint enforced, which is called a circular projective reconstruction, using a factorization-based method. It is then shown that the images of the circular points of each circular projective reconstruction can be readily obtained. Subsequently, the image of the absolute conic and the calibration matrix of the camera can be determined. Experiments on both synthetic and real image sequence are given, showing the accuracy and robustness of the new algorithm.     

Which pattern? Biasing aspects of planar calibration patterns and detection methods

This paper provides a comparative study on the use of planar patterns in the generation of control points for camera calibration. This is an important but often neglected aspect in camera calibration. Two popular checkerboard and circular dot patterns are each examined with two detection strategies for invariance to the potential bias from projective transformations and nonlinear distortions. It is theoretically and experimentally shown that circular patterns can potentially be affected by both biasing sources. Guidelines are given to control such bias. In contrast, appropriate checkerboard detection is shown to be bias free. The findings have important implications for camera calibration, indicating that well accepted methods may give poorer results than necessary if applied naively.     

一种非定标图像高精度三维重建算法

由非定标图像重建三维场景有着广泛的应用。给出了一种非定标多视图像三维重建算法。该算法主要基于因子分解和光束法平差技术。首先用因子分解方法得到射影空间下相机投影矩阵和物点坐标,以旋转矩阵的正交性以及对偶绝对二次曲面秩为3为约束,将射影空间升级到欧式空间,最后用光束法平差进行优化。该方法可同时获得相机的内外参数、畸变系数和场景的三维坐标。仿真实验表明,在1000 mm×1000 mm×400mm的范围内,当像点检测误差在0-1pixel和0-2pixel内,所重建三维点的误差分别为0.1530 mm和0.6712 mm。在500 mm×500 m×200 mm下,真实实验重构三维点的误差在0.3 mm以内。所提出的算法稳定可靠,可对实际工程进行指导。     

Camera calibration using identical objects

This paper describes a method for camera calibration using identical products. In this paper, we postulate an imaginative rigid motion between any two identical products, and the imaginative rigid motion could offer a pair of circular points. As is known, three pairs of projections of the circular points are needed to result in the closed-form solution for calibration. In our method, we obtain three pairs of projections of the circular points from only two images of three identical products, or three images of two identical products. When only two identical products are utilized, our method is almost the dual of the stereo calibration from rigid motions. A direct approach is taken here instead of the two-step process in stereo calibration. Furthermore, a better projective reconstruction could be performed from the estimation of the camera parameters to avoid the dominant projective-to-affine error in the stereo calibration. Finally, we conduct a nonlinear refinement based on the maximum likelihood estimation. The experimental results from synthetic data and real data prove our method convenient and robust to noise.     

基于梯形棋盘格的摄像机和激光雷达标定方法

针对无人车（UGV）自主跟随目标车辆检测过程中需要对激光雷达（LiDAR）数据和摄像机图像进行信息融合的问题,提出了一种基于梯形棋盘格标定板对激光雷达和摄像机进行联合标定的方法。首先,利用激光雷达在梯形标定板上的扫描信息,获取激光雷达安装的俯仰角和安装高度;然后,通过梯形标定板上的黑白棋盘格标定出摄像机相对于车体的外参数;其次,结合激光雷达数据点与图像像素坐标之间的对应关系,对两个传感器进行联合标定;最后,综合激光雷达和摄像机的标定结果,对激光雷达数据和摄像机图像进行了像素级的数据融合。该方法只要让梯形标定板放置在车体前方,采集一次图像和激光雷达数据就可以满足整个标定过程,实现两种类型传感器的标定。实验结果表明,该标定方法的平均位置偏差为3.5691 pixel,折算精度为13 μm,标定精度高。同时从激光雷达数据和视觉图像融合的效果来看,所提方法有效地完成激光雷达与摄像机的空间对准,融合效果好,对运动中的物体体现出了强鲁棒性。     

Online robot calibration based on vision measurement

Robot calibration is a useful diagnostic method to improve positioning accuracy in robot production and maintenance. Unlike traditional calibration methods that require expensive equipment and complex steps, a vision-based online robot calibration method that only requires several reference images is presented in this paper. The method requires a camera that is rigidly attached to the robot end effector (EE), and a calibration board must be settled around the robot where the camera can see it. An efficient automatic approach to detect the corners from the images of the calibration board is proposed. The poses of the robot can be estimated from the detected corners. The kinematic parameters can be conducted automatically based on the known poses of the robot. Unlike in the existing self-calibration methods, the great advantage of this online self-calibration method is that the entire process of robot calibration is automatic and without any manual intervention, enabling the robot calibration to be completed online when the robot is working. Therefore, the proposed approach is particularly suitable for unknown environments, such as deep sea or outer space. In these high-temperature and/or high-pressure environments, the shapes of the robot links are easy to change. Thus, the robot kinematic parameters are changed by allowing the robot to grab objects with different qualities to verify the performance of the online robot calibration. Experimental studies on a GOOGOL GRB3016 robot show that the proposed method has high accuracy, convenience, and high efficiency.     

Geometric camera calibration using circular control points

Modern CCD cameras are usually capable of a spatial accuracy greater than 1/50 of the pixel size. However, such accuracy is not easily attained due to various error sources that can affect the image formation process. Current calibration methods typically assume that the observations are unbiased, the only error is the zero-mean independent and identically distributed random noise in the observed image coordinates, and the camera model completely explains the mapping between the 3D coordinates and the image coordinates. In general, these conditions are not met, causing the calibration results to be less accurate than expected. In the paper, a calibration procedure for precise 3D computer vision applications is described. It introduces bias correction for circular control points and a nonrecursive method for reversing the distortion model. The accuracy analysis is presented and the error sources that can reduce the theoretical accuracy are discussed. The tests with synthetic images indicate improvements in the calibration results in limited error conditions. In real images, the suppression of external error sources becomes a prerequisite for successful calibration.     

A generalized registration method for augmented reality systems

In augmented reality systems, registration is one of the most difficult problems currently limiting their applications. In this paper, we propose a generalized registration method using projective reconstruction technique in computer vision. This registration method is composed of embedding and tracking. Embedding involves specifying four points to build the world coordinate system on which a virtual object will be superimposed. In this stage, any arbitrary two unrelated images or any 3×4 projective matrices with rank 3 can be used to calculate the 3D pseudo-projective coordinates of the four specified points. In the tracking process, these 3D pseudo-projective coordinates are used to track the four specified points to compute the registration matrix for augmentation. The proposed method is simple, as only four points need to be specified at the embedding stage, and the virtual object can then be easily augmented onto a real scene from a video sequence. One advantage is that the virtual objects can still be superimposed on the specified regions even when the regions are occluded in the video sequence. Another advantage of the proposed method is that the registration errors can be adjusted in real-time to ensure that they are less than certain thresholds that have been specified at the initial embedding stage. Several experiments have been conducted to validate the performance of the proposed generalized method.