A robust method to recognize critical configuration for camera calibration

When space points and camera optical center lie on a twisted cubic, no matter how many pairs there are used from the space points to their image points, camera parameters cannot be determined uniquely. This configuration is critical for camera calibration. We set up invariant relationship between six space points and their image points for the critical configuration. Then based on the relationship, an algorithm to recognize the critical configuration of at least six pairs of space and image points is proposed by using a constructed criterion function, where no any explicit computation on camera projective matrix or optical center is needed. Experiments show the efficiency of the proposed method.     

散焦模糊量估计的相机加权标定方法

相机标定在计算机视觉领域中有着至关重要的作用.绝大多数相机标定方法假设相机为针孔模型,且需要良好聚焦的图像来保证相机内外参估计的准确性.然而,这些条件会受到相机景深的影响.在薄透镜相机模型假设下,提出了一种加权相机标定的方法,其权重考虑了控制点的模糊量信息.首先对棋盘格标定物上的每一个角点进行散焦模糊量估计,在标定过程中,将散焦模糊量的大小作为一个权重加入到标定能量函数最小化过程中,使得标定精度得到提高.该方法简单高效,不需要额外的数码设备或者特别定做的标定物.在Intel Core i7处理器的计算机下,使用合成数据以及真实数据上进行的实验结果表明,文中方法能够有效减小重投影误差,提高张正友标定方法的标定精度.     

Using vanishing points for camera calibration

In this article a new method for the calibration of a vision system which consists of two (or more) cameras is presented. The proposed method, which uses simple properties of vanishing points, is divided into two steps. In the first step, the intrinsic parameters of each camera, that is, the focal length and the location of the intersection between the optical axis and the image plane, are recovered from a single image of a cube. In the second step, the extrinsic parameters of a pair of cameras, that is, the rotation matrix and the translation vector which describe the rigid motion between the coordinate systems fixed in the two cameras are estimated from an image stereo pair of a suitable planar pattern. Firstly, by matching the corresponding vanishing points in the two images the rotation matrix can be computed, then the translation vector is estimated by means of a simple triangulation. The robustness of the method against noise is discussed, and the conditions for optimal estimation of the rotation matrix are derived. Extensive experimentation shows that the precision that can be achieved with the proposed method is sufficient to efficiently perform machine vision tasks that require camera calibration, like depth from stereo and motion from image sequence.     

Multi-camera calibration based on an invariant pattern

In this paper we present a method for the calibration of multiple cameras based on the extraction and use of the physical characteristics of a one-dimensional invariant pattern which is defined by four collinear markers. The advantages of this kind of pattern stand out in two key steps of the calibration process. In the initial step of camera calibration methods, related to sample points capture, the proposed method takes advantage of using a new technique for the capture and recognition of a robust sample of projective invariant patterns, which allows to capture simultaneously more than one invariant pattern in the tracking area and recognize each pattern individually as well as each marker that composes them. This process is executed in real time while capturing our sample of calibration points in the cameras of our system. This new feature allows to capture a more numerous and robust set of sample points than other patterns used for multi-camera calibration methods. In the last step of the calibration process, related to camera parameters' optimization, we explore the collinearity feature of the invariant pattern and add this feature in the camera parameters optimization model. This approach obtains better results in the computation of camera parameters. We present the results obtained with the calibration of two multi-camera systems using the proposed method and compare them with other methods from the literature.     

Camera calibration issues in robot calibration with eye-on-hand configuration

One of the possible methods for accurate, fast, low-cost and automated robot calibration is to employ a single camera rigidly mounted to the robot end-effector together with a single camera calibration board. The end-effector pose is measured by calibration of the camera at every robot measurement configuration. This paper contends that, with several modifications, Tsai's radial alignment constraint (RAC) camera calibration method can be made a fast and sufficiently accurate pose measurement technique. This paper focuses on speed, accuracy and cost enhancement of RAC-based camera calibration. A fast RAC-based algorithm is proposed, which cuts the computation time of Tsai's original algorithm by about a 5: 1 ratio while keeping its accuracy within the tolerances required for a successful robot calibration. A low-cost method for estimation of the ratio of scale factors of the camera/vision system is also proposed. This method does not require a precision vertical micrometer stage to provide non-coplanar calibration points data for camera calibration. Finally, the phenomenon of perspective projection distortion of circular camera calibration points is fully analyzed and error compensation methods are proposed.     

一种基于近似点光源模型的光度立体视觉系统 标定方法

文章研究了一种由近似点光源组成的光度立体视觉系统的标定方法。由于光源自身的非均匀发光特性,传统的平行光和点光源模型不再适用,为实现精确的三维法向重建,必须对光源及光照场进行精确的标定。论文首先根据光源自身的发光特性建立其辐射度模型,进而提出了一种两步标定策略,对光源位置参数及主光轴参数进行标定。以相机作为参照系,提出了一种多球标定方法,用于计算各个光源的位置参数,该方法利用相机观察到的多个球面高光点图像坐标,结合球体轮廓线及球体半径实现了光源位置的精确计算。为实现光源主光轴参数的估算,提出了一种基于参考平面的标定方法,通过分析近似点光源照射下的平面亮度分布,结合等亮度线拟合策略实现了光源主光轴方向参数的计算。基于系统标定参数以及光源的发光模型,就可以对每个场景点的入射光条件进行精确建模,从而实现精确的法向计算。在实验部分,分别对标准几何物体和自由曲面物体进行三维重建实验,并与传统的平行光及点光源模型进行了对比。结果显示,所提出的标定方法能够在非均匀光照条件下获得精确的三维法向重建结果。     

Estimation of mirror shape and extrinsic parameters in axial non-central catadioptric systems

We propose a method to estimate the mirror shape and position, and the extrinsic parameters in axial non-central catadioptric systems (i.e. systems with an axial symmetrical mirror and a pinhole camera with its optical center located at the mirror axis). Our method requires one or more images of a planar calibration pattern consisting of points and lines with known position (e.g. a checkerboard), and that the camera be internally calibrated. We also present an alternative algorithm for the particular case of catadioptric systems with spherical mirror, were the estimation is achieved by fitting quartic curves to the images of lines of the calibration pattern. An analytical solution is presented for every method. Each analytical solution is then refined by a non-linear optimization procedure. We present experimental results, on simulated and real images, that demonstrate the validity of our work.     

交通监控场景下的相机标定与车辆速度测量

针对交通监控场景中对车辆速度测量的需求,提出了一种相机标定方法和车辆速度测量方案。首先,通过深度学习YOLO检测算法和光流跟踪算法对图像中的车辆目标进行检测和跟踪,根据获得的轨迹集合使用级联霍夫变换计算出道路方向上的消失点,从而检测出道路上的标志线。之后根据消失点和标志线,使用试探焦距思想完成相机标定任务。最后通过计算多帧之间瞬时速度的平均值来实现车辆速度的测量。通过真实交通监控场景的实验结果表明,这种基于消失点的自动相机标定方法具有较好的稳定性和较高的标定精度,能够满足车辆速度测量和实际工程应用的需求。     

基于二次曲线的线阵相机标定技术

针对绕固定轴旋转的线阵相机,提出一种基于二次曲线的相机标定方法。该方法只需要相机在2个或更多不同的方位拍摄图像,通过相机的转动在每个方位拍摄多帧图像。靶标采用一个包含3个或更多二次曲线的平板。相机和靶标可以自由移动,不需要知道运动参数。通过坐标变换,把每个方位所拍摄的多帧线阵图像排列成面阵图像。从面阵图像中提取二次曲线作为标定基元,以此简化基元对应问题。仿真实验结果表明,该方法精度较高,鲁棒性较好。     

基于改进圆形靶的圆心自动提取与排序

针对传统圆形靶不便于相机全自动标定、特征圆圆心提取精度不高以及圆心点阵排序受圆形靶旋转角度影响较大的问题,设计了适用于相机全自动标定的圆形靶,并针对该靶,提出了基于随机抽样一致的最小二乘圆心拟合法和基于向量夹角的圆心点阵顺序排序法。实验结果表明,采用该圆心提取算法,平均拟合误差为0.006?1个像素,相比传统的最小二乘拟合法,精度较高;对于标定靶0°~360°角度的旋转,均能够快速且准确地完成圆心点阵排序,平均排序时间为0.009?6?s,易于实现在线的相机全自动标定。     

一种基于DLT模型和圆环点改正的摄像机定标方法

提出一种基于DLT(直接线性变换)模型和圆环点改正的摄像机定标方法.运用计算机视觉原理,通过三维DLT平面模板模型平移对摄像机进行定标,并在模板上设计一个圆环,使用圆环上的点进行定标参数改进.实验数据证明,定标方法是有效的.     

Autonomous robot calibration using vision technology

Unlike the traditional robot calibration methods, which need external expensive calibration apparatus and elaborate setups to measure the 3D feature points in the reference frame, a vision-based self-calibration method for a serial robot manipulator, which only requires a ground-truth scale in the reference frame, is proposed in this paper. The proposed algorithm assumes that the camera is rigidly attached to the robot end-effector, which makes it possible to obtain the pose of the manipulator with the pose of the camera. By designing a manipulator movement trajectory, the camera poses can be estimated up to a scale factor at each configuration with the factorization method, where a nonlinear least-square algorithm is applied to improve its robustness. An efficient approach is proposed to estimate this scale factor. The great advantage of this self-calibration method is that only image sequences of a calibration object and a ground-truth length are needed, which makes the robot calibration procedure more autonomous in a dynamic manufacturing environment. Simulations and experimental studies on a PUMA 560 robot reveal the convenience and effectiveness of the proposed robot self-calibration approach.     

基于特征点位置校正的靶标位姿测量方法

针对图像式路基沉降监测系统中由于振动等因素导致靶标与相机发生偏转产生测量误差的问题,本文在设计监测系统靶面位姿测量系统的基础上提出了基于4特征点位置校正的位姿测量方法.首先介绍了图像式路基沉降监测方法的工作原理;然后根据实际情况设计了区别于传统特征点的4特征点靶面的位姿测量系统,并利用特殊特征点对靶面特征点进行位置校正;最后根据设计的4特征点靶面测量系统提出已知矩形4特征点边长的位姿求解方法.实验结果表明:本文方法比迭代法位姿解算后角度误差值更小,其位姿解算相对误差减小1.2%.当偏转角度小于2°时,本文方法位姿求解旋转角度误差小于0.09°,相对角度误差为1.003%.其时间和测量精度都能够达到监测系统要求,可以应用于监测系统中需要对相机和靶标进行实时标定的场景.     

An efficient camera calibration method for vision-based head tracking

The aim of this study is to develop and evaluate an efficient camera calibration method for vision-based head tracking. Tracking head movements is important in the design of an eye-controlled human/computer interface. A vision-based head tracking system is proposed to allow the user's head movements in the design of the eye-controlled human/computer interface. We propose an efficient camera calibration method to track the three-dimensional position and orientation of the user's head accurately. We also evaluate the performance of the proposed method and the influence of the configuration of calibration points on the performance. The experimental error analysis results showed that the proposed method can provide more accurate and stable pose (i.e. position and orientation) of the camera than the direct linear transformation method which has been used in camera calibration. The results for this study can be applied to the tracking of head movements related to the eye-controlled human/computer interface and the virtual reality technology.     

基于二值几何编码图案的高精度结构光系统参数标定方法研究

该文提出了一种基于空间编码图案的结构光系统参数标定方法。与传统的基于棋盘格图案标 定策略不同的是,该文采用结构光编码图案实现了系统的高精度标定,具体实施步骤包括：(1)根据编码图案的几何分布特性提出了一种编码特征点检测算子,基于检测出的编码特征点构建拓扑结构,利 用仿射变换原理及双线性插值算法提取出编码几何元素图像;(2)将几何元素识别转化为监督分类问题,通过采集大量训练样本训练卷积神经网络,实现编码元素的准确识别和解码过程;(3)利用射影变 换原理建立相机像平面与投影机像平面之间的对应关系,利用此对应关系将标定板上棋盘格角点在相机像平面上的坐标转换至投影机像平面,最终实现了对相机和投影仪内外部参数的同时标定。标定结果显示,该方法对投影仪的标定重投影误差不超过 0.3 像素;三维重建实验结果显示,与传统标定方法相比,该文方法能够显著提升系统的标定和三维重建精度。     

基于边缘关联点云的激光雷达与相机外参标定方法

激光雷达的点云和相机的图像经常被融合应用在多个领域。准确的外参标定是融合两者信息的前提。点云特征提取是外参标定的关键步骤。但是点云的低分辨率和低质量会影响标定结果的精度。针对这些问题,提出一种基于边缘关联点云的激光雷达与相机外参标定方法。首先,利用双回波提取标定板边缘关联点云;然后,通过优化方法从边缘关联点云中提取出与实际标定板尺寸大小兼容的标定板角点;最后,将点云中角点和图像中角点匹配。用多点透视方法求解激光雷达与相机之间的外参。实验结果表明,该方法的重投影误差为1.602px,低于同类对比方法,验证了该方法的有效性与准确性。     

基于透视式增强现实的BIM建筑三维重建仿真

为了提高三维建筑模型的精准度,需要深入研究BIM建筑三维重建方法。当前方法耗时较长,得到的三维建筑模型与实际建筑之间的误差较大,存在效率低和精准度低的问题。将透视式增强现实技术应用到BIM建筑三维重建中,提出基于透视式增强现实的BIM建筑三维重建方法,通过BIM构建初始三维建筑模型,采用直接线性变换算法计算摄像机的内部参数和外部参数,完成摄像机标定。在摄像机标定结果的基础上采用LK光流计算方法得到像素在图像中的光流,根据光流的方向阈值和光流的大小筛选图像中的光流,提取到图像的匹配点,基于初始三维建筑模型针对建筑图像匹配点构成空间三维点云,采用Delaunay方法对空间三维点云进行三角化处理,针对处理后的建筑图像通过贴纹理完成BIM建筑三维重建。仿真结果表明,所提方法的效率高、精准度高。     

3D reconstruction of specular surfaces using a calibrated projector–camera setup

Structured light is widely used for shape measurement of beamless surfaces using the triangulation principle. In the case of specular surfaces deflectometry is an appropriate method. Hereby the reflection of a light pattern is observed by a camera. The distortion of the reflected pattern is evaluated to obtain information about the reflecting surface. An important requirement for a 3d reconstruction of a specular surface by deflectometry is a calibrated measurement setup. We propose a method for the overall calibration of a setup consisting of a structured light source, a projection screen and a camera. We consider all extrinsic and intrinsic parameters for the optical mapping including a distortion model for the projector and for the camera, respectively. Given the deflectometric data obtained by the calibrated setup two methods are described which allow the 3d reconstruction of points on a specular surface. This is not trivial as a reconstruction using solely deflectometric data shows ambiguity. In the first method screen displacement between two deflectometric measurements is used to overcome this ambiguity. In the second method curvature-like features on the surface are determined to serve as starting points for a region growing approach. Results of the reconstruction of a specular surface are shown and the performance of the described reconstruction methods are compared to each other.     

基于平面格网的非量测CCD相机自标定

传统的相机标定方法通常需要建立复杂3维标定块或高精度3维控制场,在实际应用中受到了一定的限制。本文采用平面控制格网作为标定块,根据相机的理想模型确定内方位元素,利用2维直接线性变换和共线方程分解出相机的外方位元素初值,采用改进的Hough变换算法检测标定图像中的格网直线并利用最小二乘法拟合出最佳直线,通过求直线的交点得到标定格网点的像坐标。最后利用自检校光线束法平差进行相机的精确标定。实际图像数据实验结果表明,主点和焦距的标定精度分别达到了0.2像素和0.3像素左右。可以满足高精度近景3维量测的要求。     

一种简单快速的相机标定新方法

本文提出了一种新的相机自标定方法,该方法要求摄像机在3个(或3个以上)不同方位摄取一个包含其内接正三角形的圆的新型标定模板的图像.首先,从模板图像中推导得到圆环点的像点坐标;然后通过得到的圆环点像点坐标,可线性求解摄像机内参数.与传统方法不同的是,该方法避免了复杂的椭圆拟合和直线拟合,降低了计算复杂度,提高了标定速度和...