Self-calibration of spherical rectification for a PTZ-stereo system

Since PTZ (pan–tilt–zoom) camera is able to obtain multi-view-angle and multi-resolution information, PTZ-stereo system using two PTZ cameras has much higher capability and flexibility compared with traditional stereo system. In this paper, we propose a self-calibration framework to deal with the calibration of spherical rectification, which can be deemed as a kind of relative pose estimation, for a PTZ-stereo system. The goal of this calibration is to guarantee high performance of stereo rectification, so that stereo matching can be achieved more efficiently and accurately. In this framework, we assume two PTZ cameras are fully calibrated, i.e., the focal length and the local camera orientation can be computed by given pan–tilt–zoom values. This approach, which is based on point matches, aims at finding uniformly distributed point matches in an iterative way. At each iteration, according to the distribution of previously used point matches, the system could automatically guide two cameras to move to collect a new match. Point matching is firstly performed for the lowest zoom setting (widest field of view). Once a candidate match is chosen, each camera is then controlled to zoom in on corresponding point to get a refined match with high spatial resolution. The final match will be added into the estimation to update the calibration parameters. Compared with previous researches, the proposed framework has the following advantages: (1) Neither manual interaction nor calibration object is needed. Calibration samples (point matches) will be added and removed in each stage automatically. (2) The distribution of calibration samples is as uniform as possible so that biased estimation could be avoided to some extent. (3) The accuracy of calibration can be controlled and improved when iteration goes on. These advantages make the proposed framework more practicable in applications. Experimental results illustrate its accuracy.     

基于单幅图片的相机完全标定

现有相机标定方法的标定过程比较繁琐,不利于标定相机的广泛使用。为此,从摄像机镜头畸变矫正着手,结合标定板信息及消失点约束,提出一种基于单张图片的相机标定方法。利用非线性迭代得到相机镜头的畸变系数,通过线性求解得出相机的内参,直接计算得到相机的外参,从而实现仅需拍摄单张标定板图片的相机完全标定。实验结果表明,该方法在标定板与视平面夹角小于45°的情况下均能成功标定,并且重投影误差小于0.3像素。     

用于交会测量的摄像机标定系统设计

介绍了一种简易的摄像机立体标定系统的设计方案,主要应用于多CCD交会测量技术中,可以完成单个摄像机的标定、多个摄像机之间的立体标定和标定精度评估等功能.建立了包含透镜径向畸变和切向畸变的摄像机成像模型,采用两步法求解摄像机参数,最后通过交会测量得到的多个棋盘格的边长与实际边长的误差量来衡量摄像机标定的精度.该系统不要求使用者具有专业的3D几何知识,速度快,成本低,而且可以达到很高的精度.     

双摄像机模组的组合式标定和校正方法

提出了双摄像机模组的组合式标定和校正方法,能够将传统的标定和校正2道工序合并为1道工序,不需要借助于外部测量设备,仅利用双摄像机同时对目标模板拍摄的1幅图像,即可实现双摄像机模组的标定和校正。先基于交比不变性计算摄像机的径向畸变系数,将摄像机畸变成像模型转换为线性模型,利用线性模型分别对2个摄像机进行标定;然后计算2个摄像机之间的位姿偏移参数,调节右摄像机位姿,进行双摄像机之间的位姿校正;最后标定2个摄像机之间的位姿参数。实际应用结果表明,所提出的双摄像机模组校正和标定方法,校正和标定精度高,缩短了工艺时间,提高了工艺效率,能够满足双摄像机模组封装生产工艺的要求。     

Generalized Camera Calibration Including Fish-Eye Lenses

A method is described for accurately calibrating cameras including radial lens distortion, by using known points such as those measured from a calibration fixture. Both the intrinsic and extrinsic parameters are calibrated in a single least-squares adjustment, but provision is made for including old values of the intrinsic parameters in the adjustment. The distortion terms are relative to the optical axis, which is included in the model so that it does not have to be orthogonal to the image sensor plane. These distortion terms represent corrections to the basic lens model, which is a generalization that includes the perspective projection and the ideal fish-eye lens as special cases. The position of the entrance pupil point as a function of off-axis angle also is included in the model. (The complete camera model including all of these effects often is called CAHVORE.) A way of adding decentering distortion also is described. A priori standard deviations can be used to apply weight to given initial approximations (which can be zero) for the distortion terms, for the difference between the optical axis and the perpendicular to the sensor plane, and for the terms representing movement of the entrance pupil, so that the solution for these is well determined when there is insufficient information in the calibration data. For the other parameters, initial approximations needed for the nonlinear least-squares adjustment are obtained in a simple manner from the calibration data and other known information. (Weight can be given to these also, if desired.) Outliers among the calibration points that disagree excessively with the other data are removed by means of automatic editing based on analysis of the residuals. The use of the camera model also is described, including partial derivatives for propagating both from object space to image space and vice versa. These methods were used to calibrate the cameras on the Mars Exploration Rovers.     

机器人立体视觉中摄像机的标定

针对机器人立体视觉标定问题,提出一种介于传统标定法和自标定法之间的摄像机标定方法。与传统方法相比,将内参数、畸变参数与外参数分别标定。首先根据张氏平面标定法求出内参数;其次在考虑透镜径向畸变的基础上求出畸变参数;最后重点探讨在摄像机带有运动的情况下外参数的标定方法,避免了在原有标定环境下摄像机运动时需要重新标定的问题。实验依据传统标定的模板原理,结合双目立体视觉模型,验证了该种分离标定方法的可行性。     

线阵相机的圆环旋转标定方法

由于传统线阵相机的标定过程复杂,且对标定物精度要求较高,难以保证缺陷的定位精度,本文提出一种线阵相机的圆环旋转标定方法以提高缺陷的定位精度。该方法设计一种新型的圆环形标定板,在静态标定基础上通过旋转线阵相机采集相机视线与圆的交点的坐标,得到旋转角度以及多组标定点,建立线阵相机的成像模型和径向畸变模型,通过非线性优化整体误差函数求解相机的内参和畸变参数,同时分析相机不同旋转角度对标定精度的影响。实验结果表明,当θ≤20°时,该方法的标定精度在0.35 pixel以内,满足实际检测的定位要求,并且在PCB缺陷检测中得到较好的验证。     

Camera array calibration for light field acquisition

Light field cameras are becoming popular in computer vision and graphics, with many research and commercial applications already having been proposed.Various types of cameras have been developed with the camera array being one of the ways of acquiring a 4D light field image usingmultiple cameras. Camera calibration is essential, since each application requires the correct projection and ray geometry of the light field. The calibrated parameters are used in the light field image rectified from the images captured by multiple cameras. Various camera calibration approaches have been proposed for a single camera, multiple cameras, and amoving camera. However, although these approaches can be applied to calibrating camera arrays, they are not effective in terms of accuracy and computational cost. Moreover, less attention has been paid to camera calibration of a light field camera. In this paper, we propose a calibration method for a camera array and a rectification method for generating a light field image from the captured images. We propose a two-step algorithm consisting of closed form initialization and nonlinear refinement, which extends Zhang’swell-known method to the camera array. More importantly, we introduce a rigid camera constraint whereby the array of cameras is rigidly aligned in the camera array and utilize this constraint in our calibration. Using this constraint, we obtained much faster and more accurate calibration results in the experiments.     

一种摄像机复合标定方法及其在汽车碰撞实验中的应用

提出了一种摄像机的复合标定方法:基于共面点分步标定摄像机的初始内外参数;基于最小二乘法求解径向畸变参数,进而迭代优化。标定点的识别中,中心点的识别采用了Hough直线检测及直线求交法,避免通常的Hough椭圆检测法带来的测量误差。应用于汽车碰撞过程的定性和定量分析,结果表明了其有效性与稳定性。     

Optimizing PTZ camera calibration from two images

In this paper, we address the problem of calibrating an active pan–tilt–zoom (PTZ) camera. In this regard, we make three main contributions: first, for the general camera rotation, we provide a novel solution that yields four independent constraints from only two images, by directly decomposing the infinite homography using a series of Givens rotations. Second, for a camera varying its focal length, we present a solution for the degenerate cases of pure pan and pure tilt that occur very frequently in practical applications of PTZ cameras. Third, we derive a new optimized error function for pure rotation or pan–tilt rotation, which plays a similar role as the epipolar constraint in a freely moving camera, in terms of characterizing the reprojection error of point correspondences. Our solutions and analysis are thoroughly validated and tested on both synthetic and real data, whereby the new geometric error function is shown to outperform existing methods in terms of accuracy and noise resilience.     

Kinect传感器的彩色和深度相机标定

目的 针对现有的Kinect传感器中彩色相机和深度相机标定尤其是深度相机标定精度差、效率低的现状,本文在现有的基于彩色图像和视差图像标定算法的基础上,提出一种快速、精确的改进算法。方法 用张正友标定法标定彩色相机,用泰勒公式化简深度相机中用于修正视差值的空间偏移量以简化由视差与深度的几何关系构建的视差畸变模型,并以该模型完成Kinect传感器的标定。结果 通过拍摄固定于标定平板上的标定棋盘在不同姿态下的彩色图像和视差图像,完成Kinect传感器的标定,获得彩色相机和深度相机的畸变参数及两相机之间的旋转和平移矩阵,标定时间为116 s,得到彩色相机的重投影误差为0.33,深度相机的重投影误差为0.798。结论 实验结果表明,该改进方法在保证标定精度的前提下,优化了求解过程,有效提高了标定效率。     

一种摄像机亚象素线性标定方法

提出了一种考虑径向畸变的摄像机线性标定方法。采用一个方格图样模板进行标定,先利用改进的Harris算子精确提取角点的亚象素坐标,通过预标定获得主点坐标;然后在考虑摄像机径向畸变的情况下建立摄像机模型,并求解摄像机内外参数。实验及误差分析表明:该标定方法具有较高的精度和较好的实时性。     

Tsai氏相机平面标定算法的一种解析改进

针对径向畸变的针孔透视投影模型,提出了一种简单快速的相机标定算法。该算法在假设图像中心点与CCD或CMOS传感器中心重合的前提下,将相机的内外参数和相机模型的畸变参数分离,以进一步进行线性相机标定,避免了非线性优化带来的误差,降低了算法复杂度,可适当提高标定精度,节约计算时间。首先,根据透视投影的交比不变性原理标定镜头的畸变系数;然后,根据旋转变换关系和平移变换关系,充分利用径向畸变约束、旋转变换的正交性和旋转矩阵特有的性质约束线性求解出相机的内参和外参;最后,通过实验与Tsai氏相机平面标定算法进行对比,所提算法在标定时间上节约了35%左右,在精度上至少提高了15%。     

基于光束法平差的双线阵系统标定技术

针对线阵相机特殊使用场景中所需要的高精度图像,对线阵相机进行高精度标定。提出一种基于光束法平差的双线阵相机标定方法。通过背景差分法获取线阵相机的特征点的像素坐标。再利用已有的直接线性变换方法和非线性优化方法求出相机的内参,外参,畸变参数后,将得到的初始参数与世界坐标作为待优化集合,利用LM法和光束法平差对该集合进行更进一步的优化,使得双线阵系统的重投影误差降到最低。实验表明,该方法与传统的线阵相机标定方法相比重投影误差降低了75.01%。     

一种简单的基于共面的摄像机参数标定方法

共面摄像机标定就是采用平面式模板来确定摄像机内外参数的过程,在此过程中图像像素和二维特征点是已知的。对于共面标定提出了一种简单及有效的方法去标定摄像机参数。即使用帧缓存中的计算机阵列图像直接来标定参数。首先采用预标定的方法标定出图像中心位置,然后根据帧存图像坐标和世界坐标之间的对应关系使用正交矩阵的约束条件来求解,在此算法中假设尺度因子为1,并且不考虑透镜畸变。所提出的算法用数字仿真图像及真实的图像检验。结果显示,所提出的算法具有较好的精度,是一种简单有效的标定方法。     

一种基于主动视觉的线性自标定方法

基于主动视觉的摄像机自标定是摄像机标定的一个重要分支，通过控制摄像机做严格的运动，可以发现一些比较简单的算法，本文提出了一种新的基于主动视觉的摄像机自标定方法，通过控制摄像机作3次不共面的平移运动．可以线性标定摄像机的五个内参数．大量的仿真实验表明该算法精度很高，且鲁棒性很强．     

一种基于非量测畸变校正的摄像机标定方法

设计一种基于非量测畸变校正的摄像机标定方法.该方法利用单参数除式模型校正镜头畸变,根据直线透视投影保留同素性,通过拉凡格氏法（LM）优化标定出畸变模型系数和摄像机主点坐标,然后校正成像点,使其满足针孔模型映射关系.根据内参数的两个基本方程,线性求解剩余参数.实验表明,该方法在非量测标定过程具有较好的鲁棒性,且对比张正友标定方法,可在单幅标靶图像下进行标定,避免了模型内外参数耦合在一起,提高了标定效率.     

Hand–eye calibration with epipolar constraints: Application to endoscopy

In this paper, we propose a new calibration method for a hand–eye system equipped with a camera undergoing radial distortion as a rigid endoscope. While classic methods propose either a separated estimation of the camera intrinsics and the hand–eye transform or a mixed non-linear estimation of both hand–eye and camera intrinsics assuming a pin-hole model, the proposed approach enables a simultaneous refinement of the hand–eye and the camera parameters including the distortion factor with only three frames of the calibrated pattern. We propose and compare two criteria to minimize: (i) the first one is based on the epipolar constraint between pairs of frames and (ii) the second one expresses the camera extrinsic with respect to hand–eye and world-grid transforms in the single frame reprojection error. We run bundle-adjustment on each criterion with respect to the distortion parameters, the camera intrinsics and the hand–eye transform. Our method allows us to recover more accurate 3D shapes when compared to state-of-the-art non-linear methods.     

基于数据拟合的摄像机标定和图像的数值校正

采用的摄像机成像模型考虑了透镜的径向畸变和切向畸变。标定过程包括对摄像机的内外部参数的直接线性变换估算和基于内部映射牛顿法的子空间置信域法的非线性优化算法优化。同时提出了对畸变图像校正的数值计算方法。     

基于改进的SUSAN法的摄像机线性标定方法

设计并实现了一种考虑径向畸变的逐步线性摄像机标定方法。结合边缘检测，缩小了SUSAN法检测角点的范围，并利用角点的邻域特征，剔除伪角点，从而提高了SUSAN法角点检测的速度和准确度。利用此改进的SUSAN法精确提取方格模板角点的亚像素坐标，并通过预标定获得主点坐标；然后在考虑摄像机径向畸变的情况下建立摄像机模型，并求解摄像机内外参数。最后通过实验及误差分析表明，本标定方法具有较高的精度和较好的实时性。