双目立体视觉中特征点三维坐标重构校准研究

双目立体视觉是一种商业化较成熟的三维测量技术,左右摄像机内外参数的精确标定是实现三维重构的基础和关键。针对棋盘格和圆点两种标定板图案研究了相应的图像处理技术,实现了标定点的亚像素精度定位及其有效排序。采用基于单映性约束和非线性优化的多视角平面标定算法实现了摄像机光学及空间位置参数求解。用极线约束残差法衡量标定结果的准确度。基于桥式三坐标标准实现标定点三维重构平面度以及多平面空间夹角测量结果的校准,基于光学三坐标标准实现了标定点三维重构空间距离的校准,并分析了校准结果的不确定度。圆标志点三维重构空间距离示值误差为0.029 mm,不确定度U=24 μm（k=2）     

Pose estimation for autonomous grasping with a robotic arm system

A robust and accurate method for estimating the 3-D pose of a planar rigid object is presented. This article demonstrates that 3-D pose estimation becomes feasible by using the 2-D tracking points on an object of scale-invariant feature transform (SIFT) and 3-D point cloud detected by stereo vision on an object, assuming that a 3-D geometric model of an object is known a priori. The roll and pitch angles of an object are estimated by the normal vector of approximate plane of 3-D point cloud on an object and the yaw angle is estimated by 2-D tracking point on an object of SIFT. Accurate object detection and localization in the camera coordinate system is crucial for grasping. In the motion planning, the bidirectional rapidly exploring random tree algorithm is used to search for a valid path for efficient grasping. Our robot arm can robustly and autonomously grasp a randomly rotative rigid object detected by SIFT in 3-D space. We have realized a grasping scenario with a dexterous arm (ADAM) such that an object in front of ADAM can be grasped. This demonstration shows how the proposed components build a dexterous and robust system integrating object detection, pose estimation, and motion planning.     

线结构光传感器标定不确定度估计

分析了标定样本数据的不确定度对线结构光传感器标定精度的影响,利用矩阵扰动理论和一阶不确定度分析理论,给出线结构光视觉传感器模型中映射矩阵参数不确定度的评估方法,并建立了从标定样本数据不确定度到标定不确定度的传播模型。利用蒙特卡洛统计法进行了仿真验证,结果表明所建立不确定度传播模型的有效性,为线结构光传感器标定精度的评估提供了依据。     

基于四元数最少特征点的相机位姿估计

为解决相机位姿估计的问题,提出了一种基于四元数最少特征点的相机位姿估计算法。在相机拍摄的二维图像中检测并匹配特征点,根据特征点坐标与约束条件建立多项式系统,通过求解对应的矩阵方程来求解多项式系统。用四元数表示相机的旋转,避免了求解中相机旋转与平移相互纠缠的问题,当2个摄像机视图之间的平移为零时能够很好地进行位姿求解。求解中结合5点算法对求解原理进行了详细推导,并进行抗噪声测试。测试中随着匹配的特征点数增加,算法平均估计误差范围不超过2%。利用KITTI数据集测试算法的实用性,并与其他几种方法进行结果比较。结果显示,相同条件下算法将估计精度提高了24.5%以上,体现出良好的估计精度。     

基于2D-3D双目运动估计的立体视觉定位算法

运动估计算法是影响立体视觉定位精度的重要因素,传统的3D-3D运动估计算法受噪声影响很大,计算精度不高.本文提出了一种基于2D-3D双目运动估计的立体视觉定位算法.算法不使用运动后的特征点3D坐标,而直接利用其2D图像投影坐标.首先,利用EPnP运动估计算法确定匹配内点和初始运动参数.接着,利用双目相机之间的2D投影几...     

基于高精度匹配点的对极几何估计

提出了一种以Harris算子和空间位置约束条件自动提取的初始特征点为引导,利用小面元模型进行灰度分布的拟合曲面求极值点的超精度特征点定位方法。并利用超精度的特征点估计立体图像对的对极几何约束关系。通过对真实图像的对比实验证明该方法能有效的提高基本矩阵估计精度,与传统的基于像素级特征点的估计算法相比,平均余差值降低了3.4%~21.4%,算法运行速度快,能在视觉测量中有效地提高测量精度。     

基于深度数据的空间人脸旋转角度估计

提出一种基于三维人脸深度数据的人脸姿态计算方法。利用人脸的深度数据以及与其一一对应的灰度图像,根据微分几何原理和相应的曲率算法与人脸数据中的灰度特征对人脸面部关键特征点定位,进而计算出人脸姿态在三维空间中的3个姿态角。实验证明该方法能在姿态变化情况下实现对人脸旋转角的准确估计,为进一步的人脸识别和表情分析提供基础。     

稀疏立体视觉算法在自动包装机器人中的应用

目的为实现包装机器人自动测距的功能,提出将双目稀疏立体视觉算法应用到自动包装机器人视觉系统中。方法为验证算法的实用性,利用深圳市元创兴科技有限公司生产的配备双目视觉系统的REBot-V-6R六自由度机器人进行实验,计算实验台上包装件与摄像机的距离,通过计算值与测量值之间的误差评估算法的精确度。结果实验证明双目稀疏立体视觉算法在600~1000 mm范围内深度计算误差小于7%。结论该稀疏立体视觉算法可以应用于自动包装机器人测距。     

Face tracking and pose estimation with automatic three-dimensional model construction

A method for robustly tracking and estimating the face pose of a person using stereo vision is presented. The method is invariant to identity and does not require previous training. A face model is automatically initialised and constructed online: a fixed point distribution is superposed over the face when it is frontal to the cameras, and several appropriate points close to those locations are chosen for tracking. Using the stereo correspondence of the cameras, the three-dimensional (3D) coordinates of these points are extracted, and the 3D model is created. The 2D projections of the model points are tracked separately on the left and right images using SMAT. RANSAC and POSIT are used for 3D pose estimation. Head rotations up to plusmn45deg are correctly estimated. The approach runs in real time. The purpose of this method is to serve as the basis of a driver monitoring system, and has been tested on sequences recorded in a moving car.     

Algorithm of locating the sphere center imaging point based on novel edge model and Zernike moments for vision measurement

High accuracy of locating the sphere center imaging points is crucial for the vision measurement system. This paper investigates the effect of projection projective model on extraction of the sphere center, upon which the sub-pixel edge-location algorithm based on the sphere projection model is proposed. The sphere center projection model is established by analysing the process of sphere imaging, and the sub-pixel edge-location algorithm consisted of the novel edge model and the improved Zernike moment computing is studied. The novel edge model based on the Erf (error function) is adopted for modelling the practical edge part, which obtains the edge distribution points with high precision. Then a closed-form solution of edge locating error compensation is calculated based on Zernike moments. Finally, the proposed method is verified via simulations and experiments. The relevant results show that the proposed method can accurately locate the sphere center imaging point, which further improves the precision and robustness of the vision measurement system.     

Using neural networks for 3D measurement in stereo vision inspection systems

This paper presents a stereo vision inspection process which derives precise 3D measurements. Two artificial neural networks are used to facilitate the whole measurement process. At first, a simple camera calibration process is developed to derive the focal lengths and the relative information. A Hopfield neural network is used to solve the stereo matching problem, which has been constructed as an energy function. By means of a recursive process, the disparities of extracted feature points are obtained. In addition, a backpropagation neural network-based measurement error correction model for 3D measurement is proposed. It reduces the errors of 3D measurement associated with a part's orientation, position, magnitude and distance between the object and cameras. Four procedural processes are designed to implement this model. Our laboratory experiments demonstrate that the proposed measurement process has a satisfactory measurement result.     

一种高效的实时视觉姿态测量

由光学传感器和计算机视觉理论来确定目标物体的姿态参数具有重要的实用价值和理论意义.本文以提高当前物体姿态求解方法的实时性和准确性为目的,提出一种高效的基于特征点的姿态求解方法,该方法首先采用P3P算法求解目标物体的近似姿态,然后将该近似姿态作为初始值嵌入正交迭代(OI)优化算法求取目标姿态的最优值,该方法可以适用于任意...     

网格投影式立体视觉三维表面重建系统

提出了一种基于立体视觉的三维表面重建的新方法。该方法以立体视觉为基础,结合网格投影,把被动的立体视觉与主动的非结构光网格投影相结合,采用一种算法简单的由粗到精网格图像立体匹配方法,有效地解决了常用的立体视觉系统中存在的算法复杂、处理时间长、容易产生误匹配等问题。基于该方法的三维表面重建系统具有结构简单、操作方便、数据采集速度快、实时性强等优点。实验结果表明该系统能够有效地对三维表面,特别是对无明显特征的光滑自由三维曲面进行重建。     

Estimating three-dimensional vehicle motion in an outdoor scene using stereo image sequences

We propose a motion estimation system that uses stereo image pairs as the input data. To perform experimental work, we also obtain a sequence of outdoor stereo images taken by two metric cameras. The system consists of four main stages, which are (1) determination of point correspondences on the stereo images, (2) correction of distortions in image coordinates, (3) derivation of 3D point coordinates from 2D correspondences, and (4) estimation of motion parameters based on 3D point correspondences. For the first stage of the system, we use a four-way matching algorithm to obtain matched point on two stereo image pairs at two consecutive time instants (t_i and t_{i + 1}). Since the input data are stereo images taken by cameras, it has two types of distortions, which are (i) film distortion and (ii) lens distortion. These two distortions must be corrected before any process can be applied on the matched points. To accomplish this goal, we use (i) bilinear transform for film distortion correction and (ii) lens formulas for lens distortion correction. After correcting the distortions, the results are 2D coordinates of each matched point that can be used to derive 3D coordinates. However, due to data noise, the calculated 3D coordinates to not usually represent a consistent rigid structure that is suitable for motion estimation; therefore, we suggest a procedure to select good 3D point sets as the input for motion estimation. The procedure exploits two constraints, rigidity between different time instants and uniform point distribution across the object on the image. For the last stage, we use an algorithm to estimate the motion parameters. We also wish to know what is the effect of quantization error on the estimated results; therefore an error analysis based on quantization error is performed on the estimated motion parameters. In order to test our system, eight sets of stereo image pairs are extracted from an outdoor stereo image sequence and used as the input data. The experimental results indicate that the proposed system does provide reasonable estimated motion parameters.     

基于视差空间运动估计的高精度立体视觉定位

立体视觉定位算法的运动估计通常在3D欧式空间中进行,但由于特征点3D坐标的噪声各向异性且分布不均匀,3D重建在深度方向上比另两个方向上的准确性差,从而导致3D欧式空间运动估计精确不高.本文提出了一种新的基于视差空间运动估计的高精度立体视觉定位算法.算法首先采用视差空间4点闭环线性解法和RANSAC算法得到初始鲁棒运动估计和匹配内点.接着,利用新的视差空间再投影误差函数提出了基于LM算法的视差空间运动参数非线性优化方法,对初始运动参数进一步优化.视差空间噪声分布均匀且各向同性,本文的初始运动参数线性估计和非线性优化都在视差空间中进行且能达到全局最小.仿真实验和真实实验结果表明,本文算法能得到高精度的立体视觉定位结果,优于传统的3D欧式空间运动估计方法.     

飞机大部件位姿调整的关键测量特征点误差控制权值计算方法

为了实现飞机大部件的最佳位姿调整,基于层次分析-误差评定组合方法,研究了一种应用于综合评估数字化装配中关键测量特征点的误差控制权值的计算方法。采用引入权值的最小二乘法求解大部件位姿调整量,提高装配精度。通过层次分析(AHP)方法确定关键测量特征点主观权值,误差评定法确定关键测量特征点客观权值,两者结合综合评定关键测量特征点权值。以最小装配误差为优化目标,利用权值实现多个关键测量特征点的误差分配优化。实例分析中,将超差的对接交点误差由1.23 mm降低到了0.72 mm,满足各个测量点的容差要求。以奇异值分解算法求解目标优化初值,采用牛顿法迭代求解,得到部件的最优位姿,并以中后机身对接为对象分析验证权值分配的合理性。     

面向板料精准堆垛的线特征位姿标定方法

目的 板料堆垛是现代流程工业生产中常见的生产环节,其堆垛质量影响着包装和运输安全。针对多边形板料自动堆垛中机械手抓取和对齐问题,提出一种基于网格筛选的线特征相机位姿标定方法,给出空间特征点的选择标准,解决因板料纹理不足带来的点特征精度下降的问题。方法 首先通过检测特征点来表示待匹配线,然后利用基于三角网格的线特征构型筛选算法,获得精确的匹配线;再利用单应性矩阵求解获得转换矩阵,最后通过转换在线板料图像,获得实际抓取点和转换角度。结果 通过桌面板料抓取实验和现场验证,重投影误差不超过2像素,1 m板料的堆垛误差为0.5 mm,结论 证明了此方法在板料自动堆垛过程中针对特征检测和位姿估计问题的有效性。     

Probabilistic 3D object recognition and pose estimation using multiple interpretations generation

This paper presents a probabilistic object recognition and pose estimation method using multiple interpretation generation in cluttered indoor environments. How to handle pose ambiguity and uncertainty is the main challenge in most recognition systems. In order to solve this problem, we approach it in a probabilistic manner. First, given a three-dimensional (3D) polyhedral object model, the parallel and perpendicular line pairs, which are detected from stereo images and 3D point clouds, generate pose hypotheses as multiple interpretations, with ambiguity from partial occlusion and fragmentation of 3D lines especially taken into account. Different from the previous methods, each pose interpretation is represented as a region instead of a point in pose space reflecting the measurement uncertainty. Then, for each pose interpretation, more features around the estimated pose are further utilized as additional evidence for computing the probability using the Bayesian principle in terms of likelihood and unlikelihood. Finally, fusion strategy is applied to the top ranked interpretations with high probabilities, which are further verified and refined to give a more accurate pose estimation in real time. The experimental results show the performance and potential of the proposed approach in real cluttered domestic environments.     

复杂光照环境下空间目标相对位姿测量方法研究

为解决空间复杂光照环境下可见光相机获取的图像照度不一、信息失真、特征不完整导致的目标 航天器相对位姿求解困难的问题,提出了一种基于图像增强和弧段特征的双目视觉相对位姿测量方法。首先通 过基于带色彩保留的多尺度Retinex（Multi?scale Retinex with Chromaticity Preservation, MSRCP）自适应图像预处理 方法提升空间暗弱光、局部强曝光环境下的图像质量;然后利用基于边缘弧支撑线段的椭圆检测算法提取目标 航天器表面星箭对接环的弧段特征,并拟合得到椭圆轮廓;最后利用双目相机搭建了空间相对位姿测量物理仿 真实验平台,建立双目空间椭圆锥测量模型解算目标的六自由度相对位姿,实现了近距离正常光照和暗弱光照 场景下目标航天器相对位姿求解。实验结果显示：在正常光照场景下,相对位置平均误差优于20 mm,相对姿 态平均误差优于0. 3°;在暗弱光照场景下,相对位置平均误差优于30 mm,相对姿态平均误差优于1°。研究成 果为近距离空间交会对接等在轨服务任务中的目标识别与测量提供了参考,具有技术借鉴价值。     

Stereo vision calibration based on GMDH neural network

In order to improve the accuracy and stability of stereo vision calibration, a novel stereo vision calibration approach based on the group method of data handling (GMDH) neural network is presented. Three GMDH neural networks are utilized to build a spatial mapping relationship adaptively in individual dimension. In the process of modeling, the Levenberg-Marquardt optimization algorithm is introduced as an interior criterion to train each partial model, and the corrected Akaike's information criterion is introduced as an exterior criterion to evaluate these models. Experiments demonstrate that the proposed approach is stable and able to calibrate three-dimensional (3D) locations more accurately and learn the stereo mapping models adaptively. It is a convenient way to calibrate the stereo vision without specialized knowledge of stereo vision.