基于立体视觉的3D地形拼接

为了从月球车上的全景相机所捕获的立体图像对重建月球车周围的3D地形,给地面科学家制定科学探测指令提供一个直观的可视化平台,预先展开了基于立体视觉的3D地形重建的研究,主要介绍了在3D地形拼接方面的研究进展。当恢复出多个局部3D地形模型时,首先基于边缘检测和图像匹配技术提取出相邻局部模型之间的公共数据点,然后采用分离旋转变换和平移矢量的策略拟合出相邻模型之间的坐标转换关系,之后就可以将局部模型统一在同一个坐标系下。通过室内和室外多次实验验证了该拼接方案。     

基于立体视觉的接触式三维测量系统

传统的三维接触式测量方法存在着速度慢、测量范围受限等缺点,而纯粹的非接触式测量方法则存在着特征边缘无法获取的问题。结合两种测量方法,设计了一种新的三维测量系统,该系统采用立体视觉技术对接触式测头的空间位置和姿态进行定位,进而间接计算接触式探针针尖位置来完成空间点的三维坐标测量。实验结果表明:系统测量精度优于0.2 mm,能够应用于工业现场进行复杂工件的典型几何特征检测和模型重构。     

3-D shape reconstruction in an active stereo vision system using genetic algorithms

The recovery of 3-D shape information (depth) using stereo vision analysis is one of the major areas in computer vision and has given rise to a great deal of literature in the recent past. The widely known stereo vision methods are the passive stereo vision approaches that use two cameras. Obtaining 3-D information involves the identification of the corresponding 2-D points between left and right images. Most existing methods tackle this matching task from singular points, i.e. finding points in both image planes with more or less the same neighborhood characteristics. One key problem we have to solve is that we are on the first instance unable to know a priori whether a point in the first image has a correspondence or not due to surface occlusion or simply because it has been projected out of the scope of the second camera. This makes the matching process very difficult and imposes a need of an a posteriori stage to remove false matching.In this paper we are concerned with the active stereo vision systems which offer an alternative to the passive stereo vision systems. In our system, a light projector that illuminates objects to be analyzed by a pyramid-shaped laser beam replaces one of the two cameras. The projections of laser rays on the objects are detected as spots in the image. In this particular case, only one image needs to be treated, and the stereo matching problem boils down to associating the laser rays and their corresponding real spots in the 2-D image. We have expressed this problem as a minimization of a global function that we propose to perform using Genetic Algorithms (GAs). We have implemented two different algorithms: in the first, GAs are performed after a deterministic search. In the second, data is partitioned into clusters and GAs are independently applied in each cluster. In our second contribution in this paper, we have described an efficient system calibration method. Experimental results are presented to illustrate the feasibility of our approach. The proposed method yields high accuracy 3-D reconstruction even for complex objects. We conclude that GAs can effectively be applied to this matching problem.     

Coarse-to-fine stereo vision with accurate 3D boundaries

This paper presents methods for efficient recovery of accurate binocular disparity estimates in the vicinity of 3D surface discontinuities. Of particular concern are methods that impact coarse-to-fine, local block-based matching as it forms the basis of the fastest and the most resource efficient stereo computation procedures. A novel coarse-to-fine refinement procedure that adapts match window support across scale to ameliorate corruption of disparity estimates near boundaries is presented. Extensions are included to account for half-occlusions and colour uniformity. Empirical results show that incorporation of these advances in the standard coarse-to-fine, block matching framework reduces disparity errors by more than a factor of two, while performing little extra computation, preserving low complexity and the parallel/pipeline nature of the framework. Moreover, the proposed advances prove to be beneficial for CTF global matchers as well.     

双目立体视觉的三维人脸重建方法

创建逼真的三维人脸模型始终是一个极具挑战性的课题.随着三维人脸模型在虚拟现实、视频监控、三维动画、人脸识别等领域的广泛应用,三维人脸重建成为计算机图像学和计算机视觉领域的一个研究热点.针对这一问题,提出一种基于双目立体视觉的三维人脸重建方法,重建过程中无需三维激光扫描仪和通用人脸模型.首先利用标定的2台摄像机获取人脸正面图像对,通过图像校正使图像对的极线对齐并且补偿摄像机镜头的畸变;在立体匹配方面,选择具有准确可靠视差的人脸边缘特征点作为种子像素,以种子像素的视差作为区域生长的视差,在外极线约束、单调性约束以及对应匹配的边缘特征点的约束下,进行水平扫描线上的区域生长,从而得到整个人脸区域的视差图,提高了对应点匹配的速度和准确度;最后,根据摄像机标定结果和立体匹配生成的视差图计算人脸空间散乱点的三维坐标,对人脸的三维点云进行三角剖分、网格细分和光顺处理.实验结果表明,该方法能够生成光滑、逼真的三维人脸模型,证明了该算法的有效性.     

A high-quality 3D multiview model-building technique based on CAD

In this paper, we propose a method for building a high-quality 3D model efficiently from a CAD model. We automatically build the high-quality 3D model of an object by accurately extracting the 3D multiview features from the CAD model with the object-precision method instead of the existing image-precision method. Precision of the features from the image-precision method is limited to the precision of the image resolution and varies with the view distance and view-up vector. Since we exploit the object-precision method to extract the 3D multiview features, the precision of the features is equal to the precision at which the object is defined in the CAD and is independent of the view distance and view-up vector.     

双目立体视觉三维重建实验平台研究

三维重建是计算机视觉和虚拟现实领域的一个重要研究内容,其中,欧式重建以其直观能够反应物体原貌的特点在反求工程中得到了广泛的应用。为反求工程的需要开发了一套基于双目立体视觉的三维重建软件,综合考虑了欧式三维重建误差产生多种因素,给出了一整套比较完备的欧式三维重建流程,基于真实图像的实验结果表明,该实验平台可以获得较高的重建精度和良好的重建效果。     

基于四目立体视觉的三维全自动建模

为保护并传承敦煌莫高窟世界文化遗产,研究基于四目立体视觉系统的三维全自动建模技术。由于提取的点云数量较大,导致自动建模过程中,点云的三角构网步骤无法顺利进行,因此着重研究点云的精简算法。将包围盒算法与点云的曲率特征相结合,提出一种点云精简算法,即改进的包围盒法。实验结果表明,该方法对点云的采样精度高于原始包围盒法,点云精简率可达93.6%,点云数据精简后三维建模效率大大提高,生成的三维模型精度较高。     

A portable stereo vision system for whole body surface imaging

This paper presents a whole body surface imaging system based on stereo vision technology. We have adopted a compact and economical configuration which involves only four stereo units to image the frontal and rear sides of the body. The success of the system depends on a stereo matching process that can effectively segment the body from the background in addition to recovering sufficient geometric details. For this purpose, we have developed a novel sub-pixel, dense stereo matching algorithm which includes two major phases. In the first phase, the foreground is accurately segmented with the help of a predefined virtual interface in the disparity space image, and a coarse disparity map is generated with block matching. In the second phase, local least squares matching is performed in combination with global optimization within a regularization framework, so as to ensure both accuracy and reliability. Our experimental results show that the system can realistically capture smooth and complete whole body shapes with high accuracy.     

High quality 3D reconstruction based on fusion of polarization imaging and binocular stereo vision

Polarization imaging can retrieve inaccurate objects’ 3D shapes with fine textures, whereas coarse but accurate depths can be provided by binocular stereo vision. To take full advantage of these two complementary techniques, we investigate a novel 3D reconstruction method based on the fusion of polarization imaging and binocular stereo vision for high quality 3D reconstruction. We first generate the polarization surface by correcting the azimuth angle errors on the basis of registered binocular depth, to solve the azimuthal ambiguity in the polarization imaging. Then we propose a joint 3D reconstruction model for depth fusion, including a data fitting term and a robust low-rank matrix factorization constraint. The former is to transfer textures from the polarization surface to the fused depth by assuming their relationship linear, whereas the latter is to utilize the low-frequency part of binocular depth to improve the accuracy of the fused depth considering the influences of missing-entries and outliers. To solve the optimization problem in the proposed model, we adopt an efficient solution based on the alternating direction method of multipliers. Extensive experiments have been conducted to demonstrate the efficiency of the proposed method in comparison with state-of-the-art methods and to exhibit its wide application prospects in 3D reconstruction.     

基于立体视觉和RBF变形技术的个性化人手建模

由于人手形状复杂、细节丰富,构建个性化的人手模型充满挑战。提出一种基于立体视觉和RBF几何变形技术的个性化人手建模方法,通过综合采用轮廓点和SIFT点描述手部特征,提取用户手部3维特征点云,并以点云为约束,采用几何对齐两步法对齐手模板,结合RBF插值算法,得到具有用户特征的个性化手模型。实验结果表明,该方法可以有效地重建出用户手的几何模型。     

基于粒子群算法的双目立体视觉系统标定

摄像机标定是立体视觉系统研究的重要组成部分,针对双目立体视觉系统中摄像机标定这一多参数、复杂函数的优化问题,建立带有一阶径向畸变的摄像机模型,利用粒子群算法对模型中的参数进行优化处理,并同改进遗传算法的优化结果进行比较分析。实验结果表明该方法具有较高的精度,可满足工业机器视觉的要求。     

基于双目立体视觉的机械手精确定位系统

在机械手执行任务的过程中,控制机械手定位到目标位置是一个非常的机械手自动定位系统设计方法,由双目立体视觉系统根据目标物的二维图像计算出目标物的三维坐标,然后根据此三维坐标去控制机械手自动运动到目标位置.实验表明该系统能提高排爆机器人机械手的易操作性,大大提高了机械手的性能     

基于双目立体视觉技术的桥梁裂缝测量系统

针对国内外桥梁裂缝测量效率低、成本高、精度低等现状,提出了一种基于双目立体视觉技术的桥梁裂缝测量系统。采用相机标定、图像匹配、三维坐标计算等双目立体视觉技术对桥梁裂缝的宽度和长度进行计算,实现了桥梁裂缝测量系统。实验通过与单目摄像机用图像处理方法计算的桥梁尺寸结果作对比,表明:对于同一条裂缝的宽度与长度,用所提方法在不同拍摄角度下计算结果差别不大,并且与真实值的相对误差分别保持在10%和1%以内,而同一条件下单目测量系统的计算结果则随着拍摄角度的变化相差很大,宽度测量误差最大达到了19.41%,长度测量误差最大达到了54.35%。说明基于双目立体视觉技术的桥梁裂缝测量系统可以应用于实际中,并且鲁棒性更强,测量结果更精确。     

自由双目立体视觉摄像机动态外参数的获取

针对自由双目立体视觉中由于摄像机旋转导致的摄像机外参数变化的问题,提出一种基于旋转轴标定的动态外参数获取方法。在多个不同位置,立体标定得到多组旋转平移矩阵,利用最小二乘法求解旋转轴参数;结合初始位置左右摄像机的内、外参数及旋转角度,实时获取左右摄像机的外参数。利用所提方法获取动态外参数,并对棋盘角点进行三维重建,平均误差为0.241mm,标准差为0.156mm;与基于多平面标靶的标定方法相比,精度高且操作简单。所提方法无需实时标定,可完成摄像机旋转情况下动态外参数的获取。     

一种基于单相机三维重建的简单方法

提出了一种基于单相机三维重建的简单方法.在待重建场景中放置一块平面标定模板,用内参数已知的摄像机拍摄不同角度的二幅图像,利用场景中的标定模板精确地求解出拍摄时摄像机的外参数,并以此为基础进行立体标定、配准和匹配,得到视差图进而实现欧式几何意义下的三维重建.实验结果表明,提出的算法实现简单、配置灵活,具有较强的实用性.     

基于单视频图像序列的人体三维姿态重建

提出了至少存在一个深度值已知点的约束条件下,基于单视频图像序列重建人体三维姿态的方法.利用已知间距的平面点阵来标定获得摄像机参数,在透视投影模型下,根据单视频图像序列中人体关节点的二维数据,重建其三维信息.并将人体运动序列按照运动突变点划分为若干子序列,有效消除了二义性的干扰,较为精确的实现了人体三维姿态的重建.给出了该方法的实验过程及计算结果,验证了该算法的可行性和精度.     

A pointwise smooth surface stereo reconstruction algorithm without correspondences

This paper describes an algorithm for 3D reconstruction of a smooth surface with a relatively dense set of self-similar point features from two calibrated views. We bypass the usual correspondence problem by triangulating a point in space from all pairs of features satisfying the epipolar constraint. The surface is then extracted from the resulting point cloud by taking advantage of the statistical and geometric properties of the point distribution on the surface. Results are presented for computer simulations and for a laboratory experiment on a silicon gel phantom used in a breast cancer screening project.     

基于手绘的三维建模系统的研究和实现*

研究基于手绘(sketch)的三维建模方法并实现相应的建模系统。通过对输入的手绘笔画(strokes)进行去噪、分段、识别等操作,将手绘笔画识别为直线、椭圆等基本图元,再根据图元之间的相应关系构建出三维模型,实现对用户输入意图的自动三维解释。实验结果表明,该方法能够对输入的strokes进行精确的分析处理,实现对输入手绘笔画的三维建模。     

Artificial 3-D contactless measurement in orthognathic surgery with binocular stereo vision

Stereo vision systems are utilized since it provides contactless measurements of objects in 3-D (three-dimensional). Orthognathic surgery is a very sensitive operation that requires very high accuracy in measurements. The reduction of measurement error is an essential problem in orthognathic surgery. Moreover, quality inspection of the process during the course of operation aids the surgeon to avoid or minimize the mitigating circumstances. In this paper, artificial intelligence methods (neural network and neuro-fuzzy system) are used in order to increase the accuracy of positioning of jaws during the real-time practice. The comparison of artificial measurements with the real measurements shows that a statistically acceptable accuracy is achieved in 3-D positioning of teeth.