一种无需包围盒的自适应采样可见外壳生成算法

针对可见外壳的体构造方法需要事先知道包围盒和转成三角面表示时低曲率区域存在大量小三角面的问题,本文提出一种基于体素生长的自适应采样可见外壳构造方法.将物体三维表面视为等值面,用多目立体匹配的方法求得等值面附近的一个空间点;然后以该点为中心构造体素,将体素在等值面上生长直至遍历整个等值面;同时根据体素的曲率变化控制下一个生长体素的大小.实验结果表明本文方法在不知道物体包围盒大小的情况下能够计算出可见外壳,而自适应采样可解决过多小三角面的问题.     

一种基于图割理论的快速立体匹配算法

针对传统的立体匹配算法中存在的低纹理区域和遮挡区域匹配精度低、实时性不好等问题,提出了一种基于图割理论的立体匹配算法.把图像分割成色彩单一的不同区域;计算初始视差图,利用可靠点求取各分割区域的平面模板参数,对模板参数相同的相邻区域进行融合;构造全局能量函数,采用图割算法求取全局能量最小的视差最优分配.实验结果表明,该算法对低纹理区域和遮挡区域均有较好的匹配结果,能够满足高精度、高实时性的要求.     

改进的基于图像分割的立体匹配算法

提出一种立体匹配算法．首先采用均值平移算法将参考图像根据彩色信息快速聚类成不同区域;然后通过灰度差平方和匹配计算初始视差图;在构造能量函数时,将分割结果作为视差函数的一个参考项;最后采用图切割算法求取使全局能量最小的视差最优分配．通过标准图像对进行测试,并与其他算法进行了比较．实验结果表明,与原有算法相比,该算法可有效地处理大的低纹理区域,匹配精度高,更有利于估计视差图的边界．     

一种新颖的立体匹配方法

将立体匹配转化为求物理模型的平衡状态问题,提出了基于物理模型的立体匹配方法.为了克服局部最优问题及解对初始模型的敏感问题,采用位于真实视差表面两侧的两个物理表面模型,在迭代过程中对能量较大的表面附加驱动力,使其靠近另一表面,直到两个表面收敛到同一个解.为了进一步提高匹配的速度,采用了多分辨率算法.实验结果表明了该方法的有效性.     

散乱分布数据曲面重构的光顺-有限元方法

提出了一种基于散乱分布的数据点重构三维曲面的有限元方法.根据最佳逼近与数据光顺理论建立正定的目标泛函,采用有限元最佳拟合使泛函极小化,求得最优解.通过八节点等参数有限元插值计算,重新构造出三维曲面.这种光顺-有限元方法有效地抑制了输入数据上误差噪声的影响,与有限元拟合方法相比,所需的输入数据点少,重构的曲面逼近精度高、光顺性好.数值实验表明,该方法简单,便于应用.     

快速对称多窗口正交三目立体匹配

提出了一种对称多窗口正交三目立体匹配算法,利用双目立体视觉中有效的对称多窗口（symmetry multi-window,SMW)方法视差估计的不确定度,在正交三目立体匹配中融合通过SMW方法得到的水平和垂直两个图像对的视差计算结果形成新的视差图。在实现三目立体匹配的同时提出了双目SMW立体匹配方法快速算法,使得计算一对立体图像的9个窗口两个方向（从左到右和从右到左）ZNCC的速度和计算一个ZNCC相当,计算时间约只有原来的1／18。通过对实际的三目立体图像组的实验,结果表明相对于单纯的双目SMW方法,在遮断区域、单方向平滑区域都得到了具有鲁棒性的视差估计,而且计算速度令人满意。     

基于多目立体匹配的深度获取方法

提出一种深度获取方法,利用基于颜色分割的多目立体匹配算法,从多个视点图像中提取深度信息。利用mean-shift算法,根据颜色信息分割参考图像,提取图像中的颜色一致性区域,通过局部窗口匹配算法进行多目立体匹配得到多幅初始视差图,根据融合准则将多幅视差图合成为一幅视差图以提高视差图的精度并对视差图进行优化后处理,按照视差与深度的关系,将视差图转化为深度图。该算法能有效处理匹配过程中的遮挡区域,提高匹配精度和视差图的准确度。     

基于自适应权重的全局图割立体匹配算法

针对立体匹配中存在纹理、遮挡区域和深度不连续的问题,提出一种基于自适应权重的全局图割立体匹配算法,一方面,采用单像素自适应权重加窗匹配能够减少深度不连续和稀疏纹理处匹配的误差;另一方面,对于图割中的平滑项表示和遮挡处理,使用一定平滑约束和遮挡约束构建能量函数而取得最优解。实验结果表明,该算法能保证匹配的可靠性。     

基于窄带图割的交互式快速目标提取

针对传统算法易陷入局部极值、提取效率不高的不足,运用图割理论,提出一种将目标提取问题转化为能量最小化的组合优化问题的BandCut算法。BandCut通过人机交互获取一个将目标边界包围在内的环状窄带区域,对该区域生成距离图,构造s-t网络,进行最小代价切割获取目标。实验表明,BandCut能获取最优解,提取效率是GrabCut的5倍。     

基于图割优化的能量最小化模型图像分割方法

针对主动轮廓模型中利用梯度下降法求解能量函数容易陷入局部极小的不足,设计了一个离散化最小能量函数模型。该模型以Chan-Vese模型为基础,利用图割方法优化能量泛函,实现能量的全局最优解。新模型首先将图像映射为图,将基于像素的能量泛函转换为可用图表示的离散化能量函数,通过计算节点及其邻域关系权值,迭代求解最小化能量并将其作用于形变轮廓曲线,直至达到稳定状态。新模型改进了主动轮廓模型对弱边界图像初始轮廓敏感的问题,提高了分割精度和运行速度。     

Multiview photometric stereo

This paper addresses the problem of obtaining complete, detailed reconstructions of textureless shiny objects. We present an algorithm which uses silhouettes of the object, as well as images obtained under changing illumination conditions. In contrast with previous photometric stereo techniques, ours is not limited to a single viewpoint but produces accurate reconstructions in full 3D. A number of images of the object are obtained from multiple viewpoints, under varying lighting conditions. Starting from the silhouettes, the algorithm recovers camera motion and constructs the object's visual hull. This is then used to recover the illumination and initialise a multi-view photometric stereo scheme to obtain a closed surface reconstruction. There are two main contributions in this paper: Firstly we describe a robust technique to estimate light directions and intensities and secondly, we introduce a novel formulation of photometric stereo which combines multiple viewpoints and hence allows closed surface reconstructions. The algorithm has been implemented as a practical model acquisition system. Here, a quantitative evaluation of the algorithm on synthetic data is presented together with complete reconstructions of challenging real objects. Finally, we show experimentally how even in the case of highly textured objects, this technique can greatly improve on correspondence-based multi-view stereo results.     

基于多视图三维重建方法在实验室系统中的应用研究

针对愈渐复杂的实验室系统,采用基于多视图的三维重建方法,实现对实验室系统中设备的结构重建.通过尺度不变特征变换(SIFT)匹配算法进行特征提取和匹配,并利用随机抽样一致性算法(RANSAC)和交叉过滤法降低误匹配率;通过多视图聚簇/基于面片的三维多视角立体视觉算法(CM-VS/PMVS)获取稠密点云;利用PCL泊松曲面...     

CNLPA-MVS:Coarse-Hypotheses Guided Non-Local PatchMatch Multi-View Stereo

In multi-view stereo,unreliable matching in low-textured regions has a negative impact on the completeness of reconstructed models.Since the photometric consistency of low-textured regions is not discriminative under a local window,non-local information provided by the Markov Random Field (MRF) model can alleviate the matching ambiguity but is limited in continuous space with high computational complexity.Owing to its sampling and propagation strategy,PatchMatch multi-view stereo methods have advantages in terms of optimizing the continuous labeling problem.In this paper,we propose a novel method to address this problem,namely the Coarse-Hypotheses Guided Non-Local PatchMatch Multi-View Stereo (CNLPA-MVS),which takes the advantages of both MRF-based non-local methods and PatchMatch multi-view stereo and compensates for their defects mutually.First,we combine dynamic programing (DP) and sequential propagation along scanlines in parallel to perform CNLPA-MVS,thereby obtaining the optimal depth and normal hypotheses.Second,we introduce coarse inference within a universal window provided by winner-takes-all to eliminate the stripe artifacts caused by DP and improve completeness.Third,we add a local consistency strategy based on the hypotheses of similar color pixels sharing approximate values into CNLPA-MVS for further improving completeness.CNLPA-MVS was validated on public benchmarks and achieved state-of-the-art performance with high completeness.     

Visual Modeling with a Hand-Held Camera

In this paper a complete system to build visual models from camera images is presented. The system can deal with uncalibrated image sequences acquired with a hand-held camera. Based on tracked or matched features the relations between multiple views are computed. From this both the structure of the scene and the motion of the camera are retrieved. The ambiguity on the reconstruction is restricted from projective to metric through self-calibration. A flexible multi-view stereo matching scheme is used to obtain a dense estimation of the surface geometry. From the computed data different types of visual models are constructed. Besides the traditional geometry- and image-based approaches, a combined approach with view-dependent geometry and texture is presented. As an application fusion of real and virtual scenes is also shown.     

射线图像的立体匹配技术研究

在数字射线成像检测技术中,当物体形状不适宜于旋转扫描时,传统的X射线计算机断层成像技术(CT)难以得到其3维信息,对于这种情况,立体视觉是一种较好的解决方案。立体视觉的关键技术是立体匹配,尽管目前立体匹配技术的研究已取得了很大的进展,然而这类研究主要局限于可见光等反射成像领域,对X射线图像等透射成像领域的研究很少。由于成像原理的不同,透射图像的立体匹配技术与可见光图像存在很大差异。为了对X射线图像进行正确匹配,根据射线图像的特点,首先制定了合理的立体匹配策略,并指出边缘是一种"好"的匹配基元;然后建立了射线图像立体匹配的约束条件,同时分析了射线图像匹配不确定性的原因;最后确定了由粗到精的两步匹配方法,并提出利用多目视觉约束来实现精匹配。利用工业射线像增强器系统对标准样件进行成像的实验结果表明,该技术是可行的,匹配的绝对平均误差在2pixels范围内。     

Volumetric stereo and silhouette fusion for image-based modeling

This paper presents a volumetric stereo and silhouette fusion algorithm for acquiring high quality models from multiple calibrated photographs. Our method is based on computing and merging depth maps. Different from previous methods of this category, the silhouette information is also applied in our algorithm to recover the shape information on the textureless and occluded areas. The proposed algorithm starts by computing visual hull using a volumetric method in which a novel projection test method is proposed for visual hull octree construction. Then, the depth map of each image is estimated by an expansion-based approach that returns a 3D point cloud with outliers and redundant information. After generating an oriented point cloud from stereo by rejecting outlier, reducing scale, and estimating surface normal for the depth maps, another oriented point cloud from silhouette is added by carving the visual hull octree structure using the point cloud from stereo to restore the textureless and occluded surfaces. Finally, Poisson Surface Reconstruction approach is applied to convert the oriented point cloud both from stereo and silhouette into a complete and accurate triangulated mesh model. The proposed approach has been implemented and the performance of the approach is demonstrated on several real data sets, along with qualitative comparisons with the state-of-the-art image-based modeling techniques according to the Middlebury benchmark.     

一种光栅普适的LCD多视点立体图像合成方法

多视点立体图像合成很大程度上取决于多视点立体显示设备的类型。当前,基于光栅的LCD多视点自由立体显示设备最为常见,但目前缺乏针对这类显示器的通用合成方法。因此,提出了一种通用的多视点立体视频图像合成新方法,主要分为子像素判断准则、各视点子像素的子采样、子像素排列合成三部分。该方法从原理上考虑了光栅LCD多视点自由立体显示的各种可能情况,具有普适性和实用价值。通过具体实例验证了所提方法的正确性和可行性。     

Progressively weighted affine adaptive correlation matching for quasi-dense 3D reconstruction

Correlation matching has been widely accepted as a rudimentary similarity measure to obtain dense 3D reconstruction from a stereo pair. In particular, given a large overlapping area between images with minimal scale differences, the correlation results followed by a geometrically constrained global optimisation delivers adequately dense and accurate reconstruction results. In order to achieve greater reliability, however, correlation matching should correctly account for the geometrical distortion introduced by the different viewing angles of the stereo or multi-view sensors. Conventional adaptive least squares correlation (ALSC) matching addresses this by modifying the shape of a matching window iteratively, assuming that the distortion can be approximated by an affine transform. Nevertheless, since an image captured from different viewing angle is often not practically identical due to scene occlusions, the matching confidence normally deteriorates. Subsequently, it affects the density of the reconstruction results from ALSC-based stereo region growing algorithms. To address this, we propose an advanced ALSC matching method that can progressively update matching weight for each pixel in an aggregating window using a relaxation labelling technique. The experimental results show that the proposed method can improve matching performance, which consequently enhances the quality of stereo reconstruction. Also, the results demonstrate its ability to refine a scale invariant conjugate point pair to an affine and scale invariant point pair.     

小场景交互式稠密三维重建系统

近年来,随着 GPU 技术的深入发展和并行算法的日益成熟,使得实时三维重建成 为可能。文中实现了一种针对小场景的交互式稠密三维重建系统,此系统借助先进的移动跟踪 技术,可以准确地估计相机的即时位置。提出了一种改进的多视深度生成算法,在 GPU 加速下 能够实时计算场景的深度。改进算法中的亚像素级的半全局匹配代价累积提高了多视立体匹配 的精度,并结合全局优化的方法计算出了准确的场景深度信息。深度图被转换为距离场,使用 全局优化的直方图压缩融合算法和并行的原始对偶算法实现了深度的实时融合。实验结果证明 了重建系统的可行性和重建算法的正确性。     

Accurate Camera Calibration from Multi-View Stereo and Bundle Adjustment

The advent of high-resolution digital cameras and sophisticated multi-view stereo algorithms offers the promise of unprecedented geometric fidelity in image-based modeling tasks, but it also puts unprecedented demands on camera calibration to fulfill these promises. This paper presents a novel approach to camera calibration where top-down information from rough camera parameter estimates and the output of a multi-view-stereo system on scaled-down input images is used to effectively guide the search for additional image correspondences and significantly improve camera calibration parameters using a standard bundle adjustment algorithm (Lourakis and Argyros 2008). The proposed method has been tested on six real datasets including objects without salient features for which image correspondences cannot be found in a purely bottom-up fashion, and objects with high curvature and thin structures that are lost in visual hull construction even with small errors in camera parameters. Three different methods have been used to qualitatively assess the improvements of the camera parameters. The implementation of the proposed algorithm is publicly available at Furukawa and Ponce (2008b).