动态大气散射系数的颜色衰减先验图像去雾

针对颜色衰减先验图像去雾算法存在对较浓的有雾图像去雾效果不佳的问题,提出基于动态大气散射系数的颜色衰减先验图像去雾算法.用动态大气散射系数取代颜色衰减先验去雾算法中恒定大气散射系数的假设,定义大气散射系数为关于图像景深的指数函数.利用Middlebury stereo datasets中无雾图像和相应的景深图像得到合成有雾图像.采用均方误差(MSE)和结构相似度(SSIM)的综合评价参数MSE-SSIM确定上述指数函数的两个参数的最佳取值.实验结果表明与颜色衰减先验算法、He、Meng算法相比,该算法的去雾图像清晰颜色自然,有效地提高了去雾效果.     

基于改进Census变换与梯度融合的立体匹配算法

双目立体匹配根据视差原理将平面视觉转化到三维立体视觉,是三维重建的核心步骤之一。针对局部立体匹配算法在深度不连续、弱纹理区域匹配精度低且易受光照、噪声等因素干扰的问题,提出了一种改进的立体匹配算法。首先,在代价计算阶段将改进的Census代价与梯度代价进行融合,并采用引导滤波算法对图像进行多尺度代价聚合;然后,采用赢家通吃算法计算初始视差;最后,采用左右一致性检测、中值滤波进行视差后处理,得到最终的视差图。实验结果表明,本算法在Middlebury2.0测试平台上的平均误匹配率为5.11%,且具有很好的稳健性和实用性。     

Efficient local stereo matching algorithm based on fast gradient domain guided image filtering

Guided image filtering (GIF) based cost aggregation or disparity refinement stereo matching algorithms are studied extensively owing to the edge-aware preserved smoothing property. However, GIF suffers from halo artifacts in sharp edges and shows high computational costs on high-resolution images. The performance of GIF in stereo matching would be limited by the above two defects. To solve these problems, a novel fast gradient domain guided image filtering (F-GDGIF) is proposed. To be specific, halo artifacts are effectively alleviated by incorporating an efficient multi-scale edge-aware weighting into GIF. With this multi-scale weighting, edges can be preserved much better. In addition, high computational costs are cut down by sub-sampling strategy, which decreases the computational complexity from O(N) to O(N/s²) (s: sub-sampling ratio) To verify the effectiveness of the algorithm, F-GDGIF is applied to cost aggregation and disparity refinement in stereo matching algorithms respectively. Experiments on the Middlebury evaluation benchmark demonstrate that F-GDGIF based stereo matching method can generate more accuracy disparity maps with low computational cost compared to other GIF based methods.     

基于引导滤波及视差图融合的立体匹配

立体匹配是双目视觉领域的重要研究方向.为在保证图片纹理区域匹配精度的同时降低弱纹理区域的误匹配率,提出一种基于引导滤波及视差图融合的立体匹配方法.首先,根据图像颜色相似性将图片划分为纹理较丰富区域和弱纹理区域.接着,分别采用不同参数的引导滤波进行代价聚合及视差计算,得到两张视差图.然后依据纹理区域划分的结果对获得的两张视差图进行融合.最后,通过左右一致性检测、加权中值滤波等视差优化步骤得到最终视差图.对Middlebury测试平台上标准图像对的实验结果表明,该方法在6组弱纹理图像上的平均误匹配率为9.67％,较传统引导滤波立体匹配算法具有更高的匹配精度.     

基于扩展相位相关的小基高比立体匹配方法

为获得高精度亚像素级视差以满足小基高比摄影测量需求,提出一种基于扩展相位相关的小基高比立体匹配方法.该方法采用分步式策略,首先利用自适应窗口匹配法计算整像素级视差,然后在整像素级视差的指导下建立同名像点之间的对应关系,再分别以左右同名像点为中心截取子图像,最后利用扩展相位相关匹配法对子图像进行亚像素级匹配,获得亚像素级视差.采用小基高比立体像对和带有亚像素级视差的模拟立体像对进行实验,结果表明基于扩展相位相关的小基高比立体匹配方法在精度和效率方面具有优越性能.     

Cost aggregation and occlusion handling with WLS in stereo matching

This paper presents a novel method for cost aggregation and occlusion handling for stereo matching. In order to estimate optimal cost, given a per-pixel difference image as observed data, we define an energy function and solve the minimization problem by solving the iterative equation with the numerical method. We improve performance and increase the convergence rate by using several acceleration techniques such as the Gauss-Seidel method, the multiscale approach, and adaptive interpolation. The proposed method is computationally efficient since it does not use color segmentation or any global optimization techniques. For occlusion handling, which has not been performed effectively by any conventional cost aggregation approaches, we combine the occlusion problem with the proposed minimization scheme. Asymmetric information is used so that few additional computational loads are necessary. Experimental results show that performance is comparable to that of many state-of-the-art methods. The proposed method is in fact the most successful among all cost aggregation methods based on standard stereo test beds.     

基于改进代价计算和视差候选策略的立体匹配

立体匹配算法在图像弱纹理区和重复纹理区存在匹配困难、误差大的问题,为此提出一种基于改进代价计算和视差候选策略的立体匹配算法.首先结合改进的Census变换和自适应加权融合的双向梯度信息来计算初始匹配代价,提高代价计算的可靠性.其中:为传统Census变换增加内圈编码,提高邻域信息利用率,同时降低噪声的影响;利用自适应权...     

彩色立体图像匹配算法研究

立体图像匹配对于自由立体重建、三维测量以及立体显示中图像压缩来说是非常重要的。针对区域灰度互相关图像匹配的计算量大、速度慢的情况,运用了一组快速灰度互相关计算公式,提出了用视差限制搜索空间。同时,针对彩色图像的特点,将彩色图像的色彩信息考虑进图像的匹配过程中,将彩色图像的R、G、B三单色图像分别进行灰度相关匹配,定义并采用了颜色分量权重系数来抑制误匹配点。实验表明,该方法有效地减少了计算量,加快了计算速度,提高了图像匹配精度,具有较好的实时性。该方法将应用于三维立体显示中基于视差图的视差进行图像压缩。     

Highly Dense 3D Surface Generation Using Multi‐image Matching

This study presents an automatic matching method for generating a dense, accurate, and discontinuity‐preserved digital surface model (DSM) using multiple images acquired by an aerial digital frame camera. The proposed method consists of two main procedures: area‐based multi‐image matching (AMIM) and stereo‐pair epipolar line matching (SELM). AMIM evaluates the sum of the normalized cross correlation of corresponding image points from multiple images to determine the optimal height of an object point. A novel method is introduced for determining the search height range and incremental height, which are necessary for the vertical line locus used in the AMIM. This procedure also includes the means to select the best reference and target images for each strip so that multi‐image matching can resolve the common problem over occlusion areas. The SELM extracts densely positioned distinct points along epipolar lines from the multiple images and generates a discontinuity‐preserved DSM using geometric and radiometric constraints. The matched points derived by the AMIM are used as anchor points between overlapped images to find conjugate distinct points using epipolar geometry. The performance of the proposed method was evaluated for several different test areas, including urban areas.     

Stereo matching cost computation based on nonsubsampled contourlet transform

A new matching cost computation method based on nonsubsampled contourlet transform (NSCT) for stereo image matching is proposed in this paper. Firstly, stereo image is decomposed into high frequency sub-band images at different scales and along different directions by NSCT. Secondly, by utilizing coefficients in high frequency domain and grayscales in RGB color space, the computation model of weighted matching cost between two pixels is designed based on the gestalt laws. Lastly, two types of experiments are carried out with standard stereopairs in the Middlebury benchmark. One of the experiments is to confirm optimum values of NSCT scale and direction parameters, and the other is to compare proposed matching cost with nine known matching costs. Experimental results show that the optimum values of scale and direction parameters are respectively 2 and 3, and the matching accuracy of the proposed matching cost is twice higher than that of traditional NCC cost.     

Generation of ROI Enhanced Depth Maps Using Stereoscopic Cameras and a Depth Camera

In this paper, we propose a new scheme to generate region-of-interest (ROI) enhanced depth maps combining one low-resolution depth camera with high-resolution stereoscopic cameras. Basically, the hybrid camera system produces four synchronized images at each frame: left and right images from the stereoscopic cameras, a color image and its associated depth map from the depth camera. In the hybrid camera system, after estimating initial depth information for the left image using a stereo matching algorithm, we project depths obtained from the depth camera onto ROI of the left image using three-dimensional (3-D) image warping. Then, the warped depths are linearly interpolated to fill depth holes occurred in ROI. Finally, we merge the ROI depths with background ones extracted from the initial depth information to generate the ROI enhanced depth map. Experimental results show that the proposed depth acquisition system provides more accurate depth information for ROI than previous stereo matching algorithms. Besides, the proposed scheme minimizes inherent problems of the current depth camera, such as limitation of its measuring distance and production of low-resolution depth maps.      

Virtual Control of Optical Axis of the 3DTV Camera for Reducing Visual Fatigue in Stereoscopic 3DTV

In stereoscopic television, there is a trade‐off between visual comfort and 3‐dimensional (3D) impact with respect to the baseline‐stretch of a 3DTV camera. It is necessary to adjust the baseline‐stretch at an appropriate distance depending on the contents of a scene if we want to obtain a subjectively optimal quality of an image. However, it is very hard to obtain a small baseline‐stretch using commercially available cameras of broadcasting quality where the sizes of the lens and CCD module are large. In order to overcome this limitation, we attempt to freely control the baseline‐stretch of a stereoscopic camera by synthesizing the virtual views at the desired location of interval between two cameras. This proposed technique is based on the stereo matching and view synthesis techniques. We first obtain a dense disparity map using a hierarchical stereo matching with the edge‐adaptive multiple shifted windows. Then, we synthesize the virtual views using the disparity map. Simulation results with various stereoscopic images demonstrate the effectiveness of the proposed technique.     

共轴立体视觉深度测量

共轴立体视觉测距是一种深度恢复的新方法,利用光轴处于同一直线的两架相机,从单一角度获取图像信息,将三维空间的深度信息转换成二维空间的缩放视差,从而通过图像旋转与缩放、特征点提取、图像匹配、中心点估计等技术恢复深度信息。该技术具有测量系统体积小、实时性强等特点。介绍了该技术的深度恢复公式和算法,并设计了共轴立体摄影测距传感器,用实景实验和3DSMAX模拟实验对该技术进行了验证。试验结果表明,中长距离深度测量精度优于0．1％。     

基于视差估计的中间视合成

提出了一种基于视觉估计的中间视合成方法.为了生成高质量的中间视图,在视差估计中提出了一种新的基于自适应权值的方法,并在匹配的代价函数中引入视差平滑性约束项.在获得可靠密集视差图后,通过寻找中间视图中像素点在左、右图像中的对应点来合成中间视.实验结果表明,本算法可以获得很好的视差图,合成的中间视图具有较高的质量.     

一种快速区域立体匹配算法设计及实现

为了精确建立两幅图像像素间的对应关系,克服区域立体匹配算法计算量大的缺点,提出了一种改进的区域立体匹配算法。改进的区域匹配算法运用双向立体匹配策略来提高两幅图像像素间的匹配精度,并结合mean-shift图像分割技术,在同一区域具有相同视差的假设前提下获得图像的稠密视差;为了克服区域立体匹配计算量大的缺点,该算法引入伪极线约束将真正匹配点的位置限定在一个非常小的范围内,从而大大减少了匹配点的搜索范围,有效地降低了匹配算法的计算量。实验结果表明,改进的双向匹配算法可以有效地缩小匹配搜索范围,并实现图像间的精确稠密匹配。     

Evaluation of Geometric Modeling for KOMPSAT‐1 EOC Imagery Using Ephemeris Data

Using stereo images with ephemeris data from the Korea Multi‐Purpose Satellite‐1 electro‐optical camera (KOMPSAT‐1 EOC), we performed geometric modeling for three‐dimensional (3‐D) positioning and evaluated its accuracy. In the geometric modeling procedures, we used ephemeris data included in the image header file to calculate the orbital parameters, sensor attitudes, and satellite position. An inconsistency between the time information of the ephemeris data and that of the center of the image frame was found, which caused a significant offset in satellite position. This time inconsistency was successfully adjusted. We modeled the actual satellite positions of the left and right images using only two ground control points and then achieved 3‐D positioning using the KOMPSAT‐1 EOC stereo images. The results show that the positioning accuracy was about 12‐17 m root mean square error (RMSE) when 6.6 m resolution EOC stereo images were used along with the ephemeris data and only two ground control points (GCPs). If more accurate ephemeris data are provided in the near future, then a more accurate 3‐D positioning will also be realized using only the EOC stereo images with ephemeris data and without the need for any GCPs.     

Automated Matching of Pairs of SIR-B Images for Elevation Mapping

During the SIR-B mission in October 1984, a significant number of overlapping synthetic aperture radar (SAR) images of various ground areas was collected. This has offered the first opportunity to perform stereo analyses on images from space that cover large ground areas to determine elevation information. This paper presents the preliminary results of an investigation to obtain elevation data from stereo pairs of SIR-B images. First, the accuracy with which elevation information can be derived from SIR-B image pairs is evaluated theoretically. It is shown that elevation accuracy is a function of the slant range resolution, the incidence angles with which the stereo pair is obtained, the accuracies in spacecraft state estimation, and determination of corresponding pixels in the stereo pair. Next, a hierarchical method is developed to match the corresponding pixels. This method involves iterative removal of local distortions and correlations of pairs of local neighborhoods in the two images. Since it is necessary to perform the matching at every pixel in the image, it is very computationally intensive. Therefore, it has been implemented on the Massively Parallel Processor (MPP) at the Goddard Space Flight Center (GSFC). The MPP's speed permits two iterations of this technique to operate on a pair of 512 × 512 images within 7 s. Results of applying this algorithm to SIR-B images of Mount Shasta, CA, are shown. The matching algorithm performs well in regions of the image with significant features.     

Mapping the spatial distribution and time evolution of snow water equivalent with passive microwave measurements

This paper presents an algorithm that estimates the spatial distribution and temporal evolution of snow water equivalent and snow depth based on passive remote sensing measurements. It combines the inversion of passive microwave remote sensing measurements via dense media radiative transfer modeling results with snow accumulation and melt model predictions to yield improved estimates of snow depth and snow water equivalent, at a pixel resolution of 5 arc-min. In the inversion, snow grain size evolution is constrained based on pattern matching by using the local snow temperature history. This algorithm is applied to produce spatial snow maps of Upper Rio Grande River basin in Colorado. The simulation results are compared with that of the snow accumulation and melt model and a linear regression method. The quantitative comparison with the ground truth measurements from four Snowpack Telemetry (SNOTEL) sites in the basin shows that this algorithm is able to improve the estimation of snow parameters.     

基于多尺度分析的快速相位立体匹配

基于相位的立体匹配是双目投影光栅相位法中的重要步骤,但传统的相位匹配方法在处理高分辨率图像时因存储空间大大增加,难以达到匹配速度与精度的平衡。文章提出了一种基于多尺度分析的快速相位立体匹配算法,采用分层匹配的策略,对预处理后的左右绝对相位图进行降采样以生成图像金字塔,利用低分辨率的视差匹配结果以预测下一层视差,以此降低下层高分辨率图像的视差搜索范围,达到匹配速度与精度的平衡。实验结果表明,所提算法在保证精度的情况下能有效提升相位立体匹配速度,实现高分辨率相位图快速准确的立体匹配。     

Turning images into 3-D models

In this article developments and performance analysis of image matching for detailed surface reconstruction of heritage objects is discussed. Three dimensional image-based modeling of heritages is a very interesting topic with many possible applications. In this article we propose a multistage image-based modeling approach that requires only a limited amount of human interactivity and is capable of capturing the fine geometric details with similar accuracy as close-range active range sensors. It can also cope with wide baselines using several advancements over standard stereo matching techniques. Our approach is sequential, starting from a sparse basic segmented model created with a small number of interactively measured points. This model, specifically the equation of each surface, is then used as a guide to automatically add the fine details. The following three techniques are used, each where best suited, to retrieve the details: 1) for regularly shaped patches such as planes, cylinders, or quadrics, we apply a fast relative stereo matching technique. 2) For more complex or irregular segments with unknown shape, we use a global multi-image geometrically constrained technique. 3) For segments unsuited for stereo matching, we employ depth from shading (DFS). The goal is not the development of a fully automated procedure for 3D object reconstruction from image data or a sparse stereo approach, but we aim at the digital reconstruction of detailed and accurate surfaces from calibrated and oriented images for practical daily documentation and digital conservation of wide variety of heritage objects.