基于半反图像的透射率优化降雾算法

传统的暗原色先验图像降雾算法在处理不满足暗原色先验假设的明亮区域时,估计的透射率不准确。从而导致降雾后的图像色彩出现较大偏差。针对这一不足,本文提出了一种基于半反图像的透射率优化降雾算法。该算法通过明亮区域检测来获取大气光,然后用自定义函数对图像中明亮区域透射率进行修正,最后利用引导滤波器优化初始透射率,恢复出清晰的降雾图像。实验结果表明,该算法可以有效地处理图像中不满足暗原色先验假设的明亮区域,提高了户外视觉系统的鲁棒性。     

Weakly supervised single image dehazing

Single image dehazing is a critical image pre-processing step for many practical vision systems. Most existing dehazing methods solve this problem utilizing various of hand-crafted priors or by supervised training on the synthetic hazy image information (such as haze-free image, transmission map and atmospheric light). However, the assumptions on the hand-crafted priors are easily violated and collecting realistic transmission map and atmospheric light are unpractical. In this paper, we propose a novel weakly supervised network based on the multi-level multi-scale block. The proposed network reduces the constraint on the training data and automatically estimates the transmission map and the atmospheric light as well as the intermediate haze-free image without using any realistic transmission map and atmospheric light as supervision. Moreover, the estimated intermediate haze-free image helps to generate accurate transmission map and atmospheric light by embedding the physical-model, which presents reliable restoration of the final haze-free image. In particular, our network also can be trained on the real-world dataset to fine-tune the model and the fine-tuning operation improves the dehazing performance on the real-world dataset. Quantitative and qualitative experimental results demonstrate the proposed method performs on par with the supervised methods.     

Single image dehazing using a new color channel

Images with hazy scene suffer from low-contrast, which reduces the visible quality of the scene, thus making object detection a more challenging task. Low-contrast can result from foggy weather conditions during image acquisition. Dehazing is a process of removal of haze from the photography of a hazy scene. Single-image dehazing based on dark channel priors are well-known techniques in this field. However, the performance of such techniques is limited to priors or constraints. Moreover, this type of method fails when images have sky-region. So, a method is proposed, which can restore the visibility of hazy images. First, a hazy image is divided into blocks of size 32 × 32, then the score of each block is calculated to select a block having the highest score. Atmospheric light is calculated from the selected block. A new color channel is considered to remove atmospheric scattering, obtained channel value and atmospheric light are then used to calculate the transmission map in the second step. Third, radiance is computed using a transmission map and atmospheric light. The illumination scaling factor is adopted to enhance the quality of a dehazed image in the final step. Experiments are performed on six datasets namely, I-HAZE, O-HAZE, BSDS500, FRIDA, RESIDE dataset and natural images from Google. The proposed method is compared against 11 state-of-the-art methods. The performance is analyzed using fourteen quantitative evaluation metrics. All the results demonstrate that the proposed method outperforms 11 state-of-the-art methods in most of the cases.     

基于非局部先验的雾线优化图像去雾算法

针对非局部先验去雾算法中雾线端点像素位置精确度不足的问题,提出了雾线优化的非局部先验图像去雾算法。首先分析雾线理论,结合暗通道理论确定最大聚类雾线真实端点,以其为已知条件补偿小聚类雾线端点与大气光之间的距离,根据类内不同像素与雾线对应夹角预估单个像素雾线端点进而求得像素级优化后的透射率,最后根据图像局部灰度值差异融合暗通道先验(dark channel prior, DCP)和非局部先验透射率得最终透射率图。将本文算法与其余3种去雾算法在多幅户外雾图下通过主观及客观两方面分析比较,实验结果表明该算法能取得更好的去雾效果,尤其在天空区域图像复原效果较为突出。     

基于天空区域分割与置信度图导向融合的去雾方法研究

基于暗通道先验的去雾算法总是存在复原结果中天空区域处理不佳等问题,为了进一步优化对传输函数的估计,本文提出一种基于置信度图导向融合的传输函数优化方法。首先,将雾天图像的天空区域分离出来,以达到对天空区域的优化;计算窗口级暗通道与像素级暗通道,以平滑传输函数在物体边缘并保留小于窗口尺寸的细节特征;最后,计算窗口级暗通道与像素级暗通道之间的置信度图,以其为导向对两者进行融合得到优化的传输函数图,实现图像去雾。实验结果表明,本文算法可达到很好的复原结果优化效果。     

图像去雾过程中的噪声抑制方法

大气中微小颗粒（如雾、霾等）的散射作用会使户外场景拍摄的图像发生退化,造成图像质量下降。图像去雾可以提升图像对比度,增加场景能见度,校正颜色失真,改善视觉效果。但是图像去雾经常会出现明显的噪声放大现象,尤其是无穷远处的天空区域最为严重。针对这一问题,提出了一种去雾过程中的噪声抑制方法。以传输率图像为指导,采用滤波半径变化的双边滤波对雾天图像进行模糊。再计算新的传输率图像,代入雾天成像模型,得到去噪后复原图像。结合噪声评价方法,实验结果验证了该方法的噪声抑制效果。     

Depth-aware total variation regularization for underwater image dehazing

Underwater images often show severe quality degradation due to the light absorption and scattering effects in water medium. This paper introduces a scene depth regularized underwater image dehazing method to obtain high-quality underwater images. Unlike previous underwater image dehazing methods that usually calculate a transmission map or a scene depth map using priors, we construct an exponential relationship between transmission map and normalized scene depth map. An initial scene depth is first estimated by the difference between color channels. Then it is refined by total variation regularization to keep structures while smoothing excessive details. An alternating direction algorithm is given to solve the optimization problem. Extensive experiments demonstrate that the proposed method can effectively improve the visual quality of degraded underwater images, and yields high-quality results comparative to the state-of-the-art underwater image enhancement methods quantitatively and qualitatively.     

基于迁移学习的三子网图像去雾方法

目前大部分图像去雾算法只在一种或几种均匀雾图数据集中有较好的表现,对于不同风格或非均匀雾图数据集去雾效果较差,同时算法在实际应用中会因模型泛化能力差导致模型场景受限。针对上述情况,该文提出一种基于迁移学习的卷积神经网络(CNN)用于解决去雾算法中非均匀雾图处理效果不佳和模型泛化能力差等问题。首先,该文使用ImageNet预训练的模型参数作为迁移学习模型的初始参数,以加速模型训练收敛速度。其次,主干网络模型由3个子网组成：残差特征子网络、局部特征提取子网络和整体特征提取子网络。3子网结合以保证模型可从整体和局部两个方面进行特征提取,在现实雾场景(浓雾、非均匀雾)中获得较好的去雾效果。该文在模型训练效率、去雾质量和雾图场景选择灵活性3个方面进行了研究和改进,为衡量模型性能,模型选择在去雾难度较大的非均匀雾图数据集NTIRE2020和NTIRE2021上进行定量与定性实验。实验结果证明3子网模型在图像主观和客观评价指标两个方面都取得了较好的效果。该文模型改善了算法泛化性能差和小数据集难以进行模型训练的问题,可将该文成果广泛应用于小规模数据集和多变场景图像的去雾工作中。     

Study of single image dehazing algorithm based on propagated filtering and minimum color channels

To solve the challenging problem that the edge regions of image have some remained hazes and blackspots,a novel image dehazing algorithm was proposed based on the minimal color channel and propagated filtering.Firstly,an initial atmospheric transmission map was obtained by double-area filtering,then a minimal channel color was introduced as a reference image,and the propagated filtering was combined to optimize the initial atmospheric transmission map.Optimized transmission have the similar edge characteristics as the referenced image,so the deviation of transmission estimation can be effectively avoided for the edge pixels in the depth mutated regions,and the redundant texture information were removed in the initial transmission map.Finally,L-BFGS was used to restore atmospheric light,and the haze-free image can be recovered based on the atmospheric scattering model.Experimental results show that proposed algorithm has the more accurate transmission estimation for the depth mutated edge regions of image,so the recovered image effectively preserves the edges and details in the depth mutated regions,and has better spatial smoothness in the uniform depth regions.The recovered haze-free image with proposed method has a better sharpness and richer color degree.     

基于天空约束暗通道先验的图像去雾

针对现有暗通道图像去雾算法存在的天空色彩失真,景物边缘光晕效应等问题,本文提出了基于暗通道理论的改进去雾算法.由于暗原色先验理论不适用于天空区域,本文将引导滤波用于天空区域的细化分割,准确估计包含天空区域图像的大气光照强度,解决了天空色彩失真问题;其次,利用中值滤波得到详细边缘信息,进而得到更为清晰的透射率,有效抑制了景物边缘光晕问题;最后针对去雾后图像偏暗的问题,在HSV空间对亮度分量V通道进行增强处理.实验结果表明,针对带雾图像,本文算法能够有效地去雾,改善天空区域色彩失真以及景物边缘光晕问题.     

基于区间估计的单幅图像快速去雾

针对雾、霾等天气条件下捕获的图像存在严重降质现象,该文提出一种基于区间估计的单幅图像快速去雾方法。该方法从大气散射模型出发,基于暗通道先验理论,利用最小值滤波和灰度开运算,通过区间估计得到大气光值,同时得到介质传输率的初始估计值。通过对大气光照进行白平衡处理,从而得到简化大气散射模型。然后,利用简化大气散射模型和介质传输率的初始估计值,通过区间估计得到场景反照率的暗通道值,进一步得到介质传输率的粗略估计值。将介质传输率的初始估计值和粗略估计值进行像素级融合,通过联合双边滤波和值域调整得到介质传输率的最终估计值。最后,通过简化大气散射模型和色调调整得到去雾图像。实验结果表明,所提算法具有较快的运算速度,能有效提高去雾图像的清晰度和对比度,同时获得较好的色调保真度。     

A joint cumulative distribution function and gradient fusion based method for dehazing of long shot hazy images

Hazy or foggy weather conditions significantly degrade the visual quality of an image in an outdoor environment. It also changes the color and reduces the contrast of an image. This paper introduces a novel single image dehazing technique to restore a hazy image without considering the physical model of haze formation. In order to find haze-free image, the proposed method does not require the transmission map and its costly refinement process. Since haze effect is dependent on the depth, it severely degrades the visibility of the objects located at a far distance. The objects close to the camera are unaffected. In this paper, we propose a fusion-based haze removal method based on the joint cumulative distribution function (JCDF) that treats faraway haze and nearby haze separately. The output images after the JCDF module, fused in the gradient domain to produce a haze-free image. The proposed method not only significantly enhances visibility but also preserves texture details. The proposed method is experimented and evaluated on a large set of challenging hazy images (large scene depth, night time, dense fog, etc.). Both qualitative and quantitative measures show that the performance of the proposed method is better than the state-of-the-art dehazing techniques.     

Optimized contrast enhancement for real-time image and video dehazing

A fast and optimized dehazing algorithm for hazy images and videos is proposed in this work. Based on the observation that a hazy image exhibits low contrast in general, we restore the hazy image by enhancing its contrast. However, the overcompensation of the degraded contrast may truncate pixel values and cause information loss. Therefore, we formulate a cost function that consists of the contrast term and the information loss term. By minimizing the cost function, the proposed algorithm enhances the contrast and preserves the information optimally. Moreover, we extend the static image dehazing algorithm to real-time video dehazing. We reduce flickering artifacts in a dehazed video sequence by making transmission values temporally coherent. Experimental results show that the proposed algorithm effectively removes haze and is sufficiently fast for real-time dehazing applications.     

A novel dark channel prior guided variational framework for underwater image restoration

Image captured underwater often suffers from low contrast, color distortion and noise problems, which is caused by absorbing and scattering before the light reaches the camera when traveling through water. Underwater image enhancement and restoration from a single image is known to be an ill-posed problem. To overcome these limitations, we establish an underwater total variation (UTV) model relying on underwater dark channel prior (UDCP), in which UDCP is used to estimate the transmission map. We design the data item and smooth item of the unified variational model based on the underwater image formation model. We further employ the alternating direction method of multipliers (ADMM) to accelerate the solving procedure. Numerical experiential results demonstrate that our underwater variational method obtains a good outcome on dehazing and denoising. Furthermore, compared with several other state-of-the-art algorithms, the proposed approach achieves better visual quality, which is illustrated by examples and statistics.     

基于光照估计的夜间图像去雾

相对白天雾天图像,夜晚雾天图像具有整体亮度低、光照不均匀、偏色等特点,因此去雾难度大。本文从夜间雾天成像规律出发,提出了基于光照估计的夜间图像去雾算法。针对光照不均匀问题,通过估计光照图来去除不均匀光照的影响;针对目前白天去雾算法假设不适用于夜晚图像问题,提出基于信息熵的传输图粗估计的方法;针对颜色失真问题,通过统计光源区域的颜色属性来进行颜色校正。实验结果表明,本文算法能够有效的去除不均匀光照影响,提高图像对比度,改善图像视觉效果。     

Visibility improvement of underwater turbid image using hybrid restoration network with weighted filter

Due to the attenuation of light passes through water, the captured underwater images suffer from low-contrast, halo artifacts, etc. To address this issue, the hybrid network with a weighted filter is proposed to improve the visibility of the obscured (turbid) images. In the captured image, the brighter pixels (near-to-source) are called foreground regions and the darker pixels (far-from-source) are called background regions. In order to ensure the adaptability of the proposed algorithm, the considered datasets are collected on different atmospheric light such as pond, lake, and fisheries tank. The foreground area of an image can be enhanced using the thresholding and masking technique. The background hazy region can be recovered by a hybrid Dehazenet called Generative Adversarial Network and Convolutional Neural Network. With this, the transmission map with high accuracy and color deviation can be addressed. Then both the regions are blended and the Amended Unsharp Mask filter is used to toughen the distorted edges. Finally, the blended restored image is weighted with a contrast factor to obtain the visibility improved image. The subjective and objective evaluation is done on considering the standard non-reference metric called Underwater Image Quality Measure comprises measures of color, sharpness, and contrast for a variety of water types with different atmospheric light. It is observed that the proposed technique showed a metric improvement of 57% compared to other existing techniques in an average manner. Overall, it is inferred that the proposed technique produces better results in both subjective and objective evaluation, thus it outperforms other state-of-the-art techniques.

     

基于非局部全变分正则化优化的单幅雾天图像恢复新方法

该文针对无雾图像具有高灰度对比度且大气遮罩局部平滑的特性,提出一种基于非局部全变分正则化优化的单幅雾天图像恢复新方法。先构建一种基于非局部全变分正则化的有约束优化算法对大气遮罩进行估计,然后通过优化Bregman分离迭代法求解非局部Rudin-Osher-Fatemi模型获得准确的大气遮罩,进而从雾天场景图像恢复出场景图像。实验结果表明,所提新方法可以有效地对雾天降质图像进行复原,对多纹理复杂区域的恢复效果也较好。     

基于透射率权值因子的雾天图像融合增强算法

雾天图像增强具有重要现实意义。由于现有的图像去雾算法在提升图像全局对比度的能力上存在不足,为此将暗通道先验去雾算法与直方图均衡化算法的各自优势进行整合,该文提出一种雾天图像增强新算法。首先,分别采用基于导向滤波的暗通道先验去雾算法和基于HSV色彩空间的直方图均衡化算法处理雾天图像;然后,基于修正的透射率图构造权值因子,将上述两种处理结果加权融合,得到输出图像。仿真实验结果表明,该算法比现有去雾算法具有更高的标准差、平均梯度与信息熵,具有更好的全局与局部对比度增强效果。算法运行时间主要依赖于图像去雾环节,处理一般尺寸图像能够满足实时要求。     

A non-local propagation filtering scheme for edge-preserving in variational optical flow computation

The median filtering heuristic is considered to be an indispensable tool for the currently popular variational optical flow computation. Its attractive advantages are that outliers reduction is attained while image edges and motion boundaries are preserved. However, it still may generate blurring at image edges and motion boundaries caused by large displacement, motion occlusion, complex texture, and illumination change. In this paper, we present a non-local propagation filtering scheme to deal with the above problem during the coarse-to-fine optical flow computation. First, we analyze the connection between the weighted median filtering and the blurring of image edge and motion boundary under the coarse-to-fine optical flow computing scheme. Second, to improve the quality of the initial flow field, we introduce a non-local propagation filter to reduce outliers while preserving context information of the flow field. Furthermore, we present an optimization combination of non-local propagation filtering and weighted median filtering for the flow field estimation under the coarse-to-fine scheme. Extensive experiments on public optical flow benchmarks demonstrate that the proposed scheme can effectively improve the accuracy and robustness of optical flow estimation.     

基于背景光修正成像模型的水下图像复原

光在水下传播时由于受到水体吸收和散射作用的影响,导致水下图像质量严重退化。为了有效去除色偏和模糊,改善水下图像质量,该文提出一种基于背景光修正成像模型的水下图像复原方法。该方法基于对雾天图像的观察,提出了水下图像背景光偏移假设,并基于此建立背景光修正成像模型;随后使用单目深度估计网络获得场景深度的估计,并结合背景光修正的水下成像模型,利用非线性最小二乘拟合获得水下偏移分量的估计值从而实现水下图像去水;最后优化去水后的含雾图像的透射率,并结合修正后的背景光实现图像复原。实验结果表明,该文方法在恢复水下图像颜色和去除散射光方面效果良好。