基于颜色失真去除与暗通道先验的水下图像复原

水下图像成像过程与雾天图像虽然类似,但因水对光的选择性吸收和光的散射作用,水下图像存在颜色衰减并呈现蓝(绿)色基调,传统的去雾方法用于水下图像复原时效果欠佳。针对这类方法出现的缺点,该文根据先去除颜色失真后去除背景散射的思路,提出一种新的水下图像复原方法。结合光在水中的衰减特性,提出适用于水下图像的颜色失真去除方法,并利用散射系数与波长的关系修正各通道透射率;另外,该文改进的背景光估计方法可有效避免人工光源、白色物体、噪声等影响。实验结果证明,该文方法在恢复场景物体原本颜色和去除背景散射方面效果良好。     

Depth-aware total variation regularization for underwater image dehazing

Underwater images often show severe quality degradation due to the light absorption and scattering effects in water medium. This paper introduces a scene depth regularized underwater image dehazing method to obtain high-quality underwater images. Unlike previous underwater image dehazing methods that usually calculate a transmission map or a scene depth map using priors, we construct an exponential relationship between transmission map and normalized scene depth map. An initial scene depth is first estimated by the difference between color channels. Then it is refined by total variation regularization to keep structures while smoothing excessive details. An alternating direction algorithm is given to solve the optimization problem. Extensive experiments demonstrate that the proposed method can effectively improve the visual quality of degraded underwater images, and yields high-quality results comparative to the state-of-the-art underwater image enhancement methods quantitatively and qualitatively.     

基于背景光修正成像模型的水下图像复原

光在水下传播时由于受到水体吸收和散射作用的影响,导致水下图像质量严重退化。为了有效去除色偏和模糊,改善水下图像质量,该文提出一种基于背景光修正成像模型的水下图像复原方法。该方法基于对雾天图像的观察,提出了水下图像背景光偏移假设,并基于此建立背景光修正成像模型;随后使用单目深度估计网络获得场景深度的估计,并结合背景光修正的水下成像模型,利用非线性最小二乘拟合获得水下偏移分量的估计值从而实现水下图像去水;最后优化去水后的含雾图像的透射率,并结合修正后的背景光实现图像复原。实验结果表明,该文方法在恢复水下图像颜色和去除散射光方面效果良好。     

基于蓝绿通道自适应色彩补偿的水下图像增强

光在水中传播时受到水的吸收和悬浮粒子散射作用,导致水下图像颜色失真、对比度低、可视性差。针对上述退化问题,该文提出一种基于蓝绿通道自适应色彩补偿水下图像增强方法。首先,该方法分析水下成像模型的特点,根据蓝、绿色通道均值在3通道均值和的占比,将水下场景深度划分3个等级,利用光衰减率特性自适应补偿色彩,实现多场景色彩校正。然后对色彩补偿后的图像划分暗调、中间暗调、中间亮调、亮调4个区域,利用暗区域映射函数将图像暗区域映射到亮区域,在提升对比度的同时抑制噪声的产生。最后采用双线性插值解决分块处理产生的区域块效应。真实水下数据集实验结果表明,与现有方法相比,该方法可以提升多种场景的水下图像质量。     

基于水下成像模型的图像清晰化算法

受水下场景中有机物和悬浮颗粒的影响,水下图像存在对比度低、颜色失真和细节丢失等问题。同时,水下场景中通常有人工光源存在,造成图像光照不均。传统基于图像去雾的方法用于水下图像复原时效果欠佳,为充分考虑水对光的吸收和散射作用,近期提出了新的水下成像模型和图像复原方法。但是这些方法未考虑红通道影响,导致估计的散射比偏大;另外,也未考虑人工光源的影响,导致估计的背景光过大。针对这些问题,该文提出一套有效的水下图像清晰化方案。首先,通过设置阈值确定是否将红通道信息用于暗通道计算,并将反映人工光源影响的饱和度指标用于散射比估计,以减小人工光源的影响。由此,提出了基于红通道预判和饱和度指标的暗通道计算方法。然后,根据三通道衰减系数比估计每个通道的透射率,可弥补目前很多方法假设蓝绿通道透射率一致的缺陷。最后,利用Shades of Gray算法估计环境光,并结合新的水下成像模型得到复原图像。实验结果表明,该文算法可显著提升图像的对比度,得到颜色自然、细节清晰的复原图像。     

Visibility improvement of underwater turbid image using hybrid restoration network with weighted filter

Due to the attenuation of light passes through water, the captured underwater images suffer from low-contrast, halo artifacts, etc. To address this issue, the hybrid network with a weighted filter is proposed to improve the visibility of the obscured (turbid) images. In the captured image, the brighter pixels (near-to-source) are called foreground regions and the darker pixels (far-from-source) are called background regions. In order to ensure the adaptability of the proposed algorithm, the considered datasets are collected on different atmospheric light such as pond, lake, and fisheries tank. The foreground area of an image can be enhanced using the thresholding and masking technique. The background hazy region can be recovered by a hybrid Dehazenet called Generative Adversarial Network and Convolutional Neural Network. With this, the transmission map with high accuracy and color deviation can be addressed. Then both the regions are blended and the Amended Unsharp Mask filter is used to toughen the distorted edges. Finally, the blended restored image is weighted with a contrast factor to obtain the visibility improved image. The subjective and objective evaluation is done on considering the standard non-reference metric called Underwater Image Quality Measure comprises measures of color, sharpness, and contrast for a variety of water types with different atmospheric light. It is observed that the proposed technique showed a metric improvement of 57% compared to other existing techniques in an average manner. Overall, it is inferred that the proposed technique produces better results in both subjective and objective evaluation, thus it outperforms other state-of-the-art techniques.

     

图像去雾过程中的噪声抑制方法

大气中微小颗粒（如雾、霾等）的散射作用会使户外场景拍摄的图像发生退化,造成图像质量下降。图像去雾可以提升图像对比度,增加场景能见度,校正颜色失真,改善视觉效果。但是图像去雾经常会出现明显的噪声放大现象,尤其是无穷远处的天空区域最为严重。针对这一问题,提出了一种去雾过程中的噪声抑制方法。以传输率图像为指导,采用滤波半径变化的双边滤波对雾天图像进行模糊。再计算新的传输率图像,代入雾天成像模型,得到去噪后复原图像。结合噪声评价方法,实验结果验证了该方法的噪声抑制效果。     

Underwater video dehazing based on spatial–temporal information fusion

In this paper, a novel multidimensional underwater video dehazing method is presented to restore and enhance the underwater degraded videos. Videos in the underwater suffer from medium scattering and light absorption. The absorption of light traveling in the water makes the underwater hazing videos different from the atmosphere hazing videos. In order to dehaze the underwater videos, a spatial–temporal information fusion method is proposed which includes two main parts. One is transmission estimation, which is based on the correlation between the adjacent frames of videos to keep the color consistency, where fast tracking and the least square method are used to reduce the influence of camera and object motions and water flowing. Another part is background light estimation to keep consistent atmospheric light values in a video. Extensive experimental results demonstrate that the proposed algorithm can have superior haze removing and color balancing capabilities.     

A joint cumulative distribution function and gradient fusion based method for dehazing of long shot hazy images

Hazy or foggy weather conditions significantly degrade the visual quality of an image in an outdoor environment. It also changes the color and reduces the contrast of an image. This paper introduces a novel single image dehazing technique to restore a hazy image without considering the physical model of haze formation. In order to find haze-free image, the proposed method does not require the transmission map and its costly refinement process. Since haze effect is dependent on the depth, it severely degrades the visibility of the objects located at a far distance. The objects close to the camera are unaffected. In this paper, we propose a fusion-based haze removal method based on the joint cumulative distribution function (JCDF) that treats faraway haze and nearby haze separately. The output images after the JCDF module, fused in the gradient domain to produce a haze-free image. The proposed method not only significantly enhances visibility but also preserves texture details. The proposed method is experimented and evaluated on a large set of challenging hazy images (large scene depth, night time, dense fog, etc.). Both qualitative and quantitative measures show that the performance of the proposed method is better than the state-of-the-art dehazing techniques.     

基于水下光照不均匀成像模型的图像清晰化算法

为了克服水下图像清晰度低和光照不均问题,首先在水下光照均匀成像模型的基础上建立水下光照不均匀条件下的成像模型,进而提出新的水下图像清晰化算法。在算法中,首先在小波变换低频子带上实现了介质散射光和光照变化混合图像的快速估计与去除,然后将得到的图像分割成亮斑区和散射区,并分别进行增强处理。实验结果表明,本文提出的算法可以显...     

动态大气散射系数的颜色衰减先验图像去雾

针对颜色衰减先验图像去雾算法存在对较浓的有雾图像去雾效果不佳的问题,提出基于动态大气散射系数的颜色衰减先验图像去雾算法.用动态大气散射系数取代颜色衰减先验去雾算法中恒定大气散射系数的假设,定义大气散射系数为关于图像景深的指数函数.利用Middlebury stereo datasets中无雾图像和相应的景深图像得到合成有雾图像.采用均方误差(MSE)和结构相似度(SSIM)的综合评价参数MSE-SSIM确定上述指数函数的两个参数的最佳取值.实验结果表明与颜色衰减先验算法、He、Meng算法相比,该算法的去雾图像清晰颜色自然,有效地提高了去雾效果.     

结合线性景深和自适应雾浓度的去雾算法

针对图像去雾中由于景深和大气光估计不准确等问题,导致军事监测、目标检测、导航、无人驾驶等系统成像设备获取到的图像质量下降,提出一种结合线性景深估计和自适应雾浓度估计的去雾算法。首先,依照景深与亮度分量和饱和度的关系,利用双滤波优化二者高亮区域,结合线性转换建立线性模型估计景深。然后,提取纹理特征构造雾浓度模型求取自适应散射系数,通过所求景深与自适应散射系数得到透射率。最后,根据对雾图是否含有天空区域的判决,采用两种不同的大气光估计方法。实验结果通过与不同去雾算法定性和定量分析,所提出的方法在保留深度边缘、颜色质量及细节方面具有良好的有效性和鲁棒性,图像恢复质量也相对较佳。     

Single underwater image haze removal with a learning-based approach to blurriness estimation

Underwater images are usually degraded due to light scattering and absorption. To recover the scene radiance of degraded underwater images, a new haze removal method is presented by incorporating a learning-based approach to blurriness estimation with the image formation model. Firstly, the image blurriness is estimated with a linear model trained on a set of selected grayscale images, the average Gaussian images and blurriness images. With the estimated image blurriness, three intermediate background lights (BLs) are computed to obtain the synthesized BL. Then the scene depth is calculated by using the estimated image blurriness and BL to construct a transmission map and restore the scene radiance. Compared with other haze removal methods, haze in degraded underwater images can be removed more accurately with our proposed method. Moreover, visual inspection, quantitative evaluation and application test demonstrate that our method is superior to the compared methods and beneficial to high-level vision tasks.     

A novel dark channel prior guided variational framework for underwater image restoration

Image captured underwater often suffers from low contrast, color distortion and noise problems, which is caused by absorbing and scattering before the light reaches the camera when traveling through water. Underwater image enhancement and restoration from a single image is known to be an ill-posed problem. To overcome these limitations, we establish an underwater total variation (UTV) model relying on underwater dark channel prior (UDCP), in which UDCP is used to estimate the transmission map. We design the data item and smooth item of the unified variational model based on the underwater image formation model. We further employ the alternating direction method of multipliers (ADMM) to accelerate the solving procedure. Numerical experiential results demonstrate that our underwater variational method obtains a good outcome on dehazing and denoising. Furthermore, compared with several other state-of-the-art algorithms, the proposed approach achieves better visual quality, which is illustrated by examples and statistics.     

Automatic Red-Channel underwater image restoration

Underwater images typically exhibit color distortion and low contrast as a result of the exponential decay that light suffers as it travels. Moreover, colors associated to different wavelengths have different attenuation rates, being the red wavelength the one that attenuates the fastest. To restore underwater images, we propose a Red Channel method, where colors associated to short wavelengths are recovered, as expected for underwater images, leading to a recovery of the lost contrast. The Red Channel method can be interpreted as a variant of the Dark Channel method used for images degraded by the atmosphere when exposed to haze. Experimental results show that our technique handles gracefully artificially illuminated areas, and achieves a natural color correction and superior or equivalent visibility improvement when compared to other state-of-the-art methods.     

基于暗原色先验模型的水下彩色图像增强算法

针对在水下环境中,光的散射和衰减导致水下光学成像质量严重下降,图像对比度低、颜色失真的问题,提出了一种暗原色先验和基于通道直方图量化的颜色校正算法相结合的图像增强新方法。对于待增强的水下彩色图像,首先建立水下光学图像成像模型,并利用优化与改进的暗原色先验算法对图像进行去模糊,然后通过分析R、G、B三通道的累积直方图,对去模糊后的彩色图像各通道灰度值进行量化,实现图像的颜色校正。实验结果表明,提出的方法可以有效地消除了由于光的散射造成图像的模糊,有效提高了水下图像的视觉效果,恢复水下图像的颜色平衡。     

低秩稀疏分解下多尺度积的运动目标检测方法

针对基于矩阵分解的运动目标检测方法易受自然场景中背景的小幅抖动和摄像头抖动等因素影响的问题,提出了一种利用多尺度积的低秩稀疏矩阵分解算法。算法假设,静态背景视频序列中,每帧图像背景可近似视为处于同一低秩子空间中,图像前景则可视为偏离低秩空间的残差部分。首先对图像序列进行滤波、仿射变换等预处理得到视频序列观测数据矩阵;然后对数据矩阵进行低秩稀疏分解得到序列图像的低秩背景部分和每帧图像的稀疏前景部分;最后对稀疏前景部分采用小波变换模极大值与多尺度积方法检测目标边缘,并进行形态学处理,得到准确的运动目标。实验结果表明,算法检测到的运动目标清晰、完整,能有效地处理光照变化、摄像头小幅度抖动、图像背景局部小幅度变化等情况下的运动目标检测。      

Single image dehazing using a new color channel

Images with hazy scene suffer from low-contrast, which reduces the visible quality of the scene, thus making object detection a more challenging task. Low-contrast can result from foggy weather conditions during image acquisition. Dehazing is a process of removal of haze from the photography of a hazy scene. Single-image dehazing based on dark channel priors are well-known techniques in this field. However, the performance of such techniques is limited to priors or constraints. Moreover, this type of method fails when images have sky-region. So, a method is proposed, which can restore the visibility of hazy images. First, a hazy image is divided into blocks of size 32 × 32, then the score of each block is calculated to select a block having the highest score. Atmospheric light is calculated from the selected block. A new color channel is considered to remove atmospheric scattering, obtained channel value and atmospheric light are then used to calculate the transmission map in the second step. Third, radiance is computed using a transmission map and atmospheric light. The illumination scaling factor is adopted to enhance the quality of a dehazed image in the final step. Experiments are performed on six datasets namely, I-HAZE, O-HAZE, BSDS500, FRIDA, RESIDE dataset and natural images from Google. The proposed method is compared against 11 state-of-the-art methods. The performance is analyzed using fourteen quantitative evaluation metrics. All the results demonstrate that the proposed method outperforms 11 state-of-the-art methods in most of the cases.     

人工光源条件下夜间雾天图像建模及去雾

夜间有雾图像光照不均匀,整体亮度较低,色偏严重,且人工光源周围存在光晕。现有的去雾模型和算法大多针对白天图像,其并不适用于夜间场景,夜间图像去雾颇具挑战性。该文深入分析夜间有雾图像的成像规律,建立含有人工光源的夜间雾天图像成像新模型,并在此基础上提出夜间图像去雾新算法。针对夜间图像光照不均问题,提出基于低通滤波的环境光估计方法,利用估计出的环境光可准确预测夜间场景传输率;针对目前夜间图像去雾后存在光源光晕问题,提出根据图像色度估计场景点属于近光源区域的程度,使算法能自适应地处理光源区域和非光源区域;针对非一致色偏问题,利用直方图匹配方法进行颜色校正。对大量图像进行实验,并与现有白天、夜晚图像去雾算法进行比较,验证了该文提出的夜间雾天图像成像模型及去雾算法的有效性。     

Color correction and restoration based on multi-scale recursive network for underwater optical image

Underwater image processing has played an important role in various fields such as submarine terrain scanning, submarine communication cable laying, underwater vehicles, underwater search and rescue. However, there are many difficulties in the process of acquiring underwater images. Specifically, the water body will selectively absorb part of the light when light travels through the water, resulting in color degradation of underwater images. At the same time, due to the influence of floating substances in the water, the light has a certain degree of scattering, which will bring serious problems such as blurred details and low contrast to underwater images. Therefore, using image processing technology to restore the real appearance of underwater images has a high practical value. In order to solve the above problems, we combine the color correction method with the deblurring network to improve the quality of underwater images in this paper. Firstly, aiming at the problem of insufficient number and diversity of underwater image samples, a network combined with depth image reconstruction and underwater image generation is proposed to simulate underwater images based on the style transfer method. Secondly, for the problem of color distortion, we propose a dynamic threshold color correction method based on image global information combined with the loss law of light propagation in water. Finally, in order to solve the problem of image blurring caused by scattering and further improve the overall image clarity, the color-corrected image is reconstructed by a multi-scale recursive convolutional neural network. Experiment results show that we can obtain images closer to underwater style with shorter training time. Compared with several latest underwater image processing methods, the proposed method has obvious advantages in multiple underwater scenes. Simultaneously, we can restore the color information, remove blurring and boost detail for underwater images.