基于循环神经网络的散焦图像去模糊算法

近年来,基于深度学习的运动模糊去除算法得到了广泛关注,然而单幅散焦图像去模糊算法鲜有研究。为针对性地解决单幅图像的散焦模糊问题,提出一种基于循环神经网络的散焦图像去模糊算法。首先级联两个残差网络,分别完成散焦图估计和图像去模糊;随后,为了保证散焦图和清晰图像的深度特征可以更好地跨阶段传播以及阶段内相互作用,在残差网络中引入LSTM（long short-term memory）循环层;最后,整个残差网络进行了多次迭代,迭代过程中网络参数共享。为了训练网络,制作了一个合成散焦图像数据集,每一张散焦图像都包含对应的清晰图像和散焦图。实验结果表明,该算法相较于对比算法在主客观图像质量评价上均有显著优势,在复原结果中具有更锐利的边缘和清晰的细节。对于真实双像素图像散焦模糊数据集DPD,该算法相比DPDNet-Single在峰值信噪比（PSNR）和结构相似性（SSIM）上分别提高了0.77 dB、5.6%,因此所提方法可以有效处理真实场景散焦模糊。     

Single‐shot High Dynamic Range Imaging Using Coded Electronic Shutter

Typical high dynamic range (HDR) imaging approaches based on multiple images have difficulties in handling moving objects and camera shakes, suffering from the ghosting effect and the loss of sharpness in the output HDR image. While there exist a variety of solutions for resolving such limitations, most of the existing algorithms are susceptible to complex motions, saturation, and occlusions. In this paper, we propose an HDR imaging approach using the coded electronic shutter which can capture a scene with row‐wise varying exposures in a single image. Our approach enables a direct extension of the dynamic range of the captured image without using multiple images, by photometrically calibrating rows with different exposures. Due to the concurrent capture of multiple exposures, misalignments of moving objects are naturally avoided with significant reduction in the ghosting effect. To handle the issues with under‐/over‐exposure, noise, and blurs, we present a coherent HDR imaging process where the problems are resolved one by one at each step. Experimental results with real photographs, captured using a coded electronic shutter, demonstrate that our method produces a high quality HDR images without the ghosting and blur artifacts.     

Algorithm for the Removing Uniformed Motion Blur

Motion deblurring is one of the basic problems inthe field of image processing. This paper summarizes the mathematical basis of the previous work and presents a deblurringmethod that can improve the estimation of the motion blurkernel and obtain a better result than the traditional methods.Experiments show the motion blur kernel loses some important and useful properties during the estimation of the kernel which may cause a bad estimation and increase the ringingartifacts. Considering that the kernel is provided by the motion of the imaging sensor during the exposure and that the kernel shows the trace of the motion, this paper ensures the physical meaning of the kernel such as the continuity and the center of thekernel during the iterative process. By adding a post process to the estimation of the motion blur kernel, we remove some discrete points and make use of the centralizationof the kernel in order to accurate the estimation. The experiment shows the existence of the post process improves the effect of the estimation of the kernel and provides a better result with the clear edges.     

Deblurring by Matching

Restoration of the photographs damaged by the camera shake is a challenging task that manifested increasing attention in the recent period. Despite of the important progress of the blind deconvolution techniques, due to the ill-posed nature of the problem, the finest details of the kernel blur cannot be recovered entirely. Moreover, the additional constraints and prior assumptions make these approaches to be relative limited.
In this paper we introduce a novel technique that removes the undesired blur artifacts from photographs taken by hand-held digital cameras. Our approach is based on the observation that in general several consecutive photographs taken by the users share image regions that project the same scene content. Therefore, we took advantage of additional sharp photographs of the same scene. Based on several invariant local feature points, filtered from the given blurred/non-blurred images, our approach matches the keypoints and estimates the blur kernel using additional statistical constraints.
We also present a simple deconvolution technique that preserves edges while minimizing the ringing artifacts in the restored latent image. The experimental results prove that our technique is able to infer accurately the blur kernel while reducing significantly the artifacts of the spoilt images.     

联合优化PSF估计与可逆性编码的去运动模糊

针对传统相机捕获的图像去运动模糊性能不稳定的问题,对编码相机的原理和编码策略进行研究,提出了一种基于相机优化编码和图像有效边缘的点扩展函数(Point spread function,PSF)估计与去运动模糊方法。首先,对传统相机的alpha蒙板去模糊方法进行研究,并将其扩展到编码相机的去运动模糊;然后,对影响去模糊性能的编码因素进行分析,找出适宜于PSF估计和可 逆性的最优化编码;最后,对一种基于有效边缘和最大后验分布的PSF估计方法进行改进,并以有效的边缘梯度为空间先验信息采用由粗到精的迭代方式完成图像的去运动模糊。基于仿真模糊图像与真实模糊图像的实验结果表明,本文方法能够有效地估计PSF,并且去运 动模糊方法的性能优于当前技术条件下的其他方法。     

基于光纹特征的激光主动照明图像去模糊

受光学系统离焦、大气扰动、平台振动的影响,激光主动照明系统捕获的图像容易被模糊,而传统的去模糊方法难以取得良好的复原效果,故本文提出基于光纹特征的盲解卷积复原方法来实现图像去模糊。首先将模糊图像降采样,建立尺度金字塔,在尺度空间查找光纹特征图像块。随后基于激光主动照明图像饱和像素较多的特点,提出新的图像退化模型。最后针对模糊核估计、光纹参数更新、清晰图像复原3个步骤,提出适用的能量函数,迭代复原出无噪清晰图像。搭建了主动照明系统,在捕获的激光主动照明图像上进行了实验,并与现有方法进行了对比。结果表明:本文方法不仅能够复原出清晰图像,而且能有效抑制振铃效应,其客观评价指标峰值信噪比(PSNR)优于已有的其他算法。     

基于边缘信息的运动模糊图像的鲁棒盲复原

为获得适用于不同模糊图像且简捷的图像盲复原方法,提出了一种稳健的从单幅模糊图像中求取模糊核并对图像去模糊的图像盲复原方法。根据模糊图像与非模糊图之间的边缘关系求模糊核,并在多尺度框架下针对各个子算法设定自适应参数,从而构建一个稳健的图像盲复原方法。对复原结果用4种无参考的图像质量评价方法的评价结果显示,本文方法在噪声和...     

基于无参考图像质量评价的反卷积去模糊算法

针对数字图像在处理过程中容易产生模糊的现象,提出了基于无参考图像质量评价的自适应反卷积去模糊算法。首先,根据无参考图像质量评价结果与其失真等级的强相关性,通过计算模糊图像的无参考评价参数确定图像的模糊等级,进而根据图像模糊等级与模糊核的对应关系确定反卷积核;其次,提出将失真图像颜色空间转变到YUV,仅对失真图像Y通道进行去模糊处理,保证了彩色图像处理前后颜色的忠实性,并提高算法运算效率;最后,针对图像灰度剧烈变化的邻域出现类吉布斯(Gibbs)振荡分布的现象,提出基于梯度的权重矩阵进行控制。实验结果表明,本文提出的算法在Tid2008图库不仅能够对图像模糊进行快速有效去除,并且恢复图像的纹理细节能够得到有效保留。     

Learn from the past – sequentially one-to-one video deblurring network

With the growing availability of hand-held cameras in recent years, more and more images and videos are taken at any time and any place. However, they usually suffer from undesirable blur due to camera shake or object motion in the scene. In recent years, a few modern video deblurring methods are proposed and achieve impressive performance. However, they are still not suitable for practical applications as high computational cost or using future information as input. To address the issues, we propose a sequentially one-to-one video deblurring network (SOON) which can deblur effectively without any future information. It transfers both spatial and temporal information to the next frame by utilizing the recurrent architecture. In addition, we design a novel Spatio-Temporal Attention module to nudge the network to focus on the meaningful and essential features in the past. Extensive experiments demonstrate that the proposed method outperforms the state-of-the-art deblurring methods, both quantitatively and qualitatively, on various challenging real-world deblurring datasets. Moreover, as our method deblurs in an online manner and is potentially real-time, it is more suitable for practical applications.