Learn from the past – sequentially one-to-one video deblurring network

With the growing availability of hand-held cameras in recent years, more and more images and videos are taken at any time and any place. However, they usually suffer from undesirable blur due to camera shake or object motion in the scene. In recent years, a few modern video deblurring methods are proposed and achieve impressive performance. However, they are still not suitable for practical applications as high computational cost or using future information as input. To address the issues, we propose a sequentially one-to-one video deblurring network (SOON) which can deblur effectively without any future information. It transfers both spatial and temporal information to the next frame by utilizing the recurrent architecture. In addition, we design a novel Spatio-Temporal Attention module to nudge the network to focus on the meaningful and essential features in the past. Extensive experiments demonstrate that the proposed method outperforms the state-of-the-art deblurring methods, both quantitatively and qualitatively, on various challenging real-world deblurring datasets. Moreover, as our method deblurs in an online manner and is potentially real-time, it is more suitable for practical applications.     

盲去模糊的多尺度编解码深度卷积网络

针对拍摄场景中物体运动不一致所带来的非均匀模糊，为提高复杂运动场景中去模糊的效果，提出一种多尺度编解码深度卷积网络。该网络采用"从粗到细"的多尺度级联结构，在模糊核未知条件下，实现盲去模糊；其中，在该网络的编解码模块中，提出一种快速多尺度残差块，使用两个感受野不同的分支增强网络对多尺度特征的适应能力；此外，在编解码之间增加跳跃连接，丰富解码端信息。与2018年国际计算机视觉与模式识别会议（CVPR）上提出的多尺度循环网络相比，峰值信噪比（PSNR）高出0.06 dB；与2017年CVPR上提出的深度多尺度卷积网络相比，峰值信噪比和平均结构相似性（MSSIM）分别提高了1.4%和3.2%。实验结果表明，该网络能快速去除图像模糊，恢复出图像原有的边缘结构和纹理细节。     

基于边缘信息的运动模糊图像的鲁棒盲复原

为获得适用于不同模糊图像且简捷的图像盲复原方法,提出了一种稳健的从单幅模糊图像中求取模糊核并对图像去模糊的图像盲复原方法。根据模糊图像与非模糊图之间的边缘关系求模糊核,并在多尺度框架下针对各个子算法设定自适应参数,从而构建一个稳健的图像盲复原方法。对复原结果用4种无参考的图像质量评价方法的评价结果显示,本文方法在噪声和...     

图像恢复的小波域加速Landweber迭代阈值方法

该文利用对忠诚项的二次逼近方法,提出了一种小波域加速Landweber迭代阈值算法。该算法的每次迭代是对前两次迭代结果的线性组合做阈值处理。与标准的迭代阈值算法相比,该方法收敛速度更快。由于参数的可选择性,新算法更有灵活性。数值实验表明新算法能够有效地提高恢复图像的质量,是一种行之有效的图像恢复方法。     

L1范数约束的非局部均值正则图像去模糊模型

为了保护图像边缘、细节等信息,建立了l₁范数约束的非局部均值正则模型.首先通过实验证明了非局部均值去噪算法余项的概率密度函数具有较强的拖尾性质,符合Laplace分布的特点.基于此,使用l₁范数约束的非局部均值去噪算法余项作为新的正则项,提出了新的正则模型.然后利用Bregman算子分裂算法求解得到相应的优化算法,并且可将新算法看成Plug-and-Play Priors算法的推广.实验结果表明,新模型在去除模糊,保护图像边缘、细节等信息方面的性能都优于l₂范数约束的非局部均值正则模型和Plug-and-Play Priors模型.     

基于无参考图像质量评价的反卷积去模糊算法

针对数字图像在处理过程中容易产生模糊的现象,提出了基于无参考图像质量评价的自适应反卷积去模糊算法。首先,根据无参考图像质量评价结果与其失真等级的强相关性,通过计算模糊图像的无参考评价参数确定图像的模糊等级,进而根据图像模糊等级与模糊核的对应关系确定反卷积核;其次,提出将失真图像颜色空间转变到YUV,仅对失真图像Y通道进行去模糊处理,保证了彩色图像处理前后颜色的忠实性,并提高算法运算效率;最后,针对图像灰度剧烈变化的邻域出现类吉布斯(Gibbs)振荡分布的现象,提出基于梯度的权重矩阵进行控制。实验结果表明,本文提出的算法在Tid2008图库不仅能够对图像模糊进行快速有效去除,并且恢复图像的纹理细节能够得到有效保留。     

BaMBNet: A Blur-Aware Multi-Branch Network for Dual-Pixel Defocus Deblurring

Reducing the defocus blur that arises from the finite aperture size and short exposure time is an essential problem in computational photography. It is very challenging because the blur kernel is spatially varying and difficult to estimate by traditional methods. Due to its great breakthrough in low-level tasks, convolutional neural networks (CNNs) have been introduced to the defocus deblurring problem and achieved significant progress. However, previous methods apply the same learned kernel for different regions of the defocus blurred images, thus it is difficult to handle nonuniform blurred images. To this end, this study designs a novel blur-aware multi-branch network (BaMBNet), in which different regions are treated differentially. In particular, we estimate the blur amounts of different regions by the internal geometric constraint of the dual-pixel (DP) data, which measures the defocus disparity between the left and right views. Based on the assumption that different image regions with different blur amounts have different deblurring difficulties, we leverage different networks with different capacities to treat different image regions. Moreover, we introduce a meta-learning defocus mask generation algorithm to assign each pixel to a proper branch. In this way, we can expect to maintain the information of the clear regions well while recovering the missing details of the blurred regions. Both quantitative and qualitative experiments demonstrate that our BaMBNet outperforms the state-of-the-art (SOTA) methods. For the dual-pixel defocus deblurring (DPD)-blur dataset, the proposed BaMBNet achieves 1.20 dB gain over the previous SOTA method in term of peak signal-to-noise ratio (PSNR) and reduces learnable parameters by 85%. The details of the code and dataset are available at https://github.com/junjun-jiang/BaMBNet.      

Single‐shot High Dynamic Range Imaging Using Coded Electronic Shutter

Typical high dynamic range (HDR) imaging approaches based on multiple images have difficulties in handling moving objects and camera shakes, suffering from the ghosting effect and the loss of sharpness in the output HDR image. While there exist a variety of solutions for resolving such limitations, most of the existing algorithms are susceptible to complex motions, saturation, and occlusions. In this paper, we propose an HDR imaging approach using the coded electronic shutter which can capture a scene with row‐wise varying exposures in a single image. Our approach enables a direct extension of the dynamic range of the captured image without using multiple images, by photometrically calibrating rows with different exposures. Due to the concurrent capture of multiple exposures, misalignments of moving objects are naturally avoided with significant reduction in the ghosting effect. To handle the issues with under‐/over‐exposure, noise, and blurs, we present a coherent HDR imaging process where the problems are resolved one by one at each step. Experimental results with real photographs, captured using a coded electronic shutter, demonstrate that our method produces a high quality HDR images without the ghosting and blur artifacts.     

改进的广义高斯分布与非局部均值图像去模糊

为了改善常规算法不能保留图像边缘细节信息的缺陷,获得更好的图像去模糊效果,在非局部均值图像复原算法的基础上提出一种新的基于广义高斯分布与非局部均值的去模糊算法。先对模糊图像进行小波变换,然后应用极大似然估计的方法以及经典的Newton-Raphson算法来估计出广义高斯分布模型的尺度参数和形状参数,利用这两个参数改进原始的单一根据指数函数的衰减速度和局限于一个参数来求图像权值的方法。在多个典型图像上的测试结果表明,改进算法后的图像去模糊化效果比原始的NL-means方法更优越,具有很好的应用前景。