外部非局部自相似先验的图像去噪

针对在噪声水平比较高的情况下难以从噪声图像本身提取准确先验信息的问题,提出一种从外部干净图像数据集学习非局部自相似先验信息的图像去噪方法。首先用高斯混合模型学习外部干净图像的非局部自相似先验信息,其次利用最大后验概率估计的方法找到与噪声图像块最匹配的外部先验信息,最后利用外部先验对噪声图像块进行稀疏表示。实验对比表明,所提算法在去除噪声的同时可以较好地保留图像的细节信息,使图像数据集的平均峰值信噪比提高0.18 dB以上。     

Video super resolution based on non-local regularization and reliable motion estimation

Video super-resolution (SR) is a process for reconstructing high-resolution (HR) images by utilizing complementary information among multiple low-resolution (LR) images. Accurate estimation of the motion among the LR images significantly affects the quality of the reconstructed HR image. In this paper, we analyze the possible reasons for the inaccuracy of motion estimation and then propose a multi-lateral filter to regularize the process of motion estimation. This filter can adaptively correct motion estimation according to the estimation reliability, image intensity discontinuity, and motion dissimilarity. Furthermore, we introduce a non-local prior to solve the ill-posed problem of HR image reconstruction. This prior can fully utilize the self-similarities existing in natural images to regularize the HR image reconstruction. Finally, we employ a Bayesian formulation to incorporate the two regularizations into one Maximum a Posteriori (MAP) estimation model, where the HR image and the motion estimation can be refined progressively in an alternative and iterative manner. In addition, an algorithm that estimates the blur kernel by analyzing edges in an image is also presented in this paper. Experimental results demonstrate that the proposed approaches are highly effective and compare favorably to state-of-the-art SR algorithms.     

Iterative non-local means filter for salt and pepper noise removal

Salt and Pepper noise (S&P noise) removal is an active research area in digital image processing. Existing techniques commonly use the local statistics within a neighborhood to estimate the centered noisy pixel, and tend to damage image details due to the image local diversity singularity and non-stationarity. To address this problem, in this paper, iterative nonlocal means filter (INLM) is proposed to exploit the image non-local similarity feature in the S&P noise removal procedure. Moreover, the proposed iterative framework update the similarity weights and the estimated values for higher accuracy. The experimental results show that the proposed INLM produces better results than state-of-art methods over a wide range of scenes both subjectively and objectively, and it is robust to the detection results.     

Multiframe super-resolution based on half-quadratic prior with artifacts suppress

The multiframe super-resolution (SR) technique aims to obtain a high-resolution (HR) image by using a set of observed low-resolution (LR) images. In the reconstruction process, artifacts may be possibly produced due to the noise, especially in presence of stronger noise. In order to suppress artifacts while preserving discontinuities of images, in this paper a multiframe SR method is proposed by involving the reconstruction properties of the half-quadratic prior model together with the quadratic prior model using a convex combination. Moreover, by analyzing local features of the underlined HR image, these two prior models are combined by using an automatically calculated weight function, making both smooth and discontinuous pixels handled properly. A variational Bayesian inference (VBF) based algorithm is designed to efficiently and effectively seek the solution of the proposed method. With the VBF framework, motion parameters and hyper-parameters are all determined automatically, leading to an unsupervised SR method. The efficiency of the hybrid prior model is demonstrated theoretically and practically, which shows that our SR method can obtain better results from LR images even with stronger noise. Extensive experiments on several visual data have demonstrated the efficacy and superior performance of the proposed algorithm, which can not only preserve image details but also suppress artifacts.     

基于同步噪声选择非局部平均除噪声的最优参数

提出基于同步噪声和信噪比（SNR）自动选择非局部平均（NCM）的核函数参数的算法。为了正确估计平滑图像中的剩余噪声,一幅纯噪声图像作为同步噪声与观测图像同步进行计算,同步噪声作为图像剩余噪声的估计值。为了保持同步噪声与剩余噪声的统计特性相似,提出了一种新的NCM算子,依据图像的特征对同步噪声进行平滑,能够保持两种噪声有...     

基于非局部双边随机投影低秩逼近图像去噪算法

该文提出一种基于非局部双边随机投影的低秩逼近图像去噪新方法。首先,对每个图像块通过非局部搜索寻找相似匹配块簇,然后对相似匹配块簇进行双边随机投影,用投影后的低秩结构恢复原图像。实验结果表明,所提方法比奇异值分解方法有较低的计算复杂度,比单边随机投影方法有较小的重构误差。特别是和3维块匹配方法相比,所提方法能保持相近的信噪比和较好的视觉质量。     

基于专家场先验模型的图像超分辨重建算法

为了进一步提高图像超分辨率重建的质量,针对非局部集中稀疏表示算法中重建图像的噪声问题,提出了一种基于专家场先验模型的图像超分辨率重建改进算法。首先,利用专家场模型从图像训练集中学习整幅图像的先验知识建立全局先验模型;然后将学习到的先验信息用于非局部集中稀疏表示模型求解最优稀疏表示系数;最后,得到高分辨率图像估计。该算法在超分辨率重建迭代运算的同时,同步更新专家场模型参数,因此在不显著增加运算复杂度的情况下,通过选取合适的先验约束,有效地增强了图像重建的效果。实验结果表明:相比非局部集中稀疏表示算法,文中算法对无噪和有噪降质图像均能取得较好的峰值信噪比结果,并且能够进一步提高有噪图像的去噪效果。     

基于迭代交替优化的图像盲超分辨率重建

基于深度卷积神经网络的图像超分辨率重建算法通常假设低分辨率图像的降质是固定且已知的,如双3次下采样等,因此难以处理降质(如模糊核及噪声水平)未知的图像。针对此问题,该文提出联合估计模糊核、噪声水平和高分辨率图像,设计了一种基于迭代交替优化的图像盲超分辨率重建网络。在所提网络中,图像重建器以估计的模糊核和噪声水平作为先验信息,由低分辨率图像重建出高分辨率图像;同时,综合低分辨率图像和估计的高分辨率图像,模糊核及噪声水平估计器分别实现模糊核和噪声水平的估计。进一步地,该文提出对模糊核/噪声水平估计器及图像重建器进行迭代交替的端对端优化,以提高它们的兼容性并使其相互促进。实验结果表明,与IKC, DASR, MANet, DAN等现有算法相比,提出方法在常用公开测试集(Set5, Set14, B100,Urban100)及真实场景图像上都取得了更优的性能,能够更好地对降质未知的图像进行重建;同时,提出方法在参数量或处理效率上也有一定的优势。     

Image denoising based on non-local means filter and its method noise thresholding

Non-local means filter uses all the possible self-predictions and self-similarities the image can provide to determine the pixel weights for filtering the noisy image, with the assumption that the image contains an extensive amount of self-similarity. As the pixels are highly correlated and the noise is typically independently and identically distributed, averaging of these pixels results in noise suppression thereby yielding a pixel that is similar to its original value. The non-local means filter removes the noise and cleans the edges without losing too many fine structure and details. But as the noise increases, the performance of non-local means filter deteriorates and the denoised image suffers from blurring and loss of image details. This is because the similar local patches used to find the pixel weights contains noisy pixels. In this paper, the blend of non-local means filter and its method noise thresholding using wavelets is proposed for better image denoising. The performance of the proposed method is compared with wavelet thresholding, bilateral filter, non-local means filter and multi-resolution bilateral filter. It is found that performance of proposed method is superior to wavelet thresholding, bilateral filter and non-local means filter and superior/akin to multi-resolution bilateral filter in terms of method noise, visual quality, PSNR and Image Quality Index.     

Multi-frame super-resolution reconstruction based on mixed Poisson–Gaussian noise

In this paper, a non-blind multi-frame super-resolution (SR) model based on mixed Poisson–Gaussian noise (MPGSR) is proposed. Poisson noise arises from the stochastic nature of the photon-counting process. Readout noise and reset noise inherent to the readout circuitry can be modeled by an additive Gaussian noise. Therefore, a mixed Poisson–Gaussian noise model is more appropriate for real imaging system. Instead of deriving the data fidelity term from the perspective of error norms and the corresponding influence functions, we address the multi-frame SR problem based on a statistical noise model. The derived objective function is decomposed into sub-functions and solved by the alternating direction method of multipliers (ADMM) algorithm which allows using techniques of constrained optimization. The validation of the proposed MPGSR was performed quantitatively and qualitatively on natural and X-ray images. In comparison to the optimization-based and learning-based state-of-the-art methods, we have demonstrated the feasibility of MPGSR and the significance of applying a more appropriate noise model on the SR image reconstruction.     

基于非局部先验的深度压缩感知图像重构网络

传统的基于迭代的压缩感知(CS)图像重构算法易于集成图像先验信息,但存在性能不足、计算复杂度高等缺点。基于深度学习的图像重构算法重构性能通常优于传统的重构算法,并且具有更低的重构计算成本。因此,为了设计出一种更有效利用先验信息的深度学习图像重构算法,该文提出基于非局部先验的深度压缩感知图像重构网络。首先,将稀疏性和非局部先验相结合建立压缩感知图像重构模型,然后通过半二次方分裂法将模型分解为3个子问题,每一个子问题的求解都在深度学习的框架下展开,最后联合建立端到端的可训练的图像重构模型。仿真实验表明,在测试的采样率与数据集下该文所提算法的峰值信噪比与当前主流的重构算法SCSNet相比平均提升了0.18 dB,与CSNet算法相比平均提升了约1.59 dB,与ISTA-Net+算法相比平均提升了约2.09 dB。     

A learning-based method for compressive image recovery

Compressive sensing (CS) theory dictates that a sparse signal can be reconstructed from a few random measurements. An important issue of compressive image recovery (CIR) is that the optimal sparse space is usually unknown and/or it often varies spatially for non-stationary signals (e.g., natural images). In this paper, apart from fixed sparse spaces, prior models, specifically a set of piecewise autoregressive (AR) models that encode the common statistics of image micro-structures, are learned from example image patches, and they are then used to construct adaptive sparsity regularizers for CIR. Furthermore, a complementary non-local structural sparsity regularizer is also incorporated into the CIR process to improve the robustness. The regularization by local AR model and non-local redundancy makes the proposed CIR very effective. Experimental results on benchmark images validate that the proposed algorithm can outperform significantly previous CIR methods in terms of both PSNR and visual quality.     

结合NSST和快速非局部均值滤波的刀具图像去噪

为消除基于图像处理的刀具磨损检测中的图像噪声,提出了结合非下采样Shearlet变换(Non-subsampled Shearlet Transform, NSST)和快速非局部均值(Fast Non-local Means, FNLM)滤波的图像去噪方法。首先,利用基于决策的非对称剪切中值(Decision Based Un-symmetric Trimmed Median, DBUTM)方法滤除图像中的椒盐噪声;然后,对图像进行NSST多尺度分解,得到一个低频子带和一系列高频子带;最后,分别使用FNLM滤波和各向异性扩散模型调整低频和高频子带系数,并由调整后的各子带系数重构出噪声滤除后的图像。实验结果表明,与基于小波的阈值收缩方法、基于Contourlet的全变差模型结合各向异性扩散方法、基于NSST和标准非局部均值滤波方法相比,本文方法在主观视觉去噪效果、峰值信噪比、结构相似度以及处理速度等4个方面性能更优。      

基于非局部先验的雾线优化图像去雾算法

针对非局部先验去雾算法中雾线端点像素位置精确度不足的问题,提出了雾线优化的非局部先验图像去雾算法。首先分析雾线理论,结合暗通道理论确定最大聚类雾线真实端点,以其为已知条件补偿小聚类雾线端点与大气光之间的距离,根据类内不同像素与雾线对应夹角预估单个像素雾线端点进而求得像素级优化后的透射率,最后根据图像局部灰度值差异融合暗通道先验(dark channel prior, DCP)和非局部先验透射率得最终透射率图。将本文算法与其余3种去雾算法在多幅户外雾图下通过主观及客观两方面分析比较,实验结果表明该算法能取得更好的去雾效果,尤其在天空区域图像复原效果较为突出。     

基于标准剂量CT图像非局部权值先验的低剂量图像恢复

本文提出一种基于标准剂量CT图像非局部权值先验的低剂量图像恢复方法,该方法首先将先前标准剂量图像与低剂量CT图像配准,并对低剂量CT图像进行预处理以抑制部分噪声,随后利用非局部均值的思想计算配准后的先前标准剂量CT图像的权值矩阵,基于该权值矩阵对预处理后的低剂量CT图像进行加权均值滤波.仿真实验和临床脑灌注数据实验表明,本文方法在消除低剂量CT图像噪声和伪影的同时,还可提升图像分辨率,对临床脑灌注CT扫描的疾病诊断中尤为有效.     

Sparse intrinsic decomposition and applications

This paper proposes an intrinsic decomposition method from a single RGB-D image. To remedy the highly ill-conditioned problem, the reflectance component is regularized by a sparsity term, which is weighted by a bilateral kernel to exploit non-local structural correlation. As shading images are piece-wise smooth and have sparse gradient fields, the sparse-induced ${\ell }_1$-norm is used to regularize the finite difference of the direct irradiance component, which is the most dominant sub-component of shading and describes the light directly received by the surfaces of the objects from the light source. To derive an efficient algorithm, the proposed model is transformed into an unconstrained minimization of the augmented Lagrangian function, which is then optimized via the alternating direction method. The stability of the proposed method with respect to parameter perturbation and its robustness to noise are investigated by experiments. Quantitative and qualitative evaluation demonstrates that our method has better performance than state-of-the-art methods. Our method can also achieve intrinsic decomposition from a single color image by integrating existed depth estimation methods. We also present a depth refinement method based on our intrinsic decomposition method, which obtains more geometry details without texture artifacts. Other application, e.g., texture editing, also demonstrates the effectiveness of our method.     

基于低秩分解和改进的非局部平均的SAR图像相干斑抑制

为抑制合成孔径雷达（SAR）图像成像过程中形成的相干斑噪声,提出了一种基于低秩分解和改进的非局部平均的SAR图像相干斑去噪方法。首先将SAR图像进行对数处理,将乘性噪声转换为加性噪声;然后利用低秩稀疏分解将对数图像分解成低秩图像部分和稀疏图像部分;接着对含噪严重的稀疏图像部分分析其结构张量,生成非局部平均滤波所需的衰减因子,进行改进的非局部平均滤波去噪;最后再做图像合成,经指数变换得到去噪后的SAR图像。实验结果表明,该方法经视觉评价、边缘保持指数（EPI）和等效视数（ENL）等方面评测,具有较好的抑制噪声和保持边缘及纹理细节的能力。      

基于Zernike矩的空间视频序列时空自适应性超分辨率重建模型

Video Super-Resolution (SR) reconstruc-tion produces video sequences with High Resolu-tion (HR) via the fusion of several Low-Resolution (LR) video frames. Traditional methods rely on the accurate estimation of subpixel motion, which con-strains their applicability to video sequences with relatively simple motions such as global translation. We propose an efficient iterative spatio-temporal a-daptive SR reconstruction model based on Zernike Moment (ZM), which is effective for spatial video sequences with arbitrary motion. The model uses re-gion correlation judgment and self-adaptive thresh-old strategies to improve the effect and time effi-ciency of the ZM-based SR method. This leads to better mining of non-local self-similarity and local structural regularity, and is robust to noise and rota-tion. An efficient iterative curvature-based interpo-lation scheme is introduced to obtain the initial HR estimation of each LR video frame. Experimental results both on spatial and standard video sequences demonstrate that the proposed method outperforms existing methods in terms of both subjective visual and objective quantitative evaluations, and greatly improves the time efficiency.     

A convex variational method for super resolution of SAR image with speckle noise

Super resolution (SR) is an attractive issue in image processing. In the synthetic aperture radar (SAR) image, speckle noise is a crucial problem that is multiplicative. Therefore, numerous custom SR methods considering additive Gaussian noise cannot respond to this image degradation model. The main contribution of this paper is to propose a novel variational convex optimization model for the single SAR image SR reconstruction with speckle noise that is one of the first works in this field. Employing maximum a posteriori (MAP) estimator and proposing an effective regularization based on combination of sparse representation, total variation (TV) and a novel feature space based soft projection tool to use merits of them is the main idea. To solve the proposed model, the split Bregman algorithm is employed efficiently. Experimental results for the multiple synthetic and realistic SAR images show the effectiveness of proposed method in terms of both fidelity and visual perception.     

Dictionary learning and similarity regularization based image noise reduction

Redundant dictionary learning based image noise reduction methods explore the sparse prior of patches and have proved to lead to state-of-the-art results; however, they do not explore the non-local similarity of image patches. In this paper we exploit both the structural similarities and sparse prior of image patches and propose a new dictionary learning and similarity regularization based image noise reduction method. By formulating the image noise reduction as a multiple variables optimization problem, we alternately optimize the variables to obtain the denoised image. Some experiments are taken on comparing the performance of our proposed method with its counterparts on some benchmark natural images, and the superiorities of our proposed method to its counterparts can be observed in both the visual results and some numerical guidelines.