非局部的变分正则化图像放大算法

针对Chambolle图像放大模型存在分块效应,提出一种非局部的变分正则化图像放大算法。该算法的思想是构造一个适用于图像放大的变分泛函,该泛函由正则项和数据保真项构成,其中图像的正则项是用非局部全变差范数进行估计,进而用迭代投影方法求泛函的最小解,即为放大后的图像。与传统的图像插值方法不同,该算法是用变分的思想进行图像放大,非局部全变差的引入更使得该算法不只是利用图像的单个像素点,或某一邻域内的灰度和梯度信息进行放大,而是更大范围地利用了图像本身的信息,这将更有效地保留图像特征,避免了Chambolle方法在图像放大时出现的分块效应。实验结果表明,该算法能更好地保留边缘和细节信息,放大图像的清晰度比Chambolle图像放大方法和样条插值的效果要好。     

Error estimation for Bregman iterations and inverse scale space methods in image restoration

Summary In this paper, we consider error estimation for image restoration problems based on generalized Bregman distances. This error estimation technique has been used to derive convergence rates of variational regularization schemes for linear and nonlinear inverse problems by the authors before (cf. Burger in Inverse Prob 20: 1411–1421, 2004; Resmerita in Inverse Prob 21: 1303–1314, 2005; Inverse Prob 22: 801–814, 2006), but so far it was not applied to image restoration in a systematic way. Due to the flexibility of the Bregman distances, this approach is particularly attractive for imaging tasks, where often singular energies (non-differentiable, not strictly convex) are used to achieve certain tasks such as preservation of edges. Besides the discussion of the variational image restoration schemes, our main goal in this paper is to extend the error estimation approach to iterative regularization schemes (and time-continuous flows) that have emerged recently as multiscale restoration techniques and could improve some shortcomings of the variational schemes. We derive error estimates between the iterates and the exact image both in the case of clean and noisy data, the latter also giving indications on the choice of termination criteria. The error estimates are applied to various image restoration approaches such as denoising and decomposition by total variation and wavelet methods. We shall see that interesting results for various restoration approaches can be deduced from our general results by just exploring the structure of subgradients.      

Total Variation Wavelet Thresholding

We propose using Partial Differential Equation (PDE) techniques in wavelet based image processing to remove noise and reduce edge artifacts generated by wavelet thresholding. We employ a variational framework, in particular the minimization of total variation (TV), to select and modify the retained wavelet coefficients so that the reconstructed images have fewer oscillations near edges while noise is smoothed. Numerical experiments show that this approach improves the reconstructed image quality in wavelet compression and in denoising.     

自适应非局部数据保真项和双边总变分的图像去噪模型

针对常见去噪方法容易造成特定区域过度平滑、奇异结构残余噪声以及产生阶梯效应和对比度损失等问题,提出一种自适应非局部数据保真项和双边总变分的图像去噪模型,建立了自适应非局部正则化能量泛函和相应的变分框架。首先,对噪声图像利用自适应权值的非局部均值求得数据拟合项;其次,引入双边总变分正则化项,利用正则化系数来适度平衡数据拟合项和正则化项的影响;最后,通过能量函数最小化对不同的噪声统计快速求得最优解,从而达到降低残余噪声并纠正过度平滑的目的。通过理论分析和针对模拟噪声图像与真实噪声图像的实验结果表明,所提出的图像去噪模型能够较好地处理具有不同统计特性的图像噪声,与自适应非局部均值滤波去噪相比,所提算法的峰值信噪比（PSNR）值最多可以得到0.6 dB的改善;与全变分正则化图像去噪算法比较,所提算法的主观视觉效果明显更好,在去噪的同时图像纹理和边缘等细节信息保护得更好,PSNR值最多可以提高10 dB,而多尺度结构相似性度（MS-SSIM）指标可以提升0.3。因此,所提出的图像去噪模型可以在理论上更好地探讨如何合理处理噪声和图像内容本身的高频细节信息,在视频和图像分辨率提升等领域也具有良好的实际应用价值。     

Image Restoration via Tight Frame Regularization and Local Constraints

In this paper, we propose two variational image denosing/deblurring models which combine tight frame regularization with two types of existing local constraints. Additive white Gaussian noise is assumed in the models. By Lagrangian multiplier method, the local constraints correspond to the fidelity term with spatial adaptive parameters. As the fidelity parameter is bigger in the image regions with textures than in the cartoon region, our models can recover more texture while denoising/deblurring. Fast numerical schemes are designed for the two models based on split Bregman (SB) technique and doubly augmented Lagrangian (DAL) method with acceleration. In the experiments, we show that the proposed models have better performance compared with the existing total variation based image restoration models with global or local constraints and the frame based model with global constraint.     

Combining deblurring and denoising for handheld HDR imaging in low light conditions

This paper proposes a probability formulation that unifies both single-image deblurring and multi-image denoising using variational inference. The proposed formulation is based on a theoretical analysis that compares denoising and deblurring in the same probabilistic framework, and supported by a practical approach that deal with general motion that creates HDR images in the presence of spatially varying motion. Based on this formulation, a new algorithm for deblurring a noisy and blurry image pair is presented. Besides, we provide also an approach that combines existing optical flow and image denoising techniques for High Dynamic Range imaging.     

Locally adaptive image denoising by a statistical multiresolution criterion

It is shown how to choose the smoothing parameter in image denoising by a statistical multiresolution criterion, both globally and locally. Using inhomogeneous diffusion and total variation regularization as examples for localized regularization schemes, an efficient method for locally adaptive image denoising is presented. As expected, the smoothing parameter serves as an edge detector in this framework. Numerical examples together with applications in confocal microscopy illustrate the usefulness of the approach.     

总变差正则化断层图像重建的解耦Bregman迭代算法

在断层重建的很多工程应用中,由于低剂量以及成像硬件等原因,经常需要在测量数据不充分的情况下去重建图像。基于图像分段光滑的假设,提出采用误差的加权范数作为数据保真项,TV（total variation）作为正则项的断层图像重建模型。该模型求解时,首先通过引入代理函数将原问题解耦为残差的加权范数最小化和加权范数TV去噪这两个子问题;然后采用了Chambolle的对偶空间正交投影法的框架对加权范数TV去噪问题进行求解,避免了由于TV项在不可导处所带来的计算不稳定;最后,为了提高收敛速度并且避免由正则化参数选取所引起的数值不稳定,引入Bregman方法,给出该模型的快速迭代算法。在扇形束少角度欠采样的条件下,对理想情况和高斯噪声情况下进行仿真测试,并同多种算法进行了比较。实验结果表明,该算法重建效果好,收敛速度快。     

基于总变差的图像放大和增强方法

利用小波的多分辨分析和总变差极小原理,提出了一种实现图像放大和增强的新方法。该方法把原图像作为放大图像的小波子带,对放大图像强加了一种小波系数型的限制。放大图像利用图像总变差极小模型进行正则化。经求变分产生带限制的非线性扩散方程作为总变差极小的必要条件,求解偏微分方程得到增强的放大图像。对人工合成图像、医学MRI心脏切片和人物图像进行了实验。实验结果说明该方法同时实现图像放大和增强的有效性。     

A new image denoising scheme using support vector machine classification in shiftable complex directional pyramid domain

Edge-preserving image denoising has become a very intensive research topic. In this paper, we propose a new image denoising scheme using support vector machine (SVM) classification in shiftable complex directional pyramid (PDTDFB) domain. Firstly, the noisy image is decomposed into different subbands of frequency and orientation responses using a PDTDFB transform. Secondly, the feature vector for a pixel in a noisy image is formed by the spatial regularity in PDTDFB domain, and the least squares support vector machine (LS-SVM) model is obtained by training. Then the PDTDFB detail coefficients are divided into two classes (edge-related coefficients and noise-related ones) by LS-SVM training model. Finally, the detail subbands of PDTDFB coefficients are denoised by using the different parameters to control the multiscale and multidirectional anisotropic diffusion. Extensive experimental results demonstrate that our method can obtain better performances in terms of both subjective and objective evaluations than those state-of-the-art denoising techniques. Especially, the proposed method can preserve edges very well while removing noise.     

全变差最小化在CT图像环状伪影去除中的应用

环状伪影是多种CT图像中普遍存在的一种伪影,主要由像元响应不理想等因素引起。全变差最小化是一种广泛使用的去噪方法,将全变差最小化应用于CT图像,在模拟投影数据中人为添加噪声并重建,使用全变差最小化进行处理,观察图像环状伪影的去除情况,并得出了图像峰值信噪比随全变差最小化次数的变化曲线。     

非线性扩散图像去噪中的耦合自适应保真项研究

讨论了一种基于非线性扩散方程的图像去噪方法.在讨论了图像去噪的3个基本要求的基础上,总结了平均曲率运动去噪模型和总变差去噪模型中利用保真项的不足.将利用图像的局部信息构造的自适应保真项引入到方向扩散去噪模型中,克服了原有方法在耦合保真项上的不足,使新的非线性扩散去噪模型能够在有效地去除噪声的同时很好地保持目标尖角、边缘等重要的几何结构.实验结果表明,耦合自适应保真项的扩散方程能够很好地保持图像中目标的几何结构,同时具有良好的去噪能力.     

基于广义变分模型的自适应图像去噪算法

通过分析全变分(TV)去噪模型的优缺点,提出了一种新的改进算法。该算法根据最大后验概率(MAP)和马尔可夫随机场(MRF)的理论,推导出一个广义变分的图像去噪模型,并对平衡正则化项和数据保真项的Lagrange乘子λ进行了自适应改进,最后采用了一种鲁棒性好和边缘保持能力强的势函数,结合梯度加权最速下降法和半点格式的数值迭代算法对自适应的广义变分去噪模型寻优求解。实验结果表明,新模型能很好地应用于图像去噪,与现有的算法相比,在峰值信噪比有所提高的同时,图像的主观视觉效果也更好。     

Operator Splittings,Bregman Methods and Frame Shrinkage in Image Processing

We examine the underlying structure of popular algorithms for variational methods used in image processing. We focus here on operator splittings and Bregman methods based on a unified approach via fixed point iterations and averaged operators. In particular, the recently proposed alternating split Bregman method can be interpreted from different points of view—as a Bregman, as an augmented Lagrangian and as a Douglas-Rachford splitting algorithm which is a classical operator splitting method. We also study similarities between this method and the forward-backward splitting method when applied to two frequently used models for image denoising which employ a Besov-norm and a total variation regularization term, respectively. In the first setting, we show that for a discretization based on Parseval frames the gradient descent reprojection and the alternating split Bregman algorithm are equivalent and turn out to be a frame shrinkage method. For the total variation regularizer, we also present a numerical comparison with multistep methods.     

Fast Multiresolution Algorithms and Their Related Variational Problems for Image Denoising

When considering fast multiresolution techniques for image denoising problems, there are three important aspects. The first one is the choice of the specific multiresolution, the second one the choice of a proper filter function and the third one the choice of the thresholding parameter. Starting from the classical one, namely, linear wavelet algorithms with Donoho and Johnstone’s Soft-thresholding with the universal shrinkage parameter, the first aim of this paper is to improve it in the three mentioned directions. Thus, a new nonlinear approach is proposed and analyzed. On the other hand, the linear approach of Donoho and Johnstone is related with a well known variational problem. Our second aim is to find a related variational problem, more adapted to the denoising problem, for the new approach. We would like to mention that the analysis of theoretical properties in a nonlinear setting are usually notoriously more difficult. Finally, a comparison with other approaches, including linear and nonlinear multiresolution schemes, SVD-based schemes and filters with a non-multiresolution nature, is presented.     

整体曲率变分水平集方法的曲面去噪模型

针对曲面去噪问题,提出了一种基于整体曲率变分水平集方法的曲面去噪模型。该模型是应用于图像去噪的ROF模型在几何形状处理中的自然拓展。它基于隐式水平集变分方法,能够自动处理曲面拓扑结构的变化。对该能量模型采用变分水平集方法求其梯度最速下降方程,通过演化该方程,最终得到模型最优解。为使计算结果更加准确,采用了半点差分格式离散。实验结果表明,该模型具有良好的去噪性能,同时能有效地保持曲面中的特征信息。     

A New TV-Stokes Model with Augmented Lagrangian Method for Image Denoising and Deconvolution

Recently, TV-Stokes model has been widely researched for various image processing tasks such as denoising and inpainting. In this paper, we introduce a new TV-Stokes model for image deconvolution, and propose fast and efficient iterative algorithms based on the augmented Lagrangian method. The new TV-Stokes model is a two-step model: in the first step, a smoothed and divergence free tangential field of the observed image is recovered based on total variation (TV) minimization and a new data fidelity term; in the second step, the image is reconstructed by minimizing the distance between the unit image gradient and the regularized unit normal direction. Numerical experiments demonstrate that the proposed model has the potential to outperform popular TV-based restoration methods in preserving texture details and fine structures. As a result, an improvement in signal-to-noise ratio (SNR) is obtained for deconvolution and denoising results.     

小波域上图像非线性扩散滤波

提出一个小波域上图像扩散滤波恢复新模型。主要思想是把原图像作为最精细尺度下的小波子带，根据噪声分布的特点，导出保护较大尺度下信息的泛函模型代替小波阈值除噪，对泛函求变分得：Euler-Lagrange方程。新的滤波方法能避免小波阈值除噪的伪Gibbs现象，改进了同类型非线性扩散方程滤波的效果。利用可加算子分裂(AOS)格式求非线性扩散方程的数值解。实例的数值计算说明对图像滤波和保护边缘的有效性。     

Subdivision Schemes for Quadrilateral Meshes with the Least Polar Artifact in Extraordinary Regions

This paper presents subdivision schemes with subdivision stencils near an extraordinary vertex that are free from or with substantially reduced polar artifact in extraordinary regions while maintaining the best possible bounded curvature at extraordinary positions. The subdivision stencils are firstly constructed to meet tangent plane continuity with bounded curvature at extraordinary positions. They are further optimized towards curvature continuity at an extraordinary position with additional measures for removing or for minimizing the polar artifact in extraordinary regions. The polar artifact for subdivision stencils of lower valences is removed by applying an additional constraint to the subdominant eigenvalue to be the same as that of subdivision at regular vertices, while the polar artifact for subdivision stencils of higher valances is substantially reduced by introducing an additional thin‐plate energy function and a penalty function for maintaining the uniformity and regularity of the characteristic map. A new tuned subdivision scheme is introduced by replacing subdivision stencils of Catmull‐Clark subdivision with that from this paper for extraordinary vertices of valences up to nine. We also compare the refined meshes and limit surface quality of the resulting subdivision scheme with that of Catmull‐Clark subdivision and other tuned subdivision schemes. The results show that subdivision stencils from our method produce well behaved subdivision meshes with the least polar artifact while maintaining satisfactory limit surface quality.     

Bilateral normal filtering for mesh denoising

Decoupling local geometric features from the spatial location of a mesh is crucial for feature-preserving mesh denoising. This paper focuses on first order features, i.e., facet normals, and presents a simple yet effective anisotropic mesh denoising framework via normal field denoising. Unlike previous denoising methods based on normal filtering, which process normals defined on the Gauss sphere, our method considers normals as a surface signal defined over the original mesh. This allows the design of a novel bilateral normal filter that depends on both spatial distance and signal distance. Our bilateral filter is a more natural extension of the elegant bilateral filter for image denoising than those used in previous bilateral mesh denoising methods. Besides applying this bilateral normal filter in a local, iterative scheme, as common in most of previous works, we present for the first time a global, noniterative scheme for an isotropic denoising. We show that the former scheme is faster and more effective for denoising extremely noisy meshes while the latter scheme is more robust to irregular surface sampling. We demonstrate that both our feature-preserving schemes generally produce visually and numerically better denoising results than previous methods, especially at challenging regions with sharp features or irregular sampling.