基于2D-TDI及运动补偿的红外图像增强算法

针对红外图像的特点,提出了一种基于2D-TDI及运动补偿的新方法。将序列红外图像根据运动特性进行多分辨运动估计,然后根据得到的运动矢量进行2D-TDI。多分辨运动估计的引入,提高了运动估计对噪声的抗干扰能力,并有效地减小了运算量。该算法克服了传统图像直接叠加引入的图像边缘模糊的缺点,并能明显提高图像的信噪比。用真实的红外图像序列进行了处理,实验证明了算法的优越性,并取得了满意的效果。     

Robust Noise Estimation Based on Noise Injection

Noise estimation is an important premise for image denoising and many other image processing applications, and related research has drawn increasing attention and interest. In this paper, a novel noise level estimation algorithm is proposed by investigating the distribution of local variances in natural images. There are two major contributions of this work to tackle with the challenges in noise estimation: 1) a wavelet decomposition based preliminary estimation stage to alleviate the influence of image’s textural or structural information; 2) a noise injection based estimation stage to simulate the impact of noise-free image content on the variance distribution, which otherwise almost always leads to overestimation. The cascade scheme of this two-step estimation procedure can reduce the detrimental influence of textural image regions effectively and therefore relieves overestimation of the noise variance. Moreover, the proposed method is not limited to any specific type of noise distribution. Extensive experiments and comparative analysis demonstrate that the proposed algorithm can reliably infer noise levels and has robust performance over a wide range of visual content, as compared to relevant methods.     

基于自适应差分量化的红外背景抑制新方法

针对复杂背景下红外弱小目标图像的背景抑制难题,从图像采集环节考虑,根据自适应差分量化理论,提出了一种基于自适应背景抑制的红外弱小目标图像采集方法.其基本思想是:根据红外弱小目标图像背景杂波的相关性,利用自适应预测器,由已采集的像素信息实时估计出下一时刻背景杂波的最佳估计,并将其反馈至原始图像信号输出端,与实际采集图像信号相比较.通过量化残差图像信号来获得预测增益,从而提高采集图像的信噪比.理论分析与仿真实验表明,与传统的直接图像采集方法相比,此方法不仅等效地提高模数转化器的性能,而且能够很大程度地提高采集图像的信噪比(SNR),SNR可由1.43提高到4.57.     

采用KPCA和BP神经网络的单目车载红外图像深度估计

提出一种基于监督学习得到深度估计模型的单目车载红外图像深度估计方法。首先用核主成分分析法（KPCA）筛选红外图像特征。将最初提取的红外图像特征用核函数非线性映射到一个线性可分的高维特征空间,再完成主成分分析（PCA）,得到降维后的红外图像特征。然后以BP神经网络为模型基础,对红外图像特征和深度值进行训练,训练后的深度估计模型可对单目车载红外图像的深度分布进行估计。实验结果证明,利用该模型估计的单目车载红外图像的深度信息与原红外图像的深度信息一致。     

基于三角形网格的立体视差估计和遮挡点检测混合算法

本文提出一种新的用于立体图像编码的视差估计和遮挡点检测混合算法.其中的视差估计方法利用极线约束条件,在缩小搜索范围的同时提高了视差估计的准确性.遮挡点检测方法仅使用了匹配点唯一性约束和视差梯度限制这两个基本条件,降低了算法的复杂度.整个算法利用DT(Dalaunay triangulation)网格这一数学工具把散乱的点结合起来进行处理,使算法在实现方面更加简单化.本文算法首先对立体图像对中的左图像进行DT网格剖分,把各三角形的顶点作为"特征点"在右图像中寻找它们的匹配点.然后利用匹配点唯一性条件提取出其中一些顶点进行遮挡检测.实验结果表明,本文算法对"特征点"的视差估计比较准确,也能较为准确地检测出其中的遮挡点.借助DT 网格在图像编码方面的优势,本文算法可以方便地用于立体图像编码.     

Video super resolution based on non-local regularization and reliable motion estimation

Video super-resolution (SR) is a process for reconstructing high-resolution (HR) images by utilizing complementary information among multiple low-resolution (LR) images. Accurate estimation of the motion among the LR images significantly affects the quality of the reconstructed HR image. In this paper, we analyze the possible reasons for the inaccuracy of motion estimation and then propose a multi-lateral filter to regularize the process of motion estimation. This filter can adaptively correct motion estimation according to the estimation reliability, image intensity discontinuity, and motion dissimilarity. Furthermore, we introduce a non-local prior to solve the ill-posed problem of HR image reconstruction. This prior can fully utilize the self-similarities existing in natural images to regularize the HR image reconstruction. Finally, we employ a Bayesian formulation to incorporate the two regularizations into one Maximum a Posteriori (MAP) estimation model, where the HR image and the motion estimation can be refined progressively in an alternative and iterative manner. In addition, an algorithm that estimates the blur kernel by analyzing edges in an image is also presented in this paper. Experimental results demonstrate that the proposed approaches are highly effective and compare favorably to state-of-the-art SR algorithms.     

Approximate maximum likelihood hyperparameter estimation for Gibbspriors

The parameters of the prior, the hyperparameters, play an important role in Bayesian image estimation. Of particular importance for the case of Gibbs priors is the global hyperparameter, beta, which multiplies the Hamiltonian. Here we consider maximum likelihood (ML) estimation of beta from incomplete data, i.e., problems in which the image, which is drawn from a Gibbs prior, is observed indirectly through some degradation or blurring process. Important applications include image restoration and image reconstruction from projections. Exact ML estimation of beta from incomplete data is intractable for most image processing. Here we present an approximate ML estimator that is computed simultaneously with a maximum a posteriori (MAP) image estimate. The algorithm is based on a mean field approximation technique through which multidimensional Gibbs distributions are approximated by a separable function equal to a product of one-dimensional (1-D) densities. We show how this approach can be used to simplify the ML estimation problem. We also show how the Gibbs-Bogoliubov-Feynman (GBF) bound can be used to optimize the approximation for a restricted class of problems. We present the results of a Monte Carlo study that examines the bias and variance of this estimator when applied to image restoration.     

基于SVD-SURF的宽基线鲁棒景象匹配算法

提出一种基于SVD-SURF的宽基线鲁棒景象匹配算法。首先,在实时图与基准图奇异值分解的基础上构建SURF尺度空间,运用快速Hessian矩阵定位极值点;然后,计算出图像的64维SURF描述子;最后,通过Hessian矩阵迹进行特征点匹配,并利用RANSAC参数估计方法剔除出格点,从而实现位置参数的精确估计。实测航空图像序列位置估计实验表明了该景象匹配算法对图像的旋转、尺度变换及噪声不敏感,具有较强的实时性、精确性和鲁棒性。     

Image modeling using interscale phase properties of complex wavelet coefficients.

This paper describes an approach to image modelling using interscale phase relationships of wavelet coefficients for use in image estimation applications. The method is based on the dual tree complex wavelet transform, but a phase rotation is applied to the coefficients to create complex "derotated" coefficients. These derotated coefficients are shown to have increased correlation compared to standard wavelet coefficients near edge and ridge features allowing improved signal estimation in these areas. The nature of the benefits brought by the derotated coefficients are analyzed and the implications for image estimation algorithm design noted. The observations and conclusions provide a basis for design of the denoising algorithm in [1].     

Estimation of 2-D noisy fractional Brownian motion and itsapplications using wavelets

The two-dimensional (2-D) fractional Brownian motion (fBm) model is useful in describing natural scenes and textures. Most fractal estimation algorithms for 2-D isotropic fBm images are simple extensions of the one-dimensional (1-D) fBm estimation method. This method does not perform well when the image size is small (say, 32x32). We propose a new algorithm that estimates the fractal parameter from the decay of the variance of the wavelet coefficients across scales. Our method places no restriction on the wavelets. Also, it provides a robust parameter estimation for small noisy fractal images. For image denoising, a Wiener filter is constructed by our algorithm using the estimated parameters and is then applied to the noisy wavelet coefficients at each scale. We show that the averaged power spectrum of the denoised image is isotropic and is a nearly 1/f process. The performance of our algorithm is shown by numerical simulation for both the fractal parameter and the image estimation. Applications to coastline detection and texture segmentation in a noisy environment are also demonstrated.     

基于位平面匹配和卡尔曼滤波的视频稳定

针对数字视频帧间平移抖动的稳定问题,介绍一种基于局部求精位平面匹配运动估计和约束卡尔曼滤波运动校正的视频稳定算法。运动估计首先结合了灰阶比特平面匹配和菱形搜索策略得到初步的估计结果,然后在其附近再以最小绝对差（MAD）为测度,搜索更为准确的运动估计结果。这种运动估计方法在保证估计精度的前提下,显著地减少了运动估计需要的计算量。运动校正则考虑到实际稳像系统对校正量可能存在的某些约束,对绝对帧位移曲线采用约束卡尔曼滤波,得到平滑的位移曲线,有效地降低了帧间抖动的幅度,同时保证了校正矢量不超过稳像系统的实际校正能力。仿真实验表明,该算法具有精度高、速度快的特点,尤其适用于实时视频稳定。     

深度学习辅助的5G OFDM系统的信道估计

传统的信道估计算法难以满足5G系统中的高速率低时延的需求。针对该问题,将通信信道的时频响应视为二维图像,提出了一种基于图像恢复技术的信道估计方法。首先,设定参数产生基于5G 新空口（ New Radio,NR）标准的物理下行链路共享信道（ Physical Downlink Shared Channel,PDSCH）的信道数据信息数据集,将所产生的信道矩阵看作二维图像;然后,构建基于卷积神经网络的图像恢复网络,并融入残差连接来提高网络的性能;最后,利用训练好的网络模型进行信道估计。仿真结果表明,与最小二乘算法（Least Square,LS）、实际信道估计（Practical Channel Estimation,PCE）和基于图像超分辨率ChannelNet网络相比,所提出的信道估计算法性能提升明显。     

模型基编码的运动参数估计及误差准则

在人脸序列的图像编码中 ,模型基编码方法可以获得高的主观图像质量和低的码率 ,而受到广泛重视。但是 ,其运动参数的可靠估计还是一个难点 ,而且也没有一个较好的适合视觉特性的误差准则。本文提出了基于特征点的运动参数估计算法 ,并根据边沿 ,亮度和端点特性来自动提取特征点及自适应调整点的数目。提出用重建的图像的质量来估价运动参数误差 ,并给出了误差面积和轮廓转折率误差二个函数。这二个函数较好地反映了运动参数误差引入的图像几何失真。     

High-quality non-blind image deconvolution with adaptive regularization

Non-blind image deconvolution is a process that obtains a sharp latent image from a blurred image when a point spread function (PSF) is known. However, ringing and noise amplification are inevitable artifacts in image deconvolution since perfect PSF estimation is impossible. The conventional regularization to reduce these artifacts cannot preserve image details in the deconvolved image when PSF estimation error is large, so strong regularization is needed. We propose a non-blind image deconvolution method which preserves image details, while suppressing ringing and noise artifacts by controlling regularization strength according to local characteristics of the image. In addition, the proposed method is performed fast with fast Fourier transforms so that it can be a practical solution to image deblurring problems. From experimental results, we have verified that the proposed method restored the sharp latent image with significantly reduced artifacts and it was performed fast compared to other non-blind image deconvolution methods.     

Optical flow estimation based on the structure–texture image decomposition

Optical flow approaches for motion estimation calculate vector fields which determine the apparent velocities of objects in time-varying image sequences. Image motion estimation is a fundamental issue in low-level vision and is used in many applications in image sequence processing, such as robot navigation, object tracking, image coding and structure reconstruction. The accuracy of optical flow estimation algorithms has been improving steadily as evidenced by results on the Middlebury optical flow benchmark. Actually, several methods are used to estimate the optical flow, but a good compromise between computational cost and accuracy is hard to achieve. This work presents a combined local–global total variation approach with structure–texture image decomposition. The combination is used to control the propagation phenomena and to gain robustness against illumination changes, influence of noise on the results and sensitivity to outliers. The resulted method is able to compute larger displacements in a reasonable time.     

Estimation of image noise variance

A novel algorithm for estimating the noise variance of an image is presented. The image is assumed to be corrupted by Gaussian distributed noise. The algorithm estimates the noise variance in three steps. At first the noisy image is filtered by a horizontal and a vertical difference operator to suppress the influence of the (unknown) original image. In a second step a histogram of local signal variances is computed. Finally a statistical evaluation of the histogram provides the desired estimation value. For a comparison with several previously published estimation methods an ensemble of 128 natural and artificial test images is used. It is shown that with the novel algorithm more accurate results can be achieved     

Nonlinear image estimation using piecewise and local image models

We introduce a new approach to image estimation based on a flexible constraint framework that encapsulates meaningful structural image assumptions. Piecewise image models (PIMs) and local image models (LIMs) are defined and utilized to estimate noise-corrupted images, PIMs and LIMs are defined by image sets obeying certain piecewise or local image properties, such as piecewise linearity, or local monotonicity. By optimizing local image characteristics imposed by the models, image estimates are produced with respect to the characteristic sets defined by the models. Thus, we propose a new general formulation for nonlinear set-theoretic image estimation. Detailed image estimation algorithms and examples are given using two PIMs: piecewise constant (PICO) and piecewise linear (PILI) models, and two LIMs: locally monotonic (LOMO) and locally convex/concave (LOCO) models. These models define properties that hold over local image neighborhoods, and the corresponding image estimates may be inexpensively computed by iterative optimization algorithms. Forcing the model constraints to hold at every image coordinate of the solution defines a nonlinear regression problem that is generally nonconvex and combinatorial. However, approximate solutions may be computed in reasonable time using the novel generalized deterministic annealing (GDA) optimization technique, which is particularly well suited for locally constrained problems of this type. Results are given for corrupted imagery with signal-to-noise ratio (SNR) as low as 2 dB, demonstrating high quality image estimation as measured by local feature integrity, and improvement in SNR.     

太赫兹光场成像的深度估计方法与实验研究

在前期工作中,通过对太赫兹光场图像进行离散余弦变换(Discrete Cosine Transform,DCT)滤波和数字重聚焦,初步实现了图像去噪和前后景分割。为了进一步得到质量更高的太赫兹光场原数据并达到更加精确的深度分割效果,改进了实验方案及处理方法,并提出了一种基于极平面图像(Epipolar Plane Image,EPI)的太赫兹光场深度估计方法。在太赫兹图像特性的基础上,给出了深度与视差的关系,并利用局部视差和置信度构建了全局深度图,从而达到了深度估计的目的。最后,在实验中通过10×10的相机阵列采集太赫兹光场数据,得到了准确聚焦于不同平面的重聚焦结果和高分辨度的深度估计图,实现了太赫兹光场成像的深度估计。     

A spectral color correction framework for medical applications

This paper presents a new spectral approach to color correction for medical image analysis applications. Linear estimation with regularization by a constrained principal eigenvector method is used for calibration of the camera system and estimation of the illumination spectrum while spectral surface reflectivities are determined by Wiener inverse estimation. Nonlinear devices are handled by piecewise linear interpolation and any linear color preprocessing inside the camera is explicitly modeled. All measurement and estimation processes are combined into a spectral calibration framework for practical application in computer-assisted image analysis. The novelty of our approach lies in the generalization of the image formation model allowing for linear preprocessing inside the camera system. Such transforms would lead to erroneous results with positivity constraint based algorithms or a monochromator based measurement. We provide experimental results from a comprehensive set of reference measurements acquired with a video endoscopy system for gastroscopic application.     

Kernel estimation from salient structure for robust motion deblurring

Blind image deblurring algorithms have been improving steadily in the past years. Most state-of-the-art algorithms, however, still cannot perform perfectly in challenging cases, especially in large blur setting. In this paper, we focus on how to estimate a good blur kernel from a single blurred image based on the image structure. We found that image details caused by blur could adversely affect the kernel estimation, especially when the blur kernel is large. One effective way to remove these details is to apply image denoising model based on the total variation (TV). First, we developed a novel method for computing image structures based on the TV model, such that the structures undermining the kernel estimation will be removed. Second, we applied a gradient selection method to mitigate the possible adverse effect of salient edges and improve the robustness of kernel estimation. Third, we proposed a novel kernel estimation method, which is capable of removing noise and preserving the continuity in the kernel. Finally, we developed an adaptive weighted spatial prior to preserve sharp edges in latent image restoration. Extensive experiments testify to the effectiveness of our method on various kinds of challenging examples.