Fusion of Multispectral and Panchromatic Images Using a Restoration-Based Method

Many remote-sensing satellites can obtain images in multispectral and panchromatic bands. By fusing low-resolution multispectral and high-resolution panchromatic images, one can obtain high-resolution multispectral images. In this paper, an image fusion algorithm based on image restoration is proposed to combine multispectral and panchromatic images. For remote-sensing satellites, the wavelength of the panchromatic band usually covers the wavelengths of the multispectral bands. This relationship between the two kinds of images is useful for fusion. In our approach, the low-resolution multispectral images are first resampled to the scale of the high-resolution panchromatic image. The relationship between these two kinds of images is then used to restore the resampled multispectral images. That is, the resampled multispectral images are modeled as the noisy blurred versions of the ideal multispectral images, and the high-resolution panchromatic image is modeled as a linear combination of the ideal multispectral images plus the observation noise. The ideal high-resolution multispectral images are then estimated based on the panchromatic and the resampled multispectral images. A closed-form solution of the fused images is derived here. Experiments show that the proposed fusion algorithm works effectively in integrating multispectral and panchromatic images.     

基于多级引导滤波器的图像区域融合算法

为了提高多光谱图像与全色图像的融合质量,研究了多种滤波器和融合算法,提出了基于多级引导滤波器的区域融合方法。采用该方法对多光谱图像进行插值,利用改进的分水岭算法对全色图像进行区域划分,并将划分结果映射至每个多光谱图像,然后将多光谱图像与全色图像利用多级引导滤波器分别进行滤波,得到各自的细节信息,最后根据每个区域中全色图像和多光谱图像的关系指标局部相关系数与4阶相关系数的大小,对细节信息进行区域融合,得到融合后的多光谱图像。结果表明,该算法充分保留了多光谱图像的光谱信息,并尽可能多地注入了全色图像的细节信息,成功地提高了多光谱图像的融合效果。     

基于NSCT的多光谱和全色图像的融合

提出了一种基于无下采样Contourlet变换的多光谱和全色图像的融合方法.该方法在对多光谱影像进行IHS变换的基础上,对多光谱的I分量和高分辨率的全色影像分别进行无下采样Contourlet变换(NSCT),然后对分解得到的近似分量以及各层金字塔各方向的细节分量利用本文提出的一定的融合准则分别对近似分量和细节分量进行影像融合,最后通过无下采样Conlourlet逆变换得到新的I分量,与H,S分量一起还原到RGB空间,最终得到融合后的高分辨率多光谱彩色图像.本文采用一组多光谱图像和全色图像数据进行融合实验,其实验融合图像的目视效果和统计指标均优于传统的IHS融合方法、小波融合方法以及Contourlet变换方法.     

A simulated annealing restoration algorithm for restoring halftoned color-quantized images

Restoration of color-quantized images is rarely addressed in the literature especially when the images are color-quantized with halftoning. Most existing restoration algorithms are generally inadequate to deal with this problem as they were proposed for restoring noisy blurred images. In this paper, a restoration algorithm based on simulated annealing is proposed to solve the problem. This algorithm makes a good use of the available color palette and the mechanism of a halftoning process to derive useful a priori information for restoration. Simulation results show that it can improve the quality of a halftoned color-quantized image remarkably in terms of both SNR and CIELAB color difference metric. The subjective quality of the restored images can also be improved.     

An improved image blind deblurring based on dark channel prior

In order to solve the ringing effect caused by the incorrect estimation of the blur kernel, an improved blind image deblurring algorithm based on the dark channel prior is proposed. First, in the blur kernel estimation stage, high-pass filtering is introduced to enhance the image quality and enhance the edge information to make the blur kernel estimation more accurate. A combination of super Laplacian prior and dark channel prior is introduced to estimate the potential clear image. Then the accurate blur kernel is estimated through alternate iterations from coarse to fine. In the image restoration stage, a weighted least square filter is introduced to suppress the ringing effect of the original clear image to further improve the quality of image restoration. Finally, image deconvolution based on Laplace priors and L₀ regularized priors is used to restore clear images. Experimental results show that our approach improves the peak signal-to-noise ratio(PSNR) by about 0.4 d B and structural similarity(SSIM) by about 0.01, respectively. Compared with the existing image deblurring algorithms, this method can estimate the blur information more accurately, so that the restored image can achieve the effect of keeping the edges and removing ringing.     

一种用于水下图像的光谱重构方法:理论及应用

多光谱成像是一项非常有前景的图像高保真获取与再现技术,近年来在水下物体颜色还原的应用中也受到的极大的需求和关注。然而,不同于空气中的物体的成像过程,在水下成像过程中,当光通过水而进行传播,光被水体严重吸收和散射,导致图像变暗,在其光谱和颜色方面发生模糊和扭曲。文中讨论的是基于水下图像的水衰减系数的校准和其多光谱图像的光谱重构。首先在不同的距离处获取物体的图像,提出了基于不同距离的图像进行水体衰减系数的校准并恢复原始图像的技术;在此基础上,分析并导出满足系数校准和图像复原所需的在不同距离获取到的最少的原始图像个数。最后,通过比较复原的水下图像与空气中获取的彩色图像,实验结果证明:文中提出的技术能够对水下光谱图像的进行精确颜色复原,所有测试图像的平均相对残留误差仅为5.87％。     

A POCS-based restoration algorithm for restoring halftoned color-quantized images.

This paper studies the restoration of images which are color-quantized with error diffusion. Though there are many reported algorithms proposed for restoring noisy blurred color images and inverse halftoning, restoration of color-quantized images is rarely addressed in the literature especially when the images are color-quantized with halftoning. Direct application of existing restoration techniques are generally inadequate to deal with this problem. In this paper, a restoration algorithm based on projection onto convex sets is proposed. This algorithm makes use of the available color palette and the mechanism of a halftoning process to derive useful a priori information for restoration. Simulation results showed that it could improve the quality of a halftoned color-quantized image remarkably in terms of both SNR and CIELAB color difference metric.     

Real time interpolation algorithm based on Lanczos kernel

In order to improve the timeliness and reliability of color image scaling algorithms,a high effective real-time color image scaling algorithm was proposed,which first generated the kernel look up table that could be used for whole target image based on Lanczos kernel,and interpolation of all target image pixels had only fixed point operation which had low computational complexity.Meanwhile,an optimized method for rasterizing pixels of target image was proposed,which needed little memory space but embraced high efficiency of memory utilization.The experiment results show that the proposed algorithm achieves good image quality,and the computational complexity is far more less than classic image scaling algorithms.So the proposed algorithm can effectively implement real-time resizing of color images and color videos in any scaling factors.     

基于变分的多尺度遥感图像融合算法

全色图像与多光谱图像融合时,忽略了上采样的重要性和通道间细节的差异性.针对前者,利用不同尺度下自相似块,估计出低分辨率图像丢失信息,从而修改了图像上采样的策略,并以此构造目标函数的保真项;针对后者,利用全色图像和光谱图像梯度域结构相似性,提出局部加权动态稀疏约束,构造目标函数的正则项.本文基于变分法理论,构造了新的目标函数,并提出了多尺度迭代融合框架,通过多次迭代逐步提高融合图像的分辨率,每一层的融合结果更加准确,从而提高最终的融合精度.本文算法与Brovey等成分替代算法、P+XS等变分算法、MTF_GLP等多分辨分析算法进行比较.实验结果表明,本算法的融合结果具有良好的视觉效果,且在客观评价指标上比所有对比算法的最优值平均值均有提高.     

Restoration of multispectral images by the gradient reconstruction method and estimation of the blur parameters on the basis of the multipurpose matching model

In this study, an original method for restoration of multispectral images by means of gradient reconstruction is proposed. The method uses a simple relationship between the gradient at the neighboring points in the distorted image and the gradient at distant points in the initial image. The result of restoration by the proposed algorithm excels the result obtained by the standard method based on the Wiener filtering. A new method for estimation of the parameters of the distorting motion-blur operator is also proposed. In this case, the blurred image is considered as a superposition of M shifted original images, and the autocorrelation convolution of the distorted image can be represented as a linear combination of M ² mutual convolutions of several identical shifted images. Thus, the autocorrelation function of the distorted image is a straight line passing through the center, and the direction of this line and its length coincides with the parameters of the distorting operator. As compared to the best present-day algorithms, the proposed method exhibits higher accuracy of parameter estimation. In addition, computation of parameters with the use of this method takes much less time than with the use of popular estimation algorithms based on the Radon transform.     

基于支持向量机的湍流退化图像加速复原算法

由于湍流图像的退化原因十分复杂,现有图像复原算法很难在复原效率和复原质量间达到很好的平衡,为此提出了一种基于支持向量机的湍流退化图像加速复原算法.该算法通过设置方差阈值进行样本选择,舍弃了冗余信息、提高了样本质量;同时,对序列图像进行实时模型更新,加快了序列图像的复原速度.针对电弧风洞图像,将加速复原算法和原算法进行了比较.实验结果表明,加速算法的复原速度更快、复原效果也更好,它可以有效地解决湍流退化给图像带来的噪声和能量衰减问题,并能很好地校正湍流效应引起的模糊和抖动现象.     

Novel cooperative neural fusion algorithms for image restoration and image fusion.

To deal with the problem of restoring degraded images with non-Gaussian noise, this paper proposes a novel cooperative neural fusion regularization (CNFR) algorithm for image restoration. Compared with conventional regularization algorithms for image restoration, the proposed CNFR algorithm can relax need of the optimal regularization parameter to be estimated. Furthermore, to enhance the quality of restored images, this paper presents a cooperative neural fusion (CNF) algorithm for image fusion. Compared with existing signal-level image fusion algorithms, the proposed CNF algorithm can greatly reduce the loss of contrast information under blind Gaussian noise environments. The performance analysis shows that the proposed two neural fusion algorithms can converge globally to the robust and optimal image estimate. Simulation results confirm that in different noise environments, the proposed two neural fusion algorithms can obtain a better image estimate than several well known image restoration and image fusion methods.     

A Hybrid Contextual Approach to Wildland Fire Detection Using Multispectral Imagery

We propose a hybrid contextual fire detection algorithm for airborne and satellite thermal images. The proposed algorithm essentially treats fire pixels as anomalies in images and can be considered a special case of the more general clutter or background suppression problem. It utilizes the local background around a potential fire pixel and discriminates fire pixels based on the squared Mahalanobis distance in multispectral feature space. It also employs the normalized thermal index to identify background fire pixels that should be excluded from the calculation of the statistical properties of the local background. The use of the squared Mahalanobis distance naturally incorporates the covariance of the multispectral image into the decision and requires the setting of a single detection threshold. By contrast, previous contextual algorithms only incorporate the statistical properties of individual bands and require the manual setting of multiple thresholds. Compared with the latest Moderate Resolution Imaging Spectroradiometer fire product (version 4), our algorithm improves user accuracy and producer accuracy by 1.5% and 2.6% on average, respectively, and up to 28% for some images. In addition, the novel use of the squared Mahalanobis distance allows us to create fire probability images that are useful for fire propagation modeling. As an example, we demonstrate this use for the airborne data.     

A VQ-based blind image restoration algorithm

Learning-based algorithms for image restoration and blind image restoration are proposed. Such algorithms deviate from the traditional approaches in this area, by utilizing priors that are learned from similar images. Original images and their degraded versions by the known degradation operator (restoration problem) are utilized for designing the VQ codebooks. The codevectors are designed using the blurred images. For each such vector, the high frequency information obtained from the original images is also available. During restoration, the high frequency information of a given degraded image is estimated from its low frequency information based on the codebooks. For the blind restoration problem, a number of codebooks are designed corresponding to various versions of the blurring function. Given a noisy and blurred image, one of the codebooks is chosen based on a similarity measure, therefore providing the identification of the blur. To make the restoration process computationally efficient, the principal component analysis (PCA) and VQ-nearest neighbor approaches are utilized. Simulation results are presented to demonstrate the effectiveness of the proposed algorithms.     

Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition

Since Chavez proposed the highpass filtering procedure to fuse multispectral and panchromatic images, several fusion methods have been developed based on the same principle: to extract from the panchromatic image spatial detail information to later inject it into the multispectral one. In this paper, we present new fusion alternatives based on the same concept, using the multiresolution wavelet decomposition to execute the detail extraction phase and the intensity-hue-saturation (IHS) and principal component analysis (PCA) procedures to inject the spatial detail of the panchromatic image into the multispectral one. The multiresolution wavelet decomposition has been performed using both decimated and undecimated algorithms and the resulting merged images compared both spectral and spatially. These fusion methods, as well as standard IHS-, PCA-, and wavelet-based methods have been used to merge Systeme Pour l'Observation de la Terre (SPOT) 4 XI and SPOT 4 M images with a ratio 4:1. We have estimated the validity of each fusion method by analyzing, visually and quantitatively, the quality of the resulting fused images. The methodological approaches proposed in this paper result in merged images with improved quality with respect to those obtained by standard IHS, PCA, and standard wavelet-based fusion methods. For both proposed fusion methods, better results are obtained when an undecimated algorithm is used to perform the multiresolution wavelet decomposition.     

基于图像先验和结构特征的盲图像复原算法

提出了一种基于图像先验和图像结构特征的盲图像复原算法,在模糊核未知的情况下,采用一系列离散化的模糊核参数对模糊图像进行非盲去卷积,得到一系列对应的复原图像。同时提出一种复原图像判决准则,对这一系列复原图像进行质量判决,从中得到最优的复原图像。最后在实验部分,通过对图像的测试表明,提出的盲图像复原算法能较准确的得到最优复原图像,复原效果在主观和客观标准上均有良好表现。     

基于分裂Bregman算法的单帧运动图像盲去模糊

提出一种基于分裂Bregman算法的单帧运动图像盲去模糊方法,该算法分为模糊核估计和图像复原两个阶段.在估计模糊核时,首先利用双边滤波器去除图像中的噪声,再采用改进的冲激滤波器对图像进行边缘增强,选取有用的边缘信息估计模糊核,并对估计出的模糊核进行修正,从而得到高质量的模糊核.图像复原阶段,利用分裂Bregman算法交替迭代得到去模糊后的图像.该算法具有降噪和边缘增强的功能,并能保持图像总变分不变,使图像复原效果更好且计算时间有大幅降低.     

Spectral-spatial adaptive and well-balanced flow-based anisotropic diffusion for multispectral image denoising

Anisotropic diffusion can provide better compromise between noise reduction and edge preservation. In multispectral images, there exist different spatial local structures in the same band. Therefore, the levels of smoothing of anisotropic diffusion process should conform to both of image spectral and spatial features. In this paper, we present an effective denoising algorithm by integrating the spectral-spatial adaptive mechanism into a well-balanced flow (WBF) based anisotropic diffusion model, in which an adjustable weighted function is introduced to perform the appropriate levels of smoothing and enhancing according to different feature scales. Moreover, we make the fidelity term in the model to be adaptive by replacing the original noisy signal with the last evolution of the smoothed image. Consequently, the proposed algorithm can better control the diffusion behavior than traditional multispectral diffusion-based algorithms. The experimental results verify that our algorithm can improve visual quality of the image and obtain better quality indices.     

基于模糊核优化的图像盲去模糊算法

针对图像的模糊算法优化问题,首先选取高斯分布拟合自然图像的分布特性,利用双边滤波器从模糊图像中提取出清晰的图像边缘。针对降噪进行参数设置,在初步估计出模糊核之后,对模糊核进行正规化修正工作。最后在图像复原阶段,利用优化的凸函数拟合自然图像分布,并利用快速傅里叶变换提高算法计算速度。实验结果,表明该模糊核优化算法与现有的其他算法相比,复原后的图像具有更好的视觉效果,且计算时间减少约20%。