基于采样二通道不可分小波的多光谱图像融合

针对基于非下采样不可分小波图像融合方法空间分辨率不高、基于张量积小波融合方法会出现方块效应的不足,提出了一种基于伸缩矩阵为[1,1;1,-1]的二通道采样不可分小波的多光谱图像和全色图像融合方法.利用矩阵扩充方法,构造了一组新的不可分低通滤波器和高通滤波器组,利用所设计滤波器组分别对多光谱图像的亮度分量和全色图像作下采样的多尺度不可分小波分解,分别对分解后的低频子图像和高频子图像按不同的融合规则进行融合.实验结果表明,其保持光谱信息的能力和保持空间分辨率信息的能力比基于IHS变换融合方法、基于DWT的融合方法、基于IHS-DWT的融合方法、基于IHS-Contourlet变换的融合方法、基于IHS-Curvelet变换的融合方法、SRF方法都强,与基于非下采样的二通道不可分正交小波和不可分双正交小波融合方法相比,该方法能保持较好的整体光谱信息和较高的空间分辨率信息.     

基于多级引导滤波器的图像区域融合算法

为了提高多光谱图像与全色图像的融合质量,研究了多种滤波器和融合算法,提出了基于多级引导滤波器的区域融合方法。采用该方法对多光谱图像进行插值,利用改进的分水岭算法对全色图像进行区域划分,并将划分结果映射至每个多光谱图像,然后将多光谱图像与全色图像利用多级引导滤波器分别进行滤波,得到各自的细节信息,最后根据每个区域中全色图像和多光谱图像的关系指标局部相关系数与4阶相关系数的大小,对细节信息进行区域融合,得到融合后的多光谱图像。结果表明,该算法充分保留了多光谱图像的光谱信息,并尽可能多地注入了全色图像的细节信息,成功地提高了多光谱图像的融合效果。     

基于非下采样三通道不可分对称小波的多光谱图像融合

针对IHS变换融合方法不能保持好的光谱信息,张量积小波变换融合方法生成的融合结果图像空间分辨率偏低、且易产生方块效应等不足.提出了一种基于三通道不可分对称小波的多光谱图像融合方法.利用矩阵扩充的方法,给出了三通道不可分对称小波滤波器组的构造方法,用所构造的不可分小波滤波器组分别对多光谱图像的亮度分量和全色图像作非下采样...     

基于多特征的高光谱与全色图像融合方法

高光谱分辨率的高光谱图像与高空间分辨率的全色图像融合可以综合两类图像的优势。将全色图像与高光谱部分波段分别融合,再合成假彩色图像是融合的有效思路。引进多分辨率分析框架,首先对源图像进行小波变换,得到低频系数与高频系数;然后从中提取平均梯度特征和边缘特征分别作为两类系数融合的依据;最后将融合后的系数经过小波逆变换还原为各波段融合图像,进行假彩色合成得到最终的彩色融合图。实验结果表明,与PCA、HIS等经典方法相比,本文方法不仅能够在保证融合效率前提下有效保持光谱信息,提高融合图像的空间分辨率,融合图像的标准差、平均梯度、信息熵等各项指标也均优于其他融合方法。     

基于艇载遥感成像数据的高空间分辨率全色遥感图像仿真

高空间分辨率全色遥感图像在军事侦察、地面监视等领域具有较高的应用价值.为模拟星载全色遥感图像, 提出了一种由艇载遥感成像系统获取的低空遥感图像为数据源的高空间分辨率全色遥感图像仿真方法.首先将低空宽视场图像按典型地物类型进行监督分类, 其次将低空宽视场图像与多光谱图像按不同地物类型分类拟合, 并将多光谱拟合结果合成高空间分辨率全色仿真图像, 最后对高空间分辨率全色仿真图像进行仿真精度评价.相比星载全色遥感图像, 仿真图像同样具备高空间分辨率、全色波段、宽视场等特点.仿真方法可为星载全色遥感图像仿真提供较准确的数据支撑.     

采用区域互信息的多光谱与全色图像融合算法

为了提高多光谱与全色图像融合算法质量,提出了一种采用区域互信息的多光谱与全色图像融合算法。首先将多光谱图像变换至HSV彩色空间,并采用分水岭与区域合并的方法对V分量进行区域分割,得到区域分割映射,欧氏光谱距离作为区域合并的测度。然后采用非下采样Contourlet变换（Nonsubsample Contourlet Transform,NSCT）对多光谱图像V分量和全色图像进行多分辨率分解,将区域分割结果映射至全色图像,通过计算对应区域间的互信息对多分辨率分解系数进行融合,获得融合图像的分解系数,最后通过NSCT反变换实现融合图像重构。图像融合算法对比实验表明,文中融合算法在充分保留了多光谱图像光谱信息的同时,尽可能多地注入了全色图像的细节信息,有效提高了多光谱图像的边缘特征。     

联合多流融合和多尺度学习的卷积神经网络遥感图像融合方法

为尽可能保持原始低分辨率多光谱(LRMS)图像光谱信息的同时,显著提高融合后的多光谱图像的空间分辨率,该文提出一种联合多流融合和多尺度学习的卷积神经网络遥感图融合方法.首先将原始MS图像输入频谱特征提取子网得到其光谱特征,然后分别将通过梯度算子处理全色图像得到的梯度信息和通过卷积后的全色图像与得到的光谱特征图在通道上拼...     

基于Contourlet系数局部特征的选择性遥感图像融合算法

为了使融合后的多光谱图像在显著提高空间分辨率的同时,尽可能多地保持原始多光谱特性,提出了一种基于Contourlet变换系数局部特征的选择性遥感图像融合方法。根据多光谱和全色图像融合过程中Contourlet变换后的低频和高频部分融合目的的不同,对得到的近似和各层各方向的细节分量分别运用窗口邻域移动模板逐一计算相应区域Contourlet系数阵的不同局部特征量,然后选择适当的准则,对图像的近似和细节分量分别应用不同的策略在Contourlet系数域内进行选择性融合,通过Contourlet和亮度-色调-饱和度(IHS)逆变换得到融合的高分辨率多光谱图像。采用Landsat TM多光谱和SPOT全色图像进行的融合实验结果表明:提出的算法在显著提高空间分辨率的同时,又能很好地保持原始图像的光谱特征,并优于传统的融合方法。     

PHI高光谱数据和高空间分辨率遥感图像融合技术研究

提出了一种新的高光谱图像融合技术———基于最佳指数准则的高光谱小波包图像融合方法,即首先利用最佳指数选择高光谱的最佳合成波段,得到低分辨率的彩色合成影像,然后采用一种基于区域多特征的小波包融合算法进行融合处理.文中利用上海地区PH I高光谱数据和高分辨率全色航空像片来验证算法的有效性,实验结果表明该方法可有效的实现高光谱数据和高空间分辨率遥感图像的融合处理.     

基于区域特征的高光谱与全色图像NSCT域融合方法

针对高光谱图像解译需求,提出了一种基于目标检测理论的NSCT域高光谱图像与全色图像融合方法。首先对高光谱图像进行RX异常目标检测,得到目标背景分离图像;然后对参与融合的波段图像进行无下采样轮廓波分解,得到不同分辨率的低频子带和多方向的带通子带;对于背景区域的低频子带系数和高频子带系数,分别采用加权平均和平均梯度自适应加权的融合策略,对于目标区域,则根据不同特征采用区域方差自适应加权的低频系数融合方法和区域方差取大的高频系数融合方法;最后进行NSCT逆变换得到融合图像。实验结果表明,本文提出的融合方法能够有效提高高光谱图像的目视效果,突出目标与背景区域的差异,有利于目视解译工作的进行。     

Fusion of Multispectral and Panchromatic Images Using a Restoration-Based Method

Many remote-sensing satellites can obtain images in multispectral and panchromatic bands. By fusing low-resolution multispectral and high-resolution panchromatic images, one can obtain high-resolution multispectral images. In this paper, an image fusion algorithm based on image restoration is proposed to combine multispectral and panchromatic images. For remote-sensing satellites, the wavelength of the panchromatic band usually covers the wavelengths of the multispectral bands. This relationship between the two kinds of images is useful for fusion. In our approach, the low-resolution multispectral images are first resampled to the scale of the high-resolution panchromatic image. The relationship between these two kinds of images is then used to restore the resampled multispectral images. That is, the resampled multispectral images are modeled as the noisy blurred versions of the ideal multispectral images, and the high-resolution panchromatic image is modeled as a linear combination of the ideal multispectral images plus the observation noise. The ideal high-resolution multispectral images are then estimated based on the panchromatic and the resampled multispectral images. A closed-form solution of the fused images is derived here. Experiments show that the proposed fusion algorithm works effectively in integrating multispectral and panchromatic images.     

基于NSCT的多光谱和全色图像的融合

提出了一种基于无下采样Contourlet变换的多光谱和全色图像的融合方法.该方法在对多光谱影像进行IHS变换的基础上,对多光谱的I分量和高分辨率的全色影像分别进行无下采样Contourlet变换(NSCT),然后对分解得到的近似分量以及各层金字塔各方向的细节分量利用本文提出的一定的融合准则分别对近似分量和细节分量进行影像融合,最后通过无下采样Conlourlet逆变换得到新的I分量,与H,S分量一起还原到RGB空间,最终得到融合后的高分辨率多光谱彩色图像.本文采用一组多光谱图像和全色图像数据进行融合实验,其实验融合图像的目视效果和统计指标均优于传统的IHS融合方法、小波融合方法以及Contourlet变换方法.     

A comparative analysis of image fusion methods

There are many image fusion methods that can be used to produce high-resolution multispectral images from a high-resolution panchromatic image and low-resolution multispectral images. Starting from the physical principle of image formation, this paper presents a comprehensive framework, the general image fusion (GIF) method, which makes it possible to categorize, compare, and evaluate the existing image fusion methods. Using the GIF method, it is shown that the pixel values of the high-resolution multispectral images are determined by the corresponding pixel values of the low-resolution panchromatic image, the approximation of the high-resolution panchromatic image at the low-resolution level. Many of the existing image fusion methods, including, but not limited to, intensity-hue-saturation, Brovey transform, principal component analysis, high-pass filtering, high-pass modulation, the a/spl grave/ trous algorithm-based wavelet transform, and multiresolution analysis-based intensity modulation (MRAIM), are evaluated and found to be particular cases of the GIF method. The performance of each image fusion method is theoretically analyzed based on how the corresponding low-resolution panchromatic image is computed and how the modulation coefficients are set. An experiment based on IKONOS images shows that there is consistency between the theoretical analysis and the experimental results and that the MRAIM method synthesizes the images closest to those the corresponding multisensors would observe at the high-resolution level.     

Remote Sensing Image Fusion Using Multiscale Mapped LS-SVM

The panchromatic (Pan) sharpening of multispectral (MS) bands is an important technique in the various applications of satellite remote sensing. This paper presents an MS Pan- sharpening method using the proposed multiscale mapped least-squares support vector machine (LS-SVM). Under the LS-SVM framework, the salient features underlying the image are represented by support values, and the support value transform (SVT) is developed for image information extraction. The low-resolution MS bands are resampled to the fine scale of the Pan image and sharpened by injecting the detailed features extracted from the high-resolution Pan image. The support value analysis is implemented by using a series of multiscale support value filters that are deduced from the mapped LS-SVM with multiscale Gaussian radial basis function kernels. Experiments are carried out on very high resolution QuickBird MS + Pan data. Fusion simulations on spatially degraded data, whose original MS bands are available for reference, show that the proposed MS Pan-sharpening method performs comparable to the state-of-the-art in terms of the pertained quantitative quality evaluation indexes, such as the Spectral Angle Mapper, relative dimensionless global error in synthesis (ERGAS), modulation-transfer-function-based tool and quality index (Q4), etc. The SVT is an effective tool for remote sensing image fusion.     

High spectral quality pansharpening approach based on MTF-matched filter banks

Pansharpening consists in merging a low-resolution multispectral image (MS) with a high spatial resolution panchromatic image (PAN) to produce a high resolution pansharpened MS image. It consists in enhancing spatially the low-resolution MS image by injecting the missing details provided by the high-resolution PAN image. In this paper, we propose a novel pansharpening approach based on decomposition/reconstruction processing using low-pass and high-pass filter banks. On the one hand, the low-pass approximation (taking into account the imaging system modulation transfer function MTF) of the pansharpened MS image is assumed to be equal to the original MS image in order to preserve the spectral quality. On the other hand, the high-pass filter allowing us to extract the high-frequency PAN details is designed as complementary filter to the low-pass one in order to provide perfect reconstruction in the ideal case. Quantitative assessment performed on reduced and full-resolution images are used to validate the proposed technique and compare it to state-of-art. Experimental results using Pléaides and GeoEye-1 data show that our proposed fusion schema outperforms the pre-existing methods visually as well as quantitatively.     

一种图像融合新算法

将小波的多分辨分解、进化策略与IHS变换有机地结合起来,提出了一种多光谱与高分辨率图像融合的新算法。该方法首先依据高分辨率图像经小波分解得到的各小波面,进行区域划分,再采用分区域加边缘有效因子的融合思想,使得融合图像最大限度地保留了多光谱图像的光谱信息和高分辨率图像的空间分辨率。文中给出了该方法的融合结果,并与IHS法、MWD法进行了比较,证明了该图像融合方法的有效性。     

基于离散向量小波变换的多光谱图像融合

为了能够更好地把多光谱图像和高分辨率图像的图像信息综合起来,以提高对图像信息的分析和提取能力,在研究了离散向量小波图像分析法之后,本文提出了一种基于离散向量小波变换的像素级图像融合新方法。向量小波作为标量小波的一种扩展具有很多标量小波所没有的优点。向量小波分析能够为图像提供一种比标量小波多分辨分析更加精细的分析方法。利用向量小波将多光谱图像和高分辨率图像进行融合后得到的融合图像,能够很好地将原图像的细节融合在一起。给出了该方法的融合结果,通过与其它融合方法进行主观与客观的评价比较,证明该融合方法可以获得更好的融合效果。     

Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods

Usual image fusion methods inject features from a high spatial resolution panchromatic sensor into every low spatial resolution multispectral band trying to preserve spectral signatures and improve spatial resolution to that of the panchromatic sensor. The objective is to obtain the image that would be observed by a sensor with the same spectral response (i.e., spectral sensitivity and quantum efficiency) as the multispectral sensors and the spatial resolution of the panchromatic sensor. But in these methods, features from electromagnetic spectrum regions not covered by multispectral sensors are injected into them, and physical spectral responses of the sensors are not considered during this process. This produces some undesirable effects, such as resolution overinjection images and slightly modified spectral signatures in some features. The authors present a technique which takes into account the physical electromagnetic spectrum responses of sensors during the fusion process, which produces images closer to the image obtained by the ideal sensor than those obtained by usual wavelet-based image fusion methods. This technique is used to define a new wavelet-based image fusion method.     

基于变分的多尺度遥感图像融合算法

全色图像与多光谱图像融合时,忽略了上采样的重要性和通道间细节的差异性.针对前者,利用不同尺度下自相似块,估计出低分辨率图像丢失信息,从而修改了图像上采样的策略,并以此构造目标函数的保真项;针对后者,利用全色图像和光谱图像梯度域结构相似性,提出局部加权动态稀疏约束,构造目标函数的正则项.本文基于变分法理论,构造了新的目标函数,并提出了多尺度迭代融合框架,通过多次迭代逐步提高融合图像的分辨率,每一层的融合结果更加准确,从而提高最终的融合精度.本文算法与Brovey等成分替代算法、P+XS等变分算法、MTF_GLP等多分辨分析算法进行比较.实验结果表明,本算法的融合结果具有良好的视觉效果,且在客观评价指标上比所有对比算法的最优值平均值均有提高.