Image Fusion Processing for IKONOS 1-m Color Imagery

Many image fusion techniques have been developed. However, most existing fusion processes produce color distortion in 1-m fused IKONOS images due to nonsymmetrical spectral responses of IKONOS imagery. Here, we proposed a fusion process to minimize this spectral distortion in IKONOS 1-m color images. The 1-m fused image is produced from a 4-m multispectral (MS) and 1-m panchromatic (PAN) image, maintaining the relations of spectral responses between PAN and each band of the MS images. To obtain this relation, four spectral weighting parameters are added with the pixel value of each band of the original MS image. Then, each pixel value is updated using a steepest descent method to reflect the maximum spectral response on the fused image. Comparison among the proposed technique and existing processes [intensity hue saturation (IHS) image fusion, Brovey transform, principal component analysis, fast IHS image fusion] has been done. Our proposed technique has succeeded to generate 1-m fused images where spectral distortion has been reduced significantly, although some block distortions appeared at the edge of the fused images. To remove this block distortion, we also proposed a sharpening process using a wavelet transform, which removed block distortion without significant change in the color of the entire image.     

Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition

Since Chavez proposed the highpass filtering procedure to fuse multispectral and panchromatic images, several fusion methods have been developed based on the same principle: to extract from the panchromatic image spatial detail information to later inject it into the multispectral one. In this paper, we present new fusion alternatives based on the same concept, using the multiresolution wavelet decomposition to execute the detail extraction phase and the intensity-hue-saturation (IHS) and principal component analysis (PCA) procedures to inject the spatial detail of the panchromatic image into the multispectral one. The multiresolution wavelet decomposition has been performed using both decimated and undecimated algorithms and the resulting merged images compared both spectral and spatially. These fusion methods, as well as standard IHS-, PCA-, and wavelet-based methods have been used to merge Systeme Pour l'Observation de la Terre (SPOT) 4 XI and SPOT 4 M images with a ratio 4:1. We have estimated the validity of each fusion method by analyzing, visually and quantitatively, the quality of the resulting fused images. The methodological approaches proposed in this paper result in merged images with improved quality with respect to those obtained by standard IHS, PCA, and standard wavelet-based fusion methods. For both proposed fusion methods, better results are obtained when an undecimated algorithm is used to perform the multiresolution wavelet decomposition.     

Multi-spectral and hyperspectral image fusion using 3-D wavelet transform

Image fusion is performed between one band of multi-spectral image and two bands of hyperspectral image to produce fused image with the same spatial resolution as source multi-spectral image and the same spectral resolution as source hyperspeetral image. According to the characteristics and 3-Dimensional （3-D） feature analysis of multi-spectral and hyperspectral image data volume, the new fusion approach using 3-D wavelet based method is proposed. This approach is composed of four major procedures： Spatial and spectral resampling, 3-D wavelet transform, wavelet coefficient integration and 3-D inverse wavelet transform. Especially, a novel method, Ratio Image Based Spectral Resampling （RIBSR）method, is proposed to accomplish data resampling in spectral domain by utilizing the property of ratio image. And a new fusion rule, Average and Substitution （A＆S） rule, is employed as the fusion rule to accomplish wavelet coefficient integration. Experimental results illustrate that the fusion approach using 3-D wavelet transform can utilize both spatial and spectral characteristics of source images more adequately and produce fused image with higher quality and fewer artifacts than fusion approach using 2-D wavelet transform. It is also revealed that RIBSR method is capable of interpolating the missing data more effectively and correctly, and A＆S rule can integrate coefficients of source images in 3-D wavelet domain to preserve both spatial and spectral features of source images more properly.     

Practical remote sensing image fusion method based on guided filter and improved SML in the NSST domain

Due to the different characteristics of image modality, the panchromatic (PAN) and multispectral (MS) images include complementary and redundancy information in the spatial and spectral resolutions. Image fusion is an effective way to integrate the source PAN and MS images to obtain high-resolution MS image. In this paper, a novel remote sensing image fusion scheme in non-subsample Shearlet transform (NSST) domain is presented. An enhancement strategy is designed to solve the insufficiency of spatial detail in multiresolution analysis (MRA)-based methods after the intensity–hue–saturation (IHS) color space transform. Then, in the NSST fusion process, a guided filter-based low-frequency coefficient fusion rule and an improved sum-modified-Laplacian (SML)-based high-frequency coefficient fusion rule are proposed. The final fused image can be obtained through the inverse NSST transform and inverse IHS transform. Two different groups of satellite dataset are utilized to evaluate the fusion performance. The experiment results demonstrate that the proposed approach can achieve more spatial details and less spectral distortion compared with the existing methods regarding both the visual quality and the objective measurements.     

一种基于小波变换的可调节遥感影像融合方法

光谱保持和高分辨率保留是影像融合的两个重要问题,不同的应用可能对融合的结果有不同的要求．提出了一种基于小波变换的可调节遥感影像融合方法．该方法首先分别将高分辨率影像和多光谱影像进行小波分解,然后根据影像的特点,在小波域内进行影像融合,最后通过小波逆变换得到融合结果．通过引入可调节参数,该方法可以在细节保留和光谱保持两方面达到不同程度的平衡,在某些参数组合下,融合图像的目视效果和统计指标可以达到甚至超过传统的小波融合法、IHS变换和主成分变换融合法的效果．     

一种基于非采样Contourlet变换的遥感图像融合算法

为使融合后的多光谱图像尽可能保持原多光谱图像光谱特性的同时提高空间质量,提出了一种基于非采样Contourlet变换（NSCT）和多尺度边缘检测的融合算法。介绍了非采样Contourlet变换和多尺度边缘检测;设计了基于多尺度边缘检测、直接替代的高频、低频子带融合规则;用QuickBird卫星高分辨率遥感图像进行仿真实验。实验结果表明该算法能够在保持光谱信息的同时注入更丰富的空间细节信息,优于传统的Wavelet变换法和Contourlet变换法。     

基于采样二通道不可分小波的多光谱图像融合

针对基于非下采样不可分小波图像融合方法空间分辨率不高、基于张量积小波融合方法会出现方块效应的不足,提出了一种基于伸缩矩阵为[1,1;1,-1]的二通道采样不可分小波的多光谱图像和全色图像融合方法.利用矩阵扩充方法,构造了一组新的不可分低通滤波器和高通滤波器组,利用所设计滤波器组分别对多光谱图像的亮度分量和全色图像作下采样的多尺度不可分小波分解,分别对分解后的低频子图像和高频子图像按不同的融合规则进行融合.实验结果表明,其保持光谱信息的能力和保持空间分辨率信息的能力比基于IHS变换融合方法、基于DWT的融合方法、基于IHS-DWT的融合方法、基于IHS-Contourlet变换的融合方法、基于IHS-Curvelet变换的融合方法、SRF方法都强,与基于非下采样的二通道不可分正交小波和不可分双正交小波融合方法相比,该方法能保持较好的整体光谱信息和较高的空间分辨率信息.     

Multi-resolution analysis techniques and nonlinear PCA for hybrid pansharpening applications

Hyperspectral images have a higher spectral resolution (i.e., a larger number of bands covering the electromagnetic spectrum), but a lower spatial resolution with respect to multispectral or panchromatic acquisitions. For increasing the capabilities of the data in terms of utilization and interpretation, hyperspectral images having both high spectral and spatial resolution are desired. This can be achieved by combining the hyperspectral image with a high spatial resolution panchromatic image. These techniques are generally known as pansharpening and can be divided into component substitution (CS) and multi-resolution analysis (MRA) based methods. In general, the CS methods result in fused images having high spatial quality but the fused images suffer from spectral distortions. On the other hand, images obtained using MRA techniques are not as sharp as CS methods but they are spectrally consistent. Both substitution and filtering approaches are considered adequate when applied to multispectral and PAN images, but have many drawbacks when the low-resolution image is a hyperspectral image. Thus, one of the main challenges in hyperspectral pansharpening is to improve the spatial resolution while preserving as much as possible of the original spectral information. An effective solution to these problems has been found in the use of hybrid approaches, combining the better spatial information of CS and the more accurate spectral information of MRA techniques. In general, in a hybrid approach a CS technique is used to project the original data into a low dimensionality space. Thus, the PAN image is fused with one or more features by means of MRA approach. Finally the inverse projection is used to obtain the enhanced image in the original data space. These methods, permit to effectively enhance the spatial resolution of the hyperspectral image without relevant spectral distortions and on the same time to reduce the computational load of the entire process. In particular, in this paper we focus our attention on the use of Nonlinear Principal Component Analysis (NLPCA) for the projection of the image into a low dimensionality feature space. However, if on one hand the NLPCA has been proved to better represent the intrinsic information of hyperspectral images in the feature space, on the other hand an analysis of the impact of different fusion techniques applied to the nonlinear principal components in order to define the optimal framework for the hybrid pansharpening has not been carried out yet. More in particular, in this paper we analyze the overall impact of several widely used MRA pansharpening algorithms applied in the nonlinear feature space. The results obtained on both synthetic and real data demonstrate that an accurate selection of the pansharpening method can lead to an effective improvement of the enhanced hyperspectral image in terms of spectral quality and spatial consistency, as well as a strong reduction in the computational time.     

一种基于提升小波变换的图像融合方法

在针对传统的多尺度分解的融合方法运算速度慢、内存需求量大，不适于实时应用的局限性的基础上，提出了一种基于提升小波变换的图像融合算法。多个源图像分别进行提升小波分解，使用恰当的融合规则合并各尺度对应的分解系数，通过提升小波逆变换得到融合图像。实验结果表明，提出的算法无论在执行时间还是融合图像质量上都优于传统方法，有广泛的应用前景，特别适用于实时系统。     

The Enriched Feature Enhancement Technique for Satellite Image Based on Transforms Using PCNN

The features of the satellite images can be improved by fusing or combining two images with complementary property. By fusing these two images the spatial property of the resultant image is improved. Satellite images are one of the agents that give the features of the earth’s surface. Processing these satellite images will provide more geographical information hidden in the images. This research paper have an detailed insight study of two types of the satellite images one is Panchromatic (PAN) and other Multispectral (MS). The PAN image with high spatial resolution and MS image with spectral resolution are fused to get better resultant output. For fusion process Nonsubsampled Contour let Transform is used to decompose the images into low and high frequency values. Pulse Coupled Neural Network is used to motivate the low frequency pixel and Morphological filter is applied to the edge detected image for finding the features in the images. This is an real time transformations which will give better results in SAR image processing, video processing, stereo based reconstruction of depth and width of the features present in the image.

     

Generalized IHS‐Based Satellite Imagery Fusion Using Spectral Response Functions

Image fusion is a technical method to integrate the spatial details of the high‐resolution panchromatic (HRP) image and the spectral information of low‐resolution multispectral (LRM) images to produce high‐resolution multispectral images. The most important point in image fusion is enhancing the spatial details of the HRP image and simultaneously maintaining the spectral information of the LRM images. This implies that the physical characteristics of a satellite sensor should be considered in the fusion process. Also, to fuse massive satellite images, the fusion method should have low computation costs. In this paper, we propose a fast and efficient satellite image fusion method. The proposed method uses the spectral response functions of a satellite sensor; thus, it rationally reflects the physical characteristics of the satellite sensor to the fused image. As a result, the proposed method provides high‐quality fused images in terms of spectral and spatial evaluations. The experimental results of IKONOS images indicate that the proposed method outperforms the intensity‐hue‐saturation and wavelet‐based methods.     

Landsat ETM+ and SAR image fusion based on generalized intensity Modulation

This work presents a novel multisensor image fusion algorithm, which extends panchrmomatic sharpening of multispectral (MS) data through intensity modulation to the integration of MS and synthetic aperture radar (SAR) imagery. The method relies on SAR texture, extracted by ratioing the despeckled SAR image to its low-pass approximation. SAR texture is used to modulate the generalized intensity (GI) of the MS image, which is given by a linear transform extending intensity-hue-saturation transform to an arbitrary number of bands. Before modulation, the GI is enhanced by injection of high-pass details extracted from the available panchrmomatic image by means of the "a/spl grave/-trous" wavelet decomposition. The texture-modulated panchrmomatic-sharpened GI replaces the GI calculated from the resampled original MS data. Then, the inverse transform is applied to obtain the fusion product. Experimental results are presented on Landsat-7 Enhanced Thematic Mapper Plus and European Remote Sensing 2 satellite images of an urban area. The results demonstrate accurate spectral preservation on vegetated regions, bare soil, and also on textured areas (buildings and road network) where SAR texture information enhances the fusion product, which can be usefully applied for both visual analysis and classification purposes.     

基于方向区域的NSCT图像融合算法

提出一种新的基于方向区域的NSCT图像融合算法。算法首先对源图像进行NSCT分解,获得不同方向的高低频子带。其次对高低频系数,根据不同分解层的方向特性,按方向区域能量的规则进行融合。最后,通过反变换获得融合图像。该方法既保留了Contourlet变换方法的多尺度多方向特性,又具有移不变性。实验结果表明,提出的算法有效可行,对比常用的区域融合算法,获得了更好的融合效果。     

基于小波变换和视觉特性的多光谱图像融合

本文提出了一种基于小波变换和人眼视觉系统特性的多光谱图像融合算法。首先对已配准的源图像进行小波多尺度分解;其次基于视觉系统提出一种新的融合规则,即分别将对应的高低频分量分割成若干个块,计算出每个块的对比度方差,通过文中所构造的一种自适应的阈值方法,选取两幅图像中清晰的图像块形成新的高低频分量;最后,通过小波反演变换重构多光谱图像。实验结果表明,这种方法不仅能很好的增强多光谱图像的空间细节能力及光谱信息,而且能避免增强结果出现振铃效应,是一种十分有效的融合方法。     

High spectral quality pansharpening approach based on MTF-matched filter banks

Pansharpening consists in merging a low-resolution multispectral image (MS) with a high spatial resolution panchromatic image (PAN) to produce a high resolution pansharpened MS image. It consists in enhancing spatially the low-resolution MS image by injecting the missing details provided by the high-resolution PAN image. In this paper, we propose a novel pansharpening approach based on decomposition/reconstruction processing using low-pass and high-pass filter banks. On the one hand, the low-pass approximation (taking into account the imaging system modulation transfer function MTF) of the pansharpened MS image is assumed to be equal to the original MS image in order to preserve the spectral quality. On the other hand, the high-pass filter allowing us to extract the high-frequency PAN details is designed as complementary filter to the low-pass one in order to provide perfect reconstruction in the ideal case. Quantitative assessment performed on reduced and full-resolution images are used to validate the proposed technique and compare it to state-of-art. Experimental results using Pléaides and GeoEye-1 data show that our proposed fusion schema outperforms the pre-existing methods visually as well as quantitatively.     

Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics

Our framework is the synthesis of multispectral images (MS) at higher spatial resolution, which should be as close as possible to those that would have been acquired by the corresponding sensors if they had this high resolution. This synthesis is performed with the help of a high spatial but low spectral resolution image: the panchromatic (Pan) image. The fusion of the Pan and MS images is classically referred as pan-sharpening. A fused product reaches good quality only if the characteristics and differences between input images are taken into account. Dissimilarities existing between these two data sets originate from two causes-different times and different spectral bands of acquisition. Remote sensing physics should be carefully considered while designing the fusion process. Because of the complexity of physics and the large number of unknowns, authors are led to make assumptions to drive their development. Weaknesses and strengths of each reported method are raised and confronted to these physical constraints. The conclusion of this critical survey of literature is that the choice in the assumptions for the development of a method is crucial, with the risk to drastically weaken fusion performance. It is also shown that the Amelioration de la Resolution Spatiale par Injection de Structures concept prevents from introducing spectral distortion into fused products and offers a reliable framework for further developments.     

Fast multiresolution motion estimation algorithms for wavelet-based scalable video coding

Motion estimation and compensation in wavelet domain have received much attention recently. To overcome the inefficiency of motion estimation in critically sampled wavelet domain, the low-band-shift (LBS) method and the complete-to-overcomplete discrete wavelet transform (CODWT) method are proposed for motion estimation in shift-invariant wavelet domain. However, a major disadvantage of these methods is the computational complexity. Although the CODWT method has reduced the computational complexity by skipping the inverse wavelet transform and making the direct link between the critically sampled subbands and the shift-invariant subbands, the full search algorithm (FSA) increases it. In this paper, we proposed two fast multiresolution motion estimation algorithms in shift-invariant wavelet domain: one is the wavelet matching error characteristic based partial distortion search (WMEC-PDS) algorithm, which improves computational efficiency of conventional partial distortion search algorithms while keeping the same estimate accuracy as the FSA; another is the anisotropic double cross search (ADCS) algorithm using multiresolution-spatio-temporal context, which provides a significantly computational load reduction while only introducing negligible distortion compared with the FSA. Due to the multiresolution nature, both the proposed approaches can be applied to wavelet-based scalable video coding. Experimental results show the superiority of the proposed fast motion estimation algorithms against other fast algorithms in terms of speed-up and quality.     

An orthogonal wavelet representation of multivalued images

A new orthogonal wavelet representation of multivalued images is presented. The idea for this representation is based on the concept of maximal gradient of multivalued images. This concept is generalized from gradients toward linear vector operators in the image plane with equal components along rows and columns. Using this generalization, the pyramidal dyadic wavelet transform algorithm using quadrature mirror filters is modified to be applied to multivalued images. This results in a representation of a single image, containing multiscale detail information from all component images involved. This representation leads to multiple applications ranging from multispectral image fusion to color and multivalued image enhancement, denoising and segmentation. In this paper, the representation is applied for fusion of images. More in particular, we introduce a scheme to merge high spatial resolution greylevel images with low spatial resolution multivalued images to improve spatial resolution of the latter while preserving spectral resolution. Two applications are studied: demosaicing of color images and merging of multispectral remote sensing images.     

基于小波的全局多源遥感图像信息融合方法

提出的图像信息融合方法用于解决传统方法在空间分辨率等方面的不足。原始图像经过小波变换，分解成子图像，再进行分块处理，高、低分辨率图像根据全局方差准则分别计算融合的权值系数，进行图像融合重建，然后，对图像采用全局法进行信息融合，实验表明，方法切实可行，能使低分辨率图像接近于高分辨率图像。     

基于点扩散函数的机载光电吊舱图像增强融合

为更好地融合机载光电吊舱中多源图像的特征信息,提出一种利用点扩散函数(PSF)对多源图像进行增强融合的方法。采用刃边法和小波变换法分别对红外和可见光图像进行点扩散函数求取,利用维纳滤波恢复得到增强图像,然后采用高斯和双边联合滤波对图像进行多尺度混合分解,针对不同尺度下的分解图像,在确定融合权重时引入红外和可见光图像点扩散函数的半幅全宽(FWHM)比值作为分辨率补偿因子,以获得更高质量的融合图像。实验结果表明通过引入点扩散函数信息,光电吊舱系统的获得的融合图像能够具有更好的对比度和分辨率信息,主观和客观评价结果都有所改善。