基于改进型NSCT 变换的灰度可见光与红外图像融合方法

针对灰度可见光与红外图像融合,提出一种基于改进型非下采样轮廓波变换(NSCT)的图像融合方法.不同于经典NSCT模型,改进型NSCT变换摈弃了细节捕捉能力不强的非下采样金字塔分解机制,采用冗余提升不可分离小波变换实现对源图像的多尺度分解;然后,分别采用基于区域平均能量匹配度、邻域系数差和信息熵的融合规则,得到融合图像的低频系数和高频系数;最后,通过改进型NSCT逆变换得到了融合图像.实验结果验证了该方法的有效性.     

Image fusion for synthetic aperture radar and multispectral images based on sub-band-modulated non-subsampled contourlet transform and pulse coupled neural network methods

Fusion of synthetic aperture radar (SAR) and multispectral (MS) images can contribute to a better visual perception of the objects observed. Unfortunately, many classical approaches have been proven to be unsuitable for this task due to their intrinsic differences in imaging mechanism. In the non-subsampled contourlet transform domain, an alternative fusion method based on pulse coupled neural networks is proposed. To control the amount of SAR features to be integrated into MS image, a gradient-threshold combined modulation is designed for modulating the SAR sub-band coefficients. Experiments demonstrate that the proposed method outperforms its counterparts in spectral preservation and feature enhancement.     

Perceptual quality assessment for multimodal medical image fusion

Recent years have witnessed that the multimodal medical image fusion (MMIF) plays critical roles in clinical diagnostics and treatment. Many MMIF algorithms have been proposed to improve the MMIF images quality. The quality of multimodal medical fused images will significantly affect the results of the clinical diagnosis. However, little work has been designed to evaluate the effectiveness of MMIF algorithms and the quality of MMIF images. To this end, this paper presents a perceptual quality assessment method for MMIF. A MMIF image database (MMIFID) is first built to employ the classical MMIF algorithms, and the subjective experiment is conducted to assess the quality of each fused image. Then, a no-reference objective method is proposed for the perceptual quality evaluation of MMIF images,which uses Pulse Coupled Neural Network (PCNN) in Non-subsampled Contourlet Transform (NSCT). A fused image is decomposed by NSCT into low frequency sub-band (LFS) and high frequency sub-band (HFS). It is used to motivate the PCNN processing, and large firing times are employed to measure LFS and HFS. Finally, two components evaluation results are combined to obtain the overall objective quality score. Experimental results based on the MMIFID indicate that our presented method outperforms the existing image fusion quality evaluation metrics, and it provides a satisfactory correlation with subjective scores, which shows effectiveness in the quality assessment of medical fused images.     

Multi-modality medical image fusion based on separable dictionary learning and Gabor filtering

Sparse representation (SR) has been widely used in image fusion in recent years. However, source image, segmented into vectors, reduces correlation and structural information of texture with conventional SR methods, and extracting texture with the sliding window technology is more likely to cause spatial inconsistency in flat regions of multi-modality medical fusion image. To solve these problems, a novel fusion method that combines separable dictionary optimization with Gabor filter in non-subsampled contourlet transform (NSCT) domain is proposed. Firstly, source images are decomposed into high frequency (HF) and low frequency (LF) components by NSCT. Then the HF components are reconstructed sparsely by separable dictionaries with iterative updating sparse coding and dictionary training. In the process, sparse coefficients and separable dictionaries are updated by orthogonal matching pursuit (OMP) and manifold-based conjugate gradient method, respectively. Meanwhile, the Gabor energy as weighting factor is utilized to guide the LF components fusion, and this further improves the fusion degree of low-significant feature in the flat regions. Finally, the fusion components are transformed to obtain fusion image by inverse NSCT. Experimental results demonstrate the more competitive results of the proposal, leading to the state-of-art performance on both visual quality and objective assessment.     

基于视觉显著性的红外与可见光图像融合

现有红外与可见光图像融合规则仅依赖于图像对比度、方差、梯度等局部特征,缺少全局考虑,因此融合图像不能突出场景中的关键目标特征。针对以上问题,在基于非下采样轮廓波变换(NSCT)的图像融合框架下,提出利用图像全局视觉显著性来指导系数融合,对源图像中视觉显著的目标区域进行重点强调。实验结果分析表明,采用所提算法获得的融合图像中关键目标更加突出,背景比较真实;客观评价指标显示,采用该算法获得的融合图像明显优于传统方法的融合结果。     

基于非降采样Contourlet变换的红外与可见光图像融合及稳健性分析

提出一种基于区域显著性融合规则的非降采样Contourlet变换的红外与可见光图像融合方法.首先,对来自同一场景图像的红外与可见光图像的Ⅰ分量进行非降采样Contourlet变换;然后,依照区域匹配度量和显著性度量规则进行融合,而融合图像通过非降采样Contourlet反变换即可得到.最后,针对此方法进行大量实验,并将其融合结果与基于小波变换及拉普拉斯金子塔变换的融合结果进行比较,同时分析它们在不同噪声条件下的性能指标.     

基于非向下采样Contourlet变换的多聚焦图像融合

近年来图像融合已成为图像处理的一个热点,提出了一种基于非向下采样Contourlet变换NSCT(Nonsubsampled Contour-let transform)的多聚焦图像融合方法。首先对两幅源图像分别进行非向下采样轮廓波变换得到一个低频子带和多个高频方向子带,然后对高低频子带分别采取方向对比度的区域均值和局部熵的融合规则来选取相应的系数,最终通过反变换得到融合图像。实验中,与离散小波a、trous小波变换、NSCT的简单方法进行了比较,结果表明该方法的融合效果最好。     

基于多分辨率变换和压缩感知的肺癌PET/CT图像融合方法

针对移动医疗背景下医学图像融合信息交互的局限性问题,提出一种基于多分辨率变换NSCT和压缩感知理论的肺癌PET/CT图像融合算法.第一步,对源图像进行单层NSCT分解;第二步,通过分析PET和CT不同的成像机制和显像信息,对分解后具有较差稀疏性且主要集中源图像大部分能量的低频子带,采取高斯隶属度函数加权的融合规则,对主要呈现源图像细节信息的高频子带使用高斯随机矩阵进行压缩测量,选择基于平均梯度和区域能量的方法法对高频测量值进行融合;第三步,采取正交匹配追踪算法重构融合后的高频测量值;第四步,对低频融合图像和重构后的高频融合图像进行NSCT逆变换得到最终的融合图像;最后,对该算法进行了两方面的仿真实验:与其他压缩感知图像融合方法的比较以及与其他多分辨率图像融合方法的比较,实验结果表明,该算法是有效可行的.     

基于频带特征融合的GL-CNN遥感图像场景分类

高分辨率卫星遥感图像场景信息的分类对影像分析和解译具有重要意义，传统的高分辨卫星遥感图像场景分类方法主要依赖于人工提取的中、低层特征且不能很好的利用图像丰富的场景信息，针对这一问题，提出一种基于频带特征融合与GL-CNN(Guided Learning Convolutional Neural Network，指导学习卷积神经网络)的分类方法。首先通过NSWT（Non-Subsampled Wavelet Transform，非下采样小波变换）提取出图像的高低频子带，将高频子带进行频带特征融合得到融合高频子带，然后联合频谱角向能量分布曲线的平稳区间分析实现融合高频子带与低频子带的样本融合，最后指导卷积神经网络自动提取图像的高低频子带包含的高层特征来实现场景分类。通过对UCM_LandUse 21类数据进行试验表明，本文方法的分类正确率达到94.52%，相比以往算法有显著提高。     

基于NSST和高斯混合模型的医学图像融合算法

提出了一种基于非下采样剪切波变换（Non-subsampled shearlet transform, NSST）和高斯混合模型的医学彩色图像融合算法。首先将彩色图像转换到HSI颜色空间,提取其色度分量图像、饱和度分量图像和强度分量图像;然后对强度分量图像和MRI图像进行NSST变换,其中低频系数采用基于区域系数改进拉普拉斯能量和（Sum-modified-Laplacian,SML）加权的融合规则,高频系数采用高斯混合模型估计参数取大的融合规则;对融合后的系数进行NSST逆变换重构融合后的强度分量图像;最后将融合后的强度分量图像与色度分量图像、饱和度分量图像混合得到融合后的HSI图像,再将HSI图像转换到RGB颜色空间得到融合后的彩色图像。仿真实验表明,该算法在视觉效果和客观评价指标上具有更好的融合效果。