High-resolution multiband polarization epithelial tissue imaging method by sparse representation and fusion

Multiband polarization epithelial tissue imaging is an effective tool to measure tissue's birefringence and structure for quantitative pathology analysis. To discriminate the pathology accurately, high-resolution multiband polarization images are essential. But it is difficult to acquire high-resolution polarization images because of the limitations of imaging systems. The polarization image calculation process can be regarded as image fusion with fixed rules, and multiband polarization images are intrinsically sparse. In this paper, we propose a novel high-resolution multiband polarization image calculation method by utilizing the sparse representation and image fusion method. The multiband images are first represented in the sparse domain and we further introduce total-variation-regularization terms into the sparse representation framework. Then, polarization parameter images are calculated by simultaneous fusion and reconstruction. Higher quality multiband polarization images can be obtained through additional regularization constraint in the fusion process. Extensive experiments validate that the proposed method achieves much better results than many state-of-the-art algorithms in terms of both peak signal-to-noise-ratio and visual perception.     

IGM‐based perceptual multimodal medical image fusion using free energy motivated adaptive PCNN

Multimodal medical image fusion merges two medical images to produce a visual enhanced fused image, to provide more accurate comprehensive pathological information to doctors for better diagnosis and treatment. In this article, we present a perceptual multimodal medical image fusion method with free energy (FE) motivated adaptive pulse coupled neural network (PCNN) by employing Internal Generative Mechanism (IGM). First, source images are divided into predicted layers and detail layers with Bayesian prediction model. Then to retain human visual system inspired features, FE is used to motivate the PCNN for processing detail layers, and large firing times are selected as coefficients. The predicted layers are fused with the averaging strategy as activity level measurement. Finally, the fused image is reconstructed by merging coefficients in both fused layers. Experimental results visually and quantitatively show that the proposed fusion strategy is superior to the state‐of‐the‐art methods.     

基于双正交小波变换的资源二号卫星与多光谱影像融合方法研究

针对基于Darbechies等正交小波函数的遥感影像融合时引起失真的现象,引入双正交小波函数,提出了基于双正交小波变换的融合方法,对资源二号卫星和TM的多光谱影像的融合进行研究,并把融合结果与主成分、IHS和Brovey等融合结果进行比较。通过对光谱特征曲线、相关系数、光谱扭曲程度等分析和空间细节的对比,说明双正交小波融合方法除了提高空间分辨率外,最好地保持了多光谱影像的光谱特征,有利于专题信息的提取。     

Optimal multi-scale geometric fusion based on non-subsampled contourlet transform and modified central force optimization

In the current era of technological development, medical imaging plays an important part in several applications of medical diagnosis and therapy. This requires more precise images with much more details and information for correct medical diagnosis and therapy. Medical image fusion is one of the solutions for obtaining much spatial and spectral information in a single image. This article presents an optimization-based contourlet image fusion approach in addition to a comparative study for the performance of both multi-resolution and multi-scale geometric effects on fusion quality. An optimized multi-scale fusion technique based on the Non-Subsampled Contourlet Transform (NSCT) using the Modified Central Force Optimization (MCFO) and local contrast enhancement techniques is presented. The first step in the proposed fusion approach is the histogram matching of one of the images to the other to allow the same dynamic range for both images. The NSCT is used after that to decompose the images to be fused into their coefficients. The MCFO technique is used to determine the optimum decomposition level and the optimum gain parameters for the best fusion of coefficients based on certain constraints. Finally, an additional contrast enhancement process is applied on the fused image to enhance its visual quality and reinforce details. The proposed fusion framework is subjectively and objectively evaluated with different fusion quality metrics including average gradient, local contrast, standard deviation (STD), edge intensity, entropy, peak signal-to-noise ratio, Q ^ab/f, and processing time. Experimental results demonstrate that the proposed optimized NSCT medical image fusion approach based on the MCFO and histogram matching achieves a superior performance with higher image quality, average gradient, edge intensity, STD, better local contrast and entropy, a good quality factor, and much more details in images. These characteristics help for more accurate medical diagnosis in different medical applications.     

Medical image fusion based on nuclear norm minimization

Medical image fusion plays an important role in diagnosis and treatment of diseases such as image‐guided radiotherapy and surgery. Although numerous medical image fusion methods have been proposed, most approaches have not touched the low rank nature of matrix formed by medical image, which usually lead to fusion image distortion and image information loss. These methods also often lack universality when dealing with different kinds of medical images. In this article, we propose a novel medical image fusion to overcome aforementioned issues on existing methods with the aid of low rank matrix approximation with nuclear norm minimization (NNM) constraint. The workflow of our method is described as: firstly, nonlocal similar patches across the medical image are searched by block matching for local patch in source images. Second, a fused matrix is stacking by shared nonlocal similarity patches, then the low rank matrix approximation methods under nuclear norm minimization can be used to recover low rank feature of fused matrix. Finally, fused image can be gotten by aggregating all the fused patches. Experimental results show that the proposed method is superior to other methods in both subjectively visual performance and objective criteria. © 2015 Wiley Periodicals, Inc. Int J Imaging Syst Technol, 25, 310–316, 2015     

Improving medical image fusion method using fuzzy entropy and nonsubsampling contourlet transform

Many types of medical images must be fused, as single‐modality medical images can only provide limited information due to the imaging principles and the complexity of human organ structures. In this paper, a multimodal medical image fusion method that combines the advantages of nonsubsampling contourlet transform (NSCT) and fuzzy entropy is proposed to provide a basis for clinical diagnosis and improve the accuracy of target recognition and the quality of fused images. An image is initially decomposed into low‐ and high‐frequency subbands through NSCT. The corresponding fusion rules are adopted in accordance with the different characteristics of the low‐ and high‐frequency components. The membership degree of low‐frequency coefficients is calculated. The fuzzy entropy is also computed and subsequently used to guide the fusion of coefficients to preserve image details. High‐frequency components are fused by maximizing the regional energy. The final fused image is obtained by inverse transformation. Experimental results show that the proposed method achieves good fusion effect based on the subjective visual effect and objective evaluation criteria. This method can also obtain high average gradient, SD, and edge preservation and effectively retain the details of the fused image. The results of the proposed algorithm can provide effective reference for doctors to assess patient condition.     

Efficient Landsat image fusion using fuzzy and stationary discrete wavelet transform

Image fusion is the concept to integrate multiple same scene images while drawing out maximum radiometric information from them by avoiding noise and fictional data. The main objective is to improve the radiometric quality of fused image compared to individual images of the same scene. Existing methods are found to be efficient, but if the similar radiometric information is fused into every image, it produces redundant high frequency of pixels. Therefore, to overcome this issue, in this paper a fuzzy and stationary discrete wavelet transform (FSDWT)-based image fusion technique is proposed. It decomposes Landsat image into stationary values, and then it preserves the radiometric data by using fuzzy if-then rules. In the last phase, FSDWT injects high-frequency blocks from input images and returns a single Landsat image with maximum radiometric data. Quantitative analysis has clearly demonstrated that FSDWT has better structural detail, spatial resolution and spectral information than existing methods.     

PCA图像融合算法在包装机涂胶检测中的应用

目的为解决卷烟厂包装机烟盒涂胶检测中,单一的可见光相机或红外相机对于涂胶的有无、位置、面积、均匀性等难以同时检测的问题,文中采用PCA图像融合算法作图像预处理,用于FX-2型包装机视觉检测系统。方法检测系统需要在涂胶检测处安装红外相机,同时捕获可见光图像和红外图像,然后将可见光图像与红外图像作主成分分析,替换主成分分量后进行图像融合,最后将融合后的图像输出至后端处理系统。结果实验证明,融合后的图像纹理细节丰富,同时包含了边缘信息与温度信息,对比度高,可检测性强。结论 PCA图像融合算法在涂胶检测的前端处理中非常有效,融合后图像经过后端处理,可以快速检测出包装纸上涂胶的有无、位置、面积以及均匀性,嵌入FX-2型包装机视觉检测系统后,可实时检测出涂胶不合格的包装纸。     

Multimodal sensor medical image fusion based on mutual‐structure for joint filtering using sparse representation

Multimodal sensor medical image fusion has been widely reported in recent years, but the fused image by the existing methods introduces low contrast information and little detail information. To overcome this problem, the new image fusion method is proposed based on mutual‐structure for joint filtering and sparse representation in this article. First, the source image is decomposed into a series of detail images and coarse images by mutual‐structure for joint filtering. Second, sparse representation is adopted to fuse coarse images and then local contrast is applied for fusing detail images. Finally, the fused image is reconstructed by the addition of the fused coarse images and the fused detail images. By experimental results, the proposed method shows the best performance on preserving detail information and contrast information in the views of subjective and objective evaluations.     

一种NSCT域多聚焦图像融合新方法

针对多聚焦图像融合存在的问题,提出一种基于非下采样Contourlet变换（NSCT）的多聚焦图像融合新方法。首先,采用NSCT对多聚焦图像进行分解;然后,对低频系数采用基于改进拉普拉斯能量和（SML）的视觉特征对比度进行融合,对高频系数采用基于二维Log-Gabor能量进行融合;最后,对得到的融合系数进行重构得到融合图像。实验结果表明,无论是运用视觉的主观评价,还是基于互信息、边缘信息保留值等客观评价标准,该文所提方法都优于传统的离散小波变换、平移不变离散小波变换、NSCT等融合方法。     

Medical image fusion based on improved sum‐modified‐Laplacian

Sum‐modified‐Laplacian (SML) plays an important role in medical image fusion. However, fused rules based on larger SML always lead to fusion image distortion in transform domain image fusion or image information loss in spatial domain image fusion. Combined with average filter and median filter, a new medical image fusion method based on improved SML (ISML) is proposed. First, a basic fused image is gained by ISML, which is used for evaluation of the selection map of medical images. Second, difference images can be obtained by subtracting average image of all sources of medical images. Finally, basic fused image can be refined by difference images. The algorithm can both preserve the information of the source images well and suppress pixel distortion. Experimental results demonstrate that the proposed method outperforms the state‐of‐the‐art medical image fusion methods. © 2015 Wiley Periodicals, Inc. Int J Imaging Syst Technol, 25, 206–212, 2015     

基于导向滤波与分形维度的图像加权融合算法

目的为了解决当前图像融合技术中易丢失图像信息,不能较好地保持源图像的边缘与纹理信息,从而降低了图像分辨率与视觉质量,使其不能对目标进行清晰、完整、准确地信息描述等问题。方法提出一种导向滤波耦合分形维度的图像加权融合方案。首先对源图像进行预处理,通过增强对比度来提高图像的动态范围。通过小波变换将图像分解为低频与高频部分,并引入导向滤波器,对其低频、高频成分进行处理,获取相应的低频、高频权重,较好地保持图像的边缘信息。然后,通过提取局部特征分形维数来获取微小纹理特征。最后,定义一种加权融合方案,根据低频与高频权重进行融合,得到最后融合图像。结果实验数据表明,与当前常用图像融合算法比较,文中算法具有更好的融合视觉效果,更好地保持了源图像的真实信息;在信息熵、交互信息、平均梯度和标准差等4种定量分析指标方面,所提算法具有更大的优势。结论所提算法具有良好的融合质量,在图像处理领域具有一定的参考价值。     

一种改进多分辨率图像融合算法

提出一种基于局部熵的多分辨图像融合算法。利用小波变换得到待融合图像的多分辨结构,同时得到图像的多分辨局部熵序列。以局部熵为判据,在图像多分辨结构相应各级上进行融合,得到融合图像的多分辨结构,利用小波逆变换重构融合图像。实验结果表明,该图像融合方法在保留TM多光谱图像光谱分辨率的同时,通过融合SPOT全色图像提高了空间分辨率,丰富了图像细节信息。     

基于多目标粒子群算法的多传感器图像融合

针对图像融合中参数优化的问题,提出了一种基于多目标粒子群优化算法的多传感器图像融合方法。首先采用非采样Contourlet变换(NSCT)对源图像进行多尺度、多方向分解;然后选取图像融合的客观评价指标为优化目标函数,采用多目标粒子群优化算法对低频系数的融合参数进行优化,带通方向子带系数采用取绝对值最大的融合规则;最后通过NSCT逆变换得到融合图像。分别对多聚焦图像融合和红外与可见光图像进行融合实验,并对融合图像进行主客观评价,实验结果表明,得到的融合图像具有较好的主观视觉效果和客观评价指标。     

基于边缘信息的偏振图像融合算法及评价

偏振遥感图像通常都采用强度、偏振度、偏振角来表征目标偏振特性.本文提出的基于边缘信息的偏振图像融合算法是将三幅偏振图像利用离散小波变换把图像分解成不同尺度的低频和高频部分,采用小波区域窗口和子区域窗口统计把小波系数分类成边缘和非边缘系数,通过这些方法进行有效的边缘细节信息提取.在融合处理中,低频图像的小波系数平均值作为融合后的低频系数,高频细节系数根据不同区域特征选择方法以及对应输入图像小波系数的窗口区域方差来确定融合后高频小波系数.仿真实验结果表明,这样使得融合后的图像细节更真实更丰富,图像的偏振特性体现更为充分,同时减少对源图像的预处理要求,使图像在整体上有较好的视觉效果.从而证明这种方法能够在保留图像微小细节方面获得满意的结果,且算法有效性优于其他的图像融合方法.     

多网络联合的红外与可见光图像融合算法研究

目的针对红外与可见光图像在融合过程中,融合图像失真以及可见光图像信息融合不足的问题,提出一种联合多网络结构的红外与可见光图像融合算法。方法首先采用基于密集残差连接的编码器对输入的红外与可见光图像进行特征提取,然后利用融合策略对得到的特征图进行融合,最后将融合后的特征图送入基于GAN网络的解码器中。结果通过与可见光图像对抗优化训练,使得融合后的图像保留了更多可见光图像的细节、背景信息,增强了图像的视觉效果。结论实验表明,与现有的融合算法相比,该算法达到了更好的实验效果,在主观感知和客观评价上都具有更好的表现力。     

A novel multimodal medical image fusion using sparse representation and modified spatial frequency

Fusion of multimodal imaging data supports medical experts with ample information for better disease diagnosis and further clinical investigations. Recently, sparse representation (SR)‐based fusion algorithms has been gaining importance for their high performance. Building a compact, discriminative dictionary with reduced computational effort is a major challenge to these algorithms. Addressing this key issue, we propose an adaptive dictionary learning approach for fusion of multimodal medical images. The proposed approach consists of three steps. First, zero informative patches of source images are discarded by variance computation. Second, the structural information of remaining image patches is evaluated using modified spatial frequency (MSF). Finally, a selection rule is employed to separate the useful informative patches of source images for dictionary learning. At the fusion step, batch‐OMP algorithm is utilized to estimate the sparse coefficients. A novel fusion rule which measures the activity level in both spatial domain and transform domain is adopted to reconstruct the fused image with the sparse vectors and trained dictionary. Experimental results of various medical image pairs and clinical data sets reveal that the proposed fusion algorithm gives better visual quality and competes with existing methodologies both visually and quantitatively.     

基于旋转电极的电容层析成像技术图像融合算法

针对固定电极的电容层析成像技术独立测量值较少,且由于电极位置的影响而导致重建图像失真等问题,提出了一种基于16旋转电极的电容层析成像技术系统模型及对应的图像融合方法。模型对16电极的电容层析成像技术模型进行4次旋转,得出的数据分别采用线性反投影算法和修正共轭梯度法算法进行图像重建,再将重建的5张图像进行小波变换,变换得到的低频和高频成分分别采用加权平均和主分量分析的融合准则进行图像融合。实验结果表明:提出的电容层析成像技术旋转模型通过增加测量电容数,结合图像融合方法可明显提高重构图像质量,降低成像误差。     

改进的Shearlet变换耦合频率特征的图像融合算法

目的解决当前图像融合算法大都直接在图像的像素灰度空间上进行融合,导致融合图像存在视觉效果差及算法鲁棒性不强等问题。方法文中提出改进的Shearlet变换耦合频率特征的多聚焦图像融合算法。将Shearlet变换(ST)和非下采样小波变换(NSWT)进行融合,形成改进的Shearlet变换(ST-NSWT)对源图像分解,获取图像的低、高频子带系数;构建区域能量模型,对源图像之间的低频子带系数进行相关性度量,完成低频子带的融合;对高频子带的频率特征进行分析,建立方差模型、平均梯度模型、空间频率模型,分别对源图像的灰度相关性、清晰度相关性及活跃度相关性进行测量,完成高频子带的融合,最后通过ST-NSWT逆变换,输出融合图像。结果与当前多聚焦图像融合算法相比,文中算法融合的图像能较好地保留更多的细节及边缘信息,使融合图像具备更佳的视觉效果。结论所提算法具有更好的融合质量,可用于遥感探测与包装印刷检测等领域。     

Performance analysis of hyperspherical colour sharpening method for IRS satellite images

Various image fusion methods have been developed and investigated for different remote sensing (RS) applications. Hyperspherical Colour Sharpening (HCS) method was recently proposed for World View-2 imagery. A limited study has been carried out to find the performance of HCS method for other datasets. In this paper, an experiment is engineered in which HCS method was applied on Indian remote sensing (IRS) datasets. The performance analysis of the method was carried by both qualitative and quantitative methods. In addition to that the quality of indices image for each method is compared to analyse the suitability of methods for various applications based on these indices. Brovey transformation (BT), principal component substitution (PCS), high pass filtering (HPF) and discrete wavelet transform-based principal component substitution (DWT-PCS) were also applied on the selected data and used in comparative analysis with the HCS method. The study reveals that HCS method outperforms in terms of the spectral fidelity, but produces some shortcoming for spatial resolutions. The quality of indices images show that BT and HCS methods do not hold the spatial details after fusion indices image computation, while indices from HPF, DWT-PCS and PCS hold some of spatial information injected into fused output.