基于LatLRR和PCNN的红外与可见光融合算法

针对光谱差异较大的红外与可见光图像,本文提出一种基于潜在低秩表示(LatLRR)和脉冲式耦合神经网络(PCNN)的多尺度融合模型。首先,该算法利用非下采样剪切波变换(NSST)获取图像的低频与高频分量。鉴于图像的低频分量决定最终的融合效果,采用LatLRR算法挖掘源图像内在的显著特征对低频分量自适应加权融合。除此外,针对决定融合图像细节的高频分量,则利用双通道PCNN模型作为它的融合规则。其中平均梯度算子(AVG)和方向梯度和算子(SDG)分别作为PCNN的外界刺激与链接强度,它们能更好地表征图像的纹理特性。通过上述全新的融合规则,可将包含在红外图像内部的显著性特征与可见光图像的梯度特征完美结合,从而获取具有优良视觉效果的融合图像。本文采用3种不同的场景来测试所提方法的融合性能,与其他典型融合方法相比,本文提出的算法具有更佳的视觉效果,同时客观评价参数值增加约2%～5%。

Infrared and visible fusion algorithm based on latLRR and PCNN

Aiming at the infrared and visible images with large spectral differences, this paper proposed a multi-scale fusion model based on latent low rank representation (LatLRR) and pulse coupled neural network (PCNN). Firstly, the proposed algorithm used non-subsampled shearlet transform (NSST) to acquire the low and high-frequency components of the image. In view of the low-frequency component of the image to determine the final fusion effect, the LatLRR algorithm was used to mine the intrinsic salient features of the source image, and this feature was used to adaptively weight the fusion of low-frequency components. In addition, for the high-frequency components that determined the details of the fused image, the dual-channel PCNN model was used as its fusion rule. Among them, the average gradient operator (AVG) and the sum of the direction gradients operator (SDG) were the external stimulus and link strength of PCNN, respectively, which all can better characterize the texture characteristics of the image. Through the above new fusion rules, the saliency features contained in the infrared images can be perfectly combined with the gradient features of the visible images to obtain a fused image with excellent visual effects. In this paper, three different scenarios were used to test the fusion performance of the proposed method. Compared with other typical fusion methods, the proposed algorithm has better visual effects, and the objective evaluation parameter value increases by about 2%~5%.