结合小波变换和自适应分块的多聚焦图像快速融合

提出一种基于小波变换和自适应分块相结合的多聚焦图像快速融合算法。该算法以小波变换为框架,对小波低频系数采用自适应尺寸分块的方法进行融合,图像块的尺寸由差分进化算法优化求解,然后对此低频融合结果进行精细化处理,得到一幅能精确到每个系数来源的标签图,再利用局部小波能量与该标签图相结合的方法对小波高频系数进行融合,最后重构得到融合结果。实验表明,该算法的融合结果在主观视觉效果和客观评价准则两方面均可以接近甚至达到图像融合领域的最好水平,且在提高融合质量和降低运算代价间取得较好的折衷。     

利用局部极值点特性的多聚焦图像快速融合

目的：多聚焦图像融合技术一个关键问题是如何准确地判断待融合图像的清晰度。本文提出了基于归一化结构极值点数目的清晰度判断准则。方法：本文基于图像的局部极值点特性,定义了归一化结构极值点数目这个指标作为清晰度判断准则,同时还给出了利用该准则和融合决策矩阵快速估计技术的多聚焦图像快速融合方法。结果：利用本文提出的清晰度判断准则和融合方法,实验表明上述问题得到了很好的解决。结论：本文提出了一个新的图像清晰度判断准则,该准则判断准确率高,且对脉冲噪声有好的鲁棒性。通过与传统融合方法对两组实验图像融合结果的主客观比较表明,该方法的融合速度和效果比现有多聚焦图像融合方法有明显提高。     

Multi-focus image fusion using dictionary-based sparse representation

Multi-focus image fusion has emerged as a major topic in image processing to generate all-focus images with increased depth-of-field from multi-focus photographs. Different approaches have been used in spatial or transform domain for this purpose. But most of them are subject to one or more of image fusion quality degradations such as blocking artifacts, ringing effects, artificial edges, halo artifacts, contrast decrease, sharpness reduction, and misalignment of decision map with object boundaries. In this paper we present a novel multi-focus image fusion method in spatial domain that utilizes a dictionary which is learned from local patches of source images. Sparse representation of relative sharpness measure over this trained dictionary are pooled together to get the corresponding pooled features. Correlation of the pooled features with sparse representations of input images produces a pixel level score for decision map of fusion. Final regularized decision map is obtained using Markov Random Field (MRF) optimization. We also gathered a new color multi-focus image dataset which has more variety than traditional multi-focus image sets. Experimental results demonstrate that our proposed method outperforms existing state-of-the-art methods, in terms of visual and quantitative evaluations.     

一种改进的SIFT图像特征匹配算法

针对传统SIFT图像特征匹配算法因其特征描述算子维度过高而造成的计算量大、实时性差的问题,提出一种基于内核投影的改进SIFT图像特征匹配算法。传统SIFT特征匹配算法采用平滑加权直方图计算特征点的梯度模值和梯度方向。采用内核投影算法对其进行改进,使生成的特征描述算子的维度降低,从而能够提高特征匹配效率。实验结果表明,改进后的SIFT算法具有较高的匹配精度,同时匹配时间有所减少,使实时性得到提高。     

Multi-focus image fusion: Transformer and shallow feature attention matters

The depth of field (DOF) of camera equipment is generally limited, so it is very difficult to get a fully focused image with all the objects clear after taking only one shot. A way to obtain a fully focused image is to use a multi-focus image fusion method, which fuses multiple images with different focusing depths into one image. However, most of the existing methods focus too much on the fusion accuracy of a single pixel, ignoring the integrity of the target and the importance of shallow features, resulting in internal errors and boundary artifacts, which need to be repaired after a long time of post-processing. In order to solve these problems, we propose a cascade network based on Transformer and attention mechanism, which can directly obtain the decision map and fusion result of focusing/defocusing region through end-to-end processing of source image, avoiding complex post-processing. For improving the fusion accuracy, this paper introduces the joint loss function, which can optimize the network parameters from three aspects. Furthermore, In order to enrich the shallow features of the network, a global attention module with shallow features is designed. Extensive experiments were conducted, including a large number of ablation experiments, 6 objective measures and a variety of subjective visual comparisons. Compared with 9 state-of-the-art methods, the results show that the proposed network structure can improve the quality of multi-focus fusion images and the performance is optimal.     

一种改进的SIFT特征匹配算法

针对尺度不变特征变换(SIFT)特征匹配算法存在计算量大、复杂度高的问题,提出一种基于图像Radon变换的改进SIFT特征匹配算法。改进算法在图像的SIFT特征点采样区域内作d条不同方向的直线,以d条直线上的图像Radon变换作为SIFT特征向量描述符,降低SIFT特征向量的维数,从而提高特征匹配效率。实验结果表明,改进算法具有较高的匹配精度和较少的匹配时间,适用于虚拟场景漫游或目标识别等实时性要求较高的系统。     

改进SIFT特征在图像匹配中的应用

对SIFT算法进行研究,针对SIFT特征描述符的高维数和高复杂度问题,进行了改进。通过对大量的不同类型的图像进行特征匹配实验,实验结果表明,当图像存在不同程度的几何变形、辐射畸变和噪声影响时,改进后的算法更稳定、更快速。     

自适应字典学习的多聚焦图像融合

基于人类视觉系统及信号的过完备稀疏表示理论,提出一种新的多聚焦图像融合算法。首先从待融合图像中随机取块构成训练样本集,经迭代运算获取过完备字典;然后由正交匹配追踪算法完成图像块的稀疏分解;再按分解系数的显著性选择融合系数并完成图像块的重构;重构块经重新排列并取平均后获得最后的融合图像。实验结果表明:该算法继承了目前较为优秀的多尺度几何分析方法的融合效果;在噪声存在的情况下,该算法表现出较好的噪声抑制能力,随噪声方差的升高,融合图像的主观质量及客观评价指标均要好于传统方法。     

Multi-focus image fusion with deep residual learning and focus property detection

Multi-focus image fusion methods can be mainly divided into two categories: transform domain methods and spatial domain methods. Recent emerged deep learning (DL)-based methods actually satisfy this taxonomy as well. In this paper, we propose a novel DL-based multi-focus image fusion method that can combine the complementary advantages of transform domain methods and spatial domain methods. Specifically, a residual architecture that includes a multi-scale feature extraction module and a dual-attention module is designed as the basic unit of a deep convolutional network, which is firstly used to obtain an initial fused image from the source images. Then, the trained network is further employed to extract features from the initial fused image and the source images for a similarity comparison, aiming to detect the focus property of each source pixel. The final fused image is obtained by selecting corresponding pixels from the source images and the initial fused image according to the focus property map. Experimental results show that the proposed method can effectively preserve the original focus information from the source images and prevent visual artifacts around the boundary regions, leading to more competitive qualitative and quantitative performance when compared with the state-of-the-art fusion methods.     

结合SIFT变换与Otsu匹配的彩色眼底图像拼接方法

针对多幅单模彩色眼底图像的拼接问题,提出一种基于尺度不变特征变换（Scale Invariant Feature Transform,SIFT）与最大类间方差（Otsu）匹配的拼接方法。为克服光照不均对特征提取造成的影响,采用SIFT变换提取眼底图像特征点;利用Otsu剔除误匹配点,提高特征点的匹配精度;在此基础上,计算匹配点对之间的仿射变换矩阵,进行图像空间变换实现图像配准,并对配准图像进行融合。结果表明,提出的方法可实现对多幅单模彩色眼底图像的高精度自动拼接,具有很强的鲁棒性。     

基于小波变换的多聚焦图像融合算法

针对基于小波变换的多聚焦图像融合算法,改进融合规则和融合算子,低频分量采用以相关系数作为阈值的加权平均算法,高频分量采用基于区域特征的融合算法,并对最佳分解层数与最佳小波基的选取进行优化验证。通过对实验结果的分析,选用bior4.4小波,进行最佳分解层数小波分解,并应用改进的融合规则,在融合多聚焦图像的效果上,与其他多种融合算法相比,各项评价指标都比较理想。     

Multi-focus image fusion based on sparse decomposition and background detection

The goal of image fusion is to accurately and comprehensively describe complementary information of multiple source images in a new scene. Traditional fusion methods are easy to produce side-effects which cause artifacts and blurred edges. To solve these problems, a novel fusion algorithm based on robust principal component analysis (RPCA) and guided filter is proposed. The guided filter can preserve the edges effectively, which is often used to enhance the images without distort the details. Considering edges and flat area are treated differently by the guided filter, in this paper, sparse component of the source image is filtered by the guided filter to generate the enhanced image which contains the preserved edges and the enhanced background. And then the focused regions of the source images are detected by spatial frequency map of the difference images between the enhanced image and the corresponding source image. Finally, morphological algorithm is used to obtain precise fusion decision map. Experimental results show that the proposed method improves the fusion performance obviously which outperforms the current fusion methods.     

SIFT算法在卷烟小包装图像配准中的应用

由于SIFT算法在寻找关键点时,只考虑了图像的局部特征,使得在具有复杂纹理背景的图像处理中,无法提取出具有代表性的特征点。针对这一问题,提出在提取关键点的时候,考虑特征点间的相关性,参照SSIFT算法缩小特征描述的维数,利用统计的方式缩短算法执行时间,使得算法能快速提取到具有代表性的关键点,滤掉纹理图案中的关键点。通过实验证明了算法的执行效率以及算法的普适性。     

基于相干性的多聚焦图像融合算法

为提高多聚焦图像的融合效果,提出一种基于相干性的融合算法。该算法对源图像进行离散小波变换,利用高频小波系数构造结构张量矩阵,通过矩阵特征值定义反映局部几何信息的相干性并建立融合策略。实验结果表明,该算法得到的融合图像在主观视觉效果和客观量化指标方面均有良好的表现,提高了融合的视觉效果。     

一种基于小波变换的多聚焦图像融合方法

提出了一种改进的基于小波变换的多聚焦图像融合方法。该方法采用小波变换对源图像进行多尺度分解,得到高频和低频图像;对高频分量采用基于邻域方差加权平均的方法得到高频融合系数,对低频分量采用基于局部区域梯度信息的方法得到低频融合系数;进行小波反变换得到融合图像。采用均方根误差、信息熵以及峰值信噪比等评价标准,将该方法与传统融合方法的融合效果进行了比较。实验结果表明,该方法所得融合图像的效果和质量均有明显提高。     

基于信息瓶颈聚类的多聚焦图像融合

提出一种基于信息瓶颈聚类的多聚焦图像融合方法。该方法采用信息瓶颈算法对源图像进行聚类分析,获得联合的聚类表示;由非下采样Contourlet变换对源图像进行多分辨率分解,通过联合聚类表示指导各频域系数融合;采用非下采样Contourlet逆变换重构获得融合图像。实验结果表明,该方法具有良好的客观评价性能和主观视觉效果。     

一种简化的SIFT图像特征点提取算法*

针对目前尺度不变的图像特征点提取算法计算量较大,算法较复杂的问题,提出一种简化的SIFT图像特征点提取算法。此算法通过改变金字塔尺度空间的结构实现对SIFT特征点提取过程的简化,通过改变特征点描述子的结构实现对特征向量计算的简化,从而在保证算法鲁棒性的同时减少了计算量并增强了实时性。实验证明了该算法的有效性。     

多聚焦图像融合的Contourlet变换方法

Contourlet变换（Contourlet Transform,CT）是一种新的多尺度变换,具有良好的多尺度性和多方向性。提出了一种基于Contourlet变换的多聚焦图像融合算法,同时引入Cycle Spinning来有效地消除由于Contourlet变换缺乏平移不变性而产生的图像失真。实验结果表明该算法可获得较理想的融合图像,取得了优于laplacian塔型方法和小波变换方法的融合效果。     

自学习规则下的多聚焦图像融合

目的 基于深度学习的多聚焦图像融合方法主要是利用卷积神经网络（convolutional neural network,CNN）将像素分类为聚焦与散焦。监督学习过程常使用人造数据集,标签数据的精确度直接影响了分类精确度,从而影响后续手工设计融合规则的准确度与全聚焦图像的融合效果。为了使融合网络可以自适应地调整融合规则,提出了一种基于自学习融合规则的多聚焦图像融合算法。方法 采用自编码网络架构,提取特征,同时学习融合规则和重构规则,以实现无监督的端到端融合网络;将多聚焦图像的初始决策图作为先验输入,学习图像丰富的细节信息;在损失函数中加入局部策略,包含结构相似度（structural similarity index measure,SSIM）和均方误差（mean squared error,MSE）,以确保更加准确地还原图像。结果 在Lytro等公开数据集上从主观和客观角度对本文模型进行评价,以验证融合算法设计的合理性。从主观评价来看,模型不仅可以较好地融合聚焦区域,有效避免融合图像中出现伪影,而且能够保留足够的细节信息,视觉效果自然清晰;从客观评价来看,通过将模型融合的图像与其他主流多聚焦图像融合算法的融合图像进行量化比较,在熵、Q_w、相关系数和视觉信息保真度上的平均精度均为最优,分别为7.457 4,0.917 7,0.978 8和0.890 8。结论 提出了一种用于多聚焦图像的融合算法,不仅能够对融合规则进行自学习、调整,并且融合图像效果可与现有方法媲美,有助于进一步理解基于深度学习的多聚焦图像融合机制。     

基于快速非抽样小波变换的岩屑多聚焦图像融合

针对传统非抽样小波变换算法较复杂的缺点,结合空、频域处理上的特点,提出了一种基于快速非抽样小波变换的多聚焦图像融合算法。与之前基于非抽样小波变换的融合算法不同,该算法取消了反变换,它根据高频小波系数绝对值和取大原则,融合图像像素值直接在对应源图像的相应位置取值,从而大大提高了图像处理的实时性,改善了融合效果。通过与六种非抽样小波变换融合算法的比较,以及快速非抽样小波变换与非抽样小波变换的融合时间对比,直观地给出了该算法的效果和时间优势。