Designing efficient fusion schemes for multimodal biometric systems using face and palmprint

In this paper, we address the problem of designing efficient fusion schemes of complementary biometric modalities such as face and palmprint, which are effectively coded using Log-Gabor transformations, resulting in high dimensional feature spaces. We propose different fusion schemes at match score level and feature level, which we compare on a database of 250 virtual people built from the face FRGC and the palmprint PolyU databases. Moreover, in order to reduce the complexity of the fusion scheme, we implement a particle swarm optimization (PSO) procedure which allows the number of features (identifying a dominant subspace of the large dimension feature space) to be significantly reduced while keeping the same level of performance. Results in both closed identification and verification rates show a significant improvement of 6% in performance when performing feature fusion in Log-Gabor space over the more common optimized match score level fusion method.     

RFN-Nest: An end-to-end residual fusion network for infrared and visible images

In the image fusion field, the design of deep learning-based fusion methods is far from routine. It is invariably fusion-task specific and requires a careful consideration. The most difficult part of the design is to choose an appropriate strategy to generate the fused image for a specific task in hand. Thus, devising learnable fusion strategy is a very challenging problem in the community of image fusion. To address this problem, a novel end-to-end fusion network architecture (RFN-Nest) is developed for infrared and visible image fusion. We propose a residual fusion network (RFN) which is based on a residual architecture to replace the traditional fusion approach. A novel detail-preserving loss function, and a feature enhancing loss function are proposed to train RFN. The fusion model learning is accomplished by a novel two-stage training strategy. In the first stage, we train an auto-encoder based on an innovative nest connection (Nest) concept. Next, the RFN is trained using the proposed loss functions. The experimental results on public domain data sets show that, compared with the existing methods, our end-to-end fusion network delivers a better performance than the state-of-the-art methods in both subjective and objective evaluation. The code of our fusion method is available at https://github.com/hli1221/imagefusion-rfn-nest.     

A spectral independent approach for physiological and geometric based face recognition in the visible,middle-wave and long-wave infrared bands

The difficulty of face recognition (FR) systems to operate efficiently in diverse operational environments, e.g. day and night time, is aided by employing sensors covering different spectral bands (i.e. visible and infrared). Biometric practitioners have identified a framework of band-specific algorithms, which can contribute to both assessment and intervention. While these motions are proven to achieve improvement of identification performance, they traditionally result in solutions that typically fail to work efficiently across multiple spectrums. In this work, we designed and developed an efficient, fully automated, direct matching-based FR approach, that is designed to operate efficiently when face data is captured using either visible or passive infrared (IR) sensors. Thus, it can be applied in both daytime and nighttime environments. First, input face images are geometrically normalized using our pre-processing pipeline prior to feature-extraction. Then, face-based features including wrinkles, veins, as well as edges of facial characteristics, are detected and extracted for each operational band (visible, MWIR, and LWIR). Finally, global and local face-based matching is applied, before fusion is performed at the score level. Our approach achieves a rank-1 identification rate of at least 99.43%, regardless of the spectrum of operation. This suggests that our approach results in better performance than other tested standard commercial and academic face-based matchers, on all spectral bands used.     

基于NSCT的红外与可见光图像融合

提出一种基于非下采样Contourlet变换的红外与可见光图像融合方法。该方法对源图像经非下采样Contourlet变换分解后的高频系数,考虑不同传感器的成像机理进行活性度量,并结合多分辨率系数间相关性来实现加权融合;低频系数则通过一种局部梯度进行活性度量,再采用加权与选择相结合的规则实现融合。最后,通过非下采样Contourlet逆变换重构获得融合图像。实验结果表明了该方法的有效性和可行性。     

Multimodal biometrics: Weighted score level fusion based on non-ideal iris and face images

The iris and face are among the most promising biometric traits that can accurately identify a person because their unique textures can be swiftly extracted during the recognition process. However, unimodal biometrics have limited usage since no single biometric is sufficiently robust and accurate in real-world applications. Iris and face biometric authentication often deals with non-ideal scenarios such as off-angles, reflections, expression changes, variations in posing, or blurred images. These limitations imposed by unimodal biometrics can be overcome by incorporating multimodal biometrics. Therefore, this paper presents a method that combines face and iris biometric traits with the weighted score level fusion technique to flexibly fuse the matching scores from these two modalities based on their weight availability. The dataset use for the experiment is self established dataset named Universiti Teknologi Malaysia Iris and Face Multimodal Datasets (UTMIFM), UBIRIS version 2.0 (UBIRIS v.2) and ORL face databases. The proposed framework achieve high accuracy, and had a high decidability index which significantly separate the distance between intra and inter distance.     

Dynamical information fusion of heterogeneous sensors for 3D tracking using particle swarm optimization

This paper presents a new method for three dimensional object tracking by fusing information from stereo vision and stereo audio. From the audio data, directional information about an object is extracted by the Generalized Cross Correlation (GCC) and the object’s position in the video data is detected using the Continuously Adaptive Mean shift (CAMshift) method. The obtained localization estimates combined with confidence measurements are then fused to track an object utilizing Particle Swarm Optimization (PSO). In our approach the particles move in the 3D space and iteratively evaluate their current position with regard to the localization estimates of the audio and video module and their confidences, which facilitates the direct determination of the object’s three dimensional position. This technique has low computational complexity and its tracking performance is independent of any kind of model, statistics, or assumptions, contrary to classical methods. The introduction of confidence measurements further increases the robustness and reliability of the entire tracking system and allows an adaptive and dynamical information fusion of heterogenous sensor information.     

梯度微粒群优化算法及其收敛性分析

针对标准微粒群优化算法微粒运动轨迹的收敛性进行了分析.给出并证明了微粒运动轨迹收敛的充分条件.提出一种简便的等高线图判别法,该方法能够通过参数的位置判断微粒轨迹是否收敛并衡量收敛速度.为提高算法的收敛速度.构造出一种梯度微粒群优化算法,给出并证明了该方法收敛的充分条件.仿真结果表明,梯度微粒群优化算法具有优良的搜索性能.     

Particle swarm optimization based clustering algorithm with mobile sink for WSNs

Wireless sensor networks with fixed sink node often suffer from hot spots problem since sensor nodes close to the sink usually have more traffic burden to forward during transmission process. Utilizing mobile sink has been shown as an effective technique to enhance the network performance such as energy efficiency, network lifetime, and latency, etc. In this paper, we propose a particle swarm optimization based clustering algorithm with mobile sink for wireless sensor network. In this algorithm, the virtual clustering technique is performed during routing process which makes use of the particle swarm optimization algorithm. The residual energy and position of the nodes are the primary parameters to select cluster head. The control strategy for mobile sink to collect data from cluster head is well designed. Extensive simulation results show that the energy consumption is much reduced, the network lifetime is prolonged, and the transmission delay is reduced in our proposed routing algorithm than some other popular routing algorithms.     

基于非降采样Contourlet变换的红外与可见光图像融合及稳健性分析

提出一种基于区域显著性融合规则的非降采样Contourlet变换的红外与可见光图像融合方法.首先,对来自同一场景图像的红外与可见光图像的Ⅰ分量进行非降采样Contourlet变换;然后,依照区域匹配度量和显著性度量规则进行融合,而融合图像通过非降采样Contourlet反变换即可得到.最后,针对此方法进行大量实验,并将其融合结果与基于小波变换及拉普拉斯金子塔变换的融合结果进行比较,同时分析它们在不同噪声条件下的性能指标.     

有效的红外与可见光图像融合方法研究*

针对红外图像可视化程度弱、对比度低的问题, 提出一种基于轮廓小波变换和区域能量的红外与可见光图像融合算法。首先进行多尺度小波分解, 然后进行多方向滤波; 引入循环平移方法来消除伪吉布斯失真;采用基于区域的能量融合规则, 重构变换系数得到最终融合结果;最后用信息熵、信噪比等指标来评价融合的性能。实验表明,该方法不论在客观评价还是在主观评价指标上都优于其他融合方法, 提高了融合图像的视觉效果, 可以得到更加清晰的融合图像。     

A particle swarm optimization based simultaneous learning framework for clustering and classification

A particle swarm optimization based simultaneous learning framework for clustering and classification (PSOSLCC) is proposed in this paper. Firstly, an improved particle swarm optimization (PSO) is used to partition the training samples, the number of clusters must be given in advance, an automatic clustering algorithm rather than the trial and error is adopted to find the proper number of clusters, and a set of clustering centers is obtained to form classification mechanism. Secondly, in order to exploit more useful local information and get a better optimizing result, a global factor is introduced to the update strategy update strategy of particle in PSO. PSOSLCC has been extensively compared with fuzzy relational classifier (FRC), vector quantization and learning vector quantization (VQ+LVQ3), and radial basis function neural network (RBFNN), a simultaneous learning framework for clustering and classification (SCC) over several real-life datasets, the experimental results indicate that the proposed algorithm not only greatly reduces the time complexity, but also obtains better classification accuracy for most datasets used in this paper. Moreover, PSOSLCC is applied to a real world application, namely texture image segmentation with a good performance obtained, which shows that the proposed algorithm has a potential of classifying the problems with large scale.     

分合粒子群优化算法*

基于社会系统中普遍存在“分久必合,合久必分”的现象,提出了基于分合思想的粒子群优化算法。分策略提高了演化群体的多样性,克服了粒子群优化算法局部收敛的缺陷。合策略吸取了不同群体的优良特性,提高了算法的全局搜索能力。函数优化的仿真结果证明了算法的有效性。     

基于改进型NSCT 变换的灰度可见光与红外图像融合方法

针对灰度可见光与红外图像融合,提出一种基于改进型非下采样轮廓波变换(NSCT)的图像融合方法.不同于经典NSCT模型,改进型NSCT变换摈弃了细节捕捉能力不强的非下采样金字塔分解机制,采用冗余提升不可分离小波变换实现对源图像的多尺度分解;然后,分别采用基于区域平均能量匹配度、邻域系数差和信息熵的融合规则,得到融合图像的低频系数和高频系数;最后,通过改进型NSCT逆变换得到了融合图像.实验结果验证了该方法的有效性.     

信息分离和质量引导的红外与可见光图像融合

目的 红外与可见光图像融合的目标是将红外图像与可见光图像的互补信息进行融合,增强源图像中的细节场景信息。然而现有的深度学习方法通常人为定义源图像中需要保留的特征,降低了热目标在融合图像中的显著性。此外,特征的多样性和难解释性限制了融合规则的发展,现有的融合规则难以对源图像的特征进行充分保留。针对这两个问题,本文提出了一种基于特有信息分离和质量引导的红外与可见光图像融合算法。方法 本文提出了基于特有信息分离和质量引导融合策略的红外与可见光图像融合算法。设计基于神经网络的特有信息分离以将源图像客观地分解为共有信息和特有信息,对分解出的两部分分别使用特定的融合策略;设计权重编码器以学习质量引导的融合策略,将衡量融合图像质量的指标应用于提升融合策略的性能,权重编码器依据提取的特有信息生成对应权重。结果 实验在公开数据集RoadScene上与6种领先的红外与可见光图像融合算法进行了对比。此外,基于质量引导的融合策略也与4种常见的融合策略进行了比较。定性结果表明,本文算法使融合图像具备更显著的热目标、更丰富的场景信息和更多的信息量。在熵、标准差、差异相关和、互信息及相关系数等指标上,相较于对比算法...     

一种扩展VIFB的红外与可见光图像融合基准

红外与可见光图像融合是机器视觉的一个重要领域,在日常生活中应用广泛。近年来,虽然红外与可见光图像融合领域已有多种融合算法,但目前该领域还缺乏能够衡量多种融合算法性能的算法框架和融合基准。在简要概述了红外与可见光图像融合的最新进展后,提出了一种扩展VIFB的红外与可见光图像融合基准,该基准由56对图像、32种融合算法和16种评价指标组成。基于该融合基准进行了大量实验,用来测评所选取的融合算法的性能。通过定性和定量结果分析,确定了性能优良的图像融合算法,并对红外与可见光图像融合领域的未来前景进行了展望。     

基于微粒群算法和网格模型的参数优化方法

针对在半导体制造工艺参数优化过程中缺乏直观参考的问题,在微粒群优化算法(PSO)和等值线理论分析的基础上,将PSO与等值线矩形网格模型相结合,提出一种全新的工艺参数窗口选择方法,在二维标准多峰函数上验证了所提出方法的有效性,同时对所提出的方法进行了实际生产验证,对于双输入参数问题,该方法可以直接输出所有满足工艺要求的二维区域,从而为参数优化和范围选取提供直观参考,仿真测试结果和生产验证数据均表明了所提出的算法是一种有效的参数优化方法。     

基于注意力机制的红外与可见光图像融合网络

针对现有融合方法缺乏通用性的问题,提出一种结合空间注意力和通道注意力的特征融合网络,设计一个端到端融合框架,采用两阶段的训练策略进行训练。在第一个阶段,训练一个自编码器用来提取图像的特征;在第二个阶段,使用提出的融合损失函数对融合网络进行训练。实验结果表明,该算法既能保留红外图像显著目标特征,还能在保留可见光图像细节上有很好的特性。主观和客观的实验分析验证了该算法的有效性。     

基于模糊高斯学习策略的粒子群进化融合算法

针对粒子群优化（PSO）算法存在的开发能力不足,导致算法精度不高、收敛速度慢以及微分进化算法具有的探索能力偏弱,易陷入局部极值的问题,提出一种基于模糊高斯学习策略的粒子群-进化融合算法。在标准粒子群算法的基础上,选取精英粒子种群,运用变异、交叉、选择进化算子,构建精英粒子群-进化融合优化机制,提高粒子种群多样性与收敛性;引入符合人类思维特性的模糊高斯学习策略,提高粒子寻优能力,形成基于模糊高斯学习策略的精英粒子群和微分进化融合算法。对9个标准测试函数进行了计算测试和对比分析,结果表明函数Schwefel.1.2、Sphere、Ackley、Griewank与Quadric Noise计算平均值分别为1.5E-39、8.5E-82、9.2E-13、5.2E-17、1.2E-18,接近算法最小值;Rosenbrock、Rastrigin、Schwefel及Salomon函数收敛平均值较四种对比粒子群优化算法计算结果提高了1~3个数量级;同时,收敛性显示算法收敛速度较对比算法提高了5%~30%。算法在提高计算收敛速度和精度上效果明显,具有较强的逃离局部极值的能力和全局搜索能力。     

DTCWT域的红外与可见光图像融合算法

针对红外与可见光图像融合存在融合图像对比度和清晰度降低、噪声干扰等问题,提出一种DTCWT域的红外与可见光图像融合算法。首先对源图像进行预增强处理;然后通过DTCWT正变换得到低频子带图像和高频子带图像;再分别利用基于直觉模糊集的融合规则融合低频子带图像,基于信息反差对比度的融合规则融合高频子带图像;最后对融合后的低频子带图像和高频子带图像进行DTCWT逆变换得到融合图像。实验结果表明,本文算法能有效提高融合图像对比度和清晰度,降低噪声干扰,客观评价指标总体优于现有算法的,运行效率也有所提升。     

RXDNFuse: A aggregated residual dense network for infrared and visible image fusion

This study proposes a novel unsupervised network for IR/VIS fusion task, termed as RXDNFuse, which is based on the aggregated residual dense network. In contrast to conventional fusion networks, RXDNFuse is designed as an end-to-end model that combines the structural advantages of ResNeXt and DenseNet. Hence, it overcomes the limitations of the manual and complicated design of activity-level measurement and fusion rules. Our method establishes the image fusion problem into the structure and intensity proportional maintenance problem of the IR/VIS images. Using comprehensive feature extraction and combination, RXDNFuse automatically estimates the information preservation degrees of corresponding source images, and extracts hierarchical features to achieve effective fusion. Moreover, we design two loss function strategies to optimize the similarity constraint and the network parameter training, thus further improving the quality of detailed information. We also generalize RXDNFuse to fuse images with different resolutions and RGB scale images. Extensive qualitative and quantitative evaluations reveal that our results can effectively preserve the abundant textural details and the highlighted thermal radiation information. In particular, our results form a comprehensive representation of scene information, which is more in line with the human visual perception system.