Person recognition by fusing palmprint and palm vein images based on “Laplacianpalm” representation

Unimodal analysis of palmprint and palm vein has been investigated for person recognition. One of the problems with unimodality is that the unimodal biometric is less accurate and vulnerable to spoofing, as the data can be imitated or forged. In this paper, we present a multimodal personal identification system using palmprint and palm vein images with their fusion applied at the image level. The palmprint and palm vein images are fused by a new edge-preserving and contrast-enhancing wavelet fusion method in which the modified multiscale edges of the palmprint and palm vein images are combined. We developed a fusion rule that enhances the discriminatory information in the images. Here, a novel palm representation, called “Laplacianpalm” feature, is extracted from the fused images by the locality preserving projections (LPP). Unlike the Eigenpalm approach, the “Laplacianpalm” finds an embedding that preserves local information and yields a palm space that best detects the essential manifold structure. We compare the proposed “Laplacianpalm” approach with the Fisherpalm and Eigenpalm methods on a large data set. Experimental results show that the proposed “Laplacianpalm” approach provides a better representation and achieves lower error rates in palm recognition. Furthermore, the proposed multimodal method outperforms any of its individual modality.     

基于指部关联特征的多模态图像采集系统

针对基于单个生物特征的身份认证安全性和稳定性不足的问题,设计了基于指部关联特征的多模态图像采集系统,采用单个双波段摄像头分时采集同一根手指的指纹、指节纹和指静脉图像。指纹和指节纹采用非接触反射采集方式,指静脉采用单侧近红外光源与反射镜面相结合的透射采集方式,并根据静脉图像质量评价动态调控光源,根据特征点信息量动态调整各个特征的权重。实验结果表明,该多模态采集系统在认证通过率、误识率和拒登率等指标都优于指纹或指静脉的单模态采集系统,认证通过率达到99.1%,误识率为0.000 1%,不存在拒登现象。     

A fast feature selection technique in multi modal biometrics using cloud framework

Biometrics refers to the process that uses biological or physiological traits to identify individuals. The progress seen in technology and security has a vital role to play in Biometric recognition which is a reliable technique to validate individuals and their identity. The biometric identification is generally based on either their physical traits or their behavioural traits. The multimodal biometrics makes use of either two or more of the modalities to improve recognition. There are some popular modalities of biometrics that are palm print, finger vein, iris, face or fingerprint recognition. Another important challenge found with multimodal biometric features is the fusion, which could result in a large set of feature vectors. Most biometric systems currently use a single model for user authentication. In this existing work, a modified method of heuristics that is efficiently used to identify an optimal feature set that is based on a wrapper-based feature selection technique. The proposed method of feature selection uses the Ant Colony Optimization (ACO) and the Particle Swarm Optimization (PSO) are used to feature extraction and classification process utilizes the integration of face, and finger print texture patterns. The set of training images is converted to grayscale. The crossover operator is applied to generate multiple samples for each number of images. The wok proposed here is pre-planned for each weight of each biometric modality, which ensures that even if a biometric modality does not exist at the time of verification, a person can be certified to provide calculated weights the threshold value. The proposed method is demonstrated better result for fast feature selection in bio metric image authentication and also gives high effectiveness security.     

Feature-level fusion of fingerprint and finger-vein for personal identification

Multimodal biometrics based on feature-level fusion is a significant topic in personal identification research community. In this paper, a new fingerprint-vein based biometric method is proposed for making a finger more universal in biometrics. The fingerprint and finger-vein features are first exploited and extracted using a unified Gabor filter framework. Then, a novel supervised local-preserving canonical correlation analysis method (SLPCCAM) is proposed to generate fingerprint-vein feature vectors (FPVFVs) in feature-level fusion. Based on FPVFVs, the nearest neighborhood classifier is employed for personal identification finally. Experimental results show that the proposed approach has a high capability in fingerprint-vein based personal recognition as well as multimodal feature-level fusion.     

Online finger-knuckle-print verification for personal authentication

Biometric based personal authentication is an effective method for automatically recognizing, with a high confidence, a person's identity. By observing that the texture pattern produced by bending the finger knuckle is highly distinctive, in this paper we present a new biometric authentication system using finger-knuckle-print (FKP) imaging. A specific data acquisition device is constructed to capture the FKP images, and then an efficient FKP recognition algorithm is presented to process the acquired data in real time. The local convex direction map of the FKP image is extracted based on which a local coordinate system is established to align the images and a region of interest is cropped for feature extraction. For matching two FKPs, a feature extraction scheme, which combines orientation and magnitude information extracted by Gabor filtering is proposed. An FKP database, which consists of 7920 images from 660 different fingers, is established to verify the efficacy of the proposed system and promising results are obtained. Compared with the other existing finger-back surface based biometric systems, the proposed FKP system achieves much higher recognition rate and it works in real time. It provides a practical solution to finger-back surface based biometric systems and has great potentials for commercial applications.     

A biometric identification system based on eigenpalm and eigenfinger features

This paper presents a multimodal biometric identification system based on the features of the human hand. We describe a new biometric approach to personal identification using eigenfinger and eigenpalm features, with fusion applied at the matching-score level. The identification process can be divided into the following phases: capturing the image; preprocessing; extracting and normalizing the palm and strip-like finger subimages; extracting the eigenpalm and eigenfinger features based on the K-L transform; matching and fusion; and, finally, a decision based on the (k, l)-NN classifier and thresholding. The system was tested on a database of 237 people (1,820 hand images). The experimental results showed the effectiveness of the system in terms of the recognition rate (100 percent), the equal error rate (EER = 0.58 percent), and the total error rate (TER = 0.72 percent).     

基于手指双模态特征的自动身份验证方法及系统

针对目前单模态生物特征识别在稳定性与安全性等方面的不足以及多模态融合识别的多设备多输入困难等问题, 本文提出一种充分考虑类内与类间度量的学习模型, 实现基于手指双模态特征的自动身份验证方法及系统。由于指静脉与指折痕具有不易改变, 难以伪造的特点, 本文选取这两种重要的手部特征进行身份验证。通过结合两种不同模态特征, 利用自编码网络对类内特征进行表示, 来构建基于度量学习的孪生网络模型, 从而提取类内与类间特征; 接着将提取的指静脉和指折痕特征进行距离计算, 将距离融合后使用逻辑回归模型进行概率判断, 最终实现有效的双模态融合身份验证。为验证我们提出方法的有效性,我们对指静脉识别结果性能进行了对比。实验结果表明, 我们的方法在更具有挑战性的数据库上识别等错误率为 1.69%, 较之现有代表性论文提出的模型的等错误率降低了 2.96%。我们也将构建的双模态融合模型与仅使用单一模态模型进行对比, 结果表明融合指静脉和指折痕特征的融合模型的等错误率为 1.55%,比单一模态的指静脉与指折痕模型分别降低了 0.14%和 3.0%, 表明了双模态身份验证模型性能更优。进一步地, 本文采集了一个更具有挑战性的数据库, 开发了显示图像及识别结果的图形界面,最终实现了一个从数据采集到识别匹配的端对端的一体化自动身份验证系统。基于以上研究, 本文首次提出了一个基于指静脉和指折痕特征的多目自动身份验证方案, 实现集准确性, 鲁棒性和实效性为一体的系统。     

结合并行融合的序列化多模态生物特征识别系统框架

针对多模态生物特征识别系统并行融合模式中使用方便性和使用效率方面的问题,在现有序列化多模态生物特征识别系统的基础上,提出了一种结合并行融合和序列化融合的多生物特征识别系统框架。框架中首先采用步态、人脸与指纹三种生物特征的不同组合方式以加权相加的得分级融合算法进行的识别过程;其次,利用在线的半监督学习技术提高弱特征的识别性能,从而进一步增强系统的使用方便性和识别可靠性。理论分析和实验结果表明,在此框架下,随使用时间的推移,系统能够通过在线学习提高弱分类器的性能,用户的使用方便性和系统的识别精度都得到了进一步提升。     

Personal recognition based on an image of the palmar surface of the hand

This paper describes the design and development of a multimodal biometric personal recognition system based on features extracted from a set of 14 geometrical parameters of the hand, the palmprint, four digitprints, and four fingerprints. The features are extracted from a single high-resolution gray-scale image of the palmar surface of the hand using the linear discriminant analysis (LDA) appearance-based feature-extraction approach. The information contained in the extracted features is combined at the matching-score level. The resolutions of the palmprint, digitprint and fingerprint sub-images, the similarity/dissimilarity measures, the matching-score normalization technique, and the fusion rule at the matching-score level, which optimize the system performance, were determined experimentally. The biometric system, when using a system configuration with optimum parameters, showed an average equal error rate (EER) of 0.0005%, which makes it sufficiently accurate for use in high-security biometric systems.     

人机交互装配中手部指形轮廓信息检测方法

人机交互装配系统中人体手部生物特征的识别与描述是手部装配动作描述与行为理解的基础。在肤色建模与识别、指节特征模型学习的基础上,通过肤色识别结果给出的模板轮廓坐标,计算轮廓链的局部转角比率和逐点向量积,描述基于逐点比较法的指节处的轮廓特征,结合手指生物结构的经验判据,对指尖与指根位置进行检测与推断,实现手指轮廓特征点的初步识别,通过指形拟合完成手指初步定位,为指形平面位姿分析提供基础。在手部多特征检测的基础上进行图像信息融合,结合指节学习模型与自适应阈值识别的指节位置检测,对指形的定位信息进行修正以提高检测的准确性。实验测试结果表明,该手部指形轮廓信息检测方法可行。     

Performance evaluation of score level fusion in multimodal biometric systems

In a multimodal biometric system, the effective fusion method is necessary for combining information from various single modality systems. In this paper the performance of sum rule-based score level fusion and support vector machines (SVM)-based score level fusion are examined. Three biometric characteristics are considered in this study: fingerprint, face, and finger vein. We also proposed a new robust normalization scheme (Reduction of High-scores Effect normalization) which is derived from min-max normalization scheme. Experiments on four different multimodal databases suggest that integrating the proposed scheme in sum rule-based fusion and SVM-based fusion leads to consistently high accuracy. The performance of simple sum rule-based fusion preceded by our normalization scheme is comparable to another approach, likelihood ratio-based fusion [8] (Nandakumar et al., 2008), which is based on the estimation of matching scores densities. Comparison between experimental results on sum rule-based fusion and SVM-based fusion reveals that the latter could attain better performance than the former, provided that the kernel and its parameters have been carefully selected.     

基于图像采集质量评价的指纹与指静脉双模态识别决策级融合方法

针对单一模态生物特征识别系统性能受图像质量影响较大问题,提出一种基于图像采集质量评价的指纹与指静脉识别的决策级融合方法。该方法不仅对指纹图像进行质量评价,并首次根据指静脉图像特性设计图像采集质量评价指标,以达到克服图像质量对识别结果影响的目的。再针对这两种模态图像特点分别进行分类器设计,得出各自的识别结果后,结合上述得到的图像采集质量评价分数进行决策级融合,将融合后的结果作为最终的识别结果。实验表明,该方法有效克服图像质量对识别结果的影响,提高识别系统的性能,为多生物特征身份识别提供一种有效途径。     

Multimodal Biometric Score Fusion Using Gaussian Mixture Model and Monte Carlo Method

Multimodal biometric fusion is gaining more attention among researchers in recent days. As multimodal biometric system consolidates the information from multiple biometric sources, the effective fusion of information obtained at score level is a challenging task. In this paper, we propose a framework for optimal fusion of match scores based on Gaussian Mixture Model (GMM) and Monte Carlo sampling based hypothesis testing. The proposed fusion approach has the ability to handle: 1) small size of match scores as is more commonly encountered in biometric fusion, and 2) arbitrary distribution of match scores which is more pronounced when discrete scores and multimodal features are present. The proposed fusion scheme is compared with well established schemes such as Likelihood Ratio (LR) method and weighted SUM rule. Extensive experiments carried out on five different multimodal biometric databases indicate that the proposed fusion scheme achieves higher performance as compared with other contemporary state of art fusion techniques.     

基于Laplace逼近Gaussian过程的指节图像中层偏移测度特征学习

在人机协调装配中,为了准确描述手部位姿,需要精确的指节图像特征提取与识 别。为了丰富手部信息,提出了基于 Laplace 逼近 Gaussian 过程的多分类算法,以实现基于手 部图像的指节识别。在类别信息无关联的假设基础上,将中层偏移测度特征的学习转化为对随 机量的学习;然后通过分析二值多分类高斯场上的后验计算,给出了基于 Laplace 逼近 Gaussian 过程的多分类高斯过程学习算法;通过构造中层随机信息的正定核函数,给出了基于 Laplace 的多分类高斯过程预测算法。最后,利用中层数据的分布学习与预测算法进行了指节图像训练 学习和固定阈值的图像识别。识别结果显示,该方法具有一定的指节识别能力。     

Score normalization in multimodal biometric systems

Multimodal biometric systems consolidate the evidence presented by multiple biometric sources and typically provide better recognition performance compared to systems based on a single biometric modality. Although information fusion in a multimodal system can be performed at various levels, integration at the matching score level is the most common approach due to the ease in accessing and combining the scores generated by different matchers. Since the matching scores output by the various modalities are heterogeneous, score normalization is needed to transform these scores into a common domain, prior to combining them. In this paper, we have studied the performance of different normalization techniques and fusion rules in the context of a multimodal biometric system based on the face, fingerprint and hand-geometry traits of a user. Experiments conducted on a database of 100 users indicate that the application of min–max, z-score, and tanh normalization schemes followed by a simple sum of scores fusion method results in better recognition performance compared to other methods. However, experiments also reveal that the min–max and z-score normalization techniques are sensitive to outliers in the data, highlighting the need for a robust and efficient normalization procedure like the tanh normalization. It was also observed that multimodal systems utilizing user-specific weights perform better compared to systems that assign the same set of weights to the multiple biometric traits of all users.     

Multimodal biometric system for ECG,ear and iris recognition based on local descriptors

Multimedia Tools and Applications - Combination of multiple information extracted from different biometric modalities in multimodal biometric recognition system aims to solve the different...     

基于Adaboost的人脸与虹膜融合识别

传统生物特征识别系统的识别率经常受到环境以及生物学特征的自身局限性影响。针对该不足,提出一种基于人脸与虹膜特征级融合的多模态生物识别系统,采用中心对称局部二值模式算子提取人脸和虹膜的纹理特征,将人脸特征与虹膜特征线性整合成混合特征向量,利用Adaboost算法从该混合特征向量中优选出一组最佳特征组合,从而构成强分类器。实验结果表明,该多模态系统相比单模态系统具有更好的鲁棒性。     

基于高斯过程模型的指节图像识别方法

在基于图像的人机交互智能装配的手势识别与动作跟踪中,手部关节的图像定位是基础,并且关节信息的准确性对手势描述和行为识别与理解有直接影响.针对指节图像特征分布具有较强随机性,利用同态滤波进行图像预处理,以增强图像特征.基于高斯过程模型对手部指节图像二类特征进行学习,用样本对象的聚类测度,学习数据分布的特征模型,将学习获得的两类特征模型作为图像特征的检测器,检测结果即为图像的两个似然值.将经过正负类样本标记过的两种模型似然值作为输入,直接依据估计结果对手部关节图像进行检测识别.通过对不同位置处的手部关节识别分析和测试库检测,结果表明,本文所述方法可以直接得到后验概率的分布,提高了目标识别的准确性和效率.