Face and palmprint pixel level fusion and Kernel DCV-RBF classifier for small sample biometric recognition

Recently, multi-modal biometric fusion techniques have attracted increasing atove the recognition performance in some difficult biometric problems. The small sample biometric recognition problem is such a research difficulty in real-world applications. So far, most research work on fusion techniques has been done at the highest fusion level, i.e. the decision level. In this paper, we propose a novel fusion approach at the lowest level, i.e. the image pixel level. We first combine two kinds of biometrics: the face feature, which is a representative of contactless biometric, and the palmprint feature, which is a typical contacting biometric. We perform the Gabor transform on face and palmprint images and combine them at the pixel level. The correlation analysis shows that there is very small correlation between their normalized Gabor-transformed images. This paper also presents a novel classifier, KDCV-RBF, to classify the fused biometric images. It extracts the image discriminative features using a Kernel discriminative common vectors (KDCV) approach and classifies the features by using the radial base function (RBF) network. As the test data, we take two largest public face databases (AR and FERET) and a large palmprint database. The experimental results demonstrate that the proposed biometric fusion recognition approach is a rather effective solution for the small sample recognition problem.     

融合全局和局部方向特征的掌纹识别方法

摘 要：掌纹识别是受到较多关注的生物特征识别技术之一。在各类掌纹识别的方法中, 基于方向特征的方法取得了很好的效果。为了进一步提升识别精度,提出一种融合全局和局部 方向特征的掌纹识别算法,主要融合了基于方向编码的方法、基于方向特征局部描述子的方法 和结合方向特征和相关滤波器的方法。其中前 2 种方法属于空间域方法,可很好地提取掌纹的 局部方向特征;而第 3 种方法属于频域方法,能有效地提取全局方向特征。在匹配值层对该 3 种方法的识别结果进行融合。本文算法在 2 个掌纹数据库上进行了验证,实验结果表明,本文 方法的识别性能明显优于其他几种掌纹识别方法。     

An improved palmprint recognition system using iris features

This paper presents a bimodal biometric recognition system based on the extracted features of the human palmprint and iris using a new graph-based approach termed Fisher locality preserving projections (FLPP). This new technique employs two graphs with the first being used to characterize the within-class compactness and the second dedicated to the augmentation of the between-class separability. By applying the FLPP, only the most discriminant and stable palmprint and iris features are retained. FLPP was implemented on the frequency domain by transforming the extracted region of interest extraction of both biometric modalities using Fourier transform. Subsequently, the palmprint and iris features vectors obtained are matched with their counterpart in the templates databases and the obtained scores are fused to produce a final decision. The proposed combination of palmprint and iris patterns has shown an excellent performance compared to unimodal palmprint biometric recognition. The system was evaluated on a database of 108 subjects and the experimental results show that our system performs very well and achieves a high accuracy expressed by an equal error rate of 0.00%.     

Double-cohesion learning based multiview and discriminant palmprint recognition

Palmprint recognition has been widely used in security authentication. However, most of the existing palmprint representation methods are focused on a special application scenario using the hand-crafted features from a single-view. If the features become weak as the application scenario changes, the recognition performance will be degraded. To address this problem, we propose to comprehensively exploit palmprint features from multiple views to improve the recognition performance in generic scenarios. In this paper, a novel double-cohesion learning based multiview and discriminant palmprint recognition (DC_MDPR) method is proposed, which imposes a double-cohesion strategy to reduce the inter-view margins for each subject and the intra-class margins for each view. In this way, for each subject, the features from different views can be closer to each other in the binary-label space. Meanwhile, for each view, the features sharing the same label information can move towards each other by imposing a neighbor graph regularization. The proposed method can be flexibly applied to any type of palmprint feature fusion. Moreover, it presents the multiview features in a low-dimensionality sub-space, effectively reducing the computational complexity. Experimental results on various palmprint databases have shown that the proposed method can always achieve the best recognition performance compared to other state-of-the-art algorithms.     

Invariant pattern recognition using contourlets and AdaBoost

In this paper, we propose new methods for palmprint classification and handwritten numeral recognition by using the contourlet features. The contourlet transform is a new two dimensional extension of the wavelet transform using multiscale and directional filter banks. It can effectively capture smooth contours that are the dominant features in palmprint images and handwritten numeral images. AdaBoost is used as a classifier in the experiments. Experimental results show that the contourlet features are very stable features for invariant palmprint classification and handwritten numeral recognition, and better classification rates are reported when compared with other existing classification methods.     

基于DCT鉴别分析的掌纹特征提取

离散余玄变换是一种经典的图像处理技术，而鉴别分析是一种常用的图像特征提取技术。本文将这两种技术有机地结合起来，提出了一种新的掌纹特征提取方法。该方法首先对于掌纹的离散余玄变换图像，提出了一个二维可分性判据来选择具有良好可分性的频段;然后提出了一种改进的费舍脸方法来提取鉴别特征。在掌纹图象公共数据库上的实验结果验证了本文所提出的方法的有效性。     

加权自适应CS-LBP与局部判别映射相结合的掌纹识别方法

提取掌纹的最佳低维分类特征一直是掌纹识别研究领域的一个重要方向。针对掌纹图像具有丰富的纹理特征特点,提出一种基于加权自适应中心对称局部二值模式(WACS-LBP)与局部判别映射(LDP)相结合的掌纹识别方法。首先将掌纹感兴趣(ROI)图像分成大小均匀的小区域,利用自适应中心对称局部二值模式(ACS-LBP)算法获取不同区域的纹理特征直方图和权值,经过加权连接得到ROI的加权纹理特征直方图向量;再利用LDP算法对得到的特征向量进行维数约简;最后利用K-最近邻分类器进行掌纹识别。在掌纹公开数据库上进行实验,正确识别率高达97%以上。实验结果表明,该方法不仅是有效、可行的,而且研究思路比较明确。     

3D palmprint recognition using shape index representation and fragile bits

Recent years have witnessed a growing interesting in developing automatic palmprint recognition methods. Most of the previous works have concentrated on two dimensional (2D) palmprint recognition in the past decade. However, the shape information is lost in 2D plamprint images. What’s more, 2D plamprint recognition is not robust enough in practice since its data could be easily counterfeited or contaminated by noise. Consequently, three dimensional (3D) palmprint recognition is treated as an important alternative road to both enhance the performance and robustness of current available palmprint recognition systems. In this paper, we first explore geometrical information of 3D palmprint data by employing shape index formulation, from which Gabor wavelet features are then extracted. Furthermore, we first discover that by incorporating fragile bits information, the performance of coding strategy related 3D recognition method can be further improved. Experiments conducted on the public available 3D plamprint database validate that our method can obtain the highest recognition performance among the state-of-the-art methods estimated.     

2D and 3D palmprint fusion and recognition using PCA plus TPTSR method

This paper employs both two-dimensional (2D) and three-dimensional (3D) features of palmprint for recognition. While 2D palmprint image contains plenty of texture information, 3D palmprint image contains the depth information of the palm surface. Using two different features, we can achieve higher recognition accuracy than using only one of them. In addition, we can improve the robustness. To recognize palmprints, we use two-phase test sample representation (TPTSR) which is proved to be successful in face recognition. Before TPTSR, we perform principal component analysis to extract global features from the 2D and 3D palmprint images. We make decision based on the fusion of 2D and 3D features matching scores. We perform experiments on the PolyU 2D + 3D palmprint database which contains 8,000 samples and achieve satisfying recognition performance.     

基于二维局部保留映射的小样本掌纹识别

小样本生物识别是现实应用中一个较难解决的问题,通过有限训练样本很难得到满意的识别结果。因此,提出了一种新的小样本掌纹识别方法,利用改进的二维局部保留映射（I2DLPP）提取特征,并用支持向量机（SVM）分类。改进的二维局部保留映射是通过同时在行和列方向上进行2DPCA和2DLPP的投影实现的,从而降低了计算复杂度与特征维数;并且构建最近邻图是以图像内部的列为节点,保留更多内部流形结构,改善了识别效果。SVM是针对小样本识别的非常有效的分类工具,将两者结合可以显著提高小样本掌纹识别精度。实验结果证明了该方法的有效性。     

Improved discriminant locality preserving projections for face and palmprint recognition

We propose in this paper two improved manifold learning methods called diagonal discriminant locality preserving projections (Dia-DLPP) and weighted two-dimensional discriminant locality preserving projections (W2D-DLPP) for face and palmprint recognition. Motivated by the fact that diagonal images outperform the original images for conventional two-dimensional (2D) subspace learning methods such as 2D principal component analysis (2DPCA) and 2D linear discriminant analysis (2DLDA), we first propose applying diagonal images to a recently proposed 2D discriminant locality preserving projections (2D-DLPP) algorithm, and formulate the Dia-DLPP method for feature extraction of face and palmprint images. Moreover, we show that transforming an image to a diagonal image is equivalent to assigning an appropriate weight to each pixel of the original image to emphasize its different importance for recognition, which provides the rationale and superiority of using diagonal images for 2D subspace learning. Inspired by this finding, we further propose a new discriminant weighted method to explicitly calculate the discriminative score of each pixel within a face and palmprint sample to duly emphasize its different importance, and incorporate it into 2D-DLPP to formulate the W2D-DLPP method to improve the recognition performance of 2D-DLPP and Dia-DLPP. Experimental results on the widely used FERET face and PolyU palmprint databases demonstrate the efficacy of the proposed methods.     

基于实值Gabor变换的掌纹识别

掌纹识别作为一种重要的生物特征识别方法,其中的一个重要环节就是掌纹特征的提取,本文提出了一种基于实数形式离散Gabor变换的掌纹特征提取方法,将空域的掌纹图像变换到联合（时间）空间频率域并将其联合（时间）空间频率域的能量分布作为掌纹的特征,以此为基础分别使用欧式距离和支持向量机进行了不同掌纹的匹配识别。实验结果表明,该算法对掌纹图像小的平移、小角度的旋转和小的手掌伸缩具有鲁棒性,并且获得了较高的识别率。     

Palmprint authentication using a symbolic representation of images

A new branch of biometrics, palmprint authentication, has attracted increasing amount of attention because palmprints are abundant of line features so that low resolution images can be used. In this paper, we propose a new texture based approach for palmprint feature extraction, template representation and matching. An extension of the SAX (Symbolic Aggregate approXimation), a time series technology, to 2D data is the key to make this new approach effective, simple, flexible and reliable. Experiments show that by adopting the simple feature of grayscale information only, this approach can achieve an equal error rate of 0.3%, and a rank one identification accuracy of 99.9% on a 7752 palmprint public database. This new approach has very low computational complexity so that it can be efficiently implemented on slow mobile embedded platforms. The proposed approach does not rely on any parameter training process and therefore is fully reproducible. What is more, besides the palmprint authentication, the proposed 2D extension of SAX may also be applied to other problems of pattern recognition and data mining for 2D images.     

A Performance Evaluation of Classic Convolutional Neural Networks for 2D and 3D Palmprint and Palm Vein Recognition

Palmprint recognition and palm vein recognition are two emerging biometrics technologies. In the past two decades, many traditional methods have been proposed for palmprint recognition and palm vein recognition, and have achieved impressive results. However, the research on deep learning-based palmprint recognition and palm vein recognition is still very preliminary. In this paper, in order to investigate the problem of deep learning based 2D and 3D palmprint recognition and palm vein recognition in-depth, we conduct performance evaluation of seventeen representative and classic convolutional neural networks (CNNs) on one 3D palmprint database, five 2D palmprint databases and two palm vein databases. A lot of experiments have been carried out in the conditions of different network structures, different learning rates, and different numbers of network layers. We have also conducted experiments on both separate data mode and mixed data mode. Experimental results show that these classic CNNs can achieve promising recognition results, and the recognition performance of recently proposed CNNs is better. Particularly, among classic CNNs, one of the recently proposed classic CNNs, i.e., EfficientNet achieves the best recognition accuracy. However, the recognition performance of classic CNNs is still slightly worse than that of some traditional recognition methods.

     

基于Gabor小波变换和最佳鉴别特征的掌纹识别

提出了一种提取掌纹图像特征的方法,该方法的实现过程如下：首先,计算掌纹图像上均布离散位置的二维Gabor小波变换系数的幅值,将其作为掌纹图像的原始特征;其次,利用主分量分析实现Gabor小波特征的降维;最后,通过线性判别分析提取最有利于分类的最佳鉴别特征。实验结果表明了该方法的有效性。     

A face and palmprint recognition approach based on discriminant DCT feature extraction

In the field of image processing and recognition, discrete cosine transform (DCT) and linear discrimination are two widely used techniques. Based on them, we present a new face and palmprint recognition approach in this paper. It first uses a two-dimensional separability judgment to select the DCT frequency bands with favorable linear separability. Then from the selected bands, it extracts the linear discriminative features by an improved Fisherface method and performs the classification by the nearest neighbor classifier. We detailedly analyze theoretical advantages of our approach in feature extraction. The experiments on face databases and palmprint database demonstrate that compared to the state-of-the-art linear discrimination methods, our approach obtains better classification performance. It can significantly improve the recognition rates for face and palmprint data and effectively reduce the dimension of feature space.     

Optimal subset-division based discrimination and its kernelization for face and palmprint recognition

Discriminant analysis is effective in extracting discriminative features and reducing dimensionality. In this paper, we propose an optimal subset-division based discrimination (OSDD) approach to enhance the classification performance of discriminant analysis technique. OSDD first divides the sample set into several subsets by using an improved stability criterion and K-means algorithm. We separately calculate the optimal discriminant vectors from each subset. Then we construct the projection transformation by combining the discriminant vectors derived from all subsets. Furthermore, we provide a nonlinear extension of OSDD, that is, the optimal subset-division based kernel discrimination (OSKD) approach. It employs the kernel K-means algorithm to divide the sample set in the kernel space and obtains the nonlinear projection transformation. The proposed approaches are applied to face and palmprint recognition, and are examined using the AR and FERET face databases and the PolyU palmprint database. The experimental results demonstrate that the proposed approaches outperform several related linear and nonlinear discriminant analysis methods.     

卷积神经网络在掌纹识别中的性能评估

目的 掌纹识别技术作为一种新兴的生物特征识别技术越来越受到广泛重视。深度学习是近10年来人工智能领域取得的重要突破。但是,基于深度学习的掌纹识别相关研究还比较初步,尤其缺乏深入的分析和讨论,且已有的工作使用的都是比较简单的神经网络模型。为此,本文使用多种卷积神经网络对掌纹识别进行性能评估。方法 选取比较典型的8种卷积神经网络模型,在5个掌纹数据库上针对不同网络模型、学习率、网络层数、训练数据量等进行性能评估,展开实验,并与经典的传统掌纹识别方法进行比较。结果 在不同卷积神经网络识别性能评估方面,ResNet和DenseNet超越了其他网络,并在PolyU M_B库上实现了100%的识别率。针对不同学习率、网络层数、训练数据量的实验发现,5×10^-5为比较合适的识别率;网络层数并非越深越好,VGG-16与VGG-19的识别率相当,ResNet层数由18层逐渐增加到50层,识别率则逐渐降低;参与网络训练的数据量总体来说越多越好。对比传统的非深度学习方法,卷积神经网络在识别效果方面还存在一定差距。结论 实验结果表明,对于掌纹识别,卷积神经网络也能获得较好的识别效果,但由于训练数据量不充分等原因,与传统算法的识别性能还有差距。基于卷积神经网络的掌纹识别研究还需要进一步深入开展。     

基于二维双向FLD的掌纹识别方法

采用二维双向Fisher线性判别分析对掌纹图像进行特征提取,即通过在水平和垂直2 个方向上各执行1 次二维Fisher线性判别分析,能消除掌纹图像行和列的相关性。运用Fisher准则选取更适合于分类的矩阵分量,将特征信息压缩到图像矩阵的左上角,缩小了特征的维数。测试结果表明,该方法具有更高的识别率和更低的计算复杂度。     

指节纹识别综述*

相比其它生物特征,指节纹具有特征丰富,采集设备价格低,易于结合手形、手指静脉及掌纹组成性能鲁棒的多模态识别系统等优点.文中首先介绍指节纹的定义、数据采集、预处理方法等,之后详细介绍各种指节纹识别算法及多模态识别方案.根据特征提取及匹配方法的不同,将指节纹识别算法分为6类:基于结构的算法、基于子空间学习的算法、基于编码的算法、基于纹理特征的算法、基于相关滤波器的算法和基于局部特征描述子的算法.回顾和总结各种算法的特点,展望未来指节纹识别的发展方向.