Face recognition with radial basis function (RBF) neural networks

A general and efficient design approach using a radial basis function (RBF) neural classifier to cope with small training sets of high dimension, which is a problem frequently encountered in face recognition, is presented. In order to avoid overfitting and reduce the computational burden, face features are first extracted by the principal component analysis (PCA) method. Then, the resulting features are further processed by the Fisher's linear discriminant (FLD) technique to acquire lower-dimensional discriminant patterns. A novel paradigm is proposed whereby data information is encapsulated in determining the structure and initial parameters of the RBF neural classifier before learning takes place. A hybrid learning algorithm is used to train the RBF neural networks so that the dimension of the search space is drastically reduced in the gradient paradigm. Simulation results conducted on the ORL database show that the system achieves excellent performance both in terms of error rates of classification and learning efficiency.     

A novel face recognition algorithm for distinguishing faces with various angles

In order to distinguish faces of various angles during face recognition, an algorithm of the combination of approximate dynamic programming （ADP） called action dependent heuristic dynamic programming （ADHDP） and particle swarm optimization （PSO） is presented. ADP is used for dynamically changing the values of the PSO parameters. During the process of face recognition, the discrete cosine transformation （DCT） is first introduced to reduce negative effects. Then, Karhunen-Loeve （K-L） transformation can be used to compress images and decrease data dimensions. According to principal component analysis （PCA）, the main parts of vectors are extracted for data representation. Finally, radial basis function （RBF） neural network is trained to recognize various faces. The training of RBF neural network is exploited by ADP-PSO. In terms of ORL Face Database, the experimental result gives a clear view of its accurate efficiency.     

基于血流图的小波域分块DCT + FLD红外人脸识别方法

为了从生物特征角度同时结合人脸的局部特征和整体特征提高红外人脸的识别性能,提出了一种基于血流图的小波域分块DCT+FLD(Fisher线性判别)红外人脸识别方法.首先利用血流模型把温谱图转换成血流图,然后用小波变换对人脸血流图像做两级小波分解,再对低频子带进行分块并对每个分块进行DCT变换,提取部分变换后的系数作为子块的特征值,对这些子块的特征值构成的组合特征值从整体上做Fisher线性分析,得到特征子空间,最后根据欧氏距离和三阶近邻分类器进行识别,得到最终的识别结果.实验表明,同基于传统PCA+FLD,DCT+FLD以及DWT+PCA+FLD方法相比,所提出的方法得到了更好的识别效果.     

结合DCT和WT的多分类器融合的光照人脸识别

为进一步提高各种光照条件下的人脸识别精度,提出了一种将光照补偿和光照不变特征提取相结合的人脸识别方法。算法先应用对数域DCT进行光照补偿;然后,用三次样条二进小波分解提取一个低频子图和三个对光照变化鲁棒的边缘细节子图;接着,用二维线性判别分析进行特征降维并构造四个分量分类器;最后,通过多分类器融合规则进行融合分类。该文算法在CAS-PEAL人脸库光照子集上的实验达到了83.91%的识别率,在YaleB人脸库上则实现了100%的识别率,实验结果证明了该文算法对光照变换具有较好的鲁棒性。     

Learning identity with radial basis function networks

Radial basis function (RBF) networks are compared with other neural network techniques on a face recognition task for applications involving identification of individuals using low-resolution video information. The RBF networks are shown to exhibit useful shift, scale and pose (y-axis head rotation) invariance after training when the input representation is made to mimic the receptive field functions found in early stages of the human vision system. In particular, representations based on difference of Gaussian (DoG) filtering and Gabor wavelet analysis are compared. Extensions of the techniques to the case of image sequence analysis are described and a time delay (TD) RBF network is used for recognising simple movement-based gestures. Finally, we discuss how these techniques can be used in real-life applications that require recognition of faces and gestures using low-resolution video images.     

基于改进Canny算子和神经网络的人体行为识别模型

为了提高了人体行为识别的正确率,提出了一种基于改进Canny算子和神经网络的人体行为识别模型（ICanny-RBF）。采用改进Canny算子对人体行为图像进行预处理,提取人体行为轮廓,提取7个不变矩特征作为RBF神经网络的输入向量,训练出能够识别人体行为的RBF神经网络模型,并采用取k-means算法确定RBF神经网络聚类中心,采用Weizmann数据集进行仿真实验。仿真结果表明,与传统方法相比,提出的ICanny-RBF模型提高了人体行为的识别正确率。     

A pose-wise linear illumination manifold model for face recognition using video

The objective of this work is to recognize faces using video sequences both for training and novel input, in a realistic, unconstrained setup in which lighting, pose and user motion pattern have a wide variability and face images are of low resolution. There are three major areas of novelty: (i) illumination generalization is achieved by combining coarse histogram correction with fine illumination manifold-based normalization; (ii) pose robustness is achieved by decomposing each appearance manifold into semantic Gaussian pose clusters, comparing the corresponding clusters and fusing the results using an RBF network; (iii) a fully automatic recognition system based on the proposed method is described and extensively evaluated on 600 head motion video sequences with extreme illumination, pose and motion pattern variation. On this challenging data set our system consistently demonstrated a very high recognition rate (95% on average), significantly outperforming state-of-the-art methods from the literature.     

Cloud basis function neural network: A modified RBF network architecture for holistic facial expression recognition

The paper presents novel modifications to radial basis functions (RBFs) and a neural network based classifier for holistic recognition of the six universal facial expressions from static images. The new basis functions, called cloud basis functions (CBFs) use a different feature weighting, derived to emphasize features relevant to class discrimination. Further, these basis functions are designed to have multiple boundary segments, rather than a single boundary as for RBFs. These new enhancements to the basis functions along with a suitable training algorithm allow the neural network to better learn the specific properties of the problem domain. The proposed classifiers have demonstrated superior performance compared to conventional RBF neural networks as well as several other types of holistic techniques used in conjunction with RBF neural networks. The CBF neural network based classifier yielded an accuracy of 96.1%, compared to 86.6%, the best accuracy obtained from all other conventional RBF neural network based classification schemes tested using the same database.     

基于小波和非负稀疏矩阵分解的人脸识别方法

提出了利用小波变换(WT)、非负稀疏矩阵分解(NMFs)和Fisher线性判别(FLD)来进行人脸识别。用小波变换分解人脸图像,选择最低分辨率的子段,既能捕获到人脸的实质特征,又有效地降低了计算复杂性;非负稀疏矩阵分解能显示地控制分解稀疏度和发现人脸图像的局部化表征;Fisher线性判别能在低维子空间中形成良好的分类。实验结果表明,这种方法对光照变化、人脸表情和部分遮挡不敏感,具有良好的健壮性和较高的识别效率。     

粗糙RBF神经网络集成的模式识别方法

提出一种定义属性重要度的方法,并根据属性的重要度测量元素之间的距离,以确定训练集的聚类情况.由于聚类的不确定性,提出利用粗糙集方法确定精确的下、上近似集合,用其聚类中心作为RBF神经网络的径向基中心,设计两个基函数中心不同的RBF神经网络.最后在经验风险最小化原则下,确定两个网络的每个输出值的置信度,得到神经网络集成的最终输出.网络的训练采用递推最小二乘方法,通过两个模式识别仿真实例验证该方法的有效性和正确性.     

RBF神经网络在人脸识别中的应用

RBF是模式识别中应用最为广泛的一种神经网络。将这种网络应用于人脸识别,建立了人脸识别模型。通过改进隐含层中心选择算法,利用Yale人脸图像数据库进行仿真实验,对比分析了它们各自的识别率指标,说明本文提出的方法在不影响识别率的情况下可以显著提高人脸识别的速度,减小系统的存储量,从而满足人脸识别的实用性要求。     

Illumination compensation and normalization for robust face recognition using discrete cosine transform in logarithm domain.

This paper presents a novel illumination normalization approach for face recognition under varying lighting conditions. In the proposed approach, a discrete cosine transform (DCT) is employed to compensate for illumination variations in the logarithm domain. Since illumination variations mainly lie in the low-frequency band, an appropriate number of DCT coefficients are truncated to minimize variations under different lighting conditions. Experimental results on the Yale B database and CMU PIE database show that the proposed approach improves the performance significantly for the face images with large illumination variations. Moreover, the advantage of our approach is that it does not require any modeling steps and can be easily implemented in a real-time face recognition system.     

Robust and adaptive techniques in self-organizing neural networks

Robust and adaptive training algorithms aiming at enhancing the capabilities of self-organizing and Radial Basis Function (RBF) neural networks are reviewed in this paper. The following robust variants of Learning Vector Quantizer (LVQ) are described: the order statistics LVQ, the L ₂ LVQ and the split-merge LVQ. Successful application of the marginal median LVQ that belongs to the class of order statistics LVQs in the self-organized selection of the centers in RBF neural networks is reported. Moreover, the use of the median absolute deviation in the estimation of the covariance matrix of the observations assigned to each hidden unit in RBF neural networks is proposed. Applications that prove the superiority of the proposed variants of LVQ and RBF neural networks in noisy color image segmentation, color-based image recognition, segmentation of ultrasonic images, motion-field smoothing and moving object segmentation are outlined.     

Neural networks with enhanced outlier rejection ability for off-line handwritten word recognition

For a segmentation and dynamic programming-based handwritten word recognition system, outlier rejection at the character level can improve word recognition performance because it reduces the chances that erroneous combinations of segments result in high word confidence values. We studied the multilayer perceptron (MLP) and a variant of radial basis function network (RBF) with the goal to use them as character level classifiers that have enhanced outlier rejection ability. The variant of the RBF uses principal component analysis (PCA) on the clusters defined by the nodes in the hidden layer. It was also trained with and without a regularization term that was aimed at minimizing the variances of the nodes in the hidden layer. Our experiments on handwritten word recognition showed: (1) In the case of MLPs, using more hidden nodes than that required for classification and including outliers in the training data can improve outlier rejection performance; (2) in the case of PCA-RBFs, training with the regularization term and no outlier can achieve performance very close to training with outliers. These results are both interesting. Result (1) is of interest because it is well known that minimizing the number of parameters, and therefore keeping the number of hidden units low, should increase the generalization capability. On the other hand, using more hidden units increases the chances of creating closed decision regions, as predicted by the theory in Gori and Scarselli (IEEE Trans. PAMI 20 (11) (1998) 1121). Result (2) is a strong statement in support of the use of regularization terms for the training of RBF-type neural networks in problems such as handwriting recognition for which outlier rejection is important. Additional tests on combining MLPs and PCA-RBF networks showed the potential to improve word recognition performance by exploiting the complementarity of these two kinds of neural networks.     

A fuzzy hybrid learning algorithm for radial basis function neural network with application in human face recognition

This paper presents a fuzzy hybrid learning algorithm (FHLA) for the radial basis function neural network (RBFNN). The method determines the number of hidden neurons in the RBFNN structure by using cluster validity indices with majority rule while the characteristics of the hidden neurons are initialized based on advanced fuzzy clustering. The FHLA combines the gradient method and the linear least-squared method for adjusting the RBF parameters and the neural network connection weights. The RBFNN with the proposed FHLA is used as a classifier in a face recognition system. The inputs to the RBFNN are the feature vectors obtained by combining shape information and principal component analysis. The designed RBFNN with the proposed FHLA, while providing a faster convergence in the training phase, requires a hidden layer with fewer neurons and less sensitivity to the training and testing patterns. The efficiency of the proposed method is demonstrated on the ORL and Yale face databases, and comparison with other algorithms indicates that the FHLA yields excellent recognition rate in human face recognition.     

Toward a practical face recognition system: robust alignment and illumination by sparse representation

Many classic and contemporary face recognition algorithms work well on public data sets, but degrade sharply when they are used in a real recognition system. This is mostly due to the difficulty of simultaneously handling variations in illumination, image misalignment, and occlusion in the test image. We consider a scenario where the training images are well controlled and test images are only loosely controlled. We propose a conceptually simple face recognition system that achieves a high degree of robustness and stability to illumination variation, image misalignment, and partial occlusion. The system uses tools from sparse representation to align a test face image to a set of frontal training images. The region of attraction of our alignment algorithm is computed empirically for public face data sets such as Multi-PIE. We demonstrate how to capture a set of training images with enough illumination variation that they span test images taken under uncontrolled illumination. In order to evaluate how our algorithms work under practical testing conditions, we have implemented a complete face recognition system, including a projector-based training acquisition system. Our system can efficiently and effectively recognize faces under a variety of realistic conditions, using only frontal images under the proposed illuminations as training.     

基于局部小波变换与DCT的人脸识别算法

提出了一种基于局部小波变换和离散余弦变换(DiscreteCosineTransform,DCT)相结合的人脸识别方法,该算法首先利用小波变换对人脸图像做适当层次的小波分解,然后通过离散余弦变换对低频分量作进一步的特征提取和压缩,得到人脸识别特征,最后利用欧氏距离和最近邻分类器进行识别。基于ORL人脸数据库的实验结果表明了该算法的有效性。     

Robust face recognition using 2D and 3D data: Pose and illumination compensation

The paper addresses the problem of face recognition under varying pose and illumination. Robustness to appearance variations is achieved not only by using a combination of a 2D color and a 3D image of the face, but mainly by using face geometry information to cope with pose and illumination variations that inhibit the performance of 2D face recognition. A face normalization approach is proposed, which unlike state-of-the-art techniques is computationally efficient and does not require an extended training set. Experimental results on a large data set show that template-based face recognition performance is significantly benefited from the application of the proposed normalization algorithms prior to classification.     

基于加权小波的DCT人脸识别算法研究

针对图像维数过高,计算复杂的问题,提出一种基于加权小波分析和DCT的人脸识别方法,通过对人脸图像进行小波分解,提取低频和加权高频分量的DCT变换系数作为识别特征向量,采用加权距离进行分类识别.该方法在ORL和YALE人脸库上进行了测试比较,结果表明,无论训练时间还是识别率,都优于传统的PCA方法,和小波结合PCA的方法相比较,识别率也明显提高.     

Total variation models for variable lighting face recognition

In this paper, we present the logarithmic total variation (LTV) model for face recognition under varying illumination, including natural lighting conditions, where we rarely know the strength, direction, or number of light sources. The proposed LTV model has the ability to factorize a single face image and obtain the illumination invariant facial structure, which is then used for face recognition. Our model is inspired by the SQI model but has better edge-preserving ability and simpler parameter selection. The merit of this model is that neither does it require any lighting assumption nor does it need any training. The LTV model reaches very high recognition rates in the tests using both Yale and CMU PIE face databases as well as a face database containing 765 subjects under outdoor lighting conditions.