Structural similarity classifier for facial expression recognition

A novel Gabor filter structural similarity algorithm (GFSSIM) is proposed for facial expression recognition (FER) on noisy images. Low-resolution facial images with low SNRs are specifically dealt with FER system. The features are extracted using 40 Gabor filters, and a feature subset is selected for classification. The test image is classified based on proposed GFSSIM algorithm. The experimental results show that the recognition rate for heavily deteriorated images outperforms the conventional classifier method. In addition, the proposed method is more efficient from the computational complexity point of view.     

基于Gabor滤波的表情动态特征提取方法

针对目前动态特征提取方法在提取序列表情特征时人脸外貌特征也一起被提取的缺陷,提出了一种基于Gabor滤波的表情动态特征提取方法。利用Gabor滤波器在频率和方向上的选择特性,在提取表情特征时较好地抑制了人脸外貌特征的提取,从而减少了表情特征中人脸外貌特征的含量。在Cohn-Kanade和CMU-AMP人脸库上的表情识别实验表明,本文方法获得的表情动态特征对表情识别更有效。     

基于Gabor小波的人脸表情特征提取研究

为了使计算机能更好的识别人脸表情,对基于Gabor小波变换的人脸表情识别方法进行了研究。首先对包含表情区域的静态灰度图像进行预处理,包括对确定的人脸表情区域进行尺寸和灰度归一化,然后利用二维Gabor小波变换提取脸部表情特征,使用快速PCA方法对提取的Gabor小波特征初步降维。再在低维的空间中,利用Fisher准则提取那些有利于分类的特征,最后用SVM分类器进行分类。实验结果表明,上述提出的方法比传统的方法识别速度更快,能达到实时性的要求,并且具有很好的鲁棒性,识别率高。     

结合Gabor特征与Adaboost的人脸表情识别

通过提取人脸图像的Gabor特征，结合Adaboost，进行人脸表情识别（FER）。针对Gabor特征维数高、冗余大的特点，引入Adaboost算法进行特征选择降低特征向量的维数。然后再以支持向量机（SVM）和最近邻分类法相结合组成分类器进行分类。该方法综合运用了Gabor特征对于人脸表情的良好表征能力、Adaboost算法的强大特征选择能力以及SVM在处理少样本、高维数问题中的优势。在JAFFE库上进行测试的结果验证了该法的有效性。从Adaboost所选择的特征集可知，在眼和嘴区域提取的特征，对于FER是最为重要的。     

Comparison of ICA approaches for facial expression recognition

Independent component analysis (ICA) and Gabor wavelets extract the most discriminating features for facial action unit classification by employing either a cosine similarity measure (CSM) classifier or support vector machines (SVMs). So far, only the ICA approach, which is based on the InfoMax principle, has been tested for facial expression recognition. In this paper, in addition to the InfoMax approach, another five ICA approaches extract features from two facial expression databases. In particular, the Extended InfoMax ICA, the undercomplete ICA, and the nonlinear kernel-ICA approaches are exploited for facial expression representation for the first time. When applied to images, ICA treats the images as being mixtures of independent sources and decomposes them into an independent basis and the corresponding mixture coefficients. Two architectures for representing the images can be employed yielding either independent and sparse basis images or independent and sparse distributions of image representation coefficients. After feature extraction, facial expression classification is performed with the help of either a CSM classifier or an SVM classifier. A detailed comparative study is made with respect to the accuracy offered by each classifier. The correlation between the accuracy and the mutual information of independent components or the kurtosis is evaluated. Statistically significant correlations between the aforementioned quantities are identified. Several issues are addressed in the paper: (i) whether features having super- and sub-Gaussian distribution facilitate facial expression classification; (ii) whether a nonlinear mixture of independent sources improves the classification accuracy; and (iii) whether an increased “amount” of sparseness yields more accurate facial expression recognition. In addition, performance enhancements by employing leave-one-set of expressions-out and subspace selection are studied. Statistically significant differences in accuracy between classifiers using several feature extraction methods are also indicated.     

基于Gabor小波与HOG特征的目标检测方法

针对传统的HOG目标识别方法,提出一种通过Gabor滤波融合后的进行HOG特征提取的目标检测方法。为了提高HOG特征提取信息的有效性,首先用Gabor对目标图像做了预处理,其预处理过程是针对图像Gabor特征的在尺度和方向上进行融合,形成一幅Gabor图像。为了有效提取全局的Gabor图像纹理、轮廓信息,将该图像分为大小相同且重叠的块,分别对每个块进行统计,最后用RealAdaboost级联方法对目标和非目标样本进行学习,并对测试序列进行分类。结果表明,基于梯度的Gabor预处理技术能提高目标特征提取性能。与传统的HOG目标识别的方法比较,该方法在目标图像受到干扰的情况(遮挡、重叠等)下,监测效果明显优越。     

Entropy-based feature selection for improved 3D facial expression recognition

Facial expressions contain most of the information on human face which is essential for human–computer interaction. Development of robust algorithms for automatic recognition of facial expressions with high recognition rates has been a challenge for the last 10 years. In this paper, we propose a novel feature selection procedure which recognizes basic facial expressions with high recognition rates by utilizing three-Dimensional (3D) geometrical facial feature positions. The paper presents a system of classifying expressions in one of the six basic emotional categories which are anger, disgust, fear, happiness, sadness, and surprise. The paper contributes on feature selections for each expression independently and achieves high recognition rates with the proposed geometric facial features selected for each expression. The novel feature selection procedure is entropy based, and it is employed independently for each of the six basic expressions. The system’s performance is evaluated using the 3D facial expression database, BU-3DFE. Experimental results show that the proposed method outperforms the latest methods reported in the literature.     

Retrieval of head–neck medical images using Gabor filter based on power-law transformation method and rank BHMT

This research aims to work on the specific medical domain. In this work, retrieval of the head–neck medical images from a database is discussed. Content-based medical image retrieval system (CBMIR) is used for retrieving the head–neck images. CBMIR is automatic and more efficient compared with the text-based approach. Shape and texture features are used for constructing feature vector. Texture feature is extracted using a modified Gabor filter based on power-law transformation method. Shape feature is extracted using rank BHMT (rank-order blur hit or miss transformation) method. Shape and texture features are combined to form a single feature vector. Threshold value very near to zero is used to retrieve images from the database. The proposed method is compared with log-Gabor filters and rank BHMT method. Combinations of modified Gabor filter with rank BHMT gave better performance than other methods.     

An unsupervised texture segmentation algorithm with feature spacereduction and knowledge feedback

This paper presents an unsupervised texture segmentation algorithm based on feature extraction using multichannel Gabor filtering. It is shown that feature contrast, a criterion derived for Gabor filter parameter selection, is well suited for feature coordinate weighting in order to reduce the feature space dimension. The central idea of the proposed segmentation algorithm is to decompose the actual segmented image into disjunct areas called scrap images and use them after lowpass filtering as additional features for repeated k-means clustering and minimum distance classification. This yields a classification of texture regions with an improved degree of homogeneity while preserving precise texture boundaries.     

基于Gabor调制的深度多层子空间人脸识别算法

人脸识别的关键在于特征提取,过去主要从完美的低维特征子空间来刻画高维图像,但是近年来深度学习模型为特征提取提供新方向。本文提出在Gabor特征描述子调制下的深度子空间模型,在深度子空间这一新型深度学习框架基础上,使用Gabor滤波器组处理图像,并构建深度特征提取多层网络,得到Gabor调制下的深层抽象特征。首先将传统的8个方向5个尺度的40个Gabor滤波器在尺度上进行压缩得到8个基本Gabor滤波器组;然后将经过Gabor滤波的描述特征分别送入深度化改造的子空间模型,得到图像的深层特征表示;其次将这些特征进行哈希编码,直方图分块,作为描述特征。本文在FERET、ORL、CMU_PIE等数据库上讨论加入Gabor滤波器调制后的深度多层子空间特征提取模型在人脸识别问题上性能的提升,实验结果表明,该算法可以取得较好的识别率,并对光照、表情、姿态等有很好的鲁棒性,能够弥补浅层网络易受训练图像影响的缺点。      

A comparative study of local matching approach for face recognition.

In contrast to holistic methods, local matching methods extract facial features from different levels of locality and quantify them precisely. To determine how they can be best used for face recognition, we conducted a comprehensive comparative study at each step of the local matching process. The conclusions from our experiments include: (1) additional evidence that Gabor features are effective local feature representations and are robust to illumination changes; (2) discrimination based only on a small portion of the face area is surprisingly good; (3) the configuration of facial components does contain rich discriminating information and comparing corresponding local regions utilizes shape features more effectively than comparing corresponding facial components; (4) spatial multiresolution analysis leads to better classification performance; (5) combining local regions with Borda count classifier combination method alleviates the curse of dimensionality. We implemented a complete face recognition system by integrating the best option of each step. Without training, illumination compensation and without any parameter tuning, it achieves superior performance on every category of the FERET test: near perfect classification accuracy (99.5%) on pictures taken on the same day regardless of indoor illumination variations, and significantly better than any other reported performance on pictures taken several days to more than a year apart. The most significant experiments were repeated on the AR database, with similar results.     

融合局部纹理和形状特征的人脸表情识别

针对局部二值模式(LBP)、中心对称局部二值模式(CS-LBP)和梯度方向直方图(HOG)的不足进行改进,该文提出中心对称局部平滑二值模式(CS-LSBP)和绝对梯度方向直方图(HOAG),并提出一种融合局部纹理特征和局部形状特征的人脸表情识别方法。该方法首先采用CS-LSBP算子和HOAG算子分别提取人脸表情图像的局部纹理特征和局部形状特征,然后使用典型线性分析法(CCA)进行特征融合,最后利用支持向量机(SVM)进行表情分类。在JAFFE人脸表情库和Cohn-Kanade(CK)人脸表情库上的实验结果表明,改进的特征提取方法能更加完整、精确地提取图像的细节信息,基于CCA的特征融合方法能充分发挥特征的表征能力,该文所提人脸表情识别方法取得了较好的分类识别效果。     

基于MG-LTP与ELM的微表情识别

特征提取和表情分类是表情识别的关键技术。针对传统方法识别率低的缺点,首先,提出了一种基于平均灰度的局部三值模式(MG-LTP)新算法,用于提取表情特征;其次,使用极限学习机(ELM)作为分类器,用于特征分类;最后,将二者结合用于表情识别,并进一步应用于人脸微表情识别中。在JAFFE数据库及CASME人脸微表情数据库进行试验,与传统方法对比,取得了较好的效果。     

基于Gabor滤波器和局部纹理特征提取的SAR目标识别算法

该文提出了一种基于Gabor滤波器和Three-Patch Local Binary Patterns(TPLBP)局部纹理特征提取的合成孔径雷达(Synthetic Aperture Rader, SAR)图像目标识别算法。首先, 利用Gabor滤波器对SAR图像在不同方向上进行滤波, 增强SAR图像中目标及其阴影的关键特征;然后, 利用TPLBP算法对Gabor滤波之后的图像进行局部纹理特征提取, 该算法克服了Local Binary Patterns(LBP)算法无法描述大范围领域纹理特征的缺陷, 并且保持了LBP旋转不变的特性, 减少了SAR图像目标方位变化对识别效果的影响;最后利用极限学习机(Extreme Learning Machine, ELM)分类器实现目标识别。该文通过MSTAR数据库中的3类SAR目标识别实验验证了该算法的有效性。      

Adaptive feature selection based on reconstruction residual and accurately located landmarks for expression-robust 3D face recognition

A novel adaptive feature selection based on reconstruction residual and accurately located landmarks for expression-robust 3D face recognition is proposed in this paper. Firstly, the novel facial coarse-to-fine landmarks localization method based on Active Shape Model and Gabor wavelets transformation is proposed to exactly and automatically locate facial landmarks in range image. Secondly, the multi-scale fusion of the pyramid local binary patterns (F-PLBP) based on the irregular segmentation associated with the located landmarks is proposed to extract the discriminative feature. Thirdly, a sparse representation-based classifier based on the adaptive feature selection (A-SRC) using the distribution of the reconstruction residual is presented to select the expression-robust feature and identify the faces. Finally, the experimental evaluation based on FRGC v2.0 indicates that the adaptive feature selection method using F-PLBP combined with the A-SRC can obtain the high recognition accuracy by performing the higher discriminative power to overcome the influence from the facial expression variations.     

基于GLCM、CGA和Adaboost的人脸表情识别方法研究

提出基于灰度共生矩阵(GLCM)和混沌遗传优化算法(CGA)的人脸表情识别方法(FER)。为了消除遗传算法中个体在解空间内分布的不均匀性,利用混沌的随机性、遍历性和规律性,将混沌引入到遗传算法中,由此得到了混沌遗传优化算法(CGA);通过灰度共生矩阵提取出的特征和改进后的混沌遗传优化算法,将人脸表情识别的寻找感兴趣区域(ROI)和特征提取结合成一步;利用Adaboost算法进行图像分类。经过理论和实验证明,该方法实现简单、切实可行。     

Monocular precrash vehicle detection: features and classifiers.

Robust and reliable vehicle detection from images acquired by a moving vehicle (i.e., on-road vehicle detection) is an important problem with applications to driver assistance systems and autonomous, self-guided vehicles. The focus of this work is on the issues of feature extraction and classification for rear-view vehicle detection. Specifically, by treating the problem of vehicle detection as a two-class classification problem, we have investigated several different feature extraction methods such as principal component analysis, wavelets, and Gabor filters. To evaluate the extracted features, we have experimented with two popular classifiers, neural networks and support vector machines (SVMs). Based on our evaluation results, we have developed an on-board real-time monocular vehicle detection system that is capable of acquiring grey-scale images, using Ford's proprietary low-light camera, achieving an average detection rate of 10 Hz. Our vehicle detection algorithm consists of two main steps: a multiscale driven hypothesis generation step and an appearance-based hypothesis verification step. During the hypothesis generation step, image locations where vehicles might be present are extracted. This step uses multiscale techniques not only to speed up detection, but also to improve system robustness. The appearance-based hypothesis verification step verifies the hypotheses using Gabor features and SVMs. The system has been tested in Ford's concept vehicle under different traffic conditions (e.g., structured highway, complex urban streets, and varying weather conditions), illustrating good performance.     

基于局部二元模式的快速红外人脸识别系统

红外人脸成像具有对光照、人脸皮肤、表情、姿态等因素变化不敏感的特点,可以在一定程度上弥补这些因素对可见光人脸识别影响的不足。为了充分提取红外人的局部鉴别特征,文中提出了一个基于局部二元模式的快速红外人脸识别系统。该系统首先通过thermoVision A40型红外热像仪获分辨率为320240的红外人脸图像,并通过人脸检测和归一化方法提取大小为6080的标准红外人脸图像。其次,基于人脸图像的对称性,将红外人脸图像分块。通过局部二元模式直方图提取每一分块所包含的纹理模式特征。最后,采用Kruskal-Wallis（KW）特征选择算法,进一步抽取对识别有贡献的局部纹理特征用于分类识别。实验结果表明:提出的热红外人脸系统识别率明显优于基于主成分分析（PCA）和线性鉴别分析（LDA）的传统红外人脸识别系统,可以达到98.6%的识别率。与此同时,提出的红外人脸识别系统识别速度也快于传统基于PCA和LDA系统,可以广泛应用于实时人脸识别中。