General tensor discriminant analysis and gabor features for gait recognition

The traditional image representations are not suited to conventional classification methods, such as the linear discriminant analysis (LDA), because of the under sample problem (USP): the dimensionality of the feature space is much higher than the number of training samples. Motivated by the successes of the two dimensional LDA (2DLDA) for face recognition, we develop a general tensor discriminant analysis (GTDA) as a preprocessing step for LDA. The benefits of GTDA compared with existing preprocessing methods, e.g., principal component analysis (PCA) and 2DLDA, include 1) the USP is reduced in subsequent classification by, for example, LDA; 2) the discriminative information in the training tensors is preserved; and 3) GTDA provides stable recognition rates because the alternating projection optimization algorithm to obtain a solution of GTDA converges, while that of 2DLDA does not.We use human gait recognition to validate the proposed GTDA. The averaged gait images are utilized for gait representation. Given the popularity of Gabor function based image decompositions for image understanding and object recognition, we develop three different Gabor function based image representations: 1) the GaborD representation is the sum of Gabor filter responses over directions, 2) GaborS is the sum of Gabor filter responses over scales, and 3) GaborSD is the sum of Gabor filter responses over scales and directions. The GaborD, GaborS and GaborSD representations are applied to the problem of recognizing people from their averaged gait images.A large number of experiments were carried out to evaluate the effectiveness (recognition rate) of gait recognition based on first obtaining a Gabor, GaborD, GaborS or GaborSD image representation, then using GDTA to extract features and finally using LDA for classification. The proposed methods achieved good performance for gait recognition based on image sequences from the USF HumanID Database. Experimental comparisons are made with nine state of the art classification methods in gait recognition.     

Face recognition based on fusion of multi-resolution Gabor features

In this paper, we propose a Gabor-based face recognition method. This method fuses multi-resolution Gabor features of face images at the matching score level. The first implementation scheme of this method directly takes the sum of the matching scores of multi-resolution Gabor features of face images as the final matching score. The second implementation scheme first codes the phase of the Gabor feature and then uses a weighted matching score level fusion algorithm to fuse the magnitude and phase of the Gabor feature. A number of experimental results show that the proposed method has a good performance and outperforms conventional Gabor-based face recognition methods that equally treat all the Gabor features and directly fuse them at the feature level. The experimental result also illustrates that in face recognition, the low-resolution representation of the phase of the Gabor feature such as the code of the phase is more discriminative than the phase itself. The codes of our method will be available at http://www.yongxu.org/lunwen.html.     

基于Log Gabor滤波的指纹纹理匹配*

分析了Log Gabor滤波器的性能,详述了用于指纹识别的Log Gabor滤波器的构造方法,在此基础上提出了基于Log Gabor滤波器的指纹纹理匹配算法。首先采用了一种快速有效的参考点定位方法,在确定有效区域并归一化后,通过傅里叶变换把指纹图像转换到频域,在频域进行Log Gabor滤波,最后在滤波图像中提取特征,并与传统方法作了比较。实验结果表明,所提出算法的性能优于基于Gabor滤波的纹理匹配方法和基于细节点的方法,提高了指纹识别的准确率。     

Robust palmprint identification based on directional representations and compressed sensing

In this paper, we propose a novel approach for palmprint recognition, which contains two interesting components: directional representation and compressed sensing. Gabor wavelets can be well represented for biometric image for their similar characteristics to human visual system. However, these Gabor-based algorithms are not robust for image recognition under non-uniform illumination and suffer from the heavy computational burden. To improve the recognition performance under the low quality conditions with a fast operation speed, we propose novel palmprint recognition approach using directional representations. Firstly, the directional representation for palmprint appearance is obtained by the anisotropy filter, which is robust to drastic illumination changes and preserves important discriminative information. Then, the principal component analysis (PCA) is used for feature extraction to reduce the dimensions of the palmprint images. At last, based on a sparse representation on PCA feature, the compressed sensing is used to distinguish palms from different hands. Experimental results on the PolyU palmprint database show the proposed algorithm have better performance than that of the Gabor based methods.     

基于Gabor滤波器和聚类的图像配准算法

提出一种基于多尺度、多方向Gabor滤波器提取图像局部不变特征并用AP聚类进行约束的配准算法。该方法首先利用Gabor尺度空间核函数对图像进行尺度空间分解,在每一层尺度图像的不同方向上提取Harris角点,在以Harris角点为中心的固定大小的搜索窗内搜索三维尺度空间的极值点作为局部特征点的位置和特征尺度;在特征子区域内用梯度描述特征点;将得到的两幅图像的特征点AP聚类分析,实现m:n的粗匹配,最终通过各类之间的欧式距离实现对应点的匹配,通过AP聚类可有效排除多相似内容的图像之间的误匹配。实验结果表明,该算法能够提取稳健的精确特征点,并且可以有效去除多相似内容图像带来的匹配误差,实现图像的配准。     

基于Gabor滤波器和HOG特征的织物疵点检测

针对织物疵点检测问题,提出了一种基于Gabor滤波器和方向梯度直方图（HOG）特征的织物疵点检测算法。首先使用3个尺度、4个方向的Gabor滤波器组对织物图像进行滤波,并做融合处理,增强织物图像疵点区域和背景纹理之间的对比度;然后使用双边滤波减弱图像背景纹理和噪声的影响;最后将图像划分成均匀子块,提取每个子图像块的HOG特征,利用图像疵点区域和背景纹理的HOG特征差异进行阈值分割实现织物疵点的检测。实验选取5种常见织物疵点进行验证,并与传统的Gabor滤波算法进行了实验对比,结果表明该算法可以较好的抑制织物背景纹理的干扰,更加准确的检测出织物疵点。     

Pose robust face tracking by combining view-based AAMs and temporal filters

Active appearance models (AAMs) are useful for face tracking for the advantages of detailed face interpretation, accurate alignment and high efficiency. However, they are sensitive to initial parameters and may easily be stuck in local minima due to the gradient-descent optimization, which makes the AAM based face tracker unstable in the presence of large pose deviation and fast motion. In this paper, we propose to combine the view-based AAMs with two novel temporal filters to overcome the limitations. First, we build a new view space based on the shape parameters of AAMs, instead of the model parameters controlling both the shape and appearance, for the purpose of pose estimation. Then the Kalman filter is used to simultaneously update the pose and shape parameters for a better fitting of each frame. Second, we propose a temporal matching filter which is twofold. The inter-frame local appearance constraint is incorporated into AAM fitting, where the mechanism of the active shape model (ASM) is also implemented in a unified framework to find more accurate matching points. Moreover, we propose to initialize the shape with correspondences found by a random forest based local feature matching. By introducing the local information and temporal correspondences, the twofold temporal matching filter improves the tracking stability when confronted with fast appearance changes. Experimental results show that our algorithm is more pose robust than basic AAMs and some state-of-art AAM based methods, and that it can also handle large expressions and non-extreme illumination changes in test video sequences.     

Visually distinct patterns with matching subband statistics

A commonly used representation of a visual pattern is a statistical distribution measured from the output of a bank of filters (Gaussian, Laplacian, Gabor, etc.). Both marginal and joint distributions of filter responses have been advocated and effectively used for a variety of vision tasks, including texture classification, texture synthesis, object detection, and image retrieval. This paper examines the ability of these representations to discriminate between an arbitrary pair of visual stimuli. Examples of patterns are derived that provably possess the same marginal and joint statistical properties, yet are "visually distinct." This is accomplished by showing sufficient conditions for matching the first k moments of the marginal distributions of a pair of images. Then, given a set of filters, we show how to match the marginal statistics of the subband images formed through convolution with the filter set. Next, joint statistics are examined and images with similar joint distributions of subband responses are shown. Finally, distinct periodic patterns are derived that possess approximately the same subband statistics for any arbitrary filter set.     

Gabor滤波器组实现颅脑图像的边缘快速提取

在医学图像处理过程中,针对一般方法提取颅脑图像边缘不是很清晰的情况,提出了一种基于短时傅立叶变换的新的Gabor滤波方法。该方法通过选取一组能够覆盖整个频域的滤波器,分别提取图像的局部边缘信息,然后按照一定的规则将提取出局部信息的多幅图像整合成一幅图像。普通Gabor滤波计算量较大,耗时较长,而该文所述方法能显著地减少运算量。并且相对于其他几种滤波方法也表现出定位准确,检测效果明显,以及鲁棒性较好的特点。     

基于二维正交滤波的虹膜识别算法

提出一种针对灰度虹膜图像进行虹膜特征提取及匹配的方法,其利用四元数二维正交Log Gabor小波提取虹膜图像的纹理特征,以滤波后图像的解析信号作为虹膜的特征编码.该方法可以同时表征虹膜纹理多方向上的特征,更加全面地描述了虹膜纹理的特征空间.特征匹配采用类似汉明距的方式,同时以虹膜图像中眼睑、睫毛以及光斑的分布为匹配模版来减少它们的干扰.大量实验的结果表明该方法具有非常优越的识别性能.     

Image representation using 2D Gabor wavelets

This paper extends to two dimensions the frame criterion developed by Daubechies for one-dimensional wavelets, and it computes the frame bounds for the particular case of 2D Gabor wavelets. Completeness criteria for 2D Gabor image representations are important because of their increasing role in many computer vision applications and also in modeling biological vision, since recent neurophysiological evidence from the visual cortex of mammalian brains suggests that the filter response profiles of the main class of linearly-responding cortical neurons (called simple cells) are best modeled as a family of self-similar 2D Gabor wavelets. We therefore derive the conditions under which a set of continuous 2D Gabor wavelets will provide a complete representation of any image, and we also find self-similar wavelet parametrization which allow stable reconstruction by summation as though the wavelets formed an orthonormal basis. Approximating a “tight frame” generates redundancy which allows low-resolution neural responses to represent high-resolution images     

利用Gabor滤波的相位图像进行光流估计

提出一种联合Gabor滤波器和加权最小二乘法估计序列图像光流的方法,用Gabor滤波器的滤波结果作为新的图像特征来计算空间和时间相位梯度．为了获得较为精确的结果,用加权最小二乘法来估计序列图像的光流．实验结果表明,文中算法在光流的计算精度上要优于Lueas,Fleet等的方法．     

基于改进Gabor优化选择的布匹瑕疵检测方法

针对传统Gabor优化选择方法用于布匹瑕疵检测时准确率低、鲁棒性差的缺点,提出了改进的优化选择方法,通过瑕疵图像与标准图像Gabor滤波后分块子图均值差平方和的代价函数实现优化选择。设置一组不同方向和尺度的Gabor滤波器并提取标准图像滤波后相关参数,通过改进的优化选择方法实现滤波后瑕疵图像的最优选择,利用迭代式阈值分割对最优滤波后图像进行二值分割,根据分割后图像的像素信息检测是否含有瑕疵并输出瑕疵信息。实验验证该方法,并与传统优化选择方法对比分析,结果表明该方法运算量较少,且检查性能高,可满足在线检测要求。     

Chinese text location under complex background using Gabor filter and SVM

For the Chinese text location under complex background, this paper presents a novel method by combining Gabor filter and support vector machine (SVM). It bases on such a fact that Chinese characters are composed of four kinds of strokes. By extracting four kinds of stroke features with Gabor filters, Chinese text location problem can be transformed into a texture classification one, which can use SVM classifier for the purpose. So, the proposed method is composed of two phases. First, Gabor filters with different scales and orientations are employed to obtain four texture images representing the stokes of Chinese text in horizontal line, top-down vertical line, left-downward slope line and short pausing stroke directions. Then, the text regions and background regions in four texture images are used to train four SVM classifiers to distinguish the texture in four directions, by integrating an SVM classification network to obtain the final classification results, according to the sum of the weights to determine whether the block is the text region. Some experiments are conducted on a large amount of typical images with different texts and different fonts. Compared with some existing methods, the proposed approach achieves better results for Chinese text location.     

A method for fingerprint image identification based on Gabor filter and power spectrum

This work presents a fingerprint identification scheme using a coefficient map based on Gabor filter and power spectrum. This process uses Poincaré index in order to locate fingerprint core and delta points and the images are aligned through these singular points before matching. From the core point, this technique divides an input image into quadrants, where information about texture orientation on three Gabor-filter directions is extracted. In the frequency domain, the analysis is based on the power spectrum, aiming towards reducing computational time. Results illustrate the method efficiency and accuracy.     

基于增强Gabor特征和直接分步线性判别分析的人脸识别

Gabor特征能从不同方向和尺度有效表示人脸图片的局部特征,但是利用传统Gabor特征的方法却忽略原始人脸图片所包含的全局特征。文中把Gabor特征和原始图片信息结合起来,构成增强的Gabor特征,并结合直接分步线性判别分析算法,提出一种人脸识别方法。在Yale、ORL和Georgia Tech人脸库的仿真实验结果表明,相对于传统Gabor特征,增强Gabor特征能够有效提高人脸识别率。     

基于Gabor能量空间的尺度不变兴趣点检测方法(英文)

Interest point detection is a fundamental issue in many intermediate level vision problems and plays a significant role in vision systems. The previous interest point detectors are designed to detect some special image structures such as corners,junctions, line terminations and so on. These detectors based on some simplified 2D feature models will not work for image features that differ significantly from the models. In this paper, a scale invariant interest point detector, which is appropriate for most types of image features, is proposed based on an iterative method in the Gabor based energy space. It detects interest points by noting that there are some similarities in the phase domain for all types of image features, which are obtained by different detectors respectively. Firstly, this approach obtains the positions of candidate points by detecting the local maxima of a series of energy maps constructed by Gabor filter responses.Secondly, an iterative algorithm is adopted to select the corresponding characteristic scales and accurately locate the interest points simultaneously in the Gabor based energy space. Finally,in order to improve the real-time performance of the approach, a fast implementation of Gabor function is used to accelerate the process of energy space construction. Experiments show that this approach has a broader applicability than the other detectors and has a good performance under rotation and some other image changes.     

Elastic shape-texture matching for human face recognition

In this paper, a novel, elastic, shape-texture matching method, namely ESTM, for human face recognition is proposed. In our approach, both the shape and the texture information are used to compare two faces without establishing any precise pixel-wise correspondence. The edge map is used to represent the shape of an image, while the texture information is characterized by both the Gabor representations and the gradient direction of each pixel. Combining these features, a shape-texture Hausdorff distance is devised to compute the similarity of two face images. The elastic matching is robust to small, local distortions of the feature points such as those caused by facial expression variations. In addition, the use of the edge map, Gabor representations and the direction of the image gradient can all alleviate the effect of illumination to a certain extent.With different databases, experimental results show that our algorithm can always achieve a better performance than other face recognition algorithms under different conditions, except when an image is under poor and uneven illumination. Experiments based on the Yale database, AR database, ORL database and YaleB database show that our proposed method can achieve recognition rates of 88.7%, 97.7%, 78.3% and 89.5%, respectively.     

基于Gabor能量空间的尺度不变兴趣点检测方法

兴趣点检测是中层视觉感知过程的关键步骤,也是众多机器视觉系统的重要组成部分.此前的大多数兴趣点检测子都是针对特殊的二维图像结构设计的,比如角点、交叉点、端点等,所以对与其差别较大的特征不能检测.采用在Gabor能量空间中迭代搜索的方法,本文提出了一种尺度不变兴趣点检测子.基于结构不同的二维图像特征在相频域中表现相似的特点,该检测子能检测大多数特征.首先,基于Gabor滤波器响应获得一系列能量图像,通过极值点检测得到候选兴趣点;其次,使用一种迭代方法同时选择特征尺度与精确定位特征点位置;最后为了提高算法的实时性,采用了一种递推方法加速能量图像的计算过程.实验结果表明相对于其它检测子,本文提出的方法具有更广泛的适应性,并且在旋转、尺度、光照等变化下具有良好的稳定性.     

小波变换人体目标特征提取方法效果对比

Haar小波和Gabor小波变换是常用的特征提取方法,前者广泛用于目标检测,后者则常用于人脸识别。针对人体目标检测,提出采用Gabor小波变换进行特征提取,并采用三个主要的行人库与Haar小波方法进行对比实验,实验显示：由于二维Gabor小波变换响应能够在多个尺度的多个方向上对目标的局部区域像素值变化进行描述,所以相比只能在水平、垂直和对角线三个方向上描述目标的Haar小波,其优势明显。