一种基于PCA的组合特征提取文本分类方法

为了获得更好的文本分类准确率和更快的执行效率, 研究了多种Web文本的特征提取方法, 通过对互信息(MI)、文档频率(DF)、信息增益(IG)和χ²统计（CHI）算法的研究, 利用其各自的优势互补, 提出一种基于主成分分析(PCA)的多重组合特征提取算法(PCA-CFEA)。通过PCA算法的正交变换快速地将文本特征空间降维, 再通过多重组合特征提取算法在降维后的特征空间中快速提取出更具代表性的特征项, 过滤掉一些代表性较弱的特征项, 最后使用SVM分类器对文本进行分类。实验结果表明, PCA-CFEA能有效地提高文本分类的正确率和执行效率。     

分块PCA鉴别特征抽取能力的分析研究

基于主成分分析(Principal Component Analysis,PCA),本文提出了分块 PCA 人脸识别方法。分块 PCA 从模式的原始数字图像出发,先对图像进行分块,对分块得到的子图像矩阵采用 PCA 方法进行特征抽取,从而实现模式的分类。新方法的特点是能有效地抽取图像的局部特征,正是这些特征使此类模式区别于彼类。在 Yale 人脸数据库上测试了该方法的鉴别能力。实验的结果表明,分块 PCA 在识别性能上优于通常的 PCA 方法,也优于基于 Fisher 鉴别准则的鉴别分析方法:Fisherfaces 方法、F-S 方法、组合鉴别方法,识别率可以达到100%。     

基于分块PCA的人脸识别方法

本文提出了一种称为M2PCA＋FDA的新的人脸识别方法．新方法从模式的原始数字图像出发，先对样本图像进行分块，对分块得到的子图像矩阵采用PCA进行特征抽取，从而得到能代替原始模式的低维的新模式，然后，对新模式施行“Fisherfaces”方法，实现模式的分类．其特点是能有效地抽取图像的局部特征，正是这些特征使此类模式区别于彼类．在ORL和NUST603两个人脸数据库上对M2PCAA-FDA方法进行了测试，实验的结果表明，本文提出的方法在识别性能上优于“Fisherfaces”方法和PCA方法．     

一种广义的主成分分析特征提取方法

提出了一种广义的PCA特征提取方法。该方法先将图像矩阵进行重组,根据重组的图像矩阵构造出总体散布矩阵,然后求出最佳投影向量进行特征提取。它是2DPCA和模块2DPCA的进一步推广,可以建立任意维数的散布矩阵,得到任意维数的投影向量。实验表明,随着总体散布矩阵维数的减小,广义PCA的特征提取能力更强,特征提取的速度也更快。     

基于PCA特征和融合特征的ECG身份识别方法

ECG作为一种活体生物特征用于身份识别在国际上引起了广泛重视.针对基于解析特征的ECG身份识别方法对特征点检测精度要求较高的缺点,提出一种仅需R波峰值点检测的ECG身份识别方法,该方法通过有针对性的设定相应阈值,将PCA特征和小波融合特征方法相结合.实验结果表明该方法优于PCA特征方法、波形特征方法和小波特征方法,既减少了特征点检测的复杂性和特征点检测不准确带来的误差,又可获得较高的识别率,是一种实时、高效算法.     

基于类间散布矩阵的二维主分量分析

主分量分析是一种线性特征抽取方法,被广泛地应用在人脸等图像识别领域。但传统的PCA都以总体散布矩阵作为产生矩阵,并且要将作为图像的矩阵转换为列向量进行计算。该文给出了一种利用图像矩阵直接计算的二维PCA,以类间散布矩阵的本征向量作为投影方向,取得了比利用总体散布矩阵更好的识别效果,并且特征抽取速度更快。在ORL和NUSTFDBⅡ标准人脸库上的实验验证了该方法的有效性。     

A feature extraction method for use with bimodal biometrics

Bimodal biometrics has been found to outperform single biometrics and are usually implemented using the matching score level or decision level fusion, though this fusion will enable less information of bimodal biometric traits to be exploited for personal authentication than fusion at the feature level. This paper proposes matrix-based complex PCA (MCPCA), a feature level fusion method for bimodal biometrics that uses a complex matrix to denote two biometric traits from one subject. The method respectively takes the two images from two biometric traits of a subject as the real part and imaginary part of a complex matrix. MCPCA applies a novel and mathematically tractable algorithm for extracting features directly from complex matrices. We also show that MCPCA has a sound theoretical foundation and the previous matrix-based PCA technique, two-dimensional PCA (2DPCA), is only one special form of the proposed method. On the other hand, the features extracted by the developed method may have a large number of data items (each real number in the obtained features is called one data item). In order to obtain features with a small number of data items, we have devised a two-step feature extraction scheme. Our experiments show that the proposed two-step feature extraction scheme can achieve a higher classification accuracy than the 2DPCA and PCA techniques.     

A globally convergent learning algorithm for PCA neural networks

Principal component analysis (PCA) by neural networks is one of the most frequently used feature extracting methods. To process huge data sets, many learning algorithms based on neural networks for PCA have been proposed. However, traditional algorithms are not globally convergent. In this paper, a new PCA learning algorithm based on cascade recursive least square (CRLS) neural network is proposed. This algorithm can guarantee the network weight vector converges to an eigenvector associated with the largest eigenvalue of the input covariance matrix globally. A rigorous mathematical proof is given. Simulation results show the effectiveness of the algorithm.     

一种星载高光谱图像特征提取算法的实现

为了解决当前PCA算法对星载高光谱图像光谱维特征提取速度无法满足空间应用实时性要求的问题,提出了一种面向空间应用的FPGA器件的光谱维特征提取的实现方法。该方法利用时分复用与并行流水计算技术对systolic结构进行了改进,使用高带宽的寄存器组代替了传统的RAM存储区,对数据进行中间寄存,不但保留了原算法结构的高速性,而且大大降低了芯片的使用面积。实验结果表明,该方法可以快速提取高光谱图像的光谱维特征值,为高光谱图像降维和压缩的工程应用提供了支撑。     

A novel hybrid approach based on sub-pattern technique and whitened PCA for face recognition

Recently, in a task of face recognition, some researchers presented that independent component analysis (ICA) Architecture I involves a vertically centered principal component analysis (PCA) process (PCA I) and ICA Architecture II involves a whitened horizontally centered PCA process (PCA II). They also concluded that the performance of ICA strongly depends on its involved PCA process. This means that the computationally expensive ICA projection is unnecessary for further process and involved PCA process of ICA, whether PCA I or II, can be used directly for face recognition. But these approaches only consider the global information of face images. Some local information may be ignored. Therefore, in this paper, the sub-pattern technique was combined with PCA I and PCA II, respectively, for face recognition. In other words, two new different sub-pattern based whitened PCA approaches (which are called Sp-PCA I and Sp-PCA II, respectively) were performed and compared with PCA I, PCA II, PCA, and sub-pattern based PCA (SpPCA). Then, we find that sub-pattern technique is useful to PCA I but not to PCA II and PCA. Simultaneously, we also discussed what causes this result in this paper. At last, by simultaneously considering global and local information of face images, we developed a novel hybrid approach which combines PCA II and Sp-PCA I for face recognition. The experimental results reveal that the proposed novel hybrid approach has better recognition performance than that obtained using other traditional methods.     

A feature analysis for dimension reduction based on a data generation model with class factors and environment factors

Currently, high-dimensional data such as image data is widely used in the domain of pattern classification and signal processing. When using high-dimensional data, feature analysis methods such as PCA (principal component analysis) and LDA (linear discriminant analysis) are usually required in order to reduce memory usage or computational complexity as well as to increase classification performance. We propose a feature analysis method for dimension reduction based on a data generation model that is composed of two types of factors: class factors and environment factors. The class factors, which are prototypes of the classes, contain important information required for discriminating between various classes. The environment factors, which represent distortions of the class prototypes, need to be diminished for obtaining high class separability. Using the data generation model, we aimed to exclude environment factors and extract low-dimensional class factors from the original data. By performing computational experiments on artificial data sets and real facial data sets, we confirmed that the proposed method can efficiently extract low-dimensional features required for classification and has a better performance than the conventional methods.     

二维投影与PCA相结合的人脸识别算法

传统的特征抽取算法是基于向量的,在模式是图像时并不方便。二维投影方法利用图像矩阵直接计算,虽然抽取特征速度快,但抽取出的特征是矩阵,对应的特征数量大,影响分类速度。该文结合二者的优点,先用二维投影处理原始图像,降维后再做主分量分析,抽取出少量的特征进行分类,识别率和分类速度均有提高。在ORL人脸库上20次实验的平均识别率达95.83%。     

使用PCA建立基于规则的组合分类器

提出了一种使用基于规则的基分类器建立组合分类器的新方法PCARules。尽管新方法也采用基分类器预测的加权投票来决定待分类样本的类,但是为基分类器创建训练数据集的方法与bagging和boosting完全不同。该方法不是通过抽样为基分类器创建数据集,而是随机地将特征划分成K个子集,使用PCA得到每个子集的主成分,形成新的特征空间,并将所有训练数据映射到新的特征空间作为基分类器的训练集。在UCI机器学习库的30个随机选取的数据集上的实验表明:算法不仅能够显著提高基于规则的分类方法的分类性能,而且与bagging和boosting等传统组合方法相比,在大部分数据集上都具有更高的分类准确率。     

基于Adaboost和PCA的嵌入式人脸识别方法

针对传统的Adaboost算法和主成分分析(PCA)算法用于人脸识别时在环境与姿态等非约束性条件下识别率大大降低以及要求训练样本符合高斯分布的缺陷,提出了一种融合Adaboost和PCA的与或关联决策方法.一方面,在需要安防模式时开启或决策,拒绝近似全部负样本的请求,最大限度保证识别的正确率;另一方面,在需要访客模式时开启与决策,以减少正样本的丢失.在Samsung 2440嵌入式Linux平台上采用该方法进行人脸检测时,基于2种决策方法,分别满足各自阈值.实验结果表明:该方法在嵌入式平台运行稳定,适合推广于智能家居控制与楼宇自动化控制.     

基于互信息的主成分分析特征选择算法

主成分分析是一种常用的特征选择算法,经典方法是计算各个特征之间的相关,但是相关无法评估变量间的非线性关系.互信息可用于衡量两个变量间相互依赖的强弱程度,且不局限于线性相关,鉴于此,提出一种基于互信息的主成分分析特征选择算法.该算法计算特征间的互信息,以互信息矩阵的特征值作为评价准则确定主成分的个数,并衡量主成分分析特征选择的效果.通过实例对所提出方法和传统主成分分析方法进行比较,并以神经网络为分类器分析分类效果.     

基于PCA和禁忌搜索的网络流量特征选择算法

针对网络流量特征属性选择的寻优和效率问题,提出了一种PCA结合禁忌搜索的网络流量特征选择方法。该方法通过PCA对高维特征属性空间进行特征约减,并利用禁忌搜索得到全局最优特征子集。实验证明,相比流行的遗传算法(GA)和粒子群寻优算法(PSO-SVM),PCA和禁忌搜索方法具有更好的处理效率和特征选择精度。     

一种基于局部排序PCA的线性鉴别算法

主分量分析(Principal Component Analysis,PCA)是模式识别领域中一种重要的特征抽取方法,该方法通过K-L展开式来抽取样本的主要特征。基于此,提出一种拓展的PCA人脸识别方法,即分块排序PCA人脸识别方法(MSPCA)。分块排序PCA方法先对图像矩阵进行分块,对所有分块得到的子图像矩阵利用PCA方法求出矩阵的所有特征值所对应的特征向量并加以标识;然后找出这些所有的特征值中k个最大的特征值所对应的特征向量,用这些特征向量分别去抽取所属的子图像的特征;最后,在MSPCA的基础上,将抽取子图像所得到的特征矩阵合并,把这个合并后的特征矩阵作为新的样本进行PCA+LDA。与PCA和PCA+LDA方法相比,分块排序PCA由于使用子图像矩阵,可以避免使用奇异值分解理论,从而更加简便。在ORL人脸库上的实验结果表明,所提出的方法在识别性能上明显优于经典的PCA和PCA+LDA方法。     

一种间歇过程异常数据剔除的主元分析方法

提出一种用于间歇生产过程中异常数据控制的方法。这种方法将原始的三维间歇生产数据集合展开成一个二维数据矩阵,进行中心化和规格化后再转化成另一个按照时间序列排列的二维数据矩阵。这种方法可以克服Wold方法在对数据进行中心化时引起的原始信息失真问题。通过对聚合反应釜过程数据进行分析,表明该方法能有效地对生产数据剔除异常。     

Subpattern-based principle component analysis

We propose a subpattern-based principle component analysis (SpPCA). The traditional PCA operates directly on a whole pattern represented as a vector and acquires a set of projection vectors to extract global features from given training patterns. SpPCA operates instead directly on a set of partitioned subpatterns of the original pattern and acquires a set of projection sub-vectors for each partition to extract corresponding local sub-features and then synthesizes them into global features for subsequent classification. The experimental results show that the proposed SpPCA has (much) better classification performances on all the real-life benchmark datasets than PCA.     

From image vector to matrix: a straightforward image projection technique—IMPCA vs. PCA

The conventional principal component analysis (PCA) and Fisher linear discriminant analysis (FLD) are both based on vectors. Rather, in this paper, a novel PCA technique directly based on original image matrices is developed for image feature extraction. Experimental results on ORL face database show that the proposed IMPCA are more powerful and efficient than conventional PCA and FLD.