Using wavelet transform and multi-class least square support vector machine in multi-spectral imaging classification of Chinese famous tea

This article presented an intelligent method for recognition of different types of Chinese famous tea based on multi-spectral imaging technique. Two kinds of feature extraction methods including gray level co-occurrence matrix and wavelet transform (WT) were adopted for mining characteristic of multi-spectral image. Then multi-class least square support vector machine models were adopted for classification of multi-spectral image, which has little been used in this domain. Meanwhile the receiver operating characteristic (ROC) curve analysis was used to evaluate the performance of multi-spectral imaging classifier. To explore the structure of the wavelet textural features (WTFs), principal component analysis (PCA) was performed based on all the WTFs, and the most important features were detected through loading weight analysis of PCA. In experiments, the potential of WTFs was confirmed for extraction of characteristic from multi-spectral image with high recognition accuracy of 96.82%. And 18 WTFs were detected as the most important features for recognition by PCA. Furthermore, it can be found that the 18 features were the textural features of “contrast” of wavelet sub-space images. This finding may give great help for later research about multi-spectral image classification. The experimental results indicate that the proposed method is effective for recognition of multi-spectral image of different types of Chinese famous tea, the WT is an effective method for mining knowledge from mass multi-spectral imaging information, and PCA can be used to clear the structure of the WTFs.     

Wavelet transform applied to EO-1 hyperspectral data for forest LAI and crown closure mapping

A comparison of the performance of three feature extraction methods was made for mapping forest crown closure (CC) and leaf area index (LAI) with EO-1 Hyperion data. The methods are band selection (SB), principal component analysis (PCA) and wavelet transform (WT). Hyperion data were acquired on October 9, 2001. A total of 38 field measurements of CC and LAI were collected on August 10-11, 2001, at Blodgett Forest Research Station, University of California at Berkeley, USA. The analysis method consists of (1) conducting atmospheric correction with High Accuracy Atmospheric Correction for Hyperspectral Data (HATCH) to retrieve surface reflectance, (2) extracting features with the three methods: SB, PCA and WT, (3) establishing multivariate regression prediction models, (4) predicting and mapping pixel-based CC and LAI values, and (5) validating the CC and LAI mapped results with photo-interpreted CC and LAI values. The experimental results indicate that the energy features extracted by the WT method are the most effective for mapping forest CC and LAI (mapped accuracy (MA) for CC=84.90%, LAI MA=75.39%), followed by the PCA method (CC MA=77.42%, LAI MA=52.36%). The SB method performed the worst (CC MA=57.77%, LAI MA=50.87%).     

基于卷积特征和贝叶斯分类器的人脸识别

为解决传统人脸识别算法特征提取困难的问题,提出了基于卷积特征和贝叶斯分类器的人脸识别方法,利用卷积神经网络提取人脸特征,通过主成分分析法对特征降维,最后利用贝叶斯分类器进行判别分类,在ORL（olivetti research laboratory）人脸库上进行实验,获得了99.00%的识别准确率。实验结果表明,卷积神经网络提取的人脸图像特征具有很强的辨识度,与PCA（principal component analysis）和贝叶斯分类器结合之后可有效提高人脸识别的准确率。     

Time series forecasting based on wavelet decomposition and feature extraction

Time series forecasting is one of the most important issues in numerous applications in real life. The objective of this study was to propose a hybrid neural network model based on wavelet transform (WT) and feature extraction for time series forecasting. The motivation of the proposed model, which is called PCA-WCCNN, is to establish a single simplified model with shorter training time and satisfactory forecasting performance. This model combines the principal component analysis (PCA) and WT with artificial neural networks (ANNs). Given a forecasting sequence, order of the original forecasting model is determined firstly. Secondly, the original time series is decomposed into approximation and detail components by employing WT technique. Then, instead of using all the components as inputs, feature inputs are extracted from all the sub-series obtained from the above step. Finally, based on the extracted features and all the sub-series, a famous neural network construction method called cascade-correlation algorithm is applied to train neural network model to learn the dynamics. As an illustration, the proposed model is compared with two classical models and two hybrid models, respectively. They are the traditional cascade-correlation neural network, back-propagation neural network, wavelet-based cascade-correlation network using all the wavelet components as inputs to establish one model (WCCNN) and wavelet-based cascade-correlation network with combination of each sub-series model (WCCNN multi-models). Results obtained from this study indicate that the proposed method improves the accuracy of ANN and can yield better efficiency than other four neural network models.

     

基于局部保持投影的神经尖峰电位特征提取与分类

神经元尖峰电位的识别和分类,是神经信息处理中的关键环节之一,而尖峰电位的特征提取是识别和分类的重要基础。针对尖峰电位的特征提取和分类,提出一种基于局部保持投影(LPP)的无监督算法,对近邻参数进行了自动识别和选择,使用基于原型向量的分布离散度标准,尖峰电位的特征得到充分提取和分离。仿真和实际数据实验结果表明：基于局部保持投影的无监督特征提取和分类算法,比传统主成分分析(PCA)方法能更加有效地实现特征提取和分离。     

A novel neural-network approach of analog fault diagnosis based on kernel discriminant analysis and particle swarm optimization

Kernel principal component analysis (KPCA) and kernel linear discriminant analysis (KLDA) are two commonly used and effective methods for dimensionality reduction and feature extraction. In this paper, we propose a KLDA method based on maximal class separability for extracting the optimal features of analog fault data sets, where the proposed KLDA method is compared with principal component analysis (PCA), linear discriminant analysis (LDA) and KPCA methods. Meanwhile, a novel particle swarm optimization (PSO) based algorithm is developed to tune parameters and structures of neural networks jointly. Our study shows that KLDA is overall superior to PCA, LDA and KPCA in feature extraction performance and the proposed PSO-based algorithm has the properties of convenience of implementation and better training performance than Back-propagation algorithm. The simulation results demonstrate the effectiveness of these methods.     

水下目标信号的Lofar谱图特征的主分量分析研究

研究一种基于Lofar谱图特征和主分量分析的水下目标信号的特征处理方法。首先介绍了这种方法的应用背景．给出了舰船辐射噪声的结构和Lofar谱特征的提取方法。在简单介绍了主分量分析的有关基础知识和数学解法后，对于海上测量获得的舰船辐射噪声信号进行特征提取，利用主分量分析的方法对提取的特征向量进行降维处理。针对主分量分析处理前后的特征向量，采用结构自适应模糊聚类神经网络分类器分类，与直接对Lofar谱特征分类相比，主分量提取后的分类准确率有明显提高。     

基于主元和判别集成分析的模拟电路故障诊断

提出了主元和线性判别的集成分析算法以实施模拟故障数据的特征提取过程和方法。该集成分析方法首先对模拟故障数据进行主元分析,然后在主元变换空间实行线性判别分析,最后将所获得的最优判别特征模式应用于模式分类器进行故障诊断。仿真结果表明,所提出的方法能够充分利用线性方法的计算简便优势,增强单一主元分析或线性判别分析的特征提取性能,获取故障数据集的本质特征,简化模式分类器的结构,降低系统运行的计算成本。     

基于K-L变换和神经网络分类的微钙化点检测新方法

目前一般的乳腺X光片微钙化点检测系统大致都包括:图像预处理和分割;病理图像的特征提取和分类;辅助诊断和分析等几个步骤,其中神经网络经常用于特征提取和分类阶段。为了提高神经网络的分类能力,需要采用最具代表性的特征作为分类系统的输入部分,而且采用的特征数目要有利于最有效的特征提取,否则会使分类的效率大打折扣。所以分类系统一个重要的任务是对神经网络的输入样本集进行训练和特征值的优化,本文采用K-L变换用于降低输入特征向量的维数,从而达到参数优化的目的。试验表明,该方法可以有效地提高系统的灵敏度,降低诊断的假阳性。     

基于PCA与改进的最近邻法则的异常检测

提出一种新颖的基于特征抽取的异常检测方法,先对预处理数据进行标准化变换,然后应用主成份分析(PCA)抽取入侵特征,最后应用一种改进的最近邻分类方法--基于中心的最近邻分类法(CNN)检测入侵.利用KDD Cup'99数据集,将PCA删与PCA NN、PCA SVM、标准SVM进行比较,结果显示,在不降低分类器性能的情况下,特征抽取方法能对输入数据有效降维,且在各种方法中,PCA与CNN的结合能得到最优的入侵检测性能.     

Performance evaluation of PCA-based spike sorting algorithms

Deciphering the electrical activity of individual neurons from multi-unit noisy recordings is critical for understanding complex neural systems. A widely used spike sorting algorithm is being evaluated for single-electrode nerve trunk recordings. The algorithm is based on principal component analysis (PCA) for spike feature extraction. In the neuroscience literature it is generally assumed that the use of the first two or most commonly three principal components is sufficient. We estimate the optimum PCA-based feature space by evaluating the algorithm's performance on simulated series of action potentials. A number of modifications are made to the open source nev2lkit software to enable systematic investigation of the parameter space. We introduce a new metric to define clustering error considering over-clustering more favorable than under-clustering as proposed by experimentalists for our data. Both the program patch and the metric are available online. Correlated and white Gaussian noise processes are superimposed to account for biological and artificial jitter in the recordings. We report that the employment of more than three principal components is in general beneficial for all noise cases considered. Finally, we apply our results to experimental data and verify that the sorting process with four principal components is in agreement with a panel of electrophysiology experts.     

Principal component analysis of fuzzy data using autoassociative neural networks

This paper describes an extension of principal component analysis (PCA) allowing the extraction of a limited number of relevant features from high-dimensional fuzzy data. Our approach exploits the ability of linear autoassociative neural networks to perform information compression in just the same way as PCA, without explicit matrix diagonalization. Fuzzy input values are propagated through the network using fuzzy arithmetics, and the weights are adjusted to minimize a suitable error criterion, the inputs being taken as target outputs. The concept of correlation coefficient is extended to fuzzy numbers, allowing the interpretation of the new features in terms of the original variables. Experiments with artificial and real sensory evaluation data demonstrate the ability of our method to provide concise representations of complex fuzzy data.     

神经元动作电位模式分类的小波时频分析方法

对神经元动作电位进行模式分类是植入式脑机接口研究的前期关键问题。考虑到来自不同神经元的动作电位在时域或频域特征上的相似性,引入小波分析在时频域上对动作电位进行特征描述。首先以db、sym、bior三类小波函数系为例,分别获取了动作电位的高维小波系数特征;然后对特征分量进行非正态分布特性的KS检验,以实现特征降维;最后通过非监督的K均值方法完成动作电位聚类。实验结果表明：在神经信号噪声水平为0.05dB、0.1dB和0.15dB时,各小波基的分类性能略有不同。其中sym5小波性能突出,动作电位错分率基本稳定在1.21%～181%。最后与主成分分析法(PCA)进行了分类性能的比较,进一步证实了小波时频分析方法(sym5小波)在抗干扰性和稳定性方面的优势。     

基于PCA和IFOA-BP神经网络的股价预测模型

针对基于BP神经网络的股票价格预测模型在价格预测时存在较大误差的问题,在BP神经网络方法的基础上引入了主成分分析方法(PCA)和改进的果蝇算法(IFOA),提出一种基于PCA-IFOA-BP神经网络的股票价格预测模型。通过PCA对股票历史数据进行降维,减少冗余信息;采用改进的果蝇算法优化BP神经网络的初始权值和阈值;建立基于PCA和IFOA-BP神经网络的股票价格预测模型。对上证指数股票价格数据进行仿真验证,仿真结果表明:在股票价格预测中,该模型比BP神经网络、PCA-BP和PCA-FOA-BP的预测精度更高,是一种有效可行的预测方法。     

基于特征整合的卷积神经网络草地分类算法

为提高遥感影像草地分类的精度,分析了卷积神经网络中提取图像特征的特点,提出了一种基于特征整合深度神经网络的遥感影像特征提取算法。首先,将遥感影像数据进行PCA白化处理,降低数据之间的相关性,加快神经网络学习的速率;其次,将从卷积神经网络中提取到的浅层特征和深层特征进行双线性整合,使得整合后的新特征更加完善和优化;最后,对遥感数据进行训练,由于新特征中有效信息的增加,使得特征表达能力得到提高,达到提高草地分类准确率的目的。实验结果表明:该算法能够有效地提高草地分类的准确率,分类精度达到94.65%,相较于卷积神经网络、BP神经网络和基于SVM的分类算法分别提高了4.3%、10.39%和15.33%。     

Wavelet entropy and neural network for text-independent speaker identification

In the present study, the techniques of wavelet transform (WT) and neural network were developed for speech based text-independent speaker identification. The first five formants in conjunction with the Shannon entropy of wavelet packet (WP) upon level four features extraction method was developed. Thirty-five features were fed to feed-forward backpropagation neural networks (FFPBNN) for classification. The functions of features extraction and classification are performed using the wavelet packet and formants neural networks (WPFNN) expert system. The declared results show that the proposed method can make an effectual analysis with average identification rates reaching 91.09. Two published methods were investigated for comparison. The best recognition rate selection obtained was for WPFNN. Discrete wavelet transform (DWT) was studied to improve the system robustness against the noise of −2 dB.     

一种基于各向异性高斯核核惩罚的PCA特征提取算法

提出了一种基于各向异性高斯核核惩罚的主成分分析的特征提取算法.该算法不同于传统的核主成分分析算法.在非线性数据降维中,传统的核主成分分析算法忽略了原始数据的无量纲化.此外,传统的核函数在各维度上主要由一个相同的核宽参数控制,该方法无法准确反映各维度不同特征的重要性,从而导致降维过程中准确率低下.为了解决上述问题,首先针对现原始数据的无量纲化问题,提出了一种均值化算法,使得原始数据的总方差贡献率有明显的提高.其次,引入了各向异性高斯核函数,该核函数每个维度拥有不同的核宽参数,各核宽参数能够准确地反映所在维度数据特征的重要性.再次,基于各向异性高斯核函数建立了核主成分分析的特征惩罚目标函数,以便用较少的特征表示原始数据,并反映每个主成分信息的重要性.最后,为了寻求最佳特征,引入梯度下降算法来更新特征惩罚目标函数中的核宽度和控制特征提取算法的迭代过程.为了验证所提出算法的有效性,各算法在UCI公开数据集上和KDDCUP99数据集上进行了比较.实验结果表明,所提基于各向异性高斯核核惩罚的主成分分析的特征提取算法比传统的主成分分析算法在9种公开的UCI公开数据集上准确率平均提高了4.49%.在KDDCUP99数据集上,所提基于各向异性高斯核核惩罚的主成分分析的特征提取算法比传统的主成分分析算法准确率提高了8%.     

基于改进的独立分量分析的人脸识别方法

将独立分量分析（Independent Component Analysis，ICA）作为人脸特征提取方法。ICA所提取的特征分类能力强、相互独立，对像素间高阶统计特性敏感，并且不易受光照变化的影响。实验结果表明，基于IcA的人脸特征提取方法的识别性能优于特征脸法。针对传统的ICA算法（Informax算法）存在迭代次数多，难收敛，并且需要人工设定步长来调整学习速度的不足，本文采用FastICA作为ICA的快速算法，并将其关键迭代步骤加以改进，减少了耗时的雅可比矩阵求逆的运算次数。所提出的改进的FastICA具有无需人工参与，收敛速度快，迭代次数少的优点。在特征选择方面，本文将遗传算法（Genetie Algorithm，GA）应用到独立分量的选择与优化中，从而在保证较高识别性能的前提下，获得最优的人脸特征子集。     

Model-based decoding, information estimation, and change-point detection techniques for multineuron spike trains

One of the central problems in systems neuroscience is to understand how neural spike trains convey sensory information. Decoding methods, which provide an explicit means for reading out the information contained in neural spike responses, offer a powerful set of tools for studying the neural coding problem. Here we develop several decoding methods based on point-process neural encoding models, or forward models that predict spike responses to stimuli. These models have concave log-likelihood functions, which allow efficient maximum-likelihood model fitting and stimulus decoding. We present several applications of the encoding model framework to the problem of decoding stimulus information from population spike responses: (1) a tractable algorithm for computing the maximum a posteriori (MAP) estimate of the stimulus, the most probable stimulus to have generated an observed single- or multiple-neuron spike train response, given some prior distribution over the stimulus; (2) a gaussian approximation to the posterior stimulus distribution that can be used to quantify the fidelity with which various stimulus features are encoded; (3) an efficient method for estimating the mutual information between the stimulus and the spike trains emitted by a neural population; and (4) a framework for the detection of change-point times (the time at which the stimulus undergoes a change in mean or variance) by marginalizing over the posterior stimulus distribution. We provide several examples illustrating the performance of these estimators with simulated and real neural data.     

Finger-vein pattern identification using principal component analysis and the neural network technique

This paper presents a personal identification system using finger-vein patterns with component analysis and neural network technology. In the proposed system, the finger-vein patterns are captured by a device that can transmit near infrared through the finger and record the patterns for signal analysis. The proposed biometric system for verification consists of a combination of feature extraction using principal component analysis (PCA) and pattern classification using back-propagation (BP) network and adaptive neuro-fuzzy inference system (ANFIS). Finger-vein features are first extracted by PCA method to reduce the computational burden and removes noise residing in the discarded dimensions. The features are then used in pattern classification and identification. To verify the effect of the proposed ANFIS in the pattern classification, the BP network is compared with the proposed system. The experimental results indicated the proposed system using ANFIS has better performance than the BP network for personal identification using the finger-vein patterns.