Common Spatial Pattern Ensemble Classifier and Its Application in Brain-Computer Interface

Common spatial pattern (CSP) algorithm is a successful tool in feature estimate of brain-computer interface (BCI). However, CSP is sensitive to outlier and may result in poor outcomes since it is based on pooling the covariance matrices of trials. In this paper, we propose a simple yet effective approach, named common spatial pattern ensemble (CSPE) classifier, to improve CSP performance. Through division of recording channels, multiple CSP filters are constructed. By projection, log-operation, and subtraction on the original signal, an ensemble classifier, majority voting, is achieved and outlier contaminations are alleviated. Experiment results demonstrate that the proposed CSPE classifier is robust to various artifacts and can achieve an average accuracy of 83.02%.     

Combining spatial filters for the classification of single-trial EEG in a finger movement task

Brain-computer interface (BCI) is to provide a communication channel that translates human intention reflected by a brain signal such as electroencephalogram (EEG) into a control signal for an output device. In recent years, the event-related desynchronization (ERD) and movement-related potentials (MRPs) are utilized as important features in motor related BCI system, and the common spatial patterns (CSP) algorithm has shown to be very useful for ERD-based classification. However, as MRPs are slow nonoscillatory EEG potential shifts, CSP is not an appropriate approach for MRPs-based classification. Here, another spatial filtering algorithm, discriminative spatial patterns (DSP), is newly introduced for better extraction of the difference in the amplitudes of MRPs, and it is integrated with CSP to extract the features from the EEG signals recorded during voluntary left versus right finger movement tasks. A support vector machines (SVM) based framework is designed as the classifier for the features. The results show that, for MRPs and ERD features, the combined spatial filters can realize the single-trial EEG classification better than anyone of DSP and CSP alone does. Thus, we propose an EEG-based BCI system with the two feature sets, one based on CSP (ERD) and the other based on DSP (MRPs), classified by SVM.     

脑-机接口中基于ERS/ERD的自适应空间滤波算法

在与运动相关的脑-机接口(Brain-Computer Interface,BCI)研究中,如果样本规模小,共同空间模式(Common Spatial Patterns,CSP)滤波算法对离群点(可能为噪声)敏感,鲁棒性不好.为此该文提出自适应空间滤波(Adaptive Spatial Filter,ASF)算法,抽取滤波后脑电信号的方差作为特征,并寻找最优滤波器使两类特征中心的比值最大.与CSP不同,ASF是迭代算法,具有软判决机制,能够依据历代更新后的滤波器,自适应地降低离群点对各类特征中心计算带来的影响.采用BCI competition 2003和2005中两套数据集进行实验,结果表明:尤其是在训练样本少的情况下,相对于CSP,ASF所提取的特征分类效果更好.     

Relevancy contemplation in medical data analytics and ranking of feature selection algorithms

This article performs a detailed data scrutiny on a chronic kidney disease (CKD) dataset to select efficient instances and relevant features. Data relevancy is investigated using feature extraction, hybrid outlier detection, and handling of missing values. Data instances that do not influence the target are removed using data envelopment analysis to enable reduction of rows. Column reduction is achieved by ranking the attributes through feature selection methodologies, namely, extra-trees classifier, recursive feature elimination, chi-squared test, analysis of variance, and mutual information. These methodologies are ranked via Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) using weight optimization to identify the optimal features for model building from the CKD dataset to facilitate better prediction while diagnosing the severity of the disease. An efficient hybrid ensemble and novel similarity-based classifiers are built using the pruned dataset, and the results are thereafter compared with random forest, AdaBoost, naive Bayes, k-nearest neighbors, and support vector machines. The hybrid ensemble classifier yields a better prediction accuracy of 98.31% for the features selected by extra tree classifier (ETC), which is ranked as the best by TOPSIS.     

单次样本对的CSP滤波器设计及其在脑电 训练样本优化中的应用

在运动想象脑-机接口（Motor imagery brain-computer interface，MI-BCI）系统研究中，共空间模式（Common spatial pattern，CSP）作为一种有监督空域滤波设计方法，已被广泛应用于运动想象脑电信号（Electroencephalography，EEG）的特征提取。但是EEG训练样本的采集过程不仅会受到各种噪声伪迹干扰，也会受到受试者分心和疲劳等因素的影响，因此，训练集中难免出现“低质量”的异常单次试验数据。如果不加选择地将所有的单次样本用于CSP滤波器设计和分类器训练，会给所建BCI系统的性能带来较严重的负面影响。针对这一问题，本文提出一种新颖而实用的EEG训练样本筛选方法。方法的基本步骤是，先依次选择单次EEG样本对进行CSP滤波器设计，并结合零训练分类器构造相应的CSP-BCI测试系统。然后以所建CSP-BCI系统的交叉验证识别率为指标，剔除低识别率对应的单次训练数据，以实现对训练样本集的优化。基于所提方法，论文对6位受试者在不同时间采集的75组两类运动想象EEG数据进行了优化筛选和测试。实验结果表明，相比传统方法设计的CSP-BCI系统，基于训练样本优化方法的CSP-BCI系统性能得到明显改善，针对六位受试者测试集的平均识别率分别提高了5.04%、6.42%、13.15%、15.51%、1.94%和8.26%。      

分类器组合技术的多样性研究

分类器组合技术可以提高模式识别的性能,受到了模式识别领域研究人员的广泛关注。实现成员分类器的多样性是提高分类器组合泛化能力主要手段。本文从成员分类器的生成介绍了实现成员分类器多样性的各种方法,同时介绍了度量成员分类器多样性的各种技术,并提出了一种如何训练多样性成员分类器的技术思路。     

An Algorithm for Idle-State Detection and Continuous Classifier Design in Motor-Imagery-Based BCI

Abstract-The development of asynchronous brain-computer interface （BCI） based on motor imagery （M1） poses the research in algorithms for detecting the nontask states （i.e., idle state） and the design of continuous classifiers that classify continuously incoming electroencephalogram （EEG） samples. An algorithm is proposed in this paper which integrates two two-class classifiers to detect idle state and utilizes a sliding window to achieve continuous outputs. The common spatial pattern （CSP） algorithm is used to extract features of EEG signals and the linear support vector machine （SVM） is utilized to serve as classifier. The algorithm is applied on dataset IVb of BCI competition Ⅲ, with a resulting mean square error of 0.66. The result indicates that the proposed algorithm is feasible in the first step of the development of asynchronous systems.     

基于特征排名的图像隐写分析算法

为提高用于隐写分析的集成分类器的检测精度,提出一种基于特征排名的隐写分析算法。首先计算每维检测特征的互信息得分并根据得分高低将特征进行排名,然后设置分界点将特征分为重要特征区域与普通特征区域,依据设定的抽样比例从两个区域随机抽取特征组成不同的特征子空间并训练集成分类器。最后使用集成分类器进行分类。实验结果表明,针对使用nsF5及S-UNIWARD算法进行隐写的频域及空域图像,本算法较传统分类器在检测错误率方面分别平均下降约0.006 5和0.006 2,具有较好的检测效果。针对频域与空域中两种不同的隐写算法,与传统的集成分类器相比,该算法具有更高的检测精度。     

An Algorithm for Idle-State Detection and Continuous Classifier Design in Motor-Imagery-Based BCI

The development of asynchronous braincomputer interface (BCI) based on motor imagery (MI) poses the research in algorithms for detecting the nontask states (i.e., idle state) and the design of continuous classifiers that classify continuously incoming electroencephalogram (EEG) samples. An algorithm is proposed in this paper which integrates two two-class classifiers to detect idle state and utilizes a sliding window to achieve continuous outputs. The common spatial pattern (CSP) algorithm is used to extract features of EEG signals and the linear support vector machine (SVM) is utilized to serve as classifier. The algorithm is applied on dataset IVb of BCI competition III, with a resulting mean square error of 0.66. The result indicates that the proposed algorithm is feasible in the first step of the development of asynchronous systems.     

Key-Attributes-Based Ensemble Classifier for Customer Churn Prediction

Recently, it has been seen that the ensemble classifier is an effective way to enhance the prediction performance. However, it usually suffers from the problem of how to construct an appropriate classifier based on a set of complex data, for example, the data with many dimensions or hierarchical attributes. This study proposes a method to constructe an ensemble classifier based on the key attributes. In addition to its high-performance on precision shared by common ensemble classifiers, the calculation results are highly intelligible and thus easy for understanding. Furthermore, the experimental results based on the real data collected from China Mobile show that the key-attributes-based ensemble classifier has the good performance on both of the classifier construction and the customer churn prediction.     

Recognition of motor imagery tasks for BCI using CSP and chaotic PSO twin SVM

Accurate modeling and recognition of the brain activity patterns for reliable communication and interaction are still a challenging task for the motor imagery (MI) brain-computer interface (BCI) system. In this paper, we propose a common spatial pattern (CSP) and chaotic particle swarm optimization (CPSO) twin support vector machine (TWSVM) scheme for classification of MI electroencephalography (EEG). The self-adaptive artifact removal and CSP were used to obtain the most distinguishable features. To improve the recognition results, CPSO was employed to tune the hyper-parameters of the TWSVM classifier. The usefulness of the proposed method was evaluated using the BCI competition IV-IIa dataset. The experimental results showed that the mean recognition accuracy of our proposed method was increased by 5.35%, 4.33%, 0.78%, 1.45%, and 9.26% compared with the CPSO support vector machine (SVM), particle swarm optimization (PSO) TWSVM, linear discriminant analysis LDA), back propagation (BP) and probabilistic neural network (PNN), respectively. Furthermore, it achieved a faster or comparable central processing unit (CPU) running time over the traditional SVM methods.     

Critic-driven ensemble classification

We develop new rules for combining the estimates obtained from each classifier in an ensemble, in order to address problems involving multiple (>2) classes. A variety of techniques have been previously suggested, including averaging probability estimates from each classifier, as well as hard (0-1) voting schemes. In this work, we introduce the notion of a critic associated with each classifier, whose objective is to predict the classifier's errors. Since the critic only tackles a two class problem, its predictions are generally more reliable than those of the classifier and, thus, can be used as the basis for improved combination rules. Several such rules are suggested here. While previous techniques are only effective when the individual classifier error rate is p<0.5, the new approach is successful, as proved under an independence assumption, even when this condition is violated-in particular, so long as p+q<1, with q the critic's error rate. More generally, critic-driven combining is found to achieve significant performance gains over alternative methods on a number of benchmark data sets. We also propose a new analytical tool for modeling ensemble performance, based on dependence between experts. This approach is substantially more accurate than the analysis based on independence that is often used to justify ensemble methods     

基于多分类器投票组合的语音情感识别

为了提高语音情感的正确识别率,提出一种基于多分类器投票组合的语音情感识别新方法.在提取情感语音的韵律特征和音质特征基础上,利用投票方法将支持向量机、K近邻法和人工神经网络三种分类器构成组合分类器,实现对汉语生气、高兴、悲伤和惊奇4种主要情感类型的识别.实验结果表明,与使用单一分类器相比,组合分类器对语音情感的识别取得了87.4%的平均正确识别率,识别效果优于单一分类器.     

Spatio-spectral filters for improving the classification of single trial EEG

Data recorded in electroencephalogram (EEG)-based brain-computer interface experiments is generally very noisy, non-stationary, and contaminated with artifacts that can deteriorate discrimination/classification methods. In this paper, we extend the common spatial pattern (CSP) algorithm with the aim to alleviate these adverse effects. In particular, we suggest an extension of CSP to the state space, which utilizes the method of time delay embedding. As we will show, this allows for individually tuned frequency filters at each electrode position and, thus, yields an improved and more robust machine learning procedure. The advantages of the proposed method over the original CSP method are verified in terms of an improved information transfer rate (bits per trial) on a set of EEG-recordings from experiments of imagined limb movements.     

语言脑机接口康复系统中的参数优化研究

脑机接口可为失语症及运动障碍患者提供新的康复途径。本文设计了基于汉字默读的语言脑机接口实验,将9位被试脑电信号从时域、频域和空间域三方面进行特征选择和优化,用于汉字识别。采用事件相关谱扰动算法进行时频分析,以获取特征显著的时频区间,利用共空间模式进行空域分析,选择出最佳导联组并结合分类结果对电极优化选择。结果表明:默读汉字所引起的脑电信号时频能量变化主要分布在α波和β波,且随默读时间动态变化。特征选择时,改进时间与频率区间较固定时间与频率区间均能有效提高汉字的平均匹配准确率,若同时改进时间与滤波范围,匹配准确率提高范围达到3.37%。本文有助于语言脑机接口的理论研究,同时为语言康复训练提供新思路。      

Regularized common spatial pattern with aggregation for EEG classification in small-sample setting

Common spatial pattern (CSP) is a popular algorithm for classifying electroencephalogram (EEG) signals in the context of brain-computer interfaces (BCIs). This paper presents a regularization and aggregation technique for CSP in a small-sample setting (SSS). Conventional CSP is based on a sample-based covariance-matrix estimation. Hence, its performance in EEG classification deteriorates if the number of training samples is small. To address this concern, a regularized CSP (R-CSP) algorithm is proposed, where the covariance-matrix estimation is regularized by two parameters to lower the estimation variance while reducing the estimation bias. To tackle the problem of regularization parameter determination, R-CSP with aggregation (R-CSP-A) is further proposed, where a number of R-CSPs are aggregated to give an ensemble-based solution. The proposed algorithm is evaluated on data set IVa of BCI Competition III against four other competing algorithms. Experiments show that R-CSP-A significantly outperforms the other methods in average classification performance in three sets of experiments across various testing scenarios, with particular superiority in SSS.     

Common spatio-temporal pattern for single-trial detection of event-related potential in rapid serial visual presentation triage

Searching for target images in large volume imagery is a challenging problem and the rapid serial visual presentation (RSVP) triage is potentially a promising solution to the problem. RSVP triage is essentially a cortically-coupled computer vision technique that relies on single-trial detection of event-related potentials (ERP). In RSVP triage, images are shown to a subject in a rapid serial sequence. When a target image is seen by the subject, unique ERP characterized by P300 are elicited. Thus, in RSVP triage, accurate detection of such distinct ERP allows for fast searching of target images in large volume imagery. The accuracy of the distinct ERP detection in RSVP triage depends on the feature extraction method, for which the common spatial pattern analysis (CSP) was used with limited success. This paper presents a novel feature extraction method, termed common spatio-temporal pattern (CSTP), which is critical for robust single-trial detection of ERP. Unlike the conventional CSP, whereby only spatial patterns of ERP are considered, the present proposed method exploits spatial and temporal patterns of ERP separately, providing complementary spatial and temporal features for high accurate single-trial ERP detection. Numerical study using data collected from 20 subjects in RSVP triage experiments demonstrates that the proposed method offers significant performance improvement over the conventional CSP method (corrected p-value < 0.05, Pearson r = 0.64) and other competing methods in the literature. This paper further shows that the main idea of CSTP can be easily applied to other methods.     

基于贝叶斯分类器的图像隐写分析

集成分类器是目前用于图像隐写分析的主流分类器。为提高集成分类器的检测精度,针对集成分类器基分类器组合方法过于简单,无法体现基分类器之间的内在联系,不能从整体上对结果进行判定的缺点,依据图像特征在集成分类器分类超平面上的投影值服从多维正态分布这一特性,提出了一种基于贝叶斯分类器的图像隐写分析算法。首先基于随机森林算法生成若干基分类器,然后计算类条件概率密度函数与先验概率并训练贝叶斯分类器,最后使用经过训练的贝叶斯分类器代替简单投票方法进行分类判决。算法的检测错误率比以往算法平均降低了1.6%,ROC曲线比简单投票方法更接近于左上角,即具有更高的检测率,AUC值平均增长约2.12%,并且训练时间仅有少量提高,最大提高约2.610s。可以有效提高集成分类器的检测精度。     

Optimizing Spatial filters for Robust EEG Single-Trial Analysis

Due to the volume conduction multichannel electroencephalogram (EEG) recordings give a rather blurred image of brain activity. Therefore spatial filters are extremely useful in single-trial analysis in order to improve the signal-to-noise ratio. There are powerful methods from machine learning and signal processing that permit the optimization of spatio-temporal filters for each subject in a data dependent fashion beyond the fixed filters based on the sensor geometry, e.g., Laplacians. Here we elucidate the theoretical background of the common spatial pattern (CSP) algorithm, a popular method in brain-computer interface (BCD research. Apart from reviewing several variants of the basic algorithm, we reveal tricks of the trade for achieving a powerful CSP performance, briefly elaborate on theoretical aspects of CSP, and demonstrate the application of CSP-type preprocessing in our studies of the Berlin BCI (BBCI) project.     

基于对比权限模式的安卓恶意软件检测方法(英文)

As the risk of malware is sharply increasing in Android platform,Android malware detection has become an important research topic.Existing works have demonstrated that required permissions of Android applications are valuable for malware analysis,but how to exploit those permission patterns for malware detection remains an open issue.In this paper,we introduce the contrasting permission patterns to characterize the essential differences between malwares and clean applications from the permission aspect Then a framework based on contrasting permission patterns is presented for Android malware detection.According to the proposed framework,an ensemble classifier,Enclamald,is further developed to detect whether an application is potentially malicious.Every contrasting permission pattern is acting as a weak classifier in Enclamald,and the weighted predictions of involved weak classifiers are aggregated to the final result.Experiments on real-world applications validate that the proposed Enclamald classifier outperforms commonly used classifiers for Android Malware Detection.