基于C-LSTM模型的端到端多粒度运动想象脑电信号分析方法

脑电信号（Electroencephalography, EEG）是人的大脑在不同状态下产生的生物电信号。运动想象脑电信号是其中较为典型的一类信号，广泛应用于脑机接口技术中。对运动想象脑电信号分析的研究由来已久，目前主要采用公共空间模式等特征提取方法，对于如何提取更加有效的脑电信号特征以及如何对时序信息进行建模仍然是需要解决的问题。因此，本文设计了基于C-LSTM（Convolutional-Long Short Term Memory）模型的端到端多粒度脑电分析方法。并利用空间信息以及小波脑网络方法进行了改进，在BCI2008数据集上，相较传统方法提高了近10%，到达了93.6%的识别率。      

脑机接口中脑电图-近红外光谱联合分析进展研究

脑机接口(BCI)能将受试者意图相关的大脑活动转化为外部设备控制指令,在神经疾病治疗、运动康复等方面具有较高应用潜力。BCI的实现需从人脑获取有意义的信号,而脑电图(EEG)可以反映神经电活动,主要用于对反映实时性要求较高的BCI系统;近红外光谱(NIRS)主要反映血流动力学水平,一般用于神经生理状态等需要精确定位脑活跃区域的研究。EEG和NIRS因其非侵入、方便穿戴、成本较低等优点,成为BCI的重要信号获取方法。相比于单模态BCI系统,基于EEG-NIRS联合分析的混合BCI系统由于具有更丰富的信号特征,在生理状态检测、运动想象等领域得到了越来越多的关注与研究。该文从EEG-NIRS联合分析在脑机接口中应用的研究现状出发,在数据和特征融合程度、层面上归纳最近的相关领域研究现状,并对EEG-NIRS信号处理手段的研究前景进行了展望。     

基于脑电逆问题的研究及应用综述

自20世纪50年代以来,关于神经元电活动的研究一直是许多科研人员和临床医生关注的热点。大脑中的神经元组成分布式网络结构,不同的区域结构将处理视觉、感知觉、意识等不同的信息,且神经元活动随时间不断变化,因此需要一种能对大脑的时间和空间特征全面记录的方法。脑电图（Electroencephalography, EEG）由于具有无创、价格低廉和高时间分辨率的特性,自其被发现以来就已成为记录神经元活动应用最广泛的技术之一。然而EEG的空间分辨率较低,难以实现对神经元活动的精确定位。提升EEG的空间分辨率,需要从测量的头皮脑电中定位大脑的激活神经元,即解决脑电逆问题。由于电磁逆解具有不确定性,脑内不同的激活模式可能会在头皮产生相同的电位分布。近年来关于大脑的精确解剖结构、组织特性以及神经元电活动的传播规律等方面的研究为该技术提供了可靠的先验,有许多研究已经证实了该技术在定位大脑源活动中有显著的优势。脑电逆问题求解可以通过无创的手段实现对神经元电活动的空间定位,有助于了解神经网络结构和大脑信息传递过程。同时可以提升无创脑电信号的空间分辨率,拓展可用信息维度,在神经科学与技术、临床医学等领域均已有广...     

基于并行CNN和Transformer的脑电降噪网络

脑电图（electroencephalography, EEG）是一种反映大脑皮层电生理活动的技术，经常用于生物医学领域的各种应用中，但其采集过程容易受到多种噪声的污染，这些噪声会影响EEG信号的准确性和可靠性，因此脑电降噪是EEG分析中必不可少的一步。目前，基于深度学习的方法在多个基准数据集中已展现出优于传统方法的降噪性能，然而现有的基于深度学习的方法仍存在以下问题：现有的网络结构在设计时没有充分考虑信号的时序依赖性。由于不同伪影信号具有不同的形态特征，仅考虑局部或全局的时序依赖性，难以在多种伪影移除任务上获得理想的降噪效果。基于此，本文设计了一种新的脑电降噪网络CTNet。CTNet采用了CNN-Transformer结构，通过结合CNN和Transformer的优点提取潜在的判别性特征，具体来说，CNN单元和Transformer单元分别用于提取局部和全局的时序依赖性特征，通过结合局部和全局的特征更好地抑制伪影信号。为了评估CTNet在EEG降噪方面的性能，本文在四种不同的伪影移除任务上对其进行了评估，实验结果表明，CTNet在各种噪声条件下均具有较强的噪声抑制能力。在公开数据集...     

多层次时空特征自适应集成与特有-共享特征融合的双模态情感识别

在结合脑电(EEG)信号与人脸图像的双模态情感识别领域中,通常存在两个挑战性问题：(1)如何从EEG信号中以端到端方式学习到更具显著性的情感语义特征;(2)如何充分利用双模态信息,捕捉双模态特征中情感语义的一致性与互补性。为此,提出了多层次时空特征自适应集成与特有-共享特征融合的双模态情感识别模型。一方面,为从EEG信号中获得更具显著性的情感语义特征,设计了多层次时空特征自适应集成模块。该模块首先通过双流结构捕捉EEG信号的时空特征,再通过特征相似度加权并集成各层次的特征,最后利用门控机制自适应地学习各层次相对重要的情感特征。另一方面,为挖掘EEG信号与人脸图像之间的情感语义一致性与互补性,设计了特有-共享特征融合模块,通过特有特征的学习和共享特征的学习来联合学习情感语义特征,并结合损失函数实现各模态特有语义信息和模态间共享语义信息的自动提取。在DEAP和MAHNOB-HCI两种数据集上,采用跨实验验证和5折交叉验证两种实验手段验证了提出模型的性能。实验结果表明,该模型取得了具有竞争力的结果,为基于EEG信号与人脸图像的双模态情感识别提供了一种有效的解决方案。     

Chernof f加权分类器框架在运动想象脑-机接口中的应用

针对现有脑机接口(BCI)分类器与大脑认知过程结合不够紧密的问题,该文提出一种基于Chernoff加权的分类器集成框架方法,并用于同步运动想象脑机接口中。通过对训练数据进行统计分析,获得各时刻脑电信号(EEG)的统计特性,并建立基于大脑认知过程的高斯概率模型。然后利用Chernoff边界特性得到该概率模型的最小误差,并以此确定该时刻分类器的权重,通过对各时刻分类器的加权,实现同步脑机接口的信号分类。以脑机接口竞赛数据作为测试,并与线性判决分析、支持向量机和极限学习方法分别结合构成新的集成方法。由实验结果可知,加权集成框架方法的分类性能比原独立分类方法有显著提高。     

运动想象脑电信号的ERD/ERS分析基础

脑机接口能提供一种不依赖于外周神经和肌肉,实现大脑与外界进行信息交流的全新通路。运动想象脑电研究是脑机接口技术研究领域一个重要课题,本文对运动想象脑电信号分析基础做简要介绍。一、脑电分类及特点脑电是人脑神经细胞群的自发性节律电活动在大脑皮层或头皮的总体反应的体现。近年来,一系列先进的成像技术也能够非常直观地呈现人脑各区域状态的变化情况,但这些并不影响基于EEG的相关研究。相比于以上成像技术,EEG     

基于深度学习的运动想象脑机接口研究综述

近年来，随着脑机接口（Brain-Computer Interface,BCI）技术的进一步发展，对特征提取技术的鲁棒性的需求也持续增加。深度学习（Deep Learning,DL）作为多层次的神经网络模型具有从高维数据中进行特征提取并从分层表示中学习的能力，在分类识别任务领域中的表现优于手工选择特征的传统机器学习方法。深度学习模型可以自动学习高维的EEG数据集从而提取有效特征，因此基于深度学习的脑机接口成为该领域新的研究趋势。卷积神经网络（Convolution Neural Network,CNN）、深度信念网络（Deep Belief Network,DBN）和递归神经网络（Recurrent Neural Network,RNN）是深度学习中对脑电信号进行分析的三大主流算法。主要介绍了这三大主流深度学习算法的基本原理。为了探索能更好契合脑电数据特点的分类模型，还探讨了它们在BCI中集成其他方法的实际运用。     

基于核典型相关分析的语音情感识别研究

语音是人类表达思想和感情交流最重要的工具,是人类文化的重要组成部分。语音情感识别作为情感计算中的重要课题已经成为国际上的研究热点,受到越来越多的关注。已有神经科学研究表明,大脑是产生调节情感的物质基础。因此,在语音情感的研究中,我们不能仅考虑语音信号自身,还应将大脑的活动信号融入语音情感识别中,以实现更高准确率的情感识别。基于上述思想,本文提出了一种基于核典型相关分析（KCCA）的语音特征提取方法。该方法将语音特征与脑电图（EEG）特征映射到高维希尔伯特空间,并计算二者的最大相关系数。KCCA将语音特征在高维希尔伯特空间上向与脑电特征相关性最大的方向投影,最终得到包含脑电信息的语音特征。本文方法将与语音情感相关的脑电信息融入语音情感特征提取中,所提特征能够更准确的表征情感。同时,本方法在理论上具有良好的可迁移性,当所提脑电特征足够准确与具有代表性时,KCCA建模得到的投影向量具有通用性,可直接用于新的语音情感数据集中而无需重新采集和计算相应的脑电信号。在自建语音情感数据库与公开语音情感数据库MSP-IMPROV上的实验结果表明,使用投影语音特征进行语音情感分类的方法优于使用原始音频特征...     

基于互信息的脑网络及测谎研究

互信息分析方法是基于信息论提出的一种描述两信号间信息交互情况的算法,其在脑电信号领域的有效性已得到了充分证实.针对当前测谎方法中脑电信号特征提取困难以及大脑整体认知功能分析在脑认知科学研究中越来越被重视的情况,本文首次将互信息分析方法应用到脑电测谎领域中,使用互信息量化大脑各节点之间的相关性,对计算结果进行统计分析,选取出在两类人群中具有显著性差异的电极对的互信息作为分类特征,进行模式识别,得到了99.67%的准确率.这一结果表明,互信息分析方法是一种有效的脑功能连接分析方法,为基于脑电信号连接分析的测谎研究提供了一种新的途径.另外,对说谎与诚实两类受试者的大脑功能网络的分析结果表明：处于说谎状态时,大脑的额叶、顶叶、颞叶及枕叶之间协同实现谎言功能,并在躯体行为所对应的脑区与其他脑区的连接上也表现出相对诚实组的显著性差异,以上结果均有助于进一步揭示谎言的神经活动机制.     

Detection of landmines and underground utilities from acoustic and GPR images with a cepstral approach

This paper introduces a cepstral approach for the automatic detection of landmines and underground utilities from acoustic and ground penetrating radar (GPR) images. This approach is based on treating the problem as a pattern recognition problem. Cepstral features are extracted from a group of images, which are transformed first to 1-D signals by lexicographic ordering. Mel-frequency cepstral coefficients (MFCCs) and polynomial shape coefficients are extracted from these 1-D signals to form a database of features, which can be used to train a neural network with these features. The target detection can be performed by extracting features from any new image with the same method used in the training phase. These features are tested with the neural network to decide whether a target exists or not. The different domains are tested and compared for efficient feature extraction from the lexicographically ordered 1-D signals. Experimental results show the success of the proposed cepstral approach for landmine detection from both acoustic and GPR images at low as well as high signal to noise ratios (SNRs). Results also show that the discrete cosine transform (DCT) is the most appropriate domain for feature extraction.     

Electromagnetic brain mapping

There has been tremendous advances in our ability to produce images of human brain function. Applications of functional brain imaging extend from improving our understanding of the basic mechanisms of cognitive processes to better characterization of pathologies that impair normal function. Magnetoencephalography (MEG) and electroencephalography (EEG) (MEG/EEG) localize neural electrical activity using noninvasive measurements of external electromagnetic signals. Among the available functional imaging techniques, MEG and EEG uniquely have temporal resolutions below 100 ms. This temporal precision allows us to explore the timing of basic neural processes at the level of cell assemblies. MEG/EEG source localization draws on a wide range of signal processing techniques including digital filtering, three-dimensional image analysis, array signal processing, image modeling and reconstruction, and, blind source separation and phase synchrony estimation. We describe the underlying models currently used in MEG/EEG source estimation and describe the various signal processing steps required to compute these sources. In particular we describe methods for computing the forward fields for known source distributions and parametric and imaging-based approaches to the inverse problem     

EEG-based assessment of driver cognitive responses in a dynamic virtual-reality driving environment

Accidents caused by errors and failures in human performance among traffic fatalities have a high death rate and become an important issue in public security. They are mainly caused by the failures of the drivers to perceive the changes of the traffic lights or the unexpected conditions happening accidentally on the roads. In this paper, we devised a quantitative analysis for assessing driver's cognitive responses by investigating the neurobiological information underlying electroencephalographic (EEG) brain dynamics in traffic-light experiments in a virtual-reality (VR) dynamic driving environment. The VR technique allows subjects to interact directly with the moving virtual environment instead of monotonic auditory and visual stimuli, thereby provides interactive and realistic tasks without the risk of operating on an actual machine. Independent component analysis (ICA) is used to separate and extract noise-free ERP signals from the multi-channel EEG signals. A temporal filter is used to solve the time-alignment problem of ERP features and principle component analysis (PCA) is used to reduce feature dimensions. The dimension-reduced features are then input to a self-constructing neural fuzzy inference network (SONFIN) to recognize different brain potentials stimulated by red/green/yellow traffic events, the accuracy can be reached 87% in average eight subjects in this visual-stimuli ERP experiment. It demonstrates the feasibility of detecting and analyzing multiple streams of ERP signals that represent operators' cognitive states and responses to task events.     

Epileptic seizures detection in EEG using DWT-based ApEn and artificial neural network

There are numerous neurological disorders such as dementia, headache, traumatic brain injuries, stroke, and epilepsy. Out of these epilepsy is the most prevalent neurological disorder in the human after stroke. Electroencephalogram (EEG) contains valuable information related to different physiological state of the brain. A scheme is presented for detecting epileptic seizures from EEG data recorded from normal subjects and epileptic patients. The scheme is based on discrete wavelet transform (DWT) analysis and approximate entropy (ApEn) of EEG signals. Seizure detection is performed in two stages. In the first stage, EEG signals are decomposed by DWT to calculate approximation and detail coefficients. In the second stage, ApEn values of the approximation and detail coefficients are calculated. Significant differences have been found between the ApEn values of the epileptic and the normal EEG allowing us to detect seizures with 100 % classification accuracy using artificial neural network. The analysis results depicted that during seizure activity, EEG had lower ApEn values compared to normal EEG. This gives that epileptic EEG is more predictable or less complex than the normal EEG. In this study, feed-forward back-propagation neural network has been used for classification and training algorithm for this network that updates the weight and bias values according to Levenberg–Marquardt optimization technique.     

Spatiotemporal forward solution of the EEG and MEG using network modeling

Dynamic systems have proven to be well suited to describe a broad spectrum of human coordination behavior such synchronization with auditory stimuli. Simultaneous measurements of the spatiotemporal dynamics of electroencephalographic (EEG) and magnetoencephalographic (MEG) data reveals that the dynamics of the brain signals is highly ordered and also accessible by dynamic systems theory. However, models of EEG and MEG dynamics have typically been formulated only in terms of phenomenological modeling such as fixed-current dipoles or spatial EEG and MEG patterns. In this paper, it is our goal to connect three levels of organization, that is the level of coordination behavior, the level of patterns observed in the EEG and MEG and the level of neuronal network dynamics. To do so, we develop a methodological framework, which defines the spatiotemporal dynamics of neural ensembles, the neural field, on a sphere in three dimensions. Using magnetic resonance imaging we map the neural field dynamics from the sphere onto the folded cortical surface of a hemisphere. The neural field represents the current flow perpendicular to the cortex and, thus, allows for the calculation of the electric potentials on the surface of the skull and the magnetic fields outside the skull to be measured by EEG and MEG, respectively. For demonstration of the dynamics, we present the propagation of activation at a single cortical site resulting from a transient input. Finally, a mapping between finger movement profile and EEG/MEG patterns is obtained using Volterra integrals.     

CSSD＋AAR模型在脑电信号处理中的应用

针对BCI技术中的脑电信号处理方法和事件相关去同步化的特点,提出了一种结合时、频、空域的特征提取方法。结合CSSD和AAR模型来提取脑电特征,并对基于AAR模型系数的特征提取方法进行了探讨,最终选择卡尔曼平滑算法提取模型系数,然后将提取的特征用简单的线性分类器进行分类。实验结果表明测试集的分类正确率达到了94．08％,而且这种特征提取方法有很好的时间分辨率,适合于在线分类。这是一种正确率高,时间分辨率高,适合在线分类的好方法。     

Multiclass support vector machines for EEG-signals classification.

In this paper, we proposed the multiclass support vector machine (SVM) with the error-correcting output codes for the multiclass electroencephalogram (EEG) signals classification problem. The probabilistic neural network (PNN) and multilayer perceptron neural network were also tested and benchmarked for their performance on the classification of the EEG signals. Decision making was performed in two stages: feature extraction by computing the wavelet coefficients and the Lyapunov exponents and classification using the classifiers trained on the extracted features. The purpose was to determine an optimum classification scheme for this problem and also to infer clues about the extracted features. Our research demonstrated that the wavelet coefficients and the Lyapunov exponents are the features which well represent the EEG signals and the multiclass SVM and PNN trained on these features achieved high classification accuracies.     

Research on EEG emotion recognition based on CNN+BiLSTM+self-attention model

To address the problems of insufficient dimensionality of electroencephalogram (EEG) feature extraction, the tendency to ignore the importance of different sequential data segments, and the poor generalization ability of the model in EEG based emotion recognition, the model of convolutional neural network and bi-directional long short-term memory and self-attention (CNN+BiLSTM+self-attention) is proposed. This model uses convolutional neural network (CNN) to extract more distinctive features from both spatial and temporal dimensions. The bi-directional long short-term memory (BiLSTM) is used to further preserve the long-term dependencies between the temporal phases of sequential data. The self-attention mechanism can change the weights of different channels to extract and highlight important information and address the often-ignored importance of different channels and samples when extracting EEG features. The subject-dependent experiment and subject-independent experiment are performed on the database for emotion analysis using physiological signals (DEAP) and collected datasets to verify the recognition performance. The experimental results show that the model proposed in this paper has excellent recognition performance and generalization ability.