脑电情感信号正确提取仿真

脑电信号是一种微伏级信号,从头皮上采集的脑电信号包含眼电信号、心电信号以及各种环境噪音。针对情感识别如何有效处理脑电信号的问题,本文首先对实验采集的脑电信号应用小波分析和独立分量分析进行预处理去除干扰;其次为了有效地提取脑电特征,应用幅值直方图、标准差在时域上定性地找出2种情感的脑电差异;最后应用功率谱对2种情感脑电的γ波节律进行谱分析。仿真实验结果表明,将脑电信号的γ波节律用于情感识别是可行的。     

深度稀疏自编码网络识别飞行员疲劳状态

针对飞行员疲劳状态识别的复杂性和准确性,提出一种基于脑电信号的深度学习模型.首先对飞行员脑电信号进行滤波分解,提取delta波(0.5~4 Hz)、theta波(5~8 Hz)、alpha波(7~14 Hz)、beta波(14~30 Hz),提取基于脑电节律波的频域特征,作为识别模型的输入向量.其次,将一种基于深度稀疏自编码网络–Softmax模型用于飞行员疲劳状态识别,并与单层的稀疏自编码网络–Softmax和传统方法主成分分析(PCA)–Softmax模型识别结果进行比较.最后,实验结果显示,针对飞行员疲劳状态识别问题,所建立的学习模型具有很好的分类识别效果,具有较好的工程推广价值.     

小波包能量谱在睡眠分期中的应用

利用小波包技术,根据脑电信号在不同睡眠状态下各脑电节律所占的成分不同,提出一种基于小波包能量谱的睡眠脑电分期方法。首先依据脑电信号各节律的频率特点选择好分解层数对信号进行小波包分解,再重构信号,提取出睡眠脑电信号的各节律;然后运用小波包能量谱计算各节律所占的能量比重;最后用3例脑电数据进行实验。实验结果表明,不同睡眠状态下各脑电节律所占比重不同,随着睡眠的深入,睡眠脑电节律θ和δ所占的能量比重增大,而节律α和β所占的比重在减少。因此,可以运用睡眠脑电信号中各节律所占的成分不同来区分不同的睡眠状态,并可作为睡眠分期的一个特征参数。     

基于稀疏表示的脑电（EEG）情感分类

计算机对人类情绪与情感的识别研究已经成为了脑机接口领域的研究热点。通过分析人类在生活中的各种情感状态,提取脑电信号的特征并对情感状态进行识别、分类是情感智能化领域的重要方向。针对基于音乐视频诱导的情感数据集DEAP进行了研究,提取脑电信号的频域特征后,提出了采用加速近邻梯度算法（APG)和正交匹配算法（OMP）求解稀疏编码的稀疏表示分类模型进行情感分类,并与支持向量机算法（SVM）做效果比较。实验结果表明,APG算法通过L1范数正则近似求解以其快速的收敛速度在情感数据集上有着较好的分类表现,而OMP算法与SVM算法的分类效果相差无几,实现了情感脑电信号的分类。     

基于小波变换的表面肌电信号的情感识别

情感识别是情感计算的一个关键问题。针对表面肌电信号（EMG）的非平稳性,采用小波变换方法对表面肌电信号进行分析,提取小波系数最大值和最小值构造特征矢量输入用L-M算法改进的BP神经网络分类器进行情感状态识别。实验表明,用表面肌电信号对joy、anger、sadness、pleasure 4种情感识别效果较好。也说明用小波变换方法提取特征,用神经网络作分类器的方法用于情感识别有很大的应用前景。     

基于长短记忆与信息注意的视频-脑电交互协同情感识别

基于视频-脑电信号交互协同的情感识别是人机交互重要而具有挑战性的研究问题.本文提出了基于长短记忆神经网络(Long-short term memory, LSTM)和注意机制(Attention mechanism)的视频-脑电信号交互协同的情感识别模型.模型的输入是实验参与人员观看情感诱导视频时采集到的人脸视频与脑电信号, 输出是实验参与人员的情感识别结果.该模型在每一个时间点上同时提取基于卷积神经网络(Convolution neural network, CNN)的人脸视频特征与对应的脑电信号特征, 通过LSTM进行融合并预测下一个时间点上的关键情感信号帧, 直至最后一个时间点上计算出情感识别结果.在这一过程中, 该模型通过空域频带注意机制计算脑电信号${\alpha}$波, ${\beta}$波与${\theta}$波的重要度, 从而更加有效地利用脑电信号的空域关键信息; 通过时域注意机制, 预测下一时间点上的关键信号帧, 从而更加有效地利用情感数据的时域关键信息.本文在MAHNOB-HCI和DEAP两个典型数据集上测试了所提出的方法和模型, 取得了良好的识别效果.实验结果表明本文的工作为视频-脑电信号交互协同的情感识别问题提供了一种有效的解决方法.     

基于心电P-QRS-T波的特征提取及情感识别

在基于心电的情感识别中,体现不同情感状态的特征是提高情感识别率的基础。采用最优小波去噪心电信号,进行P波、QRS波、T波检测和能量计算,然后提取特征进行情感分类,并分析了P-QRS-T波能量在不同情感状态下的变化趋势和对情感状态的敏感性。实验结果表明,P-QRS-T波能量变化能体现情感状态的变化,对高兴敏感,识别率可达96%;同时最优小波去噪能有效地提高情感状态识别率。     

基于小波包分解的时变脑电节律提取

研究从时变非平稳脑电信号中提取脑电动态节律的新方法。首先用小波包分解构造不同频率特性的时变滤波器以提取各种时变的脑电节律，研究临床脑电信号瞬时变化。在此基础上测试并分析两种不同功能状态下的脑电信号，并由此构造各种节律的时变脑电地形图。实验结果表明，小波包分解可以有效提取脑电不同节律的动态特性，此方法也适用于分析其他生物医学信号。     

基于脑电节律样本熵的睡眠分期

针对睡眠脑电人工分期的不足,提出了一种基于脑电节律样本熵的睡眠分期方法。首先对睡眠脑电信号进行去噪和基本节律提取,然后计算不同睡眠状态下脑电节律的样本熵值,最后统计其样本熵均值与方差,通过对比发现:不同睡眠状态下脑电节律δ波和θ波的样本熵均值不相等且方差较小,这表明了通过分析睡眠脑电节律样本熵的方法可以用来表征不同睡眠期,为睡眠脑电分期提供了新的途径。     

基于小波变换的动态脑电节律提取

针对脑电信号和其他医学信号的非平稳性,引入小波变换处理临床脑电信号的动态特性。根据脑电信号的不同节律特性,提出应用小波包变换构造不同频率特性的滤波器,提取脑电信号的４种节律,并由各种节律对应的小波系数构造动态脑电地形图。为了研究不同脑功能状态下脑电信号４种节律的动态特性,文中对两组不同临床脑电数据进行分析与比较,给出了有关的实际分析结果。实验结果表明,利用小波包分析的滤波特性,能够有效地反映临床脑电不同节律的动态特性,也为分析其他生物医学信号提供了一条新的途径。     

小波包熵在脑电信号分析中的应用

为研究不同脑功能状态下脑电动态非线性特征，利用小波包变换的频率划分特性，对非平稳脑电信号进行节律提取，并计算相对小波能量，反映脑电节律间的相对能量关系。结合小波包熵分析脑电在不同大脑功能状态下的脑电复杂程度。实验结果表明，小波包分解能更精确地提取特定的脑电节律，小波包熵可以准确反映大脑活动的复杂程度。本方法也为分析其他非平稳信号提供了一种新的途径。     

EEG rhythm/channel selection for fuzzy rule-based alertness state characterization

The aim of the paper is to automatically select the optimal EEG rhythm/channel combinations capable of classifying human alertness states. Four alertness states were considered, namely ‘engaged’, ‘calm’, ‘drowsy’ and ‘asleep’. The features used in the automatic selection are the energies associated with the conventional rhythms, \(\delta , \theta , \alpha , \beta\) and \(\gamma\), extracted from overlapping windows of the different EEG channels. The selection process consists of two stages. In the first stage, the optimal brain regions, represented by sets of EEG channels, are selected using a simple search technique based on support vector machine (SVM), extreme learning machine (ELM) and LDA classifiers. In the second stage, a fuzzy rule-based alertness classification system (FRBACS) is used to identify, from the previously selected EEG channels, the optimal features and their supports. The IF–THEN rules used in FRBACS are constructed using a novel differential evolution-based search algorithm particularly designed for this task. Each alertness state is represented by a set of IF–THEN rules whose antecedent parts contain EEG rhythm/channel combination. The selected spatio-frequency features were found to be good indicators of the different alertness states, as judged by the classification performance of the FRBACS that was found to be comparable to those of the SVM, ELM and LDA classifiers. Moreover, the proposed classification system has the advantage of revealing simple and easy to interpret decision rules associated with each of the alertness states.

     

ICA方法用于脑电信号α波提取的研究

为在有效提取闭眼脑电信号α波的同时能够很好地保留原始信号中的其余信息,采用独立分量分析方法提取闭眼脑电信号中的α波。构造一组频率在α波频率之间的正弦和余弦信号作为对α波的参考信号,然后把这些信号以及实测闭眼脑电信号作为ICA混合矩阵的输入端,采用fastICA 算法进行信号分离,实现对α波的分离和提取,并进一步对所提取的α波进行了功率谱分析。结果表明,分离出的信号频率集中在8~13 Hz之间,完全符合α波形的特点,且去除α波后的其余信号与原始信号相关系数达到0.942,说明有效地保留了原始信号的其余信息。     

An art therapy evaluation method based on emotion recognition using EEG deep temporal features

Self-assessment methods are widely used in art therapy evaluation, but emotional recognition methods using physiological signals’ features are more objectively and accurately. In this study, we proposed an electroencephalogram (EEG)-based art therapy evaluation method that could evaluate the therapeutic effect based on the emotional changes before and after the art therapy. Twelve participants were recruited in a two-step experiment (emotion stimulation step and drawing therapy step), and their EEG signals and self-assessment scores were collected. The self-assessment model (SAM) was used to obtain and label the actual emotional states; the long short-term memory (LSTM) network was used to extract the deep temporal features of EEG to recognize emotions. Further, the classification performances in different sequence lengths, time-window lengths and frequency combinations were compared and analyzed. The results showed that emotion recognition models with LSTM deep temporal features achieved the better classification performances than the state-of-the-art methods with non-temporal features; the classification accuracies in high-frequency bands (α, β, and γ bands) were higher than those in low-frequency bands (δ and θ bands); there was a highest emotion classification accuracy (93.24%) in 10-s sequence length, 2-s time-window length and 5-band frequency combination. Our proposed method could be used for emotion recognition effectively and accurately, and was an objective approach to assist therapists or patients in evaluating the effect of art therapy.

     

ICA方法用于脑电信号α波提取的研究

为在有效提取闭眼脑电信号α波的同时能够很好地保留原始信号中的其余信息,采用独立分量分析方法提取闭眼脑电信号中的α波。构造一组频率在α波频率之间的正弦和余弦信号作为对α波的参考信号,然后把这些信号以及实测闭眼脑电信号作为ICA混合矩阵的输入端,采用fastICA 算法进行信号分离,实现对α波的分离和提取,并进一步对所提取的α波进行了功率谱分析。结果表明,分离出的信号频率集中在8~13 Hz之间,完全符合α波形的特点,且去除α波后的其余信号与原始信号相关系数达到0.942,说明有效地保留了原始信号的其余信息。     

二次滑动粗粒化的快速样本熵脑电情感分析

针对传统单一尺度样本熵对脑电信号(EEG)序列特征提取不明显、多尺度熵在粗粒化过程中会遗漏重要信息导致情感分类性能下降以及样本熵算法效率不高的问题,提出了一种基于二次滑动均值粗粒化的多尺度快速样本熵脑电特征提取方法。由于不同情感的脑电信号存在差异性,先采用二次滑动均值粗粒化对脑电信号进行多尺度处理,然后利用快速样本熵算法提取不同时间尺度的样本熵值作为特征向量,结合随机森林(RF)分类模型来识别不同的情感状态。提出的方法对多模态标准情感数据库DEAP进行了研究,发现大脑额区和右脑对情感比较敏感,正性、中性和负性情感在大脑侧额区获得了88.75%的平均分类准确率。实验结果表明,该方法可以有效地提取脑电特征,并且能够保证算法的效率。     

Classification of emotions induced by music videos and correlation with participants’ rating

Emotional experience and preference play a vital role in selection of multimedia content for an individual. Brain electrical activity bears the emotional cues needed for emotion detection, but very modest research has been done to extract those cues. This paper presents a novel machine learning approach using Dual-Tree Complex Wavelet Packet Transform (DT-CWPT) time–frequency features from electroencephalogram (EEG) to detect emotions together with an analysis of brain activity in different emotional states. Firstly, DT-CWPT is used to extract time–frequency emotional features. Then non-redundant and most discriminating emotional features are selected through singular value decomposition (SVD), QR factorization with column pivoting (QRcp) and F-Ratio based feature selection (FS) method. The reduced emotional feature set is used to classify emotion using support vector machine (SVM) and validated by leave-one-out cross-validation scheme. Results confirm the robustness and consistency in classification of emotions from EEG signals and significant correlation between participants’ self assessed ratings with emotional features. It also gives an analysis of activities in brain region during different emotional states.     

Ontology-based context modeling for emotion recognition in an intelligent web

We describe an ontological model for representation and integration of electroencephalographic (EEG) data and apply it to detect human emotional states. The model (BIO_EMOTION) is an ontology-based context model for emotion recognition and acts as a basis for: (1) the modeling of users’ contexts, including user profiles, EEG data, the situation and environment factors, and (2) supporting reasoning on the users’ emotional states. Because certain ontological concepts in the EEG domain are ill-defined, we formally represent and store these concepts, their taxonomies and high-level representation (i.e., rules) in the model. To evaluate the effectiveness for inferring emotional states, DEAP dataset is used for model reasoning. Result shows that our model reaches an average recognition ratio of 75.19 % on Valence and 81.74 % on Arousal for eight participants. As mentioned above, the BIO-EMOTION model acts like a bridge between users’ emotional states and low-level bio-signal features. It can be integrated in user modeling techniques, and be used to model web users’ emotional states in human-centric web aiming to provide active, transparent, safe and reliable services to users. This work aims at, in other words, creating an ontology-based context model for emotion recognition using EEG. Particularly, this model completely implements the loop body of the W2T data cycle once: from low-level EEG feature acquisition to emotion recognition. A long-term goal for the study is to complete this model to implement the whole W2T data cycle.