A qualitative and quantitative study of color emotion using valence-arousal

This paper describes qualitative and quantitative analysis of color emotion dimension expression using a standard device-independent colorimetric system. To collect color emotion data, 20 subjects are required to report their emotion responses, using a valence-arousal emotion model, to 52 color samples that are chosen from CIELAB Lch color spaces. Qualitative analysis, including analysis of variance (ANOVA), Pearson’s correlation and Spearman’s rank correlation, shows that significant differences exist between responses to achromatic and chromatic stimuli, but there are no significant differences between chromatic samples. There is a positive linear relationship between lightness/chroma and valence-arousal dimensions. Subsequently, several classic predictors are used to quantitatively predict emotion induced by color attributes. Furthermore, several explicit color emotion models are developed by using multiple linear regression with stepwise and pace regression. Experimental results show that chroma and lightness have stronger effects on emotions than hue, which is consistent with our qualitative results and other psychological studies. Arousal has greater predictive value than valence.     

结合非线性全局特征和谱特征的脑电情感识别

针对现有表征情感信息的脑电信号的非线性特征提取不完善的问题,将相空间重构技术引入情感脑电的识别中,提取了在相空间重构下基于轨迹的描述轮廓的三种非线性几何特征作为新的情感脑电特征。结合脑电信号的功率谱熵以及非线性属性特征（近似熵、最大Lyapunov指数、Hurst指数）,提出了基于主成分分析（PCA）的非线性全局特征（非线性几何特征+非线性属性特征）和功率谱熵的融合算法,以支持向量机（SVM）为分类器进行情感识别。结果显示,非线性全局特征能更有效地实现情感识别,二分类情感识别率约90%左右。基于PCA的融合情感特征相比单一特征能达到更佳的情感识别性能,四分类实验中平均识别率可达86.42%。结果表明,非线性全局特征相比非线性属性特征情感识别率有所提高,非线性全局特征以及功率谱熵的结合可以构造出更佳的情感脑电特征参数。     

基于脑功能网络和共空间模式分析脑电情绪识别

传统脑网络的情绪分类将聚类系数、平均最短路径等拓扑属性作为分类特征。针对这些属性易受网络连接阈值和特征选择的影响,难以完全表征不同情绪状态下的网络空间拓扑结构差异的问题,提出了一种基于脑网络和共空间模式的脑电情绪识别方法(EEG emotion classification based on common spatial patterns of brain networks topology,EEC-CSP-BNT)。该算法基于互信息在各个子频段内计算电极间的功能连接矩阵,同时利用共空间模式(common spatial pattern,CSP)分析学习空间滤波器,构建分类特征,最后通过分类器(如Fisher线性判别、支持向量机、K最近邻)实现基于脑电的情绪分类。基于DEAP和SEED数据集的实验结果表明,相比于脑网络拓扑属性,EEC-CSP-BNT能有效提取脑网络拓扑结构的分类信息,提高脑电情绪识别性能。     

How the Kano model contributes to Kansei engineering in services

Recent studies show that products and services hold great appeal if they are attractively designed to elicit emotional feelings from customers. Kansei engineering (KE) has good potential to provide a competitive advantage to those able to read and translate customer affect and emotion in actual product and services. This study introduces an integrative framework of the Kano model and KE, applied to services. The Kano model was used and inserted into KE to exhibit the relationship between service attribute performance and customer emotional response. Essentially, the Kano model categorises service attribute quality into three major groups (must-be [M], one-dimensional [O] and attractive [A]). The findings of a case study that involved 100 tourists who stayed in luxury 4- and 5-star hotels are presented. As a practical matter, this research provides insight on which service attributes deserve more attention with regard to their significant impact on customer emotional needs.

Statement of Relevance: Apart from cognitive evaluation, emotions and hedonism play a big role in service encounters. Through a focus on delighting qualities of service attributes, this research enables service providers and managers to establish the extent to which they prioritise their improvement efforts and to always satisfy their customer emotions beyond expectation.     

Individual difference of artificial emotion applied to a service robot

In order to enable personalized natural interaction in service robots, artificial emotion is needed which helps robots to appear as individuals. In the emotion modeling theory of emotional Markov chain model (eMCM) for spontaneous transfer and emotional hidden Markov model (eHMM) for stimulated transfer, there are three problems: 1) Emotion distinguishing problem: whether adjusting parameters of the model have any effects on individual emotions; 2) How much effect the change makes; 3) The problem of different initial emotional states leading to different resultant emotions from a given stimuli. To solve these problems, a research method of individual emotional difference is proposed based on metric multidimensional scaling theory. Using a dissimilarity matrix, a scalar product matrix is calculated. Subsequently, an individual attribute reconstructing matrix can be obtained by principal component factor analysis. This can display individual emotion difference with low dimension. In addition, some mathematical proofs are carried out to explain experimental results. Synthesizing the results and proofs, corresponding conclusions are obtained. This new method provides guidance for the adjustment of parameters of emotion models in artificial emotion theory.     

基于特征聚类的网络评论信息挖掘研究

网络评论中的信息特征及情感倾向是一种重要信息,文章针对有的中文产品评论信息挖掘存在的不足,提出了一种基于词汇共现性的产品特征聚类技术与细粒度情感分析技术。在产品评论中,同类的产品属性会有多种多样的表述方式,文章将产品评论中的产品特征进行归类,且与以往基于句子的整体情感分析不同,提出了针对产品特征的更细粒度情感分析技术,并且对没有相应情感倾向的属性词做出合理处理。     

基于小波相干算法的脑区情绪特性研究

研究了人脑不同区域情绪脑电信号的差异特性。按照国际10-20电极分布系统将大脑分成5个脑区,选用视频情绪诱发素材诱发被试产生正性、中性、负性情绪同时采集其脑电信号,设置各脑区小波相干指数为参数,研究其差异性并进行模式识别。结果显示:不同情绪状态下额叶、顶叶δ波段的小波相干指数具有显著差异(p<0.05),并且统计发现将中性情绪小波相干指数作为基准,负性情绪的小波相干指数增大,正性情绪的小波相干指数降低。实验结果验证了额叶和顶叶的小波相干指数对情绪三分类问题有较好的识别效果,顶叶情绪识别率高达96.67%,进一步证明了情绪处理时额叶、顶叶两个脑区被激活,且不同情绪状态下激活程度不同。     

How the Kano model contributes to Kansei engineering in services

Recent studies show that products and services hold great appeal if they are attractively designed to elicit emotional feelings from customers. Kansei engineering (KE) has good potential to provide a competitive advantage to those able to read and translate customer affect and emotion in actual product and services. This study introduces an integrative framework of the Kano model and KE, applied to services. The Kano model was used and inserted into KE to exhibit the relationship between service attribute performance and customer emotional response. Essentially, the Kano model categorises service attribute quality into three major groups (must-be [M], one-dimensional [O] and attractive [A]). The findings of a case study that involved 100 tourists who stayed in luxury 4- and 5-star hotels are presented. As a practical matter, this research provides insight on which service attributes deserve more attention with regard to their significant impact on customer emotional needs. STATEMENT OF RELEVANCE: Apart from cognitive evaluation, emotions and hedonism play a big role in service encounters. Through a focus on delighting qualities of service attributes, this research enables service providers and managers to establish the extent to which they prioritise their improvement efforts and to always satisfy their customer emotions beyond expectation.     

基于彩色CCD的双色与三色辐射测温法比较研究

双色与三色比色测温是彩色CCD辐射测温常用方法。通过理论分析和实验研究,分别从测温动态范围和测温精度两方面对双色法和三色法进行了比较研究。研究发现,在光圈快门组合保持不变的条件下,选取红、绿双色进行比色测温具有较宽的测温动态范围;在对辐射体做灰体假设的情况下,三色测温方法具有更高的测温精度。提出了构建一种可切换测温方法的统一测温硬件平台,统一测温平台综合了双色法和三色法两者的优点,可同时满足更宽的测温动态范围和更高的测温精度的要求,应用灵活。     

基于PCA的离散小波自回归情感识别

针对情感识别进行研究,提出基于主成分分析法（PCA）过滤小波变换结合自回归模型提取的信号特征方法,并基于梯度提升分类树以实现情感分类.将特征提取的重点放在脑电信号变化情况以及小波分量变化情况作为脑电信号特征.采用Koelstra等提出的分析人类情绪状态的多模态标准数据库DEAP,提取8种正负情绪代表各个脑区的14个通道脑电数据.结果表明,算法对8种情感两两分类识别平均准确率为95.76%,最高准确率为98.75%,可为情感识别提供帮助.     

Short-term emotion assessment in a recall paradigm

The work presented in this paper aims at assessing human emotions using peripheral as well as electroencephalographic (EEG) physiological signals on short-time periods. Three specific areas of the valence–arousal emotional space are defined, corresponding to negatively excited, positively excited, and calm-neutral states. An acquisition protocol based on the recall of past emotional life episodes has been designed to acquire data from both peripheral and EEG signals. Pattern classification is used to distinguish between the three areas of the valence–arousal space. The performance of several classifiers has been evaluated on 10 participants and different feature sets: peripheral features, EEG time–frequency features, EEG pairwise mutual information (MI) features. Comparison of results obtained using either peripheral or EEG signals confirms the interest of using EEGs to assess valence and arousal in emotion recall conditions. The obtained accuracy for the three emotional classes is 63% using EEG time–frequency features, which is better than the results obtained from previous studies using EEG and similar classes. Fusion of the different feature sets at the decision level using a summation rule also showed to improve accuracy to 70%. Furthermore, the rejection of non-confident samples finally led to a classification accuracy of 80% for the three classes.     

采用多路图注意力网络的情绪脑电信号识别方法

情绪是一种大脑产生的主观认知的概括。脑信号解码技术可以以一种较客观的方式来有效地研究人的情绪及其相关认知行为。本文提出了一种基于图注意力网络的脑电情绪识别方法(multi-path graph attention networks, MPGAT),该方法通过对脑电信号通道建图,利用卷积层提取脑电信号的时域特征以及各频带的特征,使用图注意力网络进一步捕捉情绪脑电信号的局部特征以及各脑区之间的内在功能关系,进而构建出更好的脑电信号表征。MPGAT在SEED和SEED-IV数据集的跨被试情绪识别平均准确率分别为86.03%、72.71%,在DREAMER数据集的效价(valence)和唤醒(arousal)维度的跨被试平均准确率分别为76.35%和75.46%,达到并部分超过了目前最先进脑电情绪识别方法的性能。本文所提出的脑电信号处理方法有望为情绪认知科学研究与情绪脑机接口系统提供新的技术手段。     

An EEG emotion recognition method based on transfer learning and echo state network for HilCPS

As a new cyber physical application, emotion recognition has been shown to make human-in-the-loop cyber-physical system (HilCPS) more efficient and sustainable. Therefore, emotion recognition is of great significance for HilCPS. Electroencephalogram (EEG) signals contain abundant and useful information, and can objectively reflect human emotional states. According to EEG signals, using machine learning to recognize emotion is the main method at present. This method depends on the quantity and quality of samples as well as the capability of classification model. However, the quantity of EEG samples is often insufficient and the quality of EEG samples is often irregular. Meanwhile, EEG samples possess strong nonlinearity. Therefore, an EEG emotion recognition method based on transfer learning (TL) and echo state network (ESN) for HilCPS is proposed in this paper. First, a selection algorithm of EEG samples based on average Frechet distance is proposed to improve the sample quality. Second, a feature transfer algorithm of EEG samples based on transfer component analysis is proposed to expand the sample quantity. Third, in order to solve the problem of the nonlinearity of EEG samples, a classification model of EEG samples based on ESN is constructed to accurately classify emotional states. Finally, experimental results show that compared with traditional methods, the proposed method can expand the quantity of the high-quality EEG samples and effectively improve the accuracy of emotion recognition.     

Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers

Current emotion recognition computational techniques have been successful on associating the emotional changes with the EEG signals, and so they can be identified and classified from EEG signals if appropriate stimuli are applied. However, automatic recognition is usually restricted to a small number of emotions classes mainly due to signal’s features and noise, EEG constraints and subject-dependent issues. In order to address these issues, in this paper a novel feature-based emotion recognition model is proposed for EEG-based Brain–Computer Interfaces. Unlike other approaches, our method explores a wider set of emotion types and incorporates additional features which are relevant for signal pre-processing and recognition classification tasks, based on a dimensional model of emotions: Valenceand Arousal. It aims to improve the accuracy of the emotion classification task by combining mutual information based feature selection methods and kernel classifiers. Experiments using our approach for emotion classification which combines efficient feature selection methods and efficient kernel-based classifiers on standard EEG datasets show the promise of the approach when compared with state-of-the-art computational methods.     

A new approach for product evaluation based on integration of EEG and eye-tracking

Exploiting biometric measures, especially neurophysiological data of evaluator for product evaluation is advantageous at avoiding bias and subjectivity in expert scoring process. This paper proposes an approach that integrates electroencephalograph (EEG) and eye-tracking (ET) data in a new way to derive multi-faceted supportive information for product evaluation. Firstly, emotion recognition from EEG signals of evaluator is carried out with a spatial–temporal neural network. Then, based on correlations between emotions and preferential judgement, general customer preference toward product design scheme is inferred from emotions by fuzzy system. Finally, general preference is integrated with ET data at application-level to quantify fine-grained customer preferences toward design modules and visual attractiveness. This approach is verified with a case study which evaluates six designs of frontal area of automotive interior, and valuable supportive information for design decision-making is yielded. Also, comprehensive analysis is conducted and the results verify the effectiveness of proposed approach.     

基于传递熵关键因果连接的情感识别方法

人脑在情绪活动中呈现的信息流是复杂多变的,因此理解脑区间的动态交互过程至关重要,但是基于原始脑电信号构建的情绪网络包含了许多与情绪无关的冗余信息.针对此问题,提出一种在不丢失关键因果信息的前提下去除情绪无关网络连接的方法,并验证其在情感识别过程中的有效性.首先,基于传递熵因果分析方法对积极、中性和消极情绪构建归一化传递熵矩阵,再从积极、消极情绪矩阵中减去中性情绪矩阵,最后基于简化后的矩阵构建因效性脑网络并利用图论分析不同情绪的网络连通性.通过在DEAP数据集上的验证发现,该方法有效地提高了情感识别准确率.     

多特征融合的脑电情绪分类

为进一步探究不同类型特征互补性对脑电情绪分类的影响,提出一种基于多特征融合的脑电情绪分类新方法。对预处理后的脑电信号进行DE、MST和SampEn特征提取,采用双样本T检验去除冗余筛选出最优特征并融合,采用SVM分类模型来识别不同的情绪状态。在SEED-Ⅳ数据集上的实验结果表明,单一特征中DE的平均分类准确率最高（77.86%）,而融合非线性SampEn特征与功能连接MST属性后平均分类准确率得到进一步提升（84.58%）,不同时间段采集的数据上重测实验则证明了该方法的有效性与稳定性。     

二次滑动粗粒化的快速样本熵脑电情感分析

针对传统单一尺度样本熵对脑电信号(EEG)序列特征提取不明显、多尺度熵在粗粒化过程中会遗漏重要信息导致情感分类性能下降以及样本熵算法效率不高的问题,提出了一种基于二次滑动均值粗粒化的多尺度快速样本熵脑电特征提取方法。由于不同情感的脑电信号存在差异性,先采用二次滑动均值粗粒化对脑电信号进行多尺度处理,然后利用快速样本熵算法提取不同时间尺度的样本熵值作为特征向量,结合随机森林(RF)分类模型来识别不同的情感状态。提出的方法对多模态标准情感数据库DEAP进行了研究,发现大脑额区和右脑对情感比较敏感,正性、中性和负性情感在大脑侧额区获得了88.75%的平均分类准确率。实验结果表明,该方法可以有效地提取脑电特征,并且能够保证算法的效率。     

基于协同过滤Attention机制的情感分析模型

该文主要研究在评论性数据中用户个性及产品信息对数据情感类别的影响。在影响数据情感类型的众多因素中,该文认为评价的主体即用户以及被评价的对象等信息对评论数据的情感至关重要。该文提出一种基于协同过滤Attention机制的情感分析方法(LSTM-CFA),使用协同过滤(CF)算法计算出用户兴趣分布矩阵,再将矩阵利用SVD分解后加入层次LSTM模型,作为模型注意力机制提取文档特征、实现情感分类。实验表明LSTM-CFA方法能够高效提取用户个性与产品属性信息,显著提升了情感分类的准确率。     

Classification of emotions induced by music videos and correlation with participants’ rating

Emotional experience and preference play a vital role in selection of multimedia content for an individual. Brain electrical activity bears the emotional cues needed for emotion detection, but very modest research has been done to extract those cues. This paper presents a novel machine learning approach using Dual-Tree Complex Wavelet Packet Transform (DT-CWPT) time–frequency features from electroencephalogram (EEG) to detect emotions together with an analysis of brain activity in different emotional states. Firstly, DT-CWPT is used to extract time–frequency emotional features. Then non-redundant and most discriminating emotional features are selected through singular value decomposition (SVD), QR factorization with column pivoting (QRcp) and F-Ratio based feature selection (FS) method. The reduced emotional feature set is used to classify emotion using support vector machine (SVM) and validated by leave-one-out cross-validation scheme. Results confirm the robustness and consistency in classification of emotions from EEG signals and significant correlation between participants’ self assessed ratings with emotional features. It also gives an analysis of activities in brain region during different emotional states.