A hybrid biogeography-based optimization algorithm for job shop scheduling problem

In this paper, a hybrid biogeography-based optimization (HBBO) algorithm has been proposed for the job-shop scheduling problem (JSP). Biogeography-based optimization (BBO) is a new bio-inpired computation method that is based on the science of biogeography. The BBO algorithm searches for the global optimum mainly through two main steps: migration and mutation. As JSP is one of the most difficult combinational optimization problems, the original BBO algorithm cannot handle it very well, especially for instances with larger size. The proposed HBBO algorithm combines the chaos theory and “searching around the optimum” strategy with the basic BBO, which makes it converge to global optimum solution faster and more stably. Series of comparative experiments with particle swarm optimization (PSO), basic BBO, the CPLEX and 14 other competitive algorithms are conducted, and the results show that our proposed HBBO algorithm outperforms the other state-of-the-art algorithms, such as genetic algorithm (GA), simulated annealing (SA), the PSO and the basic BBO.     

基于混合分布注意力机制与混合神经网络的语音情绪识别方法

针对现有语音情绪识别中存在无关特征多和准确率较差的问题,提出一种基于混合分布注意力机制与混合神经网络的语音情绪识别方法。该方法在2个通道内,分别使用卷积神经网络和双向长短时记忆网络进行语音的空间特征和时序特征提取,然后将2个网络的输出同时作为多头注意力机制的输入矩阵。同时,考虑到现有多头注意力机制存在的低秩分布问题,在注意力机制计算方式上进行改进,将低秩分布与2个神经网络的输出特征的相似性做混合分布叠加,再经过归一化操作后将所有子空间结果进行拼接,最后经过全连接层进行分类输出。实验结果表明,基于混合分布注意力机制与混合神经网络的语音情绪识别方法比现有其他方法的准确率更高,验证了所提方法的有效性。     

一种云环境下基于混合型BBO的任务调度算法

任务调度在云计算中占有重要地位,是影响云计算性能的关键因素,被证明是NP问题。启发式算法是解决该问题的最有效方法之一,针对近年来出现的一种新型启发式算法--BBO算法展开研究,由于BBO算法在求解过程中收敛速度较慢,因此结合粒子群算法提出了一种新型算法的任务调度算法--HMBBO,并结合Cloudsim云仿真平台,进行了以Makespan为目标函数的比对实验。实验结果表明,与几种经典的启发式算法相比,HMBBO算法具有寻优能力强、收敛速度快、求解质量高的特点,为解决云计算环境中任务调度问题提供了一种新思路。     

Segment-based emotion recognition from continuous Mandarin Chinese speech

Recognition of emotion in speech has recently matured to one of the key disciplines in speech analysis serving next generation human-machine interaction and communication. However, compared to automatic speech recognition, that emotion recognition from an isolated word or a phrase is inappropriate for conversation. Because a complete emotional expression may stride across several sentences, and may fetch-up on any word in dialogue. In this paper, we present a segment-based emotion recognition approach to continuous Mandarin Chinese speech. In this proposed approach, the unit for recognition is not a phrase or a sentence but an emotional expression in dialogue. To that end, the following procedures are presented: First, we evaluate the performance of several classifiers in short sentence speech emotion recognition architectures. The results of the experiments show that the WD-KNN classifier achieves the best accuracy for the 5-class emotion recognition what among the five classification techniques. We then implemented a continuous Mandarin Chinese speech emotion recognition system with an emotion radar chart which is based on WD-KNN; this system can represent the intensity of each emotion component in speech. This proposed approach shows how emotions can be recognized by speech signals, and in turn how emotional states can be visualized.     

Feature-based hybrid strategies for gradient descent optimization in end-to-end speech recognition

Multimedia Tools and Applications - With the increasing popularity of deep learning, deep learning architectures are being utilized in speech recognition. Deep learning based speech recognition...     

基于PRS元模型的粒子群优化算法及其应用*

针对传统粒子群算法优化黑箱模型过程中存在巨大计算开销的问题,提出一种基于PRS元模型的改进粒子群优化算法—PPSO算法。在该算法迭代过程中,构建PRS元模型,利用其最优值点辅助粒子种群的更新,此外仅选择元模型预估集中优值集的粒子进行目标函数的计算仿真。将PPSO算法与基本粒子群算法、混沌粒子群算法进行数值测试对比,并应用于模糊控制器的优化设计,仿真结果表明该算法可减少真实估值次数,提高优化搜索能力。     

融合模糊认知图用于语音情感识别

模糊认知图（Fuzzy Cognitive Map,FCM）作为一种图分析方法已在数据分类方面得到应用,为了提高其在语音情感识别中的分类精度,提出了融合FCM的方法。其中包括特征级融合和决策级融合两种方式。详细分析了这两种方式并提出将传统的模糊认知图的数值型输出转化为概率型输出,为不同特征提供了统一范围的初级识别结果。在此基础上,提出了自适应权值决策级融合方法。该方法充分考虑了分类器对不同特征的识别准确率差异。实验证明,提出的融合FCM方法相较于单一特征和单一分类器,具有更优的分类性能,同时大大降低了情感间的混淆程度。     

Ensemble softmax regression model for speech emotion recognition

Multimedia Tools and Applications - Automatic emotion recognition from speech signals is one of the important research areas. Most speech emotion recognition methods have been proposed, among which...     

A DE and PSO based hybrid algorithm for dynamic optimization problems

Many real world optimization problems are dynamic in which the fitness landscape is time dependent and the optima change over time. Such problems challenge traditional optimization algorithms. For such problems, optimization algorithms not only have to find the global optimum but also need to closely track its trajectory. In this paper, a new hybrid algorithm integrating a differential evolution (DE) and a particle swarm optimization (PSO) is proposed for dynamic optimization problems. Multi-population strategy is adopted to enhance the diversity and try to keep each subpopulation on a different peak in the fitness landscape. A hybrid operator combining DE and PSO is designed, in which each individual is sequentially carried out DE and PSO operations. An exclusion scheme is proposed that integrates the distance based exclusion scheme with the hill-valley function to track the adjacent peaks. The algorithm is applied to the set of benchmark functions used in CEC 2009 competition for dynamic environment. Experimental results show that it is more effective in terms of overall performance than other comparative algorithms.     

An effective hybrid biogeography-based optimization algorithm for parameter estimation of chaotic systems

Parameter estimation of chaotic systems is an important issue in the fields of computational mathematics and nonlinear science, which has gained increasing research and applications. In this paper, biogeography-based optimization (BBO), a new effective optimization algorithm based on the biogeography theory of the geographical distribution of biological organisms, is reasonably combined with differential evolution and simplex search to develop an effective hybrid algorithm for solving parameter estimation problem that is formulated as a multi-dimensional optimization problem. By suitably fusing several optimization methods with different searching mechanisms and features, the exploration and exploitation abilities of the hybrid algorithm can be enhanced and well balanced. Numerical simulation based on several typical chaotic systems and comparisons with some existing methods demonstrate the effectiveness of the proposed algorithm. In addition, the effects of population size and noise on the performances of the hybrid algorithm are investigated.     

Deep features-based speech emotion recognition for smart affective services

Emotion recognition from speech signals is an interesting research with several applications like smart healthcare, autonomous voice response systems, assessing situational seriousness by caller affective state analysis in emergency centers, and other smart affective services. In this paper, we present a study of speech emotion recognition based on the features extracted from spectrograms using a deep convolutional neural network (CNN) with rectangular kernels. Typically, CNNs have square shaped kernels and pooling operators at various layers, which are suited for 2D image data. However, in case of spectrograms, the information is encoded in a slightly different manner. Time is represented along the x-axis and y-axis shows frequency of the speech signal, whereas, the amplitude is indicated by the intensity value in the spectrogram at a particular position. To analyze speech through spectrograms, we propose rectangular kernels of varying shapes and sizes, along with max pooling in rectangular neighborhoods, to extract discriminative features. The proposed scheme effectively learns discriminative features from speech spectrograms and performs better than many state-of-the-art techniques when evaluated its performance on Emo-DB and Korean speech dataset.

     

Unsupervised domain adaptation for speech emotion recognition using PCANet

Multimedia Tools and Applications - Research in emotion recognition seeks to develop insights into the variances of features of emotion in one common domain. However, automatic emotion recognition...     

DE/BBO: a hybrid differential evolution with biogeography-based optimization for global numerical optimization

Differential evolution (DE) is a fast and robust evolutionary algorithm for global optimization. It has been widely used in many areas. Biogeography-based optimization (BBO) is a new biogeography inspired algorithm. It mainly uses the biogeography-based migration operator to share the information among solutions. In this paper, we propose a hybrid DE with BBO, namely DE/BBO, for the global numerical optimization problem. DE/BBO combines the exploration of DE with the exploitation of BBO effectively, and hence it can generate the promising candidate solutions. To verify the performance of our proposed DE/BBO, 23 benchmark functions with a wide range of dimensions and diverse complexities are employed. Experimental results indicate that our approach is effective and efficient. Compared with other state-of-the-art DE approaches, DE/BBO performs better, or at least comparably, in terms of the quality of the final solutions and the convergence rate. In addition, the influence of the population size, dimensionality, different mutation schemes, and the self-adaptive control parameters of DE are also studied.     

Speaker independent feature selection for speech emotion recognition: A multi-task approach

Nowadays, automatic speech emotion recognition has numerous applications. One of the important steps of these systems is the feature selection step. Because it is not known which acoustic features of person’s speech are related to speech emotion, much effort has been made to introduce several acoustic features. However, since employing all of these features will lower the learning efficiency of classifiers, it is necessary to select some features. Moreover, when there are several speakers, choosing speaker-independent features is required. For this reason, the present paper attempts to select features which are not only related to the emotion of speech, but are also speaker-independent. For this purpose, the current study proposes a multi-task approach which selects the proper speaker-independent features for each pair of classes. The selected features are then given to the classifier. Finally, the outputs of the classifiers are appropriately combined to achieve an output of a multi-class problem. Simulation results reveal that the proposed approach outperforms other methods and offers higher efficiency in terms of detection accuracy and runtime.

     

利用语音与文本特征融合改善语音情感识别

情感识别在人机交互中具有重要意义,为了提高情感识别准确率,将语音与文本特征融合。语音特征采用了声学特征和韵律特征,文本特征采用了基于情感词典的词袋特征（Bag-of-words,BoW）和N-gram模型。将语音与文本特征分别进行特征层融合与决策层融合,比较它们在IEMOCAP四类情感识别的效果。实验表明,语音与文本特征融合比单一特征在情感识别中表现更好;决策层融合比在特征层融合识别效果好。且基于卷积神经网络（Convolutional neural network,CNN）分类器,语音与文本特征在决策层融合中不加权平均召回率（Unweighted average recall,UAR)达到了68.98%,超过了此前在IEMOCAP数据集上的最好结果。     

A multimodal emotion recognition model integrating speech,video and MoCAP

Multimedia Tools and Applications - As one of the core technologies in the field of human-computer interaction, emotion recognition focuses on the simulation of human emotion perception and...     

基于多级SVM分类的语音情感识别算法

为了提高语音情感识别系统的识别准确率,本文在传统支持向量机(SVM)方法的基础之上,提出了一种基于PCA的多级SVM情感分类算法。首先将容易区分的情感分开,针对混淆度大且不能再利用多级分类策略直接进行区分的情感,采用主成分分析法(PCA)进行特征降维,然后逐级地判断出输入语音所属的情感类型。与传统基于SVM分类算法的语音情感识别相比,本文提出的方法可将7种情感的平均识别率提高5.05%,并且特征维度可降低58.3%,从而证明了本文所提出的方法的正确性与有效性。     

Multimodal information fusion application to human emotion recognition from face and speech

A multimedia content is composed of several streams that carry information in audio, video or textual channels. Classification and clustering multimedia contents require extraction and combination of information from these streams. The streams constituting a multimedia content are naturally different in terms of scale, dynamics and temporal patterns. These differences make combining the information sources using classic combination techniques difficult. We propose an asynchronous feature level fusion approach that creates a unified hybrid feature space out of the individual signal measurements. The target space can be used for clustering or classification of the multimedia content. As a representative application, we used the proposed approach to recognize basic affective states from speech prosody and facial expressions. Experimental results over two audiovisual emotion databases with 42 and 12 subjects revealed that the performance of the proposed system is significantly higher than the unimodal face based and speech based systems, as well as synchronous feature level and decision level fusion approaches.