多模态情感识别研究进展*

情感识别研究热点正从单模态转移到多模态。针对多模态情感特征提取与融合的技术难点,本文列举了目前应用较广的多模态情感识别数据库,介绍了面部表情和语音情感这两个模态的特征提取技术,重点阐述了多模态情感融合识别技术,主要对多模态情感特征融合策略和融合方法进行了综述,对不同算法下的识别效果进行了对比。最后,对多模态情感识别研究中存在的问题进行了探讨,并对未来的研究方向进行了展望。

Research progress of multimodal emotion recognition

The focus of emotion recognition has shifted from unimodal analysis to multimodal fusion. For the difficulties of multimodal emotion feature extraction and fusion, this paper listed some widely-used datasets for multimodal emotion recognition, and the methods of feature extraction based on facial expression features and speech features. It mainly introduced the multimodal fusion technology, and the paper stated some levels or types of fusion and methods of fusion and compared them. Finally, it explored potential issues and future research directions.