首页 | 本学科首页   官方微博 | 高级检索  
     

基于Apex帧光流和卷积自编码器的微表情识别
引用本文:温杰彬,杨文忠,马国祥,张志豪,李海磊. 基于Apex帧光流和卷积自编码器的微表情识别[J]. 计算机工程与应用, 2021, 57(4): 127-133. DOI: 10.3778/j.issn.1002-8331.1911-0399
作者姓名:温杰彬  杨文忠  马国祥  张志豪  李海磊
作者单位:1.新疆大学 信息科学与工程学院,乌鲁木齐 8300462.中国电子科学研究院 社会安全风险感知与防控大数据应用国家工程实验室,北京 1000413.新疆大学 软件学院,乌鲁木齐 830091
基金项目:社会安全风险感知与防控大数据应用国家工程实验室主任基金项目;四川省科技计划项目;国家自然科学基金
摘    要:针对跨库微表情识别问题,提出了一种基于Apex帧光流和卷积自编码器的微表情识别方法。该方法包括预处理、特征提取、微表情分类三部分。预处理部分对微表情进行Apex帧定位以及人脸检测和对齐;特征提取部分首先计算预处理过的Apex帧的TVL1光流,然后使用得到的水平和竖直光流分量图像训练卷积自编码器得到最优结构和参数;最后将两个分量自编码器中间层的特征融合后作为微表情的特征;微表情分类就是使用支持向量机(Support Vector Machine,SVM)对上一步中提取到的特征进行分类。实验结果较基准方法(LBP-TOP)有了很大的提高,UF1提高了0.134 4,UAR提高了0.140 6。该方法为微表情特征提取和识别提供了新的思路。

关 键 词:微表情识别  Apex帧  光流  卷积自编码器  支持向量机(SVM)  

Micro-expression Recognition Based on Apex Frame Optical Flow and Convolutional Autoencoder
WEN Jiebin,YANG Wenzhong,MA Guoxiang,ZHANG Zhihao,LI Hailei. Micro-expression Recognition Based on Apex Frame Optical Flow and Convolutional Autoencoder[J]. Computer Engineering and Applications, 2021, 57(4): 127-133. DOI: 10.3778/j.issn.1002-8331.1911-0399
Authors:WEN Jiebin  YANG Wenzhong  MA Guoxiang  ZHANG Zhihao  LI Hailei
Affiliation:1.College of Information Science and Engineering, Xinjiang University, Urumqi 830046, China2.National Engineering Laboratory for Public Safety Risk Perception and Control by Big Data(PSRPC), China Academy of Electronics and Information Technology, Beijing 100041, China3.School of Software, Xinjiang University, Urumqi 830091, China
Abstract:Aiming at the problem of cross-database micro-expression recognition, a micro-expression recognition method based on Apex frame optical flow and convolutional autoencoder is proposed. The method includes three parts:preprocessing, feature extraction and micro-expression classification. The preprocessing section performs Apex frame positioning, face detection and alignment on the micro-expressions. The feature extraction section first calculates the TVL1 optical flow of the pre-processed Apex frame, then uses the obtained horizontal and vertical optical flow component images to train the convolutional autoencoder to obtain the optimal structure and parameters, finally combines the two components from the features of the middle layer of the encoder as the features of the micro-expressions. In section of micro-expression classification, a Support Vector Machine(SVM) classifier is used to classify the features extracted in the previous step. The experimental results have been greatly improved compared to the baseline method(LBP-TOP). Among them, UF1 has increased by 0.134 4, and UAR has increased by 0.140 6. This method provides new ideas for micro-expression features extraction and recognition.
Keywords:micro-expression recognition  Apex frame  optical flow  convolutional autoencoder  Support Vector Machine(SVM)  
本文献已被 万方数据 等数据库收录!
点击此处可从《计算机工程与应用》浏览原始摘要信息
点击此处可从《计算机工程与应用》下载免费的PDF全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号