Non-Frontal Facial Expression Recognition Using a Depth-Patch Based Deep Neural Network |
| |
| Authors: | Nai-Ming Yao Hui Chen Qing-Pei Guo Hong-An Wang |
| |
| Affiliation: | 1.Beijing Key Laboratory of Human-Computer Interaction, Institute of Software,Chinese Academy of Sciences,Beijing,China;2.University of Chinese Academy of Sciences,Beijing,China;3.State Key Laboratory of Computer Science, Institute of Software,Chinese Academy of Sciences,Beijing,China |
| |
| Abstract: | The challenge of coping with non-frontal head poses during facial expression recognition results in considerable reduction of accuracy and robustness when capturing expressions that occur during natural communications. In this paper, we attempt to recognize facial expressions under poses with large rotation angles from 2D videos. A depth-patch based 4D expression representation model is proposed. It was reconstructed from 2D dynamic images for delineating continuous spatial changes and temporal context under non-frontal cases. Furthermore, we present an effective deep neural network classifier, which can accurately capture pose-variant expression features from the depth patches and recognize non-frontal expressions. Experimental results on the BU-4DFE database show that the proposed method achieves a high recognition accuracy of 86.87% for non-frontal facial expressions within a range of head rotation angle of up to 52°, outperforming existing methods. We also present a quantitative analysis of the components contributing to the performance gain through tests on the BU-4DFE and Multi-PIE datasets. |
| |
| Keywords: | |
| 本文献已被 SpringerLink 等数据库收录！ |
|
