基于面部表情识别的学习疲劳识别和干预方法

针对网络学习者经常出现的身体或心理上的疲劳或疲惫情绪状态即"学习疲劳"状态,提出了一种基于面部表情识别的学习疲劳识别和干预方法.考虑到网络学习的特点,定义了专注、疲劳和中性3种与学习相关的表情,利用一种基于肤色分割和模版匹配相结合的人脸检测算法检测出网络学习者的人脸区域,然后根据建立的人脸表情面部模型对学习者的面部特征进行提取,主要包括眼睛特征和嘴巴特征,最后采用基于规则的表情分类方法,识别出学习者是否处于学习疲劳状态,并采取相应的情感干预措施.实验结果表明,该方法能够快速识别网络学习者是否处于学习疲劳状态,实现实时学习疲劳干预.

Learning fatigue recognition and intervention based on facial expression recognition

A learning fatigue recognition and intervention method based on facial expression recognition is proposed when E-learners regular appeared physical or psychological fatigue state which is called "learning fatigue state".First,three learning-related expressions are defined as absorbed,fatigue and neutral.Secondly,the method combines skin color segmentation with template matching technique is used to detect E-learners' faces.Then according to the established model of facial expression of E-learners to extract the main features,including eye and mouth features.Finally,rule-based expression classification method is used to identify whether the E-learner is fatigue,and then appropriate emotional intervention measures are taken.As experimental results indicate,it is able to quickly identify whether the E-learner is in learning fatigue state and real-time learning fatigue interference is available.