首页 | 本学科首页   官方微博 | 高级检索  
     

基于HMM-FNN模型的复杂动态手势识别
引用本文:王西颖,戴国忠,张习文,张凤军.基于HMM-FNN模型的复杂动态手势识别[J].软件学报,2008,19(9):2302-2312.
作者姓名:王西颖  戴国忠  张习文  张凤军
作者单位:1. 中国科学院,软件研究所,人机交互技术与智能信息处理实验室,北京,100190;中国科学院,研究生院,北京,100049
2. 中国科学院,软件研究所,人机交互技术与智能信息处理实验室,北京,100190
基金项目:国家重点基础研究发展计划(973计划),国家自然科学基金,国家高技术研究发展计划(863计划)
摘    要:复杂动态手势识别是利用视频手势进行人机交互的关键问题.提出一种HMM-FNN模型结构.它整合了隐马尔可夫模型对时序数据的建模能力与模糊神经网络的模糊规则构建与推理能力,并将其应用到复杂动态手势的识别中.复杂动态手势具备两大特点:运动特征的可分解性与定义描述的模糊性.针对这两种特性,复杂手势被分解为手形变化、2D平面运动与Z轴方向运动3个子部分,分别利用HMM进行建模,HMM模型对观察子序列的似然概率被作为FNN的模糊隶属度,通过模糊规则推理,最终得到手势的分类类别.HMM-FNN方法将高维手势特征分解为低维子特征序列,降低了模型的复杂度.此外,它还可以充分利用人的经验辅助模型结构的创建与优化.实验表明,该方法是一种有效的复杂动态手势识别方法,并且优于传统的HMM模型方法.

关 键 词:手势识别  HMM-FNN模型  复杂动态手势  人机交互
收稿时间:2006/11/14 0:00:00
修稿时间:2007/4/18 0:00:00

Recognition of Complex Dynamic Gesture Based on HMM-FNN Model
WANG Xi-Ying,DAI Guo-Zhong,ZHANG Xi-Wen and ZHANG Feng-Jun.Recognition of Complex Dynamic Gesture Based on HMM-FNN Model[J].Journal of Software,2008,19(9):2302-2312.
Authors:WANG Xi-Ying  DAI Guo-Zhong  ZHANG Xi-Wen and ZHANG Feng-Jun
Abstract:Recognition of complex dynamic gesture is a key issue for visual gesture-based human-computer interaction.In this paper,an HMM-FNN model is proposed for gesture recognition,which combines ability of HMM model for temporal data modeling with that of fuzzy neural network for fuzzy rule modeling and fuzzy inference.Complex dynamic gesture has two important properties:Its motion can be decomposed and usually being defined in a fuzzy way.By HMM-FNN,complex gesture is firstly decomposed into three components:Posture changing,movement in 2D plane and movement in Z-axis direction,each of which is modeled by HMM.The likelihood of each HMM to observation sequence is considered as membership value of FNN,and gesture is classified through fuzzy inference of FNN.In this proposed method,high-dimensional gesture feature is transformed into several low-dimensional features,as a result,computational complexity is reduced.Furthermore, human's experience or prior knowledge can be used to build and optimize model structure.Experimental results show that the proposed method is an effective method for recognition of complex dynamic gesture,and is superior to conventional HMM method.
Keywords:gesture recognition  HMM-FNN model  complex dynamic gesture  human-computer interaction
本文献已被 CNKI 维普 万方数据 等数据库收录!
点击此处可从《软件学报》浏览原始摘要信息
点击此处可从《软件学报》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号