首页 | 本学科首页   官方微博 | 高级检索  
     

连续交互空间下的混合手势交互模型
引用本文:刘杰,黄进,田丰,胡伟平,戴国忠,王宏安. 连续交互空间下的混合手势交互模型[J]. 软件学报, 2017, 28(8): 2080-2095
作者姓名:刘杰  黄进  田丰  胡伟平  戴国忠  王宏安
作者单位:中国科学院软件研究所 人机交互北京市重点实验室, 北京 100190;中国科学院大学, 北京 100190;桂林电子科技大学 计算机科学与工程学院, 广西 桂林 541004,中国科学院软件研究所 人机交互北京市重点实验室, 北京 100190,中国科学院软件研究所 人机交互北京市重点实验室, 北京 100190,中国科学院软件研究所 人机交互北京市重点实验室, 北京 100190,中国科学院软件研究所 人机交互北京市重点实验室, 北京 100190,中国科学院软件研究所 人机交互北京市重点实验室, 北京 100190
基金项目:国家自然科学基金(61422212,61232013,61170182,61273269);国家高技术研究发展计划(863):2015AA020506,2015AA016305
摘    要:分析了触控交互技术在移动手持设备及可穿戴设备应用的应用现状及存在的问题;基于交互动作的时间连续性及空间连续性,提出了将触控交互动作的接触面轨迹与空间轨迹相结合,同时具有空中手势及触控手势的特性及优点的混合手势输入方法;基于连续交互空间的概念,将混合交互手势,空中手势、表面触控手势进行统一,建立了包括空中层、表面层、混合层的连续交互空间分层处理模型;给出了统一的信息数据定义及数转换流程;构建了通用性的手势识别框架,并对轨迹切分方法及手势分类识别方法进行了阐述.最后设计了应用实例,通过实验,对混合交互手势的可用性及连续空间分层处理模型的可行性进行了验证.实验表明,混合手势输入方式同时兼具了表面触控输入及空中手势输入的优点,在兼顾识别效率的同时,具有较好的空间自由度.

关 键 词:人机交互  手势交互  交互模型  交互空间  混合手势
收稿时间:2015-05-20
修稿时间:2015-09-10

Hybrid Gesture Interaction Model in the Continuous Interaction Space
LIU Jie,HUANG Jin,TIAN Feng,HU Wei-Ping,DAI Guo-Zhong and WANG Hong-An. Hybrid Gesture Interaction Model in the Continuous Interaction Space[J]. Journal of Software, 2017, 28(8): 2080-2095
Authors:LIU Jie  HUANG Jin  TIAN Feng  HU Wei-Ping  DAI Guo-Zhong  WANG Hong-An
Affiliation:Beijing Key Laboratory of Human-Computer Interaction(Institute of Software, The Chinese Academy of Sciences), Beijing 100190, China;University of Chinese Academy of Sciences, Beijing 100190, China;School of Computer Science and Information Security, Guilin University of Electronic Technology, Guilin 541004, China,Beijing Key Laboratory of Human-Computer Interaction(Institute of Software, The Chinese Academy of Sciences), Beijing 100190, China,Beijing Key Laboratory of Human-Computer Interaction(Institute of Software, The Chinese Academy of Sciences), Beijing 100190, China,Beijing Key Laboratory of Human-Computer Interaction(Institute of Software, The Chinese Academy of Sciences), Beijing 100190, China,Beijing Key Laboratory of Human-Computer Interaction(Institute of Software, The Chinese Academy of Sciences), Beijing 100190, China and Beijing Key Laboratory of Human-Computer Interaction(Institute of Software, The Chinese Academy of Sciences), Beijing 100190, China
Abstract:Analyzed the application and existing problems of touch interaction for mobile handsets and wearable device. Based on time continuity and space continuity of interactive action, we proposed the hybrid gesture input method with characteristic and advantages of air gesture and touch gestures, which combine the contact trajectory and in-air trajectory of the interactive action. Based on the concept of continuous interaction space, we unified hybrid interaction gestures, air gestures, surface touch gestures, and established a continuous interaction space hierarchical processing model including the air layer, surface layer and hybrid layer. Then expounded the definition information data and the transformation process. The general gesture recognition framework was constructed. Then, the trajectory segmentation method and gestures classification methods were introduced in detail. Finally, we design the application instance, and verified availability of the hybrid interaction gestures and feasibility of the continuous interaction space hierarchical processing model. Experiments showed that, the Hybrid Gesture Interaction Model got the advantages of both air gesture and touch gestures, had good recognition efficiency and better spatial freedom.
Keywords:human computer interaction  gesture interaction  interaction model  interaction space  hybrid gesture
点击此处可从《软件学报》浏览原始摘要信息
点击此处可从《软件学报》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号