空间增强现实中的人机交互技术综述

空间增强现实是增强现实的三大形式之一,它利用投影等方式在物理空间中增强显示虚拟内容.在空间增强现实系统中,用户可以在物理空间与虚拟内容交互,具有良好的环境感知、空间感知与协同感知,交互任务执行过程中认知负荷低.首先以空间增强现实显示方式为例,通过其系统架构介绍空间增强现实的技术原理;然后将空间增强现实中的人机交互技术分类为基于触控的交互、基于手势或姿势的交互、基于控制器的交互、手持投影仪交互、实物交互及多模态交互并进行分析,对相关技术在三维配准、虚实融合等方面带来的挑战进行阐述;同时总结了空间增强现实在运动锻炼、医疗辅助、教育娱乐、艺术等领域的应用状况;最后对空间增强现实中的交互技术发展趋势进行了展望,指出未来要克服现有技术在稳定性、准确性和实时性上存在的缺陷,在交互方式更自然、交互遮挡处理方法更智能、系统使用场景更广泛、与社会文化和心理现象研究相结合以及新型成像方式等方面得到突破和发展.

A Survey on Human-Computer Interaction in Spatial Augmented Reality

Spatial augmented reality(SAR),which typically uses projectors to augment physical spaces with virtual contents,is one of the three main forms of augmented reality.In SAR systems,users can interact with virtual contents in physical spaces,therefore they have good environmental,spatial and collaborative perceptions.SAR systems can also reduce the cognitive load of interaction tasks.SAR display forms are firstly demonstrated,and then SAR architectures are illustrated as well as its technical principles.SAR interaction technologies are classified into 6 categories,which are touch based interaction,gesture or posture based interaction,3D controller based interaction,handholding projector interaction,tangible interaction,and multimodal interaction.Challenges from 3D registration,virtual-real fusion are analyzed.The application status in the field of sports,medical treatment,education,entertainment and art are discussed.The trends in SAR interaction are finally predicted.Specifically,SAR interaction will become more natural,more intelligent in occlusion processing,more widely applicable,more closely related with the social,cultural and psychological researches,and novel display approaches will also be used by SAR systems.