面向混合现实教学的空中手势交互体验设计应用研究

目的 对混合现实教学中的空中手势交互体验进行深入研究,设计创新的教学体验模式,通过空中手势交互体验设计来提升教学体验。方法 采用文献研究、田野观察、深度访谈及实验研究法,以理论研究为基础,结合教学体验需求,围绕场景、用户、产品构建设计方法,定义满足教学需求的空中手势类型,最终结合有效技术手段,搭建混合现实教学场景、设计个性化教学体验环节、完成空中手势交互界面设计。结果 构建了针对混合现实教学的空中手势交互体验设计方法,定义了满足教学需求的八类空中手势类型,提出用户自定义空中手势的手势交互方式,设计了“教学指引”“徒手绘画”等具有教学指导意义的交互体验环节,适用于远程和线下的混合现实STEM教学场景,也形成了丰富的混合现实STEM课程教学资源。结论 通过用户实验论证了八类默认空中手势类型和用户自定义手势的整体可用性,为混合现实教学领域的交互体验设计研究开辟了新路径。

Application of Mid-air Gesture Interactive Experience Design for Mixed Reality Teaching

The work aims to conduct in-depth research on the interactive experience of mid-air gestures in mixed reality teaching, design innovative teaching experience modes, and enhance teaching experience through the design of mid-air gesture interactive experience. The methods of literature research, field observation, in-depth interviews, and experimental research methods were adopted. Based on theoretical research and combined with teaching experience needs, design methods were constructed around scenes, users, and products to define the types of mid-air gestures that met teaching needs. Finally, effective technical means were combined to build mixed reality teaching scenes, design personalized teaching experience links, and complete the design of mid-air gesture interaction interfaces. As a result, a design method for interactive experience of mid-air gestures for mixed reality teaching was constructed, and eight types of mid-air gestures were defined to meet teaching needs. A gesture interaction method for mid-air gestures was proposed. Interactive experience links with teaching guidance significance such as "teaching guidance" and "freehand painting" were designed, which were suitable for remote and offline mixed reality STEM teaching scenes, forming rich mixed reality STEM teaching resources. The conclusion demonstrates the overall usability of eight types of default mid-air gesture types and user-defined gestures through user experiments, opening up a new path for interactive experience design research in the field of mixed reality teaching.