基于虚拟手的人机交互关键技术

基于虚拟手的人机交互技术是虚拟现实中的研究热点。对其中的关键技术进行了研究,采用多边形网格建模方法,建立了虚拟手的逼真几何模型;基于Virtools平台开发了数据手套的数据采集模块,提出使用基于初始值的数据转换方法,解决了开始运动时的跳变问题,同时对手指的外展运动,使用约束值方法进行处理,提高了虚拟手与真实人手匹配一致性;最后,针对虚拟手与虚拟物体的操作交互,提出了一种基于有效阈值角度的抓取算法。通过Virtools平台进行验证,实验结果表明:虚拟手模型逼真度高,手型变化自然;同时实现了虚拟手对虚拟物体的操作交互,具有很强的实用性。

Key technologies of human-computer interaction based on virtual hand

Human-computer interaction technology based on virtual hand is a research focus of virtual reality. The key technologies were studied, the modeling method of polygon mesh was used and a realistic geometric model of virtual hand was established. The data acquisition module of data glove based on Virtools was developed and a method of data conversion based on initial value was proposed, the phenomenon of jump was solved when the virtual hand begin to move. For the fingers outreach motion, the method of constraint value was used, and the matching consistency of virtual hand with the real hand was increased. At last, for the interaction operation of virtual hand with virtual objects, a crawl algorithm based on effective threshold angle was put forward. Verified by Virtools platform, high fidelity of the virtual hand model is got, the shape of the hand changes naturally. Meanwhile, the interaction operation of virtual hand to virtual objects is implemented and it has a strong practicability.