虚拟现实的力触觉交互技术发展现状与趋势

虚拟现实通过模拟人的视觉、听觉、力触觉等,使人处于一种与真实世界非常逼真的虚拟世界中,来感受、体验和评价虚拟世界中的场景和设备。力触觉在虚拟现实环境中有其突出优越性,力触觉使得虚拟现实环境变得真实,是唯一的既可接受周围环境输入又可以对周围环境输出的感知通道,可极大增强可视化表达的效果。虚拟现实的力触觉交互技术包括力触觉再现技术和虚拟环境的力触觉建模。介绍了这两方面的发展现状、存在的问题和今后的发展趋势。     

力／触觉再现设备的研究现状与应用

力/触觉再现技术作为一种新兴的人机交互模式在虚拟现实系统得到较多应用。力/触觉再现设备是力/触觉再现系统实现过程中必不可少的环节,受到广泛的重视和研究。讨论了力/触觉再现设备的种类和特点,分类介绍了国内外力/触觉再现设备的研究现状,并作了分析比较。最后讨论了力/触觉再现设备在不同领域的应用,并探讨了其未来的研究发展趋势。     

弹性体力/触觉框架模型

在力/触觉建模技术中,高效的实时性与基于物理意义的准确性是与生俱来的一对矛盾.为了提高实时性与准确性的和谐程度,提出一种分析虚拟柔性体力/变形关系的框架结构模型.在柔性体内部建立一定数量并相互独立的钢架结构,运用虚功原理计算每根钢架上节点的位移;根据接触点和节点的分布,采用分水岭法将柔性体表面分割成若干区域,通过本区域内节点和接触点的位移插值计算区域内顶点的变形,进而得到柔性体的整体变形.仿真实验结果表明,该模型简便、实时性好,在具体的虚拟建模力反馈工作中可操作性强.     

Haptic Direct-Drive Robot Control Scheme in Virtual Reality

This paper explores the use of a 2-D (Direct-Drive Arm) manipulator for mechanism design applications based on virtual reality (VR). This article reviews the system include a user interface, a simulator, and a robot control scheme. The user interface is a combination of a virtual clay environment and human arm dynamics via robot effector handler. The model of the VR system is built based on a haptic interface device behavior that enables the operator to feel the actual force feedback from the virtual environment just as s/he would from the real environment. A primary stabilizing controller is used to develop a haptic interface device where realistic simulations of the dynamic interaction forces between a human operator and the simulated virtual object/mechanism are required. The stability and performance of the system are studied and analyzed based on the Nyquist stability criterion. Experiments on cutting virtual clay are used to validate the theoretical developments. It was shown that the experimental and theoretical results are in good agreement and that the designed controller is robust to constrained/unconstrained environment.     

柔顺性触觉再现技术的研究

柔顺性触觉再现的研究难点主要集中在对触觉机理了解不深入、动态的感知过程、装置性能有限等方面.介绍了当前几种有代表性的柔顺性触觉再现装置:基于电流变液的触觉再现装置、气囊触觉再现装置、气动阵列触觉再现装置和基于弹性梁触觉再现装置.在此基础上讨论了这些装置的优缺点,并进行了比较.最后总结了柔顺性触觉再现技术的发展思路.     

Upper-body haptic system for snake robot teleoperation in pipelines

Snake robots have shown a great potential for operations in confined workplaces that are less accessible or dangerous to human workers, such as the in-pipe inspection. However, the snake robot teleoperation remains a nontrivial task due to the unique locomotion mechanism (e.g., helical motion) and the constraints of the workplaces including the low visibility and indistinguishable features. Most snake robot feedback systems are based on the live camera view only. It is hard for the human operator to develop a correct spatial understanding of the remote workplace, leading to problems such as disorientation and motion sickness in snake robot teleoperation. This study designs and evaluates an innovative haptic assistant system for snake robot teleoperation in the in-pipe inspection. An upper-body haptic suit with 40 vibrators on both the front and back sides of the human operator was developed to generate haptic feedback corresponding to the bottom and up sides of the snake robot, transferring the egocentric sensation of the snake robot to the human operator. A human-subject experiment (n = 31) was performed to evaluate the efficacy of the developed system. The results indicate that the proposed haptic assistant system outperformed other feedback systems in terms of both task performance and subjective workload and motion sickness evaluations. It inspires new control and feedback designs for the future snake robot in industrial operations.     

小型化柔性触觉再现装置

提出了一种小型化的具有实时触觉反馈作用的人机接口装置的设计方法,以控制弹性梁的有效变形长度为核心,保证了触觉再现的实时性和准确性,从而可以在操作者指端大范围再现虚拟对象或远程对象的刚度。介绍了该小型化人机触觉再现接口装置的硬件设计和软件设计。该实时触觉再现接口具有尺寸小、刚度再现范围大,可方便与鼠标相结合等特点,可广泛应用于遥操作机器人和虚拟现实领域。     

一种新的虚拟纹理触觉再现方法及其装置实现

根据人的触觉是动态触觉的原理,提出了一种新的纹理触觉再现方法及其实现装置,该装置能在使用者手指端部产生类似于纹理感觉的触觉信息.它的主要组成部分是铝合金制成的圆筒,上面分布着大小不同的凹孔和凸点,通过伺服电机带动它旋转.手指在匀速旋转的圆筒上来回滑动并触摸上面的凹孔与凸点,能有明显的触觉感受,而且不同的旋转速度将会带来不同的触觉效果.通过对该实验装置进行大量实验,统计归纳出实验者在各种情况下所获得的触觉感受,证实该装置在模拟纹理触觉方面确有成效,对纹理触觉的发展起到一定的促进作用.     

虚拟体空间中的触觉雕刻

目前，在虚拟环境中大多数的信息获取是通过视觉、听觉等非接触感觉获得的。然而缺乏触觉反馈的信息减少了很大一部分的信息源。在看和听之外，能够触摸、感觉和操纵物体，在很大程度上提高了虚拟环境的真实性。该文研究了触觉绘制的基本模型，提出了采用虚平面作为中介实现体数据的实时触觉绘制。并在此基础上探讨了体的局部变形及结合触觉反馈模型，实现了具有触觉反馈的虚拟雕刻交互系统。该系统可应用于融化、燃烧、印记、构造和着色实时交互操作。     

虚拟手抓持力觉生成算法真实性的评价

目的 虽然许多学者研发了多种虚拟手交互触力觉生成算法,但是如何评价虚拟手交互触力觉生成算法的真实性是一个富有挑战性的新问题,值得深入研究.方法 构建手指抓持力测量平台,设计3种抓持姿态下指尖静力抓持球体实验内容,测得各指尖作用力的实测值;通过虚拟手静力抓持力觉生成算法,求得这3种抓持姿态下各手指作用力的理论值;对实测值进行统计和分析,并与理论值进行对比和讨论;结果 日常抓持经验和实测值是完全相符的,实测值和理论值很接近且偏差均在可接受范围之内.单个手指作用力或多个手指合力的实测值与理论值的偏差均在1%6%.结论 本文实现了一种基于物理的实验方法,评价和分析了虚拟手静力抓持力觉生成算法的真实性,证实此算法可以逼真地生成虚拟手抓持力,可应用于具有力反馈的自然的虚拟手交互.     

支持力反馈的肝脏手术虚拟仿真及研究

该文提出了一种基于支持力反馈的肝脏虚拟手术仿真系统,支持力反馈的肝脏虚拟手术仿真实现流程主要包括CT影像的肝脏三维重建、空间场景构建、实时动态交互设计、反馈力的手术操作仿真.虚拟仿真环境搭建完成后,用户能够通过头盔式显示设备HTC Vive Pro及其所配备力反馈手柄在虚拟手术场景中进行肝脏手术切割的沉浸式知识学习及实...     

面向视频感知的静电力触觉渲染方法

针对视觉障碍的人获取视频等数字媒体信息受限的问题, 为扩展视频等数字媒体信息的触觉感知通道,提出一种面向视频感知的静电力触觉渲染方法。首先,采用基于像素点的视频帧处理算法,根据手指触摸位置获取当前视频帧的目标像素点,然后将目标像素点彩色信息从RGB模型转换为HSI模型,利用像素点色调分量来映射静电力激励信号频率参量,结合像素点亮度和饱和度分量来映射静电力激励信号幅度参量,合成静电力触觉激励信号,实现对实时视频的触觉渲染和感知。最后,设计动态色彩感知实验和亮度辨识感知实验,结果表明,该方法可实现对视频中物体信息的触觉感知,动态识别平均正确率达90.6%,色彩辨识平均正确率达69.4%,亮度辨识平均正确率达80.0%,所提方法能有效提取视频中的动态特征信息,增强视频触觉渲染的实时性。     

Advanced teleoperation and control system for industrial robots based on augmented virtuality and haptic feedback

There are some industrial tasks that are still mainly performed manually by human workers due to their complexity, which is the case of surface treatment operations (such as sanding, deburring, finishing, grinding, polishing, etc.) used to repair defects. This work develops an advanced teleoperation and control system for industrial robots in order to assist the human operator to perform the mentioned tasks. On the one hand, the controlled robotic system provides strength and accuracy, holding the tool, keeping the right tool orientation and guaranteeing a smooth approach to the workpiece. On the other hand, the advanced teleoperation provides security and comfort to the user when performing the task. In particular, the proposed teleoperation uses augmented virtuality (i.e., a virtual world that includes non-modeled real-world data) and haptic feedback to provide the user an immersive virtual experience when remotely teleoperating the tool of the robot system to treat arbitrary regions of the workpiece surface. The method is illustrated with a car body surface treatment operation, although it can be easily extended to other surface treatment applications or even to other industrial tasks where the human operator may benefit from robotic assistance. The effectiveness of the proposed approach is shown with several experiments using a 6R robotic arm. Moreover, a comparison of the performance obtained manually by an expert and that obtained with the proposed method has also been conducted in order to show the suitability of the proposed approach.     

速度驱动的复杂场景多层级力觉交互算法

触/力觉交互技术应用环境的复杂化,对复杂触/力觉场景的研究提出了新的挑战.文中以虚拟现实牙科手术训练系统为背景,研究基于速度驱动的复杂场景多层级力觉交互算法.文中采用CATIA对下牙列大量数据进行网格简化,建立了下牙列场景的层次细节(Levels Of Detail,LOD)模型;基于人类触觉感知的精度随交互速度的变化规律,设计了速度驱动的LOD模型触发机制;提出了虚拟工具化身SCP(Surface Contact Point)层级映射算法,保证了力觉交互设备的稳定性,并发现了映射约束线段的长度是保证力觉逼真性及实时性协调的关键变量;最后,设计了针对一般儿何体和复杂曲面的实验,量化评价文中算法的逼真性及实时性,证明了将人手运动速度作为场景模型复杂度切换驱动条件的有效性.     

虚拟工厂现实场景系统平台设计与实现

随着现代化工业不断发展,模拟过程工业真实环境,并在此基础上进行地理信息显示与空间分析等成为当前的研究热点。构建基于虚拟现实(VR)和地理信息系统的(GIS)的虚拟工厂现实场景系统是进行工业生产仿真的一条有效途径,为此,设计开发一个三维的、可维护性强并具有一定扩展性的虚拟工厂现实场景系统具有重要的实用价值。本文通过数据准备、数据生成、系统扩展及客户端设计,实现了虚拟工厂现实场景系统开发过程。通过应用分析与对比,结果表明,该平台化系统具有更高的可扩展性且开发成本低,为虚拟工厂现实场景系统平台设计提供了一个良好的、可扩展的开发途径。     

引入力触觉的数字文物多模交互方法

目的 针对当前文物资源由传统的实体文物向虚拟展示和数字文物进行扩展的趋势,如何提供一种多模态的信息呈现方式就显得尤为重要。通过将力触觉技术引入3维文物展示领域,提出一种基于多模感知的3维文物交互式呈现的算法框架。在对文物的基本特征进行视、听、触觉多通道分析的基础上,依据用户与文物模型的接触状态对多通道信息进行计算和整合。方法 在力触觉计算渲染方面,基于嵌入深度构建弹簧系统模拟轮廓形状的接触过程,引入动摩擦和静摩擦因数来反映表面摩擦力这一材质特征,通过法线贴图来实现文物表面纹理的触觉处理;针对交互的环境由2维平面拓展至立体空间,结合力触觉设备将操作时的行为和状态映射为虚拟环境中的操作代理,借助操作代理构建"旋转"和"选择-移动-释放"两种基本的操作范式来实现用户意图;最后,物理引擎的引入将物体的基本运动规律集成至虚拟场景,提升场景交互的真实感.结果 使用Phantom Omni手控器搭建面向馆藏文物的多模感知实验系统,抽取志愿者对实验系统进行测评。实验结果表明：运用本文方法,用户可从视觉、听觉、触觉多个通道对数字文物的整体和细节信息进行感知,且交互的整体过程简单、自然、有效。结论 本文提出的基于多模感知的数字文物交互式呈现方法,可有效实现对各类数字遗产特别是3维文物的多模重现,在保证较高实时性的同时拥有良好的可用性和情感体验效果。     

视触觉融合的增强现实三维注册方法

增强现实技术是近年来人机交互领域的研究热点.在增强现实环境下加入触觉感知,可使用户在真实场景中看到并感知到虚拟对象.为了实现增强现实环境下与虚拟对象之间更加自然的交互,提出一种视触觉融合的三维注册方法.基于图像视觉技术获得三维注册矩阵;借助空间转换关系求解出触觉空间与图像空间的转换关系;结合两者与摄像头空间的关系实现视...     

The moving learner: Object manipulation in virtual reality improves vocabulary learning

A challenging aspect of foreign language acquisition is learning new vocabulary. Research has demonstrated the benefits of motor action to vocabulary learning, though these findings are rarely translated into teaching and learning practices. In this work, we present a novel paradigm for vocabulary learning in a virtual reality environment, capitalizing on the prominent advantages of this technology as an ‘embodied learning’ tool. Hebrew-speaking adults explored a virtual room and learned the Finnish names of 40 daily objects. Every participant learned the new object names under three conditions: (1) Watch-only: watching the object without performing any movement (2) performing an irrelevant movement or (3) performing a manipulation movement that implied its habitual use. Participants completed a word–picture matching test after each training block, as well as additional word–picture matching and recall tests a week after the initial training session. The overall results demonstrate improved comprehension rates for items that were learned in the manipulation movement condition compared to the irrelevant movement condition, both in the initial learning session and 1 week following it. These initial findings suggest that VR technology may indeed hold the potential to offer a more authentic, multisensory and motor context to efficient foreign language learning.     

Virtual Reality Interfaces for Visualization and Control of Remote Vehicles

The Autonomy and Robotics Area (ARA) at NASA Ames Research Center has investigated the use of various types of Virtual Reality-based operator interfaces to remotely control complex robotic mechanisms. In this paper, we describe the major accomplishments and technology applications of the ARA in this area, and highlight the advantages and issues related to this technology.