虚拟装配中基于导纳控制的力觉渲染技术

传统的力触觉渲染多采用阻抗控制,不能很好地满足虚拟装配的应用要求,相比之下导纳控制模式更适用这一领域.为此提出一种基于导纳控制的双线程力觉渲染构架,并给出相应的力觉渲染算法.首先建立用于导纳控制的动力学模型,并讨论了碰撞和约束这2个状态下的力觉渲染;为了使用力觉交互接口进行虚拟装配中的小间隙装配,提出物理约束与几何约束结合的力觉渲染方法;最后针对物理计算和力反馈循环2个线程刷新频率不匹配的问题,利用二次拉格朗日多项式进行数值插值,实现了力觉交互接口的平稳输出.通过力反馈设备与自主开发的虚拟装配原型系统VAPP的连接与应用,验证了所提出的算法满足虚拟装配系统中力觉交互的应用要求.     

A haptic-rendering technique based on hybrid surface representation

A novel haptic rendering technique using a hybrid surface representation addresses conventional limitations in haptic displays. A haptic interface lets the user touch, explore, paint, and manipulate virtual 3D models in a natural way using a haptic display device. A haptic rendering algorithm must generate a force field to simulate the presence of these virtual objects and their surface properties (such as friction and texture), or to guide the user along a specific trajectory. We can roughly classify haptic rendering algorithms according to the surface representation they use: geometric haptic algorithms for surface data, and volumetric haptic algorithms based on volumetric data including implicit surface representation. Our algorithm is based on a hybrid surface representation - a combination of geometric (B-rep) and implicit (V-rep) surface representations for a given 3D object, which takes advantage of both surface representations.     

A Fundamental Tradeoff Between Performance and Sensitivity Within Haptic Rendering

In this paper, we show that for haptic rendering using position feedback, the structure of the feedback loop imposes a fundamental tradeoff between accurate rendering of virtual environments and sensitivity of closed-loop responses to hardware variations and uncertainty. Due to this tradeoff, any feedback design that achieves high-fidelity rendering incurs a quantifiable cost in terms of sensitivity. Analysis of the tradeoff reveals certain combinations of virtual environment and haptic device dynamics for which performance is achieved only by accepting very poor sensitivity. This analysis may be used to show that certain design specifications are infeasible and may guide the choice of hardware to mitigate the tradeoff severity. We illustrate the predicted consequences of the tradeoff with an experimental study.     

Stable adaptive algorithm for Six Degrees-of-Freedom haptic rendering in a dynamic environment

Recently, physically-based simulations with haptics interaction attracted many researchers. In this paper, we propose an adaptive Six Degrees-of-Freedom (6-DOF) haptic rendering algorithm based on virtual coupling, which can automatically adjust virtual coupling parameters according to mass values of the simulated virtual tools. The algorithm can overcome the virtual tool displacement problem caused by the large mass values of the virtual tool and can provide stable force/torque display. The force/torque magnitude is saturated to the maximum force/torque values of the haptic device automatically. The implemented algorithm is tested on the simple and complex standard benchmarks. The experimental results confirm that the proposed adaptive 6-DOF haptic rendering algorithm displays good stability and accuracy for haptic rendering of dynamic virtual objects with mass values.     

Real-time area-based haptic rendering and the augmented tactile display device for a palpation simulator

Although people usually contact a surface with some area rather than a point, most haptic devices allow a user to interact with a virtual object at one point at a time and likewise most haptic rendering algorithms deal with such situations only. In a palpation procedure, medical doctors push and rub the organ's surface, and are provided the sensation of distributed pressure and contact force (reflecting force) for discerning doubtable areas of the organ. In this paper, we suggest real-time area-based haptic rendering to describe distributed pressure and contact force simultaneously, and present a haptic interface system to generate surface properties in accordance with the haptic rendering algorithm. We represent the haptic model using the shape-retaining chain link (S-chain) framework for a fast and stable computation of the contact force and distributed pressure from a volumetric virtual object. In addition, we developed a compact pin-array-type tactile display unit and attached it to the PHANToM^TM haptic device to complement each other. For the evaluation, experiments were conducted with non-homogenous volumetric cubic objects consisting of approximately 500 000 volume elements. The experimental results show that compared to the point contact, the area contact provides the user with more precise perception of the shape and softness of the object's composition, and that our proposed system satisfies the real-time and realism constraints to be useful for a virtual reality application.     

A Survey of Haptic Rendering Techniques

Computer Graphics technologies have developed considerably over the past decades. Realistic virtual environments can be produced incorporating complex geometry for graphical objects and utilising hardware acceleration for per pixel effects. To enhance these environments, in terms of the immersive experience perceived by users, the human's sense of touch, or haptic system, can be exploited. To this end haptic feedback devices capable of exerting forces on the user are incorporated. The process of determining a reaction force for a given position of the haptic device is known as haptic rendering. For over a decade users have been able to interact with a virtual environment with a haptic device. This paper focuses on the haptic rendering algorithms which have been developed to compute forces as users manipulate the haptic device in the virtual environment.     

高度复杂拟凸体的实时触觉绘制

触觉绘制目前已成为虚拟现实的研究热点之一,其核心是触觉代理与目标物体的实时碰撞检测与距离计算,对高度复杂模型的触觉绘制仍然是虚拟现实领域的难题,原因是对模型复杂度敏感的算法均不能满足触觉绘制苛刻的时间要求.提出触觉包围盒概念,并针对拟凸体提出一种基于触觉包围盒的实时触觉绘制算法.触觉包围盒记录了离散的采样光线与目标物体的相交信息,进行触觉计算时,只需要执行1次线段与包围盒求交运算和5次双线性插值运算即可高速求出碰撞信息,且所得到的碰撞信息可直接用于反馈力计算.实验结果表明,该算法不仅快速有效,而且具有与触觉绘制模型复杂度不相关的优点.     

振动触觉纹理再现技术研究综述

纹理力触觉再现是通过特定的硬件装置模拟产生与物体纹理表面接触时的触感，使用户能感受到物体的粗糙度、软硬度等纹理特征信息。振动刺激作为再现物体触觉信息的一种刺激方式，在纹理触觉再现中被广泛运用，产生了不同的振动触觉表达装置和纹理触觉表达方法。从纹理触觉认知的角度，阐述了人对振动刺激的触觉感知生理学基础；介绍了纹理触觉再现的原理和方法；从振动与纹理特征的映射方法以及振动刺激方式两个方面分析了目前振动触觉纹理再现技术的发展现状；最后对相关研究的发展进行了总结展望。     

Generating haptic texture using solid noise

Texture enhances haptic interaction by providing unique, distinguishable, and versatile surfaces. In computer haptics, texture can render environments more realistic and provide useful information. In this paper, an algorithm is proposed for virtual texture simulation by using solid noise, where only a few parameters need to be altered to generate a range of realistic and diverse textures by reproducing different frequencies similar to that of real vibrational signals in a virtual environment. The proposed method can capture the textural effect in a haptic simulation while retaining a simple overall geometry and stable update rate. This method also allows the user to change the texture at runtime and can be easily incorporated into any existing code and used in any traditional haptic device without affecting overall haptic-rendering performance. Moreover, the solid noise texture is independent of object geometry and can be applied to any shape without additional computations. We conducted a human-subject study to evaluate the recognition accuracy for each generated haptic texture as well as its realism and correspondence to real texture. The results indicated the high performance of the method and its ability to generate haptic textures with a very high recognition rate that were highly realistic.     

A Precomputed Approach for Real-Time Haptic Interaction with Fluids

The key to enhancing perception of the virtual world is improving mechanisms for interacting with that world. Through providing a sense of touch, haptic rendering is one such mechanism. Many methods efficiently display force between rigid objects, but to achieve a truly realistic virtual environment, haptic interaction with fluids is also essential. In the field of computational fluid dynamics, researchers have developed methods to numerically estimate the resistance due to fluids by solving complex partial differential equations, called the Navier-Stokes equations. However, their estimation techniques, although numerically accurate, are prohibitively time-consuming. This becomes a serious problem for haptic rendering, which requires a high frame rate. To address this issue, we developed a method for rapidly estimating and displaying forces acting on a rigid virtual object due to water. In this article, we provide an overview of our method together with its implementation and two applications: a lure-fishing simulator and a virtual canoe simulator     

MIMO Output Estimation With Reduced Multirate Sampling for Real-Time Haptic Rendering

This paper presents an output-estimation method with reduced multirate sampling for real-time multi-input-multi-output (MIMO) haptic rendering. Haptic systems employ physics-based deformation models such as finite-element models and mass-spring models. These physics-based deformation models for high fidelity have to deal with complex geometries, material properties, and realistic behavior of virtual objects. This incurs heavy computational burden and time delays so that the reflective force often cannot be computed at 1 kHz which is a safe frequency for stability of the haptic systems. Lower update rates of the haptic loop and the computational time delay also deteriorate the realism of the haptic system. This problem is resolved by the proposed MIMO output-estimation method. The haptic system is designed to have two sampling times, T and JT, for the haptic loop and the graphic loop, respectively. Dynamics of the physics-based deformation is captured in a discrete and deterministic input-output model. The MIMO output estimation method is developed drawing on a least-squares algorithm and an output-error estimation model. The P-matrix resetting algorithm is also designed to deal with the changing input-output relationship of the deformation model. The parameters of the discrete input-output model are adjusted online. Intersample outputs are computed from the estimated input-output model at a high rate, and traces the correct output computed from the deformation model. This method enables graphics rendering at a lower update rate, and haptic rendering at a higher update rate. Convergence of the proposed method is proved, and performance is demonstrated through simulation with both a linear tensor-mass and a linear mass-spring models.     

Stroke-based modeling and haptic skill display for Chinese calligraphy simulation system

The goal of this paper is to study haptic skill representation and display in a Chinese calligraphy training system. The challenge is to model haptic skill during the writing of different strokes in Chinese characters and to achieve haptic rendering with high fidelity and stability. The planning of the writing process is organized at three levels: task, representation and device level to describe the haptic handwriting skill. State transition graph (STG) is proposed to describe switches between tasks during the handwriting. Chinese characters are modeled using 39 typical strokes, which are further grouped into basic and compound strokes. The compound stroke is considered to be sequential combination of the basic strokes. Straight and curve strokes are modeled using line segment and the Bezier curve, respectively. Information from STG is used for real-time collision detection and haptic rendering. Ambiguity of the collision detection at stroke-corner points is prevented using active stroke combined with local nearest point computation. A modified virtual fixture method is developed for haptic rendering. The approach is tested on a prototype training system using Phantom desktop. Initial experiments suggest that the proposed modeling and rendering method is effective.     

Function-based approach to mixed haptic effects rendering

Commonly, surface and solid haptic effects are defined in such a way that they hardly can be rendered together. We propose a method for defining mixed haptic effects including surface, solid, and force fields. These haptic effects can be applied to virtual scenes containing various objects, including polygon meshes, point clouds, impostors, and layered textures, voxel models as well as function-based shapes. Accordingly, we propose a way how to identify location of the haptic tool in such virtual scenes as well as consistently and seamlessly determine haptic effects when the haptic tool moves in the scenes with objects having different sizes, locations, and mutual penetrations. To provide for an efficient and flexible rendering of haptic effects, we propose to concurrently use explicit, implicit and parametric functions, and algorithmic procedures.     

面向磁悬浮视触觉交互的多速率系统框架

非接触式磁悬浮视触觉交互克服了机械式交互的固有摩擦,具有广阔应用前景,但存在交互过程中虚拟工具穿透物体、图形渲染与触觉渲染速率不一致等问题.针对上述问题,提出面向磁悬浮视触觉交互的多速率系统框架,通过扩展三自由度(3-DOF)单射线触觉渲染方法,利用多射线对虚拟工具进行建模,避免工具穿透,实现六自由度(6-DOF)触觉...     

Simulation of ultrasound guided needle puncture using patient specific data with 3D textures and volume haptics

We present an integrated system for training ultrasound (US) guided needle puncture. Our aim is to provide a validated training tool for interventional radiology (IR) that uses actual patient data. IR procedures are highly reliant on the sense of touch and so haptic hardware is an important part of our solution. A hybrid surface/volume haptic rendering of an US transducer is proposed to constrain the device to remain outside the bony structures when scanning the patient's skin. A volume haptic model is proposed that implements an effective model of needle puncture. Force measurements have been made on real tissue and the resulting data is incorporated into the model. The other input data required is a computed tomography (CT) scan of the patient that is used to create the patient specific models. It is also the data source for a novel simulation of a virtual US scanner, which is used to guide the needle to the correct location. Copyright © 2007 John Wiley & Sons, Ltd.     

High-fidelity passive force-reflecting virtual environments

Passivity theory is applied to the creation of synthetic, complex multidimensional haptic environments. It can be shown that under appropriate conditions, sufficiently high rendering rates can guarantee the passivity of a simulation produced by a haptic device coupled to a discrete-time realization of a nominally passive environment. The creation of a passive, globally defined, virtual environment is either analytically complex or computationally costly. A method is described whereby a passive environment is created from transitions between locally defined force models that encode static conservative force fields. This is applied to the haptic rendering of tool contact with deformable bodies, in which sparse force-deflection responses are used to define local models. Passivity, continuity, and fidelity are provided by response-function interpolation rather than by interpolation of forces, as in previous methods. The work also includes an illustrative example.     

Six degree-of-freedom haptic rendering using spatialized normal cone search

This paper describes a haptic rendering algorithm for arbitrary polygonal models using a six degree-of-freedom haptic interface. The algorithm supports activities such as virtual prototyping of complex polygonal models and adding haptic interaction to virtual environments. The underlying collision system computes local extrema in distance between the model controlled by the haptic device and the rest of the scene. The haptic rendering computes forces and torques on the moving model based on these local extrema. The system is demonstrated on models with tens of thousands of triangles and developed in an accessibility application for finding collision-free paths.     

Improving virtual reality navigation tasks using a haptic vest and upper body tracking

Haptic feedback is an important component of immersive virtual reality (VR) applications that is often suggested to complement visual information through the sense of touch. This paper investigates the use of a haptic vest in navigation tasks. The haptic vest produces a repulsive vibrotactile feedback from nearby static virtual obstacles that augments the user spatial awareness. The tasks require the user to perform complex movements in a 3D cluttered virtual environment, like avoiding obstacles while walking backwards and pulling a virtual object. The experimental setup consists of a room-scale environment. Our approach is the first study where a haptic vest is tracked in real time using a motion capture device so that proximity-based haptic feedback can be conveyed according to the actual movement of the upper body of the user.User study experiments have been conducted with and without haptic feedback in virtual environments involving both normal and limited visibility conditions. A quantitative evaluation was carried out by measuring task completion time and error (collision) rate. Multiple haptic rendering techniques have also been tested. Results show that under limited visibility conditions proximity-based haptic feedback generated by a wearable haptic vest can significantly reduce the number of collisions with obstacles in the virtual environment.     

Time‐critical rendering algorithm with incorporation of LoD,visibility culling and object impostor

Given enough CPU time, present graphics technology can render near‐photorealistic images. However, for real‐time graphics applications such as virtual reality systems, developers must make explicit programming decisions, trading off rendering quality for interactive update rates. In this papar we present a new algorithm for rendering complex 3D models at near‐interactive rates that can be used in virtual environments composed of static or dynamic scenes. The algorithm integretes the techniques of level of details (LoD), visibility computation and object impostor. The method is more suitable for very dynamic scenes with high depth complexity. We introduce a new criterion to identify the occluder and the occludee: the object that can be replaced by its LoD model and the one that can be replaced by its impostor. The efficiency of our algorithm is then illustrated by experimental results. Copyright © 2003 John Wiley & Sons, Ltd.     

Hybrid client-server architecture and control techniques for collaborative product development using haptic interfaces

In this paper, a collaborative product development and prototyping framework is proposed by using distributed haptic interfaces along with deformable objects modeling. Collaborative Virtual Environment (CVE) is a promising technique for industrial product development and virtual prototyping. Network control problems such as network traffic and network delay in communication have greatly limited collaborative virtual environment applications. The problems become more difficult when high-update-rate haptic interfaces and computation intensive deformable objects modeling are integrated into CVEs for intuitive manipulation and enhanced realism. A hybrid network architecture is proposed to balance the computational burden of haptic rendering and deformable object simulation. Adaptive artificial time compensation is used to reduce the time discrepancy between the server and the client. Interpolation and extrapolation approaches are used to synchronize graphic and haptic data transmitted over the network. The proposed techniques can be used for collaborative product development, virtual assembly, remote product simulation and other collaborative virtual environments where both haptic interfaces and deformable object models are involved.