Haptic Cues for Image Disambiguation

Haptic interfaces represent a revolution in human computer interface technology since they make it possible for users to touch and manipulate virtual objects. In this work we describe a cross-model interaction experiment to study the effect of adding haptic cues to visual cues when vision is not enough to disambiguate the images. We relate the results to those obtained in experimental psychology as well as to more recent studies on the subject.     

视触觉融合的增强现实三维注册方法

增强现实技术是近年来人机交互领域的研究热点。在增强现实环境下加入触觉感知,可使用户在真实场景中看到并感知到虚拟对象。为了实现增强现实环境下与虚拟对象之间更加自然的交互,提出一种视触觉融合的三维注册方法。基于图像视觉技术获得三维注册矩阵;借助空间转换关系求解出触觉空间与图像空间的转换关系;结合两者与摄像头空间的关系实现视触觉融合的增强现实交互场景。为验证该方法的有效性,设计了一个基于视触觉增强现实的组装机器人项目。用户可触摸并移动真实环境中的机器人零件,还能在触摸时感受到反馈力,使交互更具真实感。     

Haptic rendering: introductory concepts

Haptic rendering allows users to "feel" virtual objects in a simulated environment. We survey current haptic systems and discuss some basic haptic-rendering algorithms. In the past decade we've seen an enormous increase in interest in the science of haptics. Haptics broadly refers to touch interactions (physical contact) that occur for the purpose of perception or manipulation of objects. These interactions can be between a human hand and a real object; a robot end-effector and a real object; a human hand and a simulated object (via haptic interface devices); or a variety of combinations of human and machine interactions with real, remote, or virtual objects. Rendering refers to the process by which desired sensory stimuli are imposed on the user to convey information about a virtual haptic object.     

The moderating role of sensation seeking tendency in robotic haptic interfaces

This study examined the interaction effects between haptic force feedback and users’ sensation seeking tendency (i.e. need for sensations) on users’ feelings of presence (i.e. the state in which users experience virtual objects and virtual environments as if they were actual) in robotic haptic interfaces. Users with low sensation seeking tendency felt stronger physical presence and spatial presence in response to force feedback haptic stimuli (versus no force feedback), whereas users with high sensation seeking tendency did not show any difference between the two conditions, thus confirming the moderating role of the users’ sensation seeking tendency in the robotic haptic interface. Theoretical implications for human–computer interaction (HCI) research and managerial implications for the interactive media market are discussed.     

Haptic‐constraint modeling based on interactive metaballs

Adding interactive haptic‐constraint sensations is important in interactive computer gaming and 3D shape design. Usually constraints are set on vertices of the object to drive the deformation. How to simulate dynamic force constraints in interactive design is still a challenging task. In this paper, we propose a novel haptic‐constraint modeling method based on interactive metaballs, during which the haptic‐constraint tools are attracted to the target location and then control the touch‐enabled deformation within the constrained areas. The interactive force feedbacks facilitate designers to accurately deform the target regions and fine carve the details as their intention on the objects. Our work studies how to apply touch sensation in such constrained deformations using interactive metaballs, thus users can truly feel and control the soft‐touch objects during the deforming interactions. Experimental results show that the dynamic sense of touch during the haptic manipulation is intuitively simulated to users, via the interacting interface we have developed. Copyright © 2010 John Wiley & Sons, Ltd.     

Object Touch by a Humanoid Robot Avatar Induces Haptic Sensation in the Real Hand

Humanoid robot embodiment is a recently developed form of mediated embodiment. In 2 studies, we report and quantify a new haptic (touch) illusion during embodiment of a humanoid robot. Around 60% of the users in our studies reported haptic sensations in their real hand when they observed their robot avatar touching a curtain with its hand. Critically, our study shows for the first time that users can experience haptic sensations from a nonanthropomorphic embodied limb/agent with visual feedback alone (i.e. no haptic feedback provided). The results have important implications for the understanding of the cognitive processes governing mediated embodiment and the design of avatar scenarios.     

Toward realistic haptic rendering of surface textures

New sophisticated haptic-rendering algorithms let users experience virtual objects through touch. We systematically investigate the unrealistic behavior of virtual haptic textures. The emerging science of haptic rendering consists of delivering properties of physical objects through the sense of touch. Owing to the recent development of sophisticated haptic-rendering algorithms, users can now experience virtual objects through touch in many exciting applications, including surgical simulations, virtual prototyping, and data perceptualization. Haptics holds great promise to enrich the sensory attributes of virtual objects that these systems can produce. One area that has received increasing attention in the haptics community is haptic texture rendering, the goal of which is to introduce micro-geometry-scale features on object surfaces. Haptic objects rendered without textures usually feel smooth, and sometimes slippery. Appropriate haptic textures superimposed on haptic objects enhance an object's realism.     

Scaled teleoperation system for nano-scale interaction and manipulation

In this paper, a visual and haptic human–machine interface is proposed for teleoperated nano-scale object interaction and manipulation. Design specifications for a bilateral scaled tele-operation system with slave and master robots, sensors, actuators and control are discussed. The Phantom? haptic device is utilized as the master manipulator, and a piezoresistive atomic force microscope probe is selected as the slave manipulator and as topography and force sensors. Using the teleoperation control system, initial experiments are realized for interacting with nano-scale surfaces. It is shown that fine structures can be felt on the operator's finger successfully, and improved nano-scale interaction and manipulation using visual and haptic feedback can be achieved.     

A tangible information explorer using vibratory touch screen

Various kinds of touch panel displays are becoming readily available for implementing futuristic human computer interaction (HCI) methods and are proven to be a useful infrastructure for inventing intuitive HCI environments. In spite of their popularity, there are some drawbacks. The most serious one is their hardness to operate especially for the weak in information technology such as elderly and blind users. A tactile feedback function has a potential ability for enabling them to make full use of the devices. We propose an approach for effectively designing user-friendly HCI environments based on the tactile feedback. We exemplify our approach through the design and development of a practical application, a haptic web browsing system. It allows even the weak users to intuitively explore various web pages without heavily depending on the visual information. While the system targets at supporting the weak, the touch interactions are quite useful means for general users to improve the stability and the degree of satisfaction in web browsing operations. The proposed system uses a touch panel haptic display for helping the users to operate with intuitive touch sensations.     

A Survey of Haptic Rendering Techniques

Computer Graphics technologies have developed considerably over the past decades. Realistic virtual environments can be produced incorporating complex geometry for graphical objects and utilising hardware acceleration for per pixel effects. To enhance these environments, in terms of the immersive experience perceived by users, the human's sense of touch, or haptic system, can be exploited. To this end haptic feedback devices capable of exerting forces on the user are incorporated. The process of determining a reaction force for a given position of the haptic device is known as haptic rendering. For over a decade users have been able to interact with a virtual environment with a haptic device. This paper focuses on the haptic rendering algorithms which have been developed to compute forces as users manipulate the haptic device in the virtual environment.     

虚拟体空间中的触觉雕刻

目前，在虚拟环境中大多数的信息获取是通过视觉、听觉等非接触感觉获得的。然而缺乏触觉反馈的信息减少了很大一部分的信息源。在看和听之外，能够触摸、感觉和操纵物体，在很大程度上提高了虚拟环境的真实性。该文研究了触觉绘制的基本模型，提出了采用虚平面作为中介实现体数据的实时触觉绘制。并在此基础上探讨了体的局部变形及结合触觉反馈模型，实现了具有触觉反馈的虚拟雕刻交互系统。该系统可应用于融化、燃烧、印记、构造和着色实时交互操作。     

Development and Evaluation of a 7-DOF Haptic Interface

With the development of human robot interaction technologies, haptic interfaces are widely used for 3D applications to provide the sense of touch. These interfaces have been utilized in medical simulation, virtual assembly and remote manipulation tasks. However, haptic interface design and control are still critical problems to reproduce the highly sensitive touch sense of humans. This paper presents the development and evaluation of a 7-DOF (degree of freedom) haptic interface based on the modified delta mechanism. Firstly, both kinematics and dynamics of the modified mechanism are analyzed and presented. A novel gravity compensation algorithm based on the physical model is proposed and validated in simulation. A haptic controller is proposed based on the forward kinematics and the gravity compensation algorithm. To evaluate the control performance of the haptic interface, a prototype has been implemented. Three kinds of experiments:gravity compensation, static response and force tracking are performed respectively. The experimental results show that the mean error of the gravity compensation is less than 0.7 N and the maximum continuous force along the axis can be up to 6 N. This demonstrates the good performance of the proposed haptic interface.      

Object interaction and task programming by demonstration in visuo-haptic augmented reality

A visuo-haptic augmented reality system is presented for object manipulation and task learning from human demonstration. The proposed system consists of a desktop augmented reality setup where users operate a haptic device for object interaction. Users of the haptic device are not co-located with the environment where real objects are present. A three degrees of freedom haptic device, providing force feedback, is adopted for object interaction by pushing, selection, translation and rotation. The system also supports physics-based animation of rigid bodies. Virtual objects are simulated in a physically plausible manner and seem to coexist with real objects in the augmented reality space. Algorithms for calibration, object recognition, registration and haptic rendering have been developed. Automatic model-based object recognition and registration are performed from 3D range data acquired by a moving laser scanner mounted on a robot arm. Several experiments have been performed to evaluate the augmented reality system in both single-user and collaborative tasks. Moreover, the potential of the system for programming robot manipulation tasks by demonstration is investigated. Experiments show that a precedence graph, encoding the sequential structure of the task, can be successfully extracted from multiple user demonstrations and that the learned task can be executed by a robot system.     

A haptic-rendering technique based on hybrid surface representation

A novel haptic rendering technique using a hybrid surface representation addresses conventional limitations in haptic displays. A haptic interface lets the user touch, explore, paint, and manipulate virtual 3D models in a natural way using a haptic display device. A haptic rendering algorithm must generate a force field to simulate the presence of these virtual objects and their surface properties (such as friction and texture), or to guide the user along a specific trajectory. We can roughly classify haptic rendering algorithms according to the surface representation they use: geometric haptic algorithms for surface data, and volumetric haptic algorithms based on volumetric data including implicit surface representation. Our algorithm is based on a hybrid surface representation - a combination of geometric (B-rep) and implicit (V-rep) surface representations for a given 3D object, which takes advantage of both surface representations.     

振动触觉纹理再现技术研究综述

纹理力触觉再现是通过特定的硬件装置模拟产生与物体纹理表面接触时的触感，使用户能感受到物体的粗糙度、软硬度等纹理特征信息。振动刺激作为再现物体触觉信息的一种刺激方式，在纹理触觉再现中被广泛运用，产生了不同的振动触觉表达装置和纹理触觉表达方法。从纹理触觉认知的角度，阐述了人对振动刺激的触觉感知生理学基础；介绍了纹理触觉再现的原理和方法；从振动与纹理特征的映射方法以及振动刺激方式两个方面分析了目前振动触觉纹理再现技术的发展现状；最后对相关研究的发展进行了总结展望。     

约束切换与阻抗显示力反馈设备的稳定性研究

􀁽研究了虚拟现实力觉交互系统中基于阻抗显示原理的交互设备丧失稳定性的原因以及振荡抑制方法.通过分析单边约束的特点,将复杂虚拟物体形状的感知和交互过程归结为动态单边约束的接触问题.采用力反馈设备Phantom建立试验平台,通过分析不同类型的单边约束下虚拟力信号的时间和空间分布规律,发现了动态单边约束交互仿真中产生振荡的原因.给出了基于虚拟力信号空间梯度的消除振荡的方法.试验表明,该方法可以有效抑制振荡,实现稳定的力觉交互控制.     

Sensation-preserving haptic rendering

Most human-computer interactive systems focus primarily on the graphical rendering of visual information and, to a lesser extent, on the display of auditory information. Haptic interfaces have the potential to increase the quality of human-computer interaction by accommodating the sense of touch. They provide an attractive augmentation to visual display and enhance the level of understanding of complex data sets. A haptic rendering system generates contact or restoring forces to prevent penetration into the virtual objects and create a sense of touch. The system computes contact forces by first detecting if a collision or penetration has occurred. Then, the system determines the (projected) contact points on the model surface. Finally, it computes restoring forces based on the amount of penetration. Researchers have recently investigated the problem of rendering the contact forces and torques between 3D virtual objects. This problem is known as six-degrees-of-freedom (6-DOF) haptic rendering, as the computed output includes both 3-DOF forces and 3-DOF torques. This article presents an overview of our work in this area. We suggest different approximation methods based on the principle of preserving the dominant perceptual factors in haptic exploration.     

Haptic sculpting of multi-resolution B-spline surfaces with shaped tools

In this paper, we first propose an implicit surface to B-spline surface haptic interface, which provides both force and torque feedback. We then present a new haptic sculpting system for B-spline surfaces with shaped tools of implicit surface. In the physical world, people touch or sculpt with their fingers or tools, instead of just manipulating points. Shaped virtual sculpting tools help users to relate the virtual modeling process to physical-world experience. Various novel haptic sculpting operations are developed to make the sculpting of B-spline surfaces more intuitive. Wavelet-based multi-resolution tools are provided to let modelers adjust the resolution of sculpture surfaces and thus the scale of deformation can be easily controlled. Moreover, sweep editing and 3D texture have been implemented by taking advantage of both the wavelet technique and haptic sculpting tools.     

Augmenting graphical user interfaces with haptic assistance for motion-impaired operators

Haptic assistance is an emerging field of research that is designed to improve human–computer interaction (HCI) by reducing error rates and targeting times through the use of force feedback. Haptic feedback has previously been investigated to assist motion-impaired computer users, however, limitations such as target distracters have hampered its integration with graphical user interfaces (GUIs). In this paper two new haptic assistive techniques are presented that utilise the 3DOF capabilities of the Phantom Omni. These are referred to as deformable haptic cones and deformable virtual switches. The assistance is designed specifically to enable motion-impaired operators to use existing GUIs more effectively. Experiment 1 investigates the performance benefits of the new haptic techniques when used in conjunction with the densely populated Windows on-screen keyboard (OSK). Experiment 2 utilises the ISO 9241-9 point-and-click task to investigate the effects of target size and shape. The results of the study prove that the newly proposed techniques improve interaction rates and can be integrated with existing software without many of the drawbacks of traditional haptic assistance. Deformable haptic cones and deformable virtual switches were shown to reduce the mean number of missed-clicks by at least 75% and reduce targeting times by at least 25%.     

A new paradigm of humanoid robot motion programming based on touch interpretation

Most humanoid soccer robot teams design the basic movements of their robots, like walking and kicking, off-line and manually. Once these motions are considered satisfactory, they are stored in the robot’s memory and played according to a high level behavioral strategy. Much time is spent in the development of the movements, and despite the significant progress made in humanoid soccer robots, the interfaces employed for the development of motions are still quite primitive. In order to accelerate development, an intuitive instruction method is desired. We propose the development of robot motions through physical interaction. In this paper we propose a ”teaching by touching” approach; the human operator teaches a motion by directly touching the robot’s body parts like a dance instructor. Teaching by directly touching is intuitive for instructors. However, the robot needs to interpret the instructor’s intention since tactile communication can be ambiguous. This paper presents a method to learn the interpretation of the touch meaning and investigates, through experiments, a general (shared among different users) and intuitive touch manner.