Surface acoustic wave tactile display

Developing realistic tactile displays for virtual reality has been challenging. Tangible displays are increasingly important interfaces not only for augmenting the reality of computer graphics but also for conveying graphical information to persons with visual impairments. We propose a tactile display using surface a acoustic waves. We can continuously change the fineness of the surface's grain by controlling the SAWs' burst frequency     

Vibratory tactile display of image-based textures

Virtual worlds must integrate tactile and force sensations to create a sense of presence. Our tactile display conveys the textural sensation of object surfaces to a user's fingertip. This vibratory tactile display contains a contact pin array that transmits vibrations to the human skin. This type of device has been investigated as a reading aid for the blind since the 1960s. A device called the Optacon, developed by J.G. Linvill and J.C. Bliss (1966) was intended for use by a visually impaired person. Therefore, methods for representing texture have not been discussed extensively for that device. We present techniques for virtually replicating surface texture sensations through a vibratory tactile display, using image data of objects. M. Minsky et al. (1990) demonstrated a method for presenting surface textures by force display, including-if needed-visual images of textures. Their system generated the images from geometrical shapes of depth maps. In contrast, we use pictures of real object surfaces to provide the distribution data for tactile stimulus     

Human shape recognition performance for 3D tactile display

The paper describes the relationship between the pin-matrix density of a tactile display and the recognition performance of displayed 3D shapes. Three types of pin-matrix tactile display, that generate 3D shapes, were used for the experiment. The pitch of pins was 2 mm, 3 mm, 5 mm each. We assumed that surfaces, edges, and vertices were primitive 3D shape information, so tested shapes were classified into these three categories. We assumed two types of finger touching mode: 1) fingertip-only, allowed full use of spatial shape information given to the fingertip; and 2) allowed tracing of the object. Recognition time and the classified error rate were measured. We obtained results on the relationship between pin pitch and recognition performance data. Regression curves for pin pitch and recognition time were plotted. A significance test of recognition time versus pin pitch was done. The error rate of identification versus pin pitch was described. Our results provide basic knowledge for developing tactile presentation devices     

Three-axis pneumatic tactile display with integrated capacitive sensors for feedback control

In this paper, we propose a three-axis pneumatic tactile display that is precisely controlled by using integrated capacitive displacement sensors. The proposed tactile display consists of a core body with a 3 × 3 balloon array on its top surface, four lateral balloons made of latex rubber, and inner and outer frames that include capacitive displacement sensors based on a flexible printed circuit board. The 3 × 3 balloon array on the core body is designed to apply normal haptic stimulation to a human fingertip. In addition, the lateral motions of the core body and each frame produce haptic stimulation in a tangential direction. Precise control of lateral motion was achieved by feedback control using the capacitive displacement sensors. The size of the fabricated tactile display was 26 × 26 × 18 mm³. We experimentally performed manipulation of the proposed device with a custom control system, thereby demonstrating accurate control of displacement.     

Electrostatic tactile display with thin film slider and its application to tactile telepresentation systems

A new electrostatic tactile display is proposed to realize compact tactile display devices that can be incorporated with virtual reality systems. The tactile display of this study consists of a thin conductive film slider with stator electrodes that excite electrostatic forces. Users of the device experience tactile texture sensations by moving the slider with their fingers. The display operates by applying two-phase cyclic voltage patterns to the electrodes. The display is incorporated into a tactile telepresentation system to realize explorations of remote surface textures with real-time tactile feedback. In the system, a PVDF tactile sensor and a DSP controller automatically generate voltage patterns to present surface texture sensations through the tactile display. A sensor, in synchronization with finger motion on the tactile display, scans a texture sample and outputs information about the sample surface. The information is processed by a DSP and fed back to the tactile display in real time. The tactile telepresentation system was evaluated in texture discrimination tests and demonstrated a 79 percent correct answer ratio. A transparent electrostatic tactile display is also reported in which the tactile display is combined with an LCD to realize a visual-tactile integrated display system.     

Real-time area-based haptic rendering and the augmented tactile display device for a palpation simulator

Although people usually contact a surface with some area rather than a point, most haptic devices allow a user to interact with a virtual object at one point at a time and likewise most haptic rendering algorithms deal with such situations only. In a palpation procedure, medical doctors push and rub the organ's surface, and are provided the sensation of distributed pressure and contact force (reflecting force) for discerning doubtable areas of the organ. In this paper, we suggest real-time area-based haptic rendering to describe distributed pressure and contact force simultaneously, and present a haptic interface system to generate surface properties in accordance with the haptic rendering algorithm. We represent the haptic model using the shape-retaining chain link (S-chain) framework for a fast and stable computation of the contact force and distributed pressure from a volumetric virtual object. In addition, we developed a compact pin-array-type tactile display unit and attached it to the PHANToM^TM haptic device to complement each other. For the evaluation, experiments were conducted with non-homogenous volumetric cubic objects consisting of approximately 500 000 volume elements. The experimental results show that compared to the point contact, the area contact provides the user with more precise perception of the shape and softness of the object's composition, and that our proposed system satisfies the real-time and realism constraints to be useful for a virtual reality application.     

Capacitive touchscreen‐integrated electrostatic tactile display with localized sensation

An electrostatic tactile display with a projected capacitive touchscreen integrated into a single panel was demonstrated. Every electrode on the panel is driven for both tactile presentation and the touch sensor. The functions are both time and spatially multiplexed, and a reference–node‐driven high‐pass filter in the touch controller filters out the noise from the tactile driving signals.     

A curved surface display for three fingers based on human visual and tactile sensory fusion

In general, it is difficult to present tactile information because arbitrary curvatures of the curved surface and many degrees of freedom need to be realised. On the other hand, psychophysical studies have suggested that human visual and tactile sensations have an illusory fusion characteristic. This means that we can recognise curved surfaces of objects through visual and tactile sensations, even if exact tactile information is not presented. Hence, by utilising the human characteristic of sensory fusion, realisation of a curved surface display can be simplified. From such motivation, the human fusion characteristics of visual and tactile sensation are measured, and are quantitatively analysed. Based on the analysed results, a curved surface display for three fingers is developed. In the curved surface display, only four curved patterns are utilised instead of presenting many curved patterns. Performance of the developed tactile display is proved through evaluated experiments.     

A novel bulk micromachined electrostatic microvalve with acurved-compliant structure applicable for a pneumatic tactile display

Recent success of microelectromechanical systems (MEMS) in projection displays have raised similar expectation for an efficient, low power, affordable, full-page and pneumatic tactile display. Such design has not been achieved by the conventional technology but could bring significant improvement to current refreshable Braille displays. This paper demonstrates a novel bulk-micromachined electrostatic microvalve suitable for a pneumatic tactile display. The microvalve, a silicon perforated diaphragm juxtaposed to a silicon inlet orifice, requires relatively low closing voltage against a large supply differential pressure and flow rate, i.e., 72.9 V-rms for 19.3 kPa and 85 mi/min. Such an attractive characteristic is due to its unique curved-compliant structure that has, unlike other electrostatic microvalves, no tolerance for any initial air gap between its electrodes. As a design tool, a mechanical model of the microvalve is introduced based on the lubrication theory and large plate deflection theory. The model is established on a steady-state coupled field problem of fluid-solid mechanics. Reynolds and von-Karman equations were simultaneously solved for the microvalve geometry by finite difference approximation and double Fourier series expansion. The results of the model and experiments are compared and found to be in good agreement with a relative error less than 10%     

Touching graphical applications: bimanual tactile interaction on the HyperBraille pin-matrix display

Universal Access in the Information Society - Novel two-dimensional tactile displays enable blind users to not only get access to the textual but also to the graphical content of a graphical user...     

A flexible three-axial capacitive tactile sensor with multilayered dielectric for artificial skin applications

In this paper, a new flexible three-axial force sensor was designed and investigated, which was composed of four capacitors, and the mechanism was based on the capacitance change induced by an applying three-axial force. For the configuration of the electrodes, four sensing electrodes and a public electrode were in the same plane, which was based on fringe effect theory. Different from the traditional dielectric layer with single material, this multilayered dielectric consisted of both the air gap and polydimethylsiloxane. The structure of the multilayered dielectric changed under the external/applied force, leading to variation of dielectric constant ε, which caused the capacitance change. Measurement results showed that the full-scale range of detectable force was around 0–10 N for all three axes. The average sensitivities of the force sensor units were 0.0095, 0.0053, and 0.0060 N⁻¹ for the normal, X-axis, and Y-axis shear forces, and more test proved its high potential for application in skin-like sensing field.

     

A compact planar distributed tactile display and effects of frequency on texture judgment

This paper describes the development of a planar distributed tactile display and the evaluation of the results of its effectiveness for displaying textures. The tactile display is composed of a 6 × 5 pin array actuated by 30 piezoelectric bimorphs. The distance between each pin's centers is 1.8 mm. Vertical excursion of each pin is controlled over a 0–0.7 mm range. Perceptual experiments were conducted to evaluate the performance of the system under three conditions: active touch, passive touch with vibration and passive touch without vibration. The experimental results showed that vibrational stimuli helped subjects discriminate tactile patterns. Measurements of the error rate during discrimination tasks were used to find an optimal vibration frequency for stimuli presented at a constant sensation level (32 SLdB above threshold). The experiment was repeated, this time holding the energy transferred mechanically to the fingertip tissue constant. At low frequencies, we found that the passive stimulation allowed subjects to discriminate just as well as active touch of static stimuli did. The results suggested new possibilities for displaying texture using passive touch, constant energy and spatially varied vibration frequency.     

Mechanical feedback analysis of a ferrofluid-based module with 2D dynamic traveling waves for tactile display application

With the advances of human-machine systems, tactile displays have become one of the important features for modern products. Tactile feedback can increase working efficiency and help humans to explore new environments or objects by the sense of touch. This study used a 3 × 3 electromagnet array and a ferrofluid bladder to build a tactile display module, which can create smooth and continuous real-time 2-D dynamic traveling waves. The interactions of magnetic fields between electromagnets in the array were used to control the directions of the magnetic lines of force to create different graph patterns. Our user test showed that the overall tactile perception rate was 74% for the 2-D dynamic graph patterns generated using the ferrofluid-based tactile display module.     

Tactile display with tangential and normal skin displacement for robot-assisted surgery

This paper proposes a tactile display providing both shear and normal feedback to the fingertip for generating three-axis tactile feedback during teleoperation of a surgical robot. The display is composed of five balloons actuated by controlling the pneumatic pressure. The implemented display is 18?mm?×?18?mm?×?15?mm. This size is suitable for mounting the display onto the master controls of a surgical robot. The maximum normal and shear displacements are 2 and 1.3?mm, respectively. The proposed tactile display may provide perceivable stimuli to a human finger pad in all five directions: normal, distal, proximal, radial, and ulnar. This paper also reports on the results of psychophysical measurement of the minimum perceivable movement of the developed tactile display for each of the five directions.     

A workstation for tactile graphics

Blind students have not had adequate access to tangible representations of pictures and diagrams. As more blind students enter the technical disciplines the absolute need for such material increases. There have been many different methods developed for the generation of tangible graphics displays, and a brief review of most of these is presented. Current efforts to design and develop a workstation based upon the methods first implemented by Dr John Gill are described. Both hardware and software are being assembled, and integrated with the needs of sighted braillists who would be the users of the workstation. The current state of development is described, and indications of future needs are stated.     

基于光学的触觉传感器电路设计

相较于电信号触觉传感器,基于光学的触觉传感器性能更好,受外界环境影响小,抗干扰性能更高.触觉传感器以弹性材料模拟人体皮肤,在弹性材料内部有标记点阵列.用摄像头拍摄标记点的图像,通过测量弹性材料受力发生形变时标记点阵列的位移情况来求解出力的分布情况,进一步计算出触觉信息.传感器采用EP4CGx30为主处理芯片,采用双层电路堆叠的方式实现,总尺寸为40mm×20mm×15 mm.     

An optical tactile sensor for manipulators

A touch sensor for robots was designed, built and demonstrated. It is based on a deformable elastic reflective surface and optical fiber technology. The device is relatively immune to electromagnetic noise and may be used in environments where it is important to protect sensitive electronic equipment from such noise. The sensed touch pattern is easily read and interpreted by a computer using current video technology. The design allows for extremely high spatial resolution (2100 sensitive spots per square inch achieved here). Spatial resolution must be traded off with sensor pad thickness to retain adequate sensitivity.     

Realizing whole-body tactile interactions with a self-organizing,multi-modal artificial skin on a humanoid robot

In this paper, we present a new approach to realize whole-body tactile interactions with a self-organizing, multi-modal artificial skin on a humanoid robot. We, therefore, equipped the whole upper body of the humanoid HRP-2 with various patches of CellulARSkin – a modular artificial skin. In order to automatically handle a potentially high number of tactile sensor cells and motors units, the robot uses open-loop exploration motions, and distributed accelerometers in the artificial skin cells, to acquire its self-centered sensory-motor knowledge. This body self-knowledge is then utilized to transfer multi-modal tactile stimulations into reactive body motions. Tactile events provide feedback on changes of contact on the whole-body surface. We demonstrate the feasibility of our approach on a humanoid, here HRP-2, grasping large and unknown objects only via tactile feedback. Kinesthetically taught grasping trajectories, are reactively adapted to the size and stiffness of different test objects. Our paper contributes the first realization of a self-organizing tactile sensor-behavior mapping on a full-sized humanoid robot, enabling a position controlled robot to compliantly handle objects.