Bridging the HASM: An OWL ontology for modeling the information pathways in haptic interfaces software

Haptics technology has received enormous attention to enhance human computer interaction. The last decade has witnessed a rapid progress in haptic application software development due to the fact that the underlying technology has become mature and has opened up novel research areas. In an attempt to organize the path between cause and effect we envision a need for a standard for haptic application software modeling. In order for the software to better enhance the tactile information sensation, flow and perception and also make interaction between humans and haptics more efficient and natural, we need a formal representation of the haptics domain. This article proposes the use of HASM, a haptic applications software modeling ontology to formally model the haptics domain in order to be used during the specifications and design phases of developing software applications for haptic interfaces. The presented ontology captures the existing knowledge in haptics domain, using OWL, and defines the pathways that the haptic information follows between the human and the machine haptic system, using SWRL rules. The haptic ontology that has been developed will be used as a basis to design effective user interfaces and assist the development of software modeling for haptic devices. A case study is demonstrating how this haptic ontology can be used to design a software model that analyzes the perception of a haptic property of an object by interacting with a haptic device.     

Enabling design and interactive selection of haptic modes

The ever increasing size and complexity of volumetric data in a wide range of disciplines makes it useful to augment volume visualization tools with alternative modalities. Studies have shown that introducing haptics can significantly increase both exploration speed and precision. It is also capable of conveying material properties of data and thus has great potential to improve user performance in volume data exploration. In this paper we describe how recent advances in volume haptics can be used to build haptic modes—building blocks for haptic schemes. These modes have been used as base components of a toolkit allowing for more efficient development of haptic prototypes and applications. This toolkit allows interactive construction, configuration and fine-tuning of both visual and haptic representations of the data. The technology is also used in a pilot study to determine the most important issues and aspects in haptic volume data interaction and exploration, and how the use of haptic modes can facilitate the implementation of effective haptic schemes.     

Toward realistic haptic rendering of surface textures

New sophisticated haptic-rendering algorithms let users experience virtual objects through touch. We systematically investigate the unrealistic behavior of virtual haptic textures. The emerging science of haptic rendering consists of delivering properties of physical objects through the sense of touch. Owing to the recent development of sophisticated haptic-rendering algorithms, users can now experience virtual objects through touch in many exciting applications, including surgical simulations, virtual prototyping, and data perceptualization. Haptics holds great promise to enrich the sensory attributes of virtual objects that these systems can produce. One area that has received increasing attention in the haptics community is haptic texture rendering, the goal of which is to introduce micro-geometry-scale features on object surfaces. Haptic objects rendered without textures usually feel smooth, and sometimes slippery. Appropriate haptic textures superimposed on haptic objects enhance an object's realism.     

Effect of kinesthetic and tactile haptic feedback on the quality of experience of edutainment applications

Haptic technologies and applications have received enormous attention in the last decade. The incorporation of haptic modality into multimedia applications adds excitement and enjoyment to an application. It also adds a more natural feel to multimedia applications, that otherwise would be limited to vision and audition, by engaging as well the user’s sense of touch, giving a more intrinsic feel essential for ambient intelligent applications. However, the improvement of an application’s Quality of Experience (QoE) by the addition of haptic feedback is still not completely understood. The research presented in this paper focuses on the effect of haptic feedback and what it potentially adds to the experience of the user as opposed to the traditional visual and auditory feedback. In essence, it investigates certain issues regarding stylus-based haptic education applications and haptic-enhanced entertainment videos. To this end, we used two haptic applications: the haptic handwriting learning tool to experiment with force feedback haptic interaction and the tactile YouTube application for tactile haptic feedback. In both applications, our analysis shows that the addition of haptic feedback will increase the QoE in the absence of fatigue or discomfort for this category of applications. This implies that the incorporation of haptic modality (both force feedback as well as tactile feedback) has positively contributed to the overall QoE for the users.     

Comments on ‘Frequency domain properties of Kalman filters’

In their recent paper, Grimble and Åström (1987) were motivated by several industrial examples to derive some frequency domain properties of the application of Kalman filters. The analysis presented related the Kalman filter application to the classical solution for such problems, namely the use of a notch filter. This note reports a more general framework for the Grimble and Åström results and presents an alternative derivation of the Kalman filter zero frequency gain property.     

Neuro-cognitively inspired haptic user interfaces

Haptic systems and devices are a recent addition to multimodal systems. These devices have widespread applications such as surgical simulations, medical and procedural training, scientific visualizations, assistive and rehabilitative devices for individuals who have physical or neurological impediments and assistive devices for individuals who are blind. While the potential of haptics in natural human machine interaction is undisputable, the realization of such means is still a long way ahead. There are considerable research challenges to development of natural haptic interfaces. The study of human tactile abilities is a recent endeavor and many of the available systems still do not incorporate the domain knowledge of psychophysics, biomechanics and neurological elements of haptic perception. Development of smart and effective haptic interfaces and devices requires extensive studies that link perceptual phenomena with measurable parameters and incorporation of such domain knowledge in the engineering of haptic interfaces. This paper presents design, development and usability testing of a neuro-cognitively inspired haptic user interface for individuals who are blind. The proposed system design is inspired by neuro-cognitive basis of haptic perception and incorporates the computational aspects and requirements of multimodal information processing system. Usability testing of the system suggests that a biologically inspired haptic user interfaces may form a powerful paradigm for haptic user interface design.

Haptic gas pedal feedback

Active driver support systems either automate a control task or present warnings to drivers when their safety is seriously degraded. In a novel approach, utilising neither automation nor discrete warnings, a haptic gas pedal (accelerator) interface was developed that continuously presents car-following support information, keeping the driver in the loop. This interface was tested in a fixed-base driving simulator. Twenty-one drivers between the ages of 24 and 30 years participated in a driving experiment to investigate the effects of haptic gas pedal feedback on car-following behaviour. Results of the experiment indicate that when haptic feedback was presented to the drivers, some improvement in car-following performance was achieved, while control activity decreased. Further research is needed to investigate the effectiveness of the system in more varied driving conditions. Haptics is an under-used modality in the application of human support interfaces, which usually draw on vision or hearing. This study demonstrates how haptics can be used to create an effective driver support interface.     

Design and validation of a complete haptic system for manipulative tasks

The present work deals with the design, implementation and assessment of a new haptic system specifically conceived for manipulative tasks in virtual environments. Such a system was designed by taking into account specific issues related to fine manipulation, such as multipoint haptics, coherence, transparency and physical representation. The haptic system described herein is integrated with a virtual environment engine for the simulation of multifinger manipulation. A preliminary evaluation of the system was conducted by comparing human performance in the manipulation of virtual objects with respect to real objects, according to the data available in the literature. The experiments confirm how the most relevant relationships among physiological and physical parameters involved in manipulation are also preserved during virtual manipulation. However, an in-depth analysis of the results shows that simulation parameters affect the level of force control during virtual manipulation and the quality of the perceived force feedback.     

Stability of Haptic Rendering: Discretization, Quantization, Time Delay, and Coulomb Effects

Rendering stiff virtual objects remains a core challenge in the field of haptics. A study of this problem is presented, which relates the maximum achievable object stiffness to the elements of the control loop. In particular, we examine how the sampling rate, quantization, computational delay, and amplifier dynamics interact with the inertia, natural viscous, and Coulomb damping of the haptic device. Nonlinear effects create distinct stability regions, and many common devices operate stably, yet in violation of passivity criteria. An energy-based approach provides theoretical insights, supported by simulations, experimental data, and a describing function analysis. The presented results subsume previously known stability conditions.     

Haptic gas pedal feedback

Active driver support systems either automate a control task or present warnings to drivers when their safety is seriously degraded. In a novel approach, utilising neither automation nor discrete warnings, a haptic gas pedal (accelerator) interface was developed that continuously presents car-following support information, keeping the driver in the loop. This interface was tested in a fixed-base driving simulator. Twenty-one drivers between the ages of 24 and 30 years participated in a driving experiment to investigate the effects of haptic gas pedal feedback on car-following behaviour. Results of the experiment indicate that when haptic feedback was presented to the drivers, some improvement in car-following performance was achieved, while control activity decreased. Further research is needed to investigate the effectiveness of the system in more varied driving conditions. Haptics is an under-used modality in the application of human support interfaces, which usually draw on vision or hearing. This study demonstrates how haptics can be used to create an effective driver support interface.     

Adaptive haptic rendering for time‐varying haptic and video frame rates in multi‐modal interactions

In multi‐modal interactions including haptics, problems such as input sensor noise, temporal mismatch between graphics and haptics, and non‐constant refresh rates may cause non‐smooth force/torque display. This paper proposes temporal smoothing technique for haptic interaction using a sensing glove in multi‐modal applications. The proposed technique employs two processes: (1) a noise reduction method is applied to reduce jitter noise at the sensors in the sensing glove and (2) an adaptive force extrapolation is applied for time‐varying haptic and video frame rates. To demonstrate the performance of the proposed method, we developed a test platform to assess a simple box model and relatively complex models such as gamephone, portable media player (PMP). It was subsequently demonstrated that the proposed method can support smooth haptic interactions in multi‐modal applications where a haptic device and a sensing glove are used. Copyright © 2009 John Wiley & Sons, Ltd.     

Realistic haptic rendering of interacting deformable objects in virtual environments

A new computer haptics algorithm to be used in general interactive manipulations of deformable virtual objects is presented. In multimodal interactive simulations, haptic feedback computation often comes from contact forces. Subsequently, the fidelity of haptic rendering depends significantly on contact space modeling. Contact and friction laws between deformable models are often simplified in up to date methods. They do not allow a "realistic" rendering of the subtleties of contact space physical phenomena (such as slip and stick effects due to friction or mechanical coupling between contacts). In this paper, we use Signorini's contact law and Coulomb's friction law as a computer haptics basis. Real-time performance is made possible thanks to a linearization of the behavior in the contact space, formulated as the so-called Delassus operator, and iteratively solved by a Gauss-Seidel type algorithm. Dynamic deformation uses corotational global formulation to obtain the Delassus operator in which the mass and stiffness ratio are dissociated from the simulation time step. This last point is crucial to keep stable haptic feedback. This global approach has been packaged, implemented, and tested. Stable and realistic 6D haptic feedback is demonstrated through a clipping task experiment.     

Stable adaptive algorithm for Six Degrees-of-Freedom haptic rendering in a dynamic environment

Recently, physically-based simulations with haptics interaction attracted many researchers. In this paper, we propose an adaptive Six Degrees-of-Freedom (6-DOF) haptic rendering algorithm based on virtual coupling, which can automatically adjust virtual coupling parameters according to mass values of the simulated virtual tools. The algorithm can overcome the virtual tool displacement problem caused by the large mass values of the virtual tool and can provide stable force/torque display. The force/torque magnitude is saturated to the maximum force/torque values of the haptic device automatically. The implemented algorithm is tested on the simple and complex standard benchmarks. The experimental results confirm that the proposed adaptive 6-DOF haptic rendering algorithm displays good stability and accuracy for haptic rendering of dynamic virtual objects with mass values.     

Rendering stiffer walls: a hybrid haptic system using continuous and discrete time feedback

Instability in conventional haptic rendering destroys the perception of rigid objects in virtual environments. Inherent limitations in the conventional haptic loop restrict the maximum stiffness that can be rendered. In this paper we present a method to render virtual walls that are much stiffer than those achieved by conventional techniques. By removing the conventional digital haptic loop and replacing it with a part-continuous and part-discrete time hybrid haptic loop, we were able to render stiffer walls. The control loop is implemented as a combinational logic circuit on an field-programmable gate array. We compared the performance of the conventional haptic loop and our hybrid haptic loop on the same haptic device, and present mathematical analysis to show the limit of stability of our device. Our hybrid method removes the computer-intensive haptic loop from the CPU—this can free a significant amount of resources that can be used for other purposes such as graphical rendering and physics modeling. It is our hope that, in the future, similar designs will lead to a haptics processing unit (HPU).     

Haptic rendering: introductory concepts

Haptic rendering allows users to "feel" virtual objects in a simulated environment. We survey current haptic systems and discuss some basic haptic-rendering algorithms. In the past decade we've seen an enormous increase in interest in the science of haptics. Haptics broadly refers to touch interactions (physical contact) that occur for the purpose of perception or manipulation of objects. These interactions can be between a human hand and a real object; a robot end-effector and a real object; a human hand and a simulated object (via haptic interface devices); or a variety of combinations of human and machine interactions with real, remote, or virtual objects. Rendering refers to the process by which desired sensory stimuli are imposed on the user to convey information about a virtual haptic object.     

Desktop haptic virtual assembly using physically based modelling

This research investigates the feasibility of using a desktop haptic virtual environment as a design tool for evaluating assembly operations. Bringing virtual reality characteristics to the desktop, such as stereo vision, further promotes the use of this technology into the every day engineering design process. In creating such a system, the affordability and availability of hardware/software tools is taken into consideration. The resulting application combines several software packages including VR Juggler, open dynamics engine (ODE)/open physics abstraction layer (OPAL), OpenHaptics, and OpenGL/GLM/GLUT libraries to explore the benefits and limitations of combining haptics with physically based modelling. The equipment used to display stereo graphics includes a Stereographics emitter, Crystal Eyes shutter glasses, and a high refresh rate CRT Monitor. One or two-handed force feedback is obtained from various PHANTOM haptic devices from SensAble Technologies Inc. The application’s ability to handle complex part interactions is tested using two different computer systems, which approximate the higher and lower end of a typical engineer’s workstation. Different test scenarios are analyzed and results presented.     

Motion estimation on meteorological infrared data using a total brightness invariance hypothesis

This work investigates a novel approach for cloud motion wind (CMW) estimation of Meteosat infrared images. It is motivated by the fact that variational techniques, such as those employed for computing the optical flow, are successfully applied to many computer vision applications but fail in this particular applicative context, mainly because optical flow techniques are adapted to rigid objects on visible data. The objective of this work is not to propose a full operational process for CMW estimation, but rather to improve optical flow techniques by applying constraints adapted to the specificity of meteorological infrared imagery.     

Haptic discrimination of virtual surface slope

We report the difference thresholds of the slope of a virtual surface rendered via a force–feedback haptic interface with the body frontal plane as a reference. The factors varied in experiments were the stiffness of a virtual plane, the lateral velocity with which the haptic probe scanned the plane, the length of a scanning interval, the movement direction of the probe to the body frontal plane (toward or away from the body), and lateral scanning direction (left-to-right or right-to-left). Measured slope thresholds ranged from 8.33° to 12.74° and were generally higher than or similar to previously published thresholds for haptic orientation or angle discrimination. The results suggested that haptic slope discriminability was independent of surface stiffness and lateral scanning velocity. Slope discrimination was largely affected by the lateral scan distance, indicating that the terminal difference of probe normal position can be an important sensory cue. In terms of scan direction, inward or rightward scans resulted in better slope discrimination than outward or leftward scans, respectively. These thresholds and findings have implications for haptics applications that involve geometric model modification or simplification of virtual objects while preserving their perceptual properties.     

Experiments in haptic-based authentication of humans

With the rapid advancement of the technological revolution, computer technology such as faster processors, advanced graphic cards, and multi-media systems are becoming more affordable. Haptics technology is a force/tactile feedback technology growing in disciplines linked to human–computer interaction. Similar to the increasing complexity of silicon-based components, haptics technology is becoming more advanced. On the other hand, currently available commercial haptics interfaces are expensive, and their application is mostly dedicated to enormous research projects or systems. However, the trend of the market is forcing haptic developers to release products for use in conjunction with current keyboards and mice technologies. Haptics allows a user to touch, fell, manipulate, create, and/or alter simulated three-dimensional objects in a virtual environment. Most of the existing applications of haptics are dedicated to hone human physical skills such as sensitive hardware repair, medical procedures, handling hazardous substances, etc. These skills can be trained in a realistic virtual world, and describe human behavioural patterns in human–computer interaction environments. The measurement of such psychomotor patterns can be used to verify a person’s identity by assessing unique-to-the-individual behavioural attributes. This paper explores the unique behaviour exhibited by different users interacting with haptic systems. Through several haptic-based applications, users’ physical attributes output data from the haptic interface for use in the construction of a biometric system.

Haptic rendering of dynamic volumetric data

With current methods for volume haptics in scientific visualization, features in time-varying data can freely move straight through the haptic probe without generating any haptic feedback the algorithms are simply not designed to handle variation with time but consider only the instantaneous configuration when the haptic feedback is calculated. This article introduces haptic rendering of dynamic volumetric data to provide a means for haptic exploration of dynamic behaviour in volumetric data. We show how haptic feedback can be produced that is consistent with volumetric data moving within the virtual environment and with data that, in itself, evolves over time. Haptic interaction with time-varying data is demonstrated by allowing palpation of a CT sequence of a beating human heart.