A virtual reality keyboard with realistic haptic feedback in a fully immersive virtual environment

This study presents a 3D virtual reality (VR) keyboard system with realistic haptic feedback. The system uses two five-fingered data gloves to track finger positions and postures, uses micro-speakers to create simulated vibrations, and uses a head-mounted display (HMD) for 3D display. When users press a virtual key in the VR environment, the system can provide realistic simulated key click haptic feedback to users. The results of this study show that the advantages of the haptic VR keyboard are that users can use it when wearing HMDs (users do not need to remove HMDs to use the VR keyboard), the haptic VR keyboard can pop-up display at any location in the VR environments (users do not need to go to a specific location to use an actual physical keyboard), and the haptic VR keyboard can be used to provide realistic key click haptic feedback (which other studies have shown enhances user performance). The results also show that the haptic VR keyboard system can be used to create complex vibrations that simulate measured vibrations from a real keyboard and enhance keyboard interaction in a fully immersive VR environment.     

Improving virtual reality navigation tasks using a haptic vest and upper body tracking

Haptic feedback is an important component of immersive virtual reality (VR) applications that is often suggested to complement visual information through the sense of touch. This paper investigates the use of a haptic vest in navigation tasks. The haptic vest produces a repulsive vibrotactile feedback from nearby static virtual obstacles that augments the user spatial awareness. The tasks require the user to perform complex movements in a 3D cluttered virtual environment, like avoiding obstacles while walking backwards and pulling a virtual object. The experimental setup consists of a room-scale environment. Our approach is the first study where a haptic vest is tracked in real time using a motion capture device so that proximity-based haptic feedback can be conveyed according to the actual movement of the upper body of the user.User study experiments have been conducted with and without haptic feedback in virtual environments involving both normal and limited visibility conditions. A quantitative evaluation was carried out by measuring task completion time and error (collision) rate. Multiple haptic rendering techniques have also been tested. Results show that under limited visibility conditions proximity-based haptic feedback generated by a wearable haptic vest can significantly reduce the number of collisions with obstacles in the virtual environment.     

Effects of using a force feedback haptic augmented simulation on the attitudes of the gifted students towards studying chemical bonds in virtual reality environment

The aim of this study is to identify the effects of force feedback haptic applications developed in virtual reality environments (VREs), which is an important field of study in computer science and engineering, on gifted students’ attitudes towards chemistry education in learning process. A 3D 6 DOF (Degree of Freedom) haptik device (Phantom Omni?) has been used to develop the algorithm in this study. It can be used to transmit force and motion using a haptic device. Visual C++ was choosen as the software development environment. OpenGL? and Haptic Device Application Programming Interface have been used for rendering graphics. At the 3D image creation state Wrap 1200?, which is a kind of head-mounted display, has been chosen. The sample of this study consists of 52 students identified as gifted and are attending 6th and 7th grades at the Istanbul Science &; Art Center in Istanbul. The experimental group studied chemical bonds using an application developed by using a force feedback haptic device in VRE and the control group studied it by traditional teaching methods. The study reveals that there is a relation between using force feedback haptic applications which are developed in VREs and gifted students’ attitudes towards educational programs.     

The influence of attentional engagement and spatial characteristics on time perception in virtual reality

Virtual Reality - Virtual reality (VR) is a simulation tool that is being used extensively to study the effects of training and perception. However, several studies have shown that some aspects of...     

Investigating learners’ attitudes toward virtual reality learning environments: Based on a constructivist approach

The use of animation and multimedia for learning is now further extended by the provision of entire Virtual Reality Learning Environments (VRLE). This highlights a shift in Web-based learning from a conventional multimedia to a more immersive, interactive, intuitive and exciting VR learning environment. VRLEs simulate the real world through the application of 3D models that initiates interaction, immersion and trigger the imagination of the learner. The question of good pedagogy and use of technology innovations comes into focus once again. Educators attempt to find theoretical guidelines or instructional principles that could assist them in developing and applying a novel VR learning environment intelligently. This paper introduces the educational use of Web-based 3D technologies and highlights in particular VR features. It then identifies constructivist learning as the pedagogical engine driving the construction of VRLE and discusses five constructivist learning approaches. Furthermore, the authors provide two case studies to investigate VRLEs for learning purposes. The authors conclude with formulating some guidelines for the effective use of VRLEs, including discussion of the limitations and implications for the future study of VRLEs.     

Spatial and attentional aftereffects of virtual reality and relations to cybersickness

Virtual Reality - Cybersickness describes the nausea and discomfort that frequently emerges upon exposure to a virtual reality (VR) environment. The extent to which cybersickness leads to temporary...     

The virtual playground: an educational virtual reality environment for evaluating interactivity and conceptual learning

The research presented in this paper aims at investigating user interaction in immersive virtual learning environments, focusing on the role and the effect of interactivity on conceptual learning. The goal has been to examine if the learning of young users improves through interacting in (i.e. exploring, reacting to, and acting upon) an immersive virtual environment (VE) compared to non-interactive or non-immersive environments. Empirical work was carried out with more than 55 primary school students between the ages of 8 and 12, in different between-group experiments: an exploratory study, a pilot study, and a large-scale experiment. The latter was conducted in a virtual environment designed to simulate a playground. In this “Virtual Playground,” each participant was asked to complete a set of tasks designed to address arithmetical “fractions” problems. Three different conditions, two experimental virtual reality (VR) conditions and a non-VR condition, that varied the levels of activity and interactivity, were designed to evaluate how children accomplish the various tasks. Pre-tests, post-tests, interviews, video, audio, and log files were collected for each participant, and analysed both quantitatively and qualitatively. This paper presents a selection of case studies extracted from the qualitative analysis, which illustrate the variety of approaches taken by children in the VEs in response to visual cues and system feedback. Results suggest that the fully interactive VE aided children in problem solving but did not provide a strong evidence of conceptual change as expected; rather, it was the passive VR environment, where activity was guided by a virtual robot, that seemed to support student reflection and recall, leading to indications of conceptual change.     

A method to measure the uniformity of the virtual image distance in an augmented reality or virtual reality device

The virtual image distance in an augmented reality (AR) or virtual reality (VR) device is an important factor in determining its performance. In this paper, a method for measuring the virtual image distance and its uniformity is proposed. The setup for measurement consists of a two-dimensional spatial sensor array on the translational stage and a pinhole array plate placed in front of the AR or VR device. As the distance between the pinhole plate and the two-dimensional spatial sensor array were changed, the positions of the rays through each pinhole were measured by a two-dimensional spatial sensor array. The ray trajectories through each pinhole were obtained by fitting these positions to straight lines. The relative distances between these ray trajectories were calculated with respect to the distance from the pinhole plate. This method is effective for measuring the uniformity, such as the azimuthal dependence of the virtual image distance or the dependence of the virtual image distance on the distance from the optical axis of the VR lens.     

Design and evaluation of a collaborative UML modeling environment in virtual reality

Software and Systems Modeling - Modeling is a key activity in conceptual design and system design. Through collaborative modeling, end-users, stakeholders, experts, and entrepreneurs are able to...     

The implementation and evaluation of a virtual haptic back

A virtual haptic back (VHB) model has been developed by a cross-disciplinary team of researchers at Ohio University. Haptics give the human the sense of touch and force from virtual computer models. The objective is to create a tool for medical and related education whereby students can train in the difficult art of palpation using virtual reality before approaching human subjects. Palpation is the art of medical diagnosis through the sense of touch. Haptic anatomy could be a key area in the future of medical school training; our goal is to add science to the art of palpation to improve osteopathic, physical therapy and massage therapy training for students and practitioners. Modelling of the VHB took place in two steps. First, Cartesian back data was collected via the Metrecom Skeletal Analysis System (SAS) digitiser. The back of a prone human subject was digitised, giving an array of three-dimensional points. Several methods were considered to smooth out the back data. Spline fitting with matched first and second derivates was the chosen method. Once an acceptable graphical model was created, haptic feedback was added using the PHANToM haptic interface, allowing the human user to explore and feel the virtual back. Experienced and novice palpators formally evaluated the VHB to give us feedback for improvements. In addition, four Doctors of Osteopathy informally interacted with our model and gave verbal feedback. Our experts all suggested modelling underlying muscles and skeletal structure in addition to the skin layer for more realism. Once this is accomplished we will further program somatic dysfunction of various types in the VHB for students to diagnose. This article contributes to the state of the art in virtual haptic anatomy. While other research groups are working in this area, our work is the first specifically aimed towards osteopathic medicine, physical therapy, and massage therapy students and practitioners.     

Salsa dance learning evaluation and motion analysis in gamified virtual reality environment

Multimedia Tools and Applications - Learning couple dance such as salsa is challenging as it requires to understand and assimilate all the dance skills (guidance, rhythm, style) correctly. Salsa is...     

The changing nature of user attitudes toward virtual world technology: A longitudinal study

Virtual world technologies have been utilized in gaming for a number of years but only recently have they been applied as a serious tool for business. Many business applications have been identified, including the use of virtual worlds for team collaboration, training, and education, but a question remains about whether users will accept the premise that virtual worlds represent useful environments for engaging in business functions. We address this question by examining user reactions to virtual worlds. The first study looks at attitudes of users of the virtual world Second Life during three time periods (i.e., before exposure to the environment, after an information session and discussion of Second Life, and after use of the environment). Two variables, user acceptance of virtual world technologies and user self-efficacy, were examined as the primary dependent measures. Results show that while self-efficacy increases over time, user acceptance decreases in a highly correlated pattern. A second study investigates the underlying causes of the observed pattern of user acceptance using a content analysis of written reflections of user experiences. Both studies paint a detailed picture of user intentions and some of the reasons these intentions developed after use. The paper concludes with a discussion of the implications of these results for business managers and researchers.     

Examining the effect of body ownership in immersive virtual and augmented reality environments

The traditional rubber hand illusion is a psychological experiment where participants are under the illusion that a rubber hand is part of their own body. This paper examines the use of real, virtual and augmented reality environments for identifying the elements that influence body ownership in healthy participants. Compared to the classical experiment where a plastic rubber hand was used, a realistic 3D representation was chosen to create the same illusion this time in both immersive virtual reality and augmented reality. Experiments were performed on 30 volunteers undergoing testing session composed of three stages. Participants were asked to complete two different questionnaires, one measuring their cognitive workload and another one regarding their experience with the rubber hand illusion. In addition, EEG signals of the individuals were recorded, resulting in 90 electroencephalogram datasets. Results indicate correlations between ownership statements with beta and gamma electroencephalogram bands in premotor cortex activity. Link between higher gamma production in ventral premotor area during the illusion was established in previous studies.     

Tangible authoring of 3D virtual scenes in dynamic augmented reality environment

This paper proposes tangible interfaces and interactions for authoring 3D virtual and immersive scenes easily and intuitively in tangible augmented reality (AR) environment. It provides tangible interfaces for manipulating virtual objects in a natural and intuitive manner and supports adaptive and accurate vision-based tracking in AR environments. In particular, RFID is used to directly integrate physical objects with virtual objects and to systematically support the tangible query of the relation between physical objects and virtual ones, which can provide more intuitive tangibility and a new way of virtual object manipulation. Moreover, the proposed approach offers an easy and intuitive switching mechanism between tangible environment and virtual environment. This paper also proposes a context-adaptive marker tracking method which can remove an inconsistent problem while embedding virtual objects into physical ones in tangible AR environments. The context-adaptive tracking method not only adjusts the locations of invisible markers by interpolating the locations of existing reference markers and those of previous ones, but also removes a jumping effect of movable virtual objects when their references are changed from one marker to another. Several case studies for generating tangible virtual scenes and comparison with previous work are given to show the effectiveness and novelty of the proposed approach.     

Immersive virtual reality and passive haptic interfaces to improve procedural learning in a formal training course for first responders

Virtual Reality - One key aspect for the safety and success of first responders’ operations is the compliance, during the intervention, with all the safety procedures and prescribed...     

An objective measure for the visual fidelity of virtual reality and the risks of falls in a virtual environment

Despite decades of development of virtual reality (VR) devices and VR’s recent renaissance, it has been difficult to measure these devices’ effectiveness in immersing the observer. Previously, VR devices have been evaluated using subjective measures of presence, but in this paper, we suggest that postural stability can be used to objectively assess visual fidelity of VR headsets. We validated this measure by testing known differences between the devices. This study also aimed to determine the stability of healthy participants, while in a stable virtual world, compared to eyes-open and eyes-closed conditions and therefore provide a standard of safety requirements for future experimentation. Participants’ ability to maintain a stable centre of pressure was measured using a Wii Balance Board, covered by a foam pad. Stability in eyes-open and eyes-closed conditions was compared with: (1) an iPod Touch in a simple Google cardboard style headset, (2) the Oculus Rift Development Kits (DK) DK1, DK2, with and without the tracking of linear head movements, and (3) the Samsung Gear VR. With a stable VR visual stimulus, the eyes-open condition allowed for significantly greater postural stability than the other conditions, which supports the validity of posturography as a measure of visual fidelity. Further, the iPod Touch, with its narrow field of view and rudimentary software, was significantly less effective at destabilising participants with visual perturbations than the other headsets, with their wider field of view and time warping. Unexpected results are discussed with respect to the possible limitations of the experimental design.     

The concept of strong and weak virtual reality

We approach the virtual reality phenomenon by studying its relationship to set theory. This approach offers a characterization of virtual reality in set theoretic terms, and we investigate the case where this is done using the wellfoundedness property. Our hypothesis is that non-wellfounded sets (so-called hypersets) give rise to a different quality of virtual reality than do familiar wellfounded sets. To elaborate this hypothesis, we describe virtual reality through Sommerhoff’s categories of first- and second-order self-awareness; introduced as necessary conditions for consciousness in terms of higher cognitive functions. We then propose a representation of first- and second-order self-awareness through sets, and assume that these sets, which we call events, originally form a collection of wellfounded sets. Strong virtual reality characterizes virtual reality environments which have the limited capacity to create only events associated with wellfounded sets. In contrast, the logically weaker and more general concept of weak virtual reality characterizes collections of virtual reality mediated events altogether forming an entirety larger than any collection of wellfounded sets. By giving reference to Aczel’s hyperset theory we indicate that this definition is not empty because hypersets encompass wellfounded sets already. Moreover, we argue that weak virtual reality could be realized in human history through continued progress in computer technology. Finally, within a more general framework, we use Baltag’s structural theory of sets (STS) to show that within this hyperset theory Sommerhoff’s first- and second-order self-awareness as well as both concepts of virtual reality admit a consistent mathematical representation. To illustrate our ideas, several examples and heuristic arguments are discussed.

Comprehensive modelling and simulation of cylindrical nanoparticles manipulation by using a virtual reality environment

With the expansion of nanotechnology, robots based on atomic force microscope (AFM) have been widely used as effective tools for displacing nanoparticles and constructing nanostructures. One of the most limiting factors in AFM-based manipulation procedures is the inability of simultaneously observing the controlled pushing and displacing of nanoparticles while performing the operation. To deal with this limitation, a virtual reality environment has been used in this paper for observing the manipulation operation. In the simulations performed in this paper, first, the images acquired by the atomic force microscope have been processed and the positions and dimensions of nanoparticles have been determined. Then, by dynamically modelling the transfer of nanoparticles and simulating the critical force-time diagrams, a controlled displacement of nanoparticles has been accomplished. The simulations have been further developed for the use of rectangular, V-shape and dagger-shape cantilevers. The established virtual reality environment has made it possible to simulate the manipulation of biological particles in a liquid medium.