A geoscience perspective on immersive 3D gridded data visualization

We describe visualization software, Visualizer, that was developed specifically for interactive, visual exploration in immersive virtual reality (VR) environments. Visualizer uses carefully optimized algorithms and data structures to support the high frame rates required for immersion and the real-time feedback required for interactivity. As an application developed for VR from the ground up, Visualizer realizes benefits that usually cannot be achieved by software initially developed for the desktop and later ported to VR. However, Visualizer can also be used on desktop systems (unix/linux-based operating systems including Mac OS X) with a similar level of real-time interactivity, bridging the “software gap” between desktop and VR that has been an obstacle for the adoption of VR methods in the Geosciences. While many of the capabilities of Visualizer are already available in other software packages used in a desktop environment, the features that distinguish Visualizer are: (1) Visualizer can be used in any VR environment including the desktop, GeoWall, or CAVE, (2) in non-desktop environments the user interacts with the data set directly using a wand or other input devices instead of working indirectly via dialog boxes or text input, (3) on the desktop, Visualizer provides real-time interaction with very large data sets that cannot easily be viewed or manipulated in other software packages. Three case studies are presented that illustrate the direct scientific benefits realized by analyzing data or simulation results with Visualizer in a VR environment. We also address some of the main obstacles to widespread use of VR environments in scientific research with a user study that shows Visualizer is easy to learn and to use in a VR environment and can be as effective on desktop systems as native desktop applications.     

Effects of virtual presence and learning outcome using low-end virtual reality systems

Low-cost technology is essential to integrate Virtual Reality (VR) into educative institutions around the world. However, low-cost technology usually refers to low-end technology, which may compromise the level of immersion of the VR system. This study evaluates whether low-end and high-end VR systems achieve a comparable learning outcome regardless their immersion level. We also analyze the relationship between virtual presence and the learning outcome arising from a VR educational experience. An evaluation with 42 participants was conducted. We measured learning outcome and virtual presence under three different configurations, namely: a desktop computer, a low-end VR system, and a high-end VR system. The impact of simulator sickness was also analyzed. Results revealed a lower learning outcome in the less immersive configuration (i.e. desktop) and a similar learning outcome in both low-end and high-end VR systems. Even though low-end VR systems are less immersive and produce a lower level of virtual presence than high-end VR systems, the results support the use of low-end VR systems for educative applications.     

A gender matching effect in learning with pedagogical agents in an immersive virtual reality science simulation

The main objective of this study is to determine whether boys and girls learn better when the characteristics of the pedagogical agent are matched to the gender of the learner while learning in immersive virtual reality (VR). Sixty‐six middle school students (33 females) were randomly assigned to learn about laboratory safety with one of two pedagogical agents: Marie or a drone, who we predicted serve as a role models for females and males, respectively. The results indicated that there were significant interactions for the dependent variables of performance during learning, retention, and transfer, with girls performing better with Marie (d = 0.98, d = 0.67, and d = 1.03; for performance, retention, and transfer, respectively) and boys performing better with the drone (d = ?0.41, d = ?0.45, d = ?0.23, respectively). The results suggest that gender‐specific design of pedagogical agents may play an important role in VR learning environments.     

桌面式虚拟现实维修训练系统的研究与应用

计算机虚拟现实技术提供一个具有直观感和沉浸感的人机界面,可作为一种用于维修训练的有效工具,但目前的相关研究主要针对沉浸式和增强型虚拟现实,开发成本高且应用性不强。该文提出一种面向对象的桌面式虚拟现实维修训练系统原型,利用面向对象的方法,将基于最优拆卸序列的维修模式运用到系统中。通过某型机械装置的虚拟拆卸,验证了该系统的有效性。     

Cybersickness during VR gaming undermines game enjoyment: A mediation model

Recent advances in virtual reality (VR) technology have ushered in a new era of VR gaming. While VR gaming experience represents a burgeoning area of research within human-computer interaction circles, the role of cybersickness, physiological repercussions of VR exposure to users characterized by a multitude of symptoms, such as nausea, lightheadedness, and dizziness, in the effect of VR gaming on game enjoyment remains understudied. In two experiments, the current study proposed and tested a causal mediation model in which the effect of VR gaming on game enjoyment was mediated by the level of cybersickness experienced during the gameplay. Results from both experiments supported the proposed model and showed that increased cybersickness levels during VR gaming led to decreases in game enjoyment, indicating that cybersickness experienced during VR gaming undermines the enjoyment of the gaming experience. Results also revealed that compared to traditional desktop gaming, VR gaming invoked greater levels of cybersickness, but VR gaming did not lead to greater levels of game enjoyment. When the effect of cybersickness on game enjoyment was statistically removed, however, VR gaming was found to be more enjoyable. The current experiments provide preliminary evidence that cybersickness may hinder the enjoyment of VR gaming experience.     

Virtual reality in problem-based learning contexts: Effects on the problem-solving performance,vocabulary acquisition and motivation of English language learners

Learning a foreign language requires interaction with language input while involved in a task. Given that problem-based learning (PBL) offers hands-on application in realistic contexts, and that virtual reality (VR) enables learners to interact with multiple modalities of information, this study examines how the integration of VR technology into PBL contexts affects students' motivation for, problem-solving during, and vocabulary acquisition in learning English as a foreign language (EFL). A total of 84 engineering majors who enrolled in a course of English for specific purposes were randomly assigned to either an experimental group or a control group. Students in the experimental group participated in a VR-assisted PBL context, in which they were to view a PBL scenario using VR technology and then to create VR videos about solving the given problems. Those in the control group participated in a PBL context without the use of VR technology for viewing and solving the identical scenario. After the intervention, all the students wrote a problem-solving analysis, took a vocabulary knowledge test, completed a learning motivation questionnaire, and participated in individual interviews. The results showed that the students in the experimental group significantly outperformed those in the control group in terms of vocabulary acquisition, and were more motivated to learn English related to their future careers, whereas there was no significant difference in the problem-solving performance of the two groups. Implications of these findings highlight the value of engaging EFL learners in immersive environments for contextualized learning through the integrated use of VR and PBL.     

Extending the desktop workplace by a portable virtual reality system

Users are increasingly recognizing the potential of virtual reality (VR) technology for applications such as data analysis, design review, product development, production planning, marketing, training, etc. The currently established workflow is to design and construct at a desktop system with CAD or modeling software, and visualize and evaluate the results at one or more VR centers equipped with CAVEs or Powerwalls.Discussions with users of VR installations have shown that there is a demand for smaller and more cost efficient VR installations. We have proposed the concept of a small VR system, PI-casso, based on user requirements, guidelines for office workplaces and some end-user tests which showed important limitations and the ergonomics problems of current VR installations. PI-casso is a compact, fully immersive VR system which complements the classic desktop workplace.In this paper we describe a set of user requirements and the results of the design in forming end-user tests, in addition to the concept and the technical specifications of the newly developed system. The first prototype of PI-casso was demonstrated at HCII 2003, where specialists from the human factors/ergonomics and the VR communities used our system and provided suggestions for improvement. This expert feedback was used to develop the improved versions described in this paper.     

The effect of the modality principle to support learning with virtual reality: An eye-tracking and electrodermal activity study

Background

Virtual reality (VR) is considered a promising approach to support learning. An instructional design is essential to optimize cognitive processes. Studies show that VR has unique instructional and pedagogical requirements.

Objectives

To evaluate the effectiveness and applicability of the modality principle, which was previously validated in 2D classic multimedia, for learning with VR. The modality principle states that multimedia information presented as spoken narration is superior to on-screen text.

Methods

A prospective experimental study with two compared conditions of instruction: VR-based learning guided by on-screen text (n = 34) versus spoken narration (n = 28). Students' cognitive learning experiences were captured by eye-tracking and electrodermal activity (EDA). In addition, students' knowledge was evaluated using a pre–post knowledge test.

Results and Conclusions

Overall, there was no significant difference in knowledge retention between the participants who learned with on-screen text compared to spoken narration. However, results from the eye-tracking analysis showed that students who learned with the on-screen text devoted longer visual attention toward important learning activity areas of interest, suggesting a better ability to discern between relevant and irrelevant information. Conversely, students who learned with the spoken narration expressed significantly more EDA peak responses, proposing a higher cognitive load.

Implications

This study outlines that while learning with VR was effective, the modality principle might not apply to learning with VR. Moreover, the analysis of the learning process suggests even an inverse effect, favouring the provision of instructional scaffolds as on-screen text. Future research should evaluate this effect on long-term knowledge retention.     

Jabiru: harnessing Java 3D behaviors for device and display portability

The aim of this paper is to use the Java 3D ConfiguredUniverse utilities to create a set of behaviors that we can integrate into existing Java 3D programs, as long as these programs use the ConfiguredUniverse. We call this behavior package Jabiru (Java 3D Application Behavior Immersive Virtual Reality Utilities). The Jabiru set of behaviors, accessible from a master menu, facilitates moving Java 3D applications originally created for desktop environments to immersive VR environments and vice versa. Jabiru also provides a six-degrees-of-freedom (6DOF) device emulator for a conventional mouse, meant to facilitate offsite testing of immersive VR behaviors on a desktop. The main focus of our work with a CAVE is in relation to bioinformatics, which has embraced Java and Java 3D as one of the choice programming environments. By creating this package, we help bring 3D graphics to both the bioinformatics community and the casual Java 3D developer or user. We discuss the design and implementation of Jabiru.     

The effects of reviews in video tutorials

This study investigates how well a video tutorial for software training that is based on Demonstration‐Based Teaching supports user motivation and performance. In addition, it is studied whether reviews significantly contribute to these measures. The Control condition employs a tutorial with instructional features added to a dynamic task demonstration. The Review condition additionally includes video reviews. Participants were 55 seventh graders who viewed task demonstrations (and reviews) followed by practice. Both tutorials increased motivation (i.e., task relevance and self‐efficacy) and performance. In addition, the Review condition had significantly better results for training time, self‐efficacy and scores on an immediate post‐test. Reviews have rarely been studied in dynamic visualizations. The present study suggests that there may be important advantages to be gained from concluding a demonstration video with a summary of the main points.     

Process and Outcome-based Evaluation between Virtual Reality-driven and Traditional Construction Safety Training

The emerging digital technologies such as virtual reality (VR) provide an alternative platform for construction safety training. In order to explore how digital-driven technologies affect the effectiveness of safety training, there is a need to empirically test the differences in performance between digital 3D/VR safety training and traditional 2D/paper approach. This research conducted a performance evaluation that emphasises both the training process and learning outcomes of trainees based on researchers’ self-developed immersive construction safety training platform. Data related to physiological indicators such as skin resistance were collected to measure safety performance before and after the training. The detailed measurement indicators included nine categories (e.g., immersion, inspiration) to form a holistic list of evaluation dimensions. The findings revealed that VR-driven immersive safety training outperformed the traditional way for trainees in terms of both process and outcome-based indicators. Results confirmed that safety training was no longer constrained by understanding or memorizing 2D information (texts and images). Instead, trainees experienced a stronger sense of embodied cognition through the immersive experience and multi-sensory engagement by interacting with the VR-driven system. By engaging the theory of embodied cognition, this research provides both the empirical evidence and in-depth analysis of how immersive virtual safety training outperforms traditional training in terms of both training process and outcomes.     

Early reading intervention by means of a multicomponent reading game

This study examined the effects of an intervention with a multicomponent reading game on the development of reading skills in 60 Dutch primary school children with special educational needs. The game contains evidence‐based reading exercises and is based on principles of applied gaming. Using a multiple baseline approach, we tested children's word, pseudoword and text reading fluency, as well as their reading motivation, at three test occasions. The results indicated that the short intervention (9 × 15 min) enhanced children's pseudoword reading fluency as well as their text reading fluency. Interestingly, the early intervention group showed a sustained intervention effect (i.e., also during retention), which shows that using this reading game has a long‐term effect on early text reading development. Intervention did not affect reading motivation, which suggests that the multicomponent reading game can be used to facilitate early reading development without compromising reading motivation.     

Investigating the role of identity and gender in technology mediated learning

Instructors and trainers are increasingly using online education and technology-mediated learning (TML) to supplement or replace traditional approaches to classroom teaching. Because mandatory involvement requirements may not intrinsically motivate learners to achieve high quality learning, social factors with commitment, such as identification among group members, are especially important determinants of TML success. This article investigates an individual's social and self identities as important determinants in developing affective commitment (identification) and intrinsic motivation (perceived enjoyment) to share knowledge by email in the TML environment. Furthermore, given the recent emphasis on gender in system adoption and socio-linguistic literature, this study investigates gender as a moderating variable in the proposed model. An empirical test of the proposed model was conducted in the pilot test (n = 155) as well as the main test (n = 411). Social and self identities influence identification (R ² = 0.42) and perceived enjoyment (R ² = 0.52) of sharing knowledge by email. As expected, there are significant moderating effects of gender in these relationships in that male shows stronger effects of self identity while female shows stronger effects of social identity. The results of this study will help us understand the antecedents of effective knowledge sharing intervention in the TML environment, based on the integrated model of social identity theory, social influence theory, self determination theory and socio-linguistic literature.     

How does desktop virtual reality enhance learning outcomes? A structural equation modeling approach

This study examined how desktop virtual reality (VR) enhances learning and not merely does desktop VR influence learning. Various relevant constructs and their measurement factors were identified to examine how desktop VR enhances learning and the fit of the hypothesized model was analyzed using structural equation modeling. The results supported the indirect effect of VR features to the learning outcomes, which was mediated by the interaction experience and the learning experience. Learning experience which was individually measured by the psychological factors, that is, presence, motivation, cognitive benefits, control and active learning, and reflective thinking took central stage in affecting the learning outcomes in the desktop VR-based learning environment. The moderating effect of student characteristics such as spatial ability and learning style was also examined. The results show instructional designers and VR software developers how to improve the learning effectiveness and further strengthen their desktop VR-based learning implementation. Through this research, an initial theoretical model of the determinants of learning effectiveness in a desktop VR-based learning environment is contributed.     

Motivation,engagement, and performance across multiple virtual reality sessions and levels of immersion

This study investigated changes in learners' motivation, engagement, performance, and spatial reasoning over time and across different levels of virtual reality (VR) immersion. Undergraduate participants explored a virtual solar system via a moderately immersive or highly immersive VR platform over three sessions. In a third condition, participants initially learned with moderate immersion and transitioned to higher immersion after the second session. Following research on novelty effects, we explored whether subjective experiences and performance would decline over time (e.g., decreasing motivation or performance) as participants became familiar with the virtual environment and tools. However, we hypothesized that transitional immersion (i.e., switching from moderate to higher immersion) might lead to a renewed sense of novelty. Results suggested that both moderate and higher levels of immersion were motivating, engaging, and supportive of learning. In contrast to predictions based on novelty effects, these outcomes did not decline overall as learners gained familiarity with the systems. However, transitional immersion emerged as a promising and testable pedagogical approach for future VR education. All participants also showed gains in spatial reasoning.     

Mild stress stimuli built into a non-immersive virtual environment can elicit actual stress responses

The experience of Virtual Reality (VR) can lead to unwanted or wanted psychological stress reactions. Highly immersive VR games for instance utilise extreme, life-threatening, or dangerous situations to achieve those responses from their players. There is also sufficient evidence that in clinical settings and specific situations, such as fear of heights or post-traumatic stress, virtual stimuli can lead to perceived stress for clients. However, there is a gap in research targeting everyday, mild emotional stimuli, which are neither extreme nor specific and which are not presented in an immersive system. To what extent can common stimuli in a non-immersive virtual environment elicit actual stress reactions for its users? We developed a desktop VR system and evaluated it in a study with 54 participants. We could show that virtual stimuli in a common, domestic family environment led to a significant increase in perceived stress as measured by quantitative (self-reports) and qualitative (semi-structured interviews analysed with a General Inductive Approach (GIA)) responses. The results also showed that the introduction of virtual stimuli induced significantly higher levels of perceived workload and sense of presence and led to different physiological reactions. These findings have implications for the design and implementation of non-immersive VR systems.     

Teaching genetics with multimedia results in better acquisition of knowledge and improvement in comprehension

The main goal of this study was to explore whether the use of multimedia in genetics instruction contributes more to students' knowledge and comprehension than other instructional modes. We were also concerned with the influence of different instructional modes on the retention of knowledge and comprehension. In a quasi‐experimental design, four comparable groups of 3rd and 4th grade high school students were taught the process of protein synthesis: group 1 was taught in the traditional lecture format (n = 112 students), group 2 only by reading text (n = 124 students), group 3 through multimedia that integrated two short computer animations (n = 115 students) and group 4 by text supplemented with illustrations (n = 117 students). All students received one pre‐test in order to estimate their prior knowledge, and two post‐tests in order to assess knowledge and comprehension immediately after learning and again after 5 weeks. Results showed that students comprising groups 3 and 4 acquired better knowledge and improved comprehension skills than the other two groups. Similar results were observed for retention of acquired knowledge and improved comprehension. These findings lead to the conclusion that better learning outcomes can be obtained by the use of animations or at least illustrations when learning genetics.     

Learning science in a virtual reality application: The impacts of animated-virtual actors’ visual complexity

As the technology in computer graphics advances, Animated-Virtual Actors (AVAs) in Virtual Reality (VR) applications become increasingly rich and complex. Cognitive Theory of Multimedia Learning (CTML) suggests that complex visual materials could hinder novice learners from attending to the lesson properly. On the other hand, previous studies have shown that visual complexity correlates with presence and may increase the perceived affective quality of the virtual world, towards an optimal experience or flow. Increasing these in VR applications may promote enjoyment and higher cognitive engagement for better learning outcomes. While visually complex materials could be motivating and pleasing to attend to, would they affect learning adversely? We developed a series of VR presentations to teach second-year psychology students about the navigational behaviour of Cataglyphis ants with flat, cartoon, or lifelike AVAs. To assess learning outcomes, we used Program Ratings, which measured perception of learning and perceived difficulty, and retention and transfer tests. The results from 200 students did not reveal any significant differences in presence, perceived affective quality, or learning outcomes as a function of the AVA’s visual complexity. While the results showed positive correlations between presence, perceived affective quality and perception of learning, none of these correlates with perceived difficulty, retention, or transfer scores. Nevertheless, our simulation produced significant improvements on retention and transfer scores in all conditions. We discuss possible explanations and future research directions.     

Cognitive and affective processes for learning science in immersive virtual reality

As immersive virtual reality (IVR) systems proliferate in classrooms, it is important to understand how they affect learning outcomes and the underlying affective and cognitive processes that may cause these outcomes. Proponents argue that IVR could improve learning by increasing positive affective and cognitive processing, thereby supporting improved performance on tests of learning outcome, whereas opponents of IVR contend that it could hurt learning by increasing distraction, thereby disrupting cognitive learning processes and leading to poorer learning outcomes. In a media comparison study, students viewed a biology lesson either as an interactive animated journey in IVR or as a slideshow on a desktop monitor. Those who viewed the IVR lesson performed significantly worse on transfer tests, reported higher emotional arousal, reported more extraneous cognitive load and showed less engagement based on EEG measures than those who viewed the slideshow lesson, with or without practice questions added to the lessons. Mediational analyses showed that the lower retention scores for the IVR lesson were related to an increase in self-reported extraneous cognitive load and emotional arousal. These results support the notion that immersive environments create high affective and cognitive distraction, which leads to poorer learning outcomes than desktop environments.     

An Exploratory Study of Entrepreneurial Creativity: Its Antecedents and Mediators in the Context of UAE Firms

In this study, we attempt to advance our understanding of the role of entrepreneurial creativity in the context of firms in the United Arab Emirates (UAE). Through field research accompanied by a review of the related literature, this study identifies crucial antecedents of entrepreneurial creativity. The proposed model combines variables belonging to different contextual factors such as external factors (resource access, resource possession, and alertness to opportunity) and individual factors (creative self‐efficacy, expertise and intrinsic motivation). The model is tested using data from a large‐scale survey of firms in the UAE. We find that expertise and creative self‐efficacy is significantly related to entrepreneurial creativity. The results also reveal that intrinsic motivation and alertness to opportunity are the key mediators between contextual factors and entrepreneurial creativity. The findings of this study present some interesting practical implications to entrepreneurs in order to improve their creative skills.