Exploring educational immersive videogames: an empirical study with a 3D multimodal interaction prototype

ABSTRACT

Gestural interaction devices emerged and originated various studies on multimodal human–computer interaction to improve user experience (UX). However, there is a knowledge gap regarding the use of these devices to enhance learning. We present an exploratory study which analysed the UX with a multimodal immersive videogame prototype, based on a Portuguese historical/cultural episode. Evaluation tests took place in high school environments and public videogaming events. Two users would be present simultaneously in the same virtual reality (VR) environment: one as the helmsman aboard Vasco da Gama’s fifteenth-century Portuguese ship and the other as the mythical Adamastor stone giant at the Cape of Good Hope. The helmsman player wore a VR headset to explore the environment, whereas the giant player used body motion to control the giant, and observed results on a screen, with no headset. This allowed a preliminary characterisation of UX, identifying challenges and potential use of these devices in multi-user virtual learning contexts. We also discuss the combined use of such devices, towards future development of similar systems, and its implications on learning improvement through multimodal human–computer interaction.     

Hand gesture recognition from depth and infrared Kinect data for CAVE applications interaction

This paper presents a real-time framework that combines depth data and infrared laser speckle pattern (ILSP) images, captured from a Kinect device, for static hand gesture recognition to interact with CAVE applications. At the startup of the system, background removal and hand position detection are performed using only the depth map. After that, tracking is started using the hand positions of the previous frames in order to seek for the hand centroid of the current one. The obtained point is used as a seed for a region growing algorithm to perform hand segmentation in the depth map. The result is a mask that will be used for hand segmentation in the ILSP frame sequence. Next, we apply motion restrictions for gesture spotting in order to mark each image as a ‘Gesture’ or ‘Non-Gesture’. The ILSP counterparts of the frames labeled as “Gesture” are enhanced by using mask subtraction, contrast stretching, median filter, and histogram equalization. The result is used as the input for the feature extraction using a scale invariant feature transform algorithm (SIFT), bag-of-visual-words construction and classification through a multi-class support vector machine (SVM) classifier. Finally, we build a grammar based on the hand gesture classes to convert the classification results in control commands for the CAVE application. The performed tests and comparisons show that the implemented plugin is an efficient solution. We achieve state-of-the-art recognition accuracy as well as efficient object manipulation in a virtual scene visualized in the CAVE.     

On the elastic modulus degradation in continuum damage mechanics

To measure accurately the elastic modulus of a metal, E, can be a difficult task when a specimen undergoes plastic strains. Moreover, some failure criteria, such as those associated with Continuum Damage Mechanics, require the change of elastic modulus with strain to define a measure of damage, D, in a material or structure. Thus, it is important to assess the possible geometrical influence of a specimen on the measurement of the elastic modulus at different deformation levels. It is shown in this article, with the aid of a numerical simulation, that any plastic strains induce important geometrical effects in the evaluation of E, which have a significant influence on the evaluation of the scalar damage parameter, D.     

An adaptive learning approach for 3-D surface reconstruction from point clouds.

In this paper, we propose a multiresolution approach for surface reconstruction from clouds of unorganized points representing an object surface in 3-D space. The proposed method uses a set of mesh operators and simple rules for selective mesh refinement, with a strategy based on Kohonen's self-organizing map (SOM). Basically, a self-adaptive scheme is used for iteratively moving vertices of an initial simple mesh in the direction of the set of points, ideally the object boundary. Successive refinement and motion of vertices are applied leading to a more detailed surface, in a multiresolution, iterative scheme. Reconstruction was experimented on with several point sets, including different shapes and sizes. Results show generated meshes very close to object final shapes. We include measures of performance and discuss robustness.     

Simulations of extensional flow in microrheometric devices

We present a detailed numerical study of the flow of a Newtonian fluid through microrheometric devices featuring a sudden contraction–expansion. This flow configuration is typically used to generate extensional deformations and high strain rates. The excess pressure drop resulting from the converging and diverging flow is an important dynamic measure to quantify if the device is intended to be used as a microfluidic extensional rheometer. To explore this idea, we examine the effect of the contraction length, aspect ratio and Reynolds number on the flow kinematics and resulting pressure field. Analysis of the computed velocity and pressure fields show that, for typical experimental conditions used in microfluidic devices, the steady flow is highly three-dimensional with open spiraling vortical structures in the stagnant corner regions. The numerical simulations of the local kinematics and global pressure drop are in good agreement with experimental results. The device aspect ratio is shown to have a strong impact on the flow and consequently on the excess pressure drop, which is quantified in terms of the dimensionless Couette and Bagley correction factors. We suggest an approach for calculating the Bagley correction which may be especially appropriate for planar microchannels. Electronic supplementary material  The online version of this article (doi:) contains supplementary material, which is available to authorized users.     

A Framework for Integrating Non-Functional Requirements into Conceptual Models

The development of complex information systems calls for conceptual models that describe aspects beyond entities and activities. In particular, recent research has pointed out that conceptual models need to model goals, in order to capture the intentions which underlie complex situations within an organisational context. This paper focuses on one class of goals, namely non-functional requirements (NFR), which need to be captured and analysed from the very early phases of the software development process. The paper presents a framework for integrating NFRs into the ER and OO models. This framework has been validated by two case studies, one of which is very large. The results of the case studies suggest that goal modelling during early phases can lead to a more productive and complete modelling activity.       

Histology, histochemistry and stereology of the adipose fin of Prochilodus lineatus

The adipose fin is small, nonpared, and usually located medially between the dorsal and caudal fin. Its taxonomic occurrence is very restrict; thus, it represents an important trace for taxon distinction. As it does not play a known vital physiological roll and it is easily removed, it is commonly used in marking and recapture studies. The present study characterizes the adipose fin of Prochilodus lineatus, as it is poorly explored by the literature. The adipose fin consists basically of a loose connective core, covered by a stratified epithelium supported by collagen fibers. At the epithelium, pigmented cells and alarm substance cells are found. Despite the name, adipocytes or lipid droplets are not observed on the structure of the fin.     

Hematopoietic progenitor constituents and adherent cell progenitor morphology isolated from black-rumped agouti (Dasyprocta prymnolopha, Wagler 1831) bone marrow

Stem cells are present in the adult tissues of most diverse species. Bone marrow is recognized to be the most exploited site to obtain stem cells and cell progenitors. The objective of the present study was to characterize hematopoietic progenitor (HP) morphology and analyze the performance of adherent cell progenitors (ACPs) cultivated in vitro from black‐rumped agouti bone marrow (Dasyprocta prymnolopha). Bone marrow aspirates were obtained from tibia crest and used to prepare histological slides and identify cell morphology. Cells were also scattered on culture plates for later isolation, expansion, and quantification. Smears obtained from bone marrow demonstrated HPs at different stages of maturity. In culture, these cells showed fibroblastoid morphology and a strong tendency to form colonies, demonstrated by the presence of cell aggregates, cytoplasmic elongations lying side by side. An 80% cell confluence was observed at 18 days in culture and progressive reduction in the percentage of nonadherent mononuclear cells. After eight passes, a mean cell viability of 96.07% was observed, from a pool of 1.6 × 10⁷ cells (ACP). Thirteen 25‐cm² culture bottles were trypsinized, resuspended in freezing medium, stored in 14 criotubes at a concentration of 1 × 10⁶ cells per milliliter, and placed in liquid nitrogen at ?196°C. Agouti bone marrow demonstrated high plasticity, moreover different HP lines, and a population of adherent cells demonstrated morphology similar to mesenchymal stem cells in culture. Microsc. Res. Tech. 2012. © 2012 Wiley Periodicals, Inc.     

Raman spectra and structural analysis in ZrOxNy thin films

Raman spectroscopy has been used as a local probe to characterize the structural evolution of magnetron-sputtered decorative zirconium oxynitride ZrO_xN_y films which result from an increase of reactive gas flow in the deposition. The lines shapes, the frequency position and widths of the Raman bands show a systematic change as a function of the reactive gas flow (a mixture of both oxygen and nitrogen). The as-deposited zirconium nitride film presents a Raman spectrum with the typical broadened bands, due to the disorder induced by N vacancies. The recorded Raman spectrum of the zirconium oxide film is typical of the monoclinic phase of ZrO₂, which is revealed also by X-ray diffraction. Raman spectra of zirconium oxynitride thin films present changes, which are found to be closely related with the oxygen content in films and the subsequent structural changes.     

Correlation of fracture behavior in high pressure pipelines with axial flaws using constraint designed test specimens. Part II: 3-D effects on constraint

This study describes an extensive set of 3-D analyses conducted on conventional fracture specimens, including pin-loaded and clamped SE(T) specimens, and axially cracked pipes with varying crack configurations. The primary objective is to examine 3-D effects on the correlation of fracture behavior for the analyzed crack configurations using the J-Q methodology. An average measure of constraint over the crack front, as given by an average hydrostatic parameter, denoted Q_avg, is employed to replace the plane-strain measure of constraint, Q. Alternatively, a local measure of constraint evaluated at the mid-thickness region of the specimen, denoted Q_Z0, is also utilized. The analysis matrix considers 3-D numerical solutions for models of SE(T) fracture specimens with varying geometries (i.e., different crack depth to specimen width ratio, a/W, as well as different loading point distance, H) and test conditions (pin-loaded ends vs. clamped ends). The 3-D numerical models for the cracked pipes cover different crack depth to pipe wall thickness ratio, a/t, and a fixed crack depth to crack length ratio, a/c. The extensive 3-D numerical analyses presented here provide a representative set of solutions which provide further support for using constraint-designed SE(T) specimens in fracture assessments of pressurized pipes and cylindrical vessels.