A gender matching effect in learning with pedagogical agents in an immersive virtual reality science simulation

The main objective of this study is to determine whether boys and girls learn better when the characteristics of the pedagogical agent are matched to the gender of the learner while learning in immersive virtual reality (VR). Sixty‐six middle school students (33 females) were randomly assigned to learn about laboratory safety with one of two pedagogical agents: Marie or a drone, who we predicted serve as a role models for females and males, respectively. The results indicated that there were significant interactions for the dependent variables of performance during learning, retention, and transfer, with girls performing better with Marie (d = 0.98, d = 0.67, and d = 1.03; for performance, retention, and transfer, respectively) and boys performing better with the drone (d = ?0.41, d = ?0.45, d = ?0.23, respectively). The results suggest that gender‐specific design of pedagogical agents may play an important role in VR learning environments.     

Customization in educational computer games and its effect on learning: Experimental study with primary school children

The instructional effects of customization features in child learning games have rarely been examined. This value-added study addresses the existing gap with regards to user-initiated cosmetic customization of environment elements (i.e., non-avatar customization). Participants (N = 143; M_age = 9.41) studied a biological topic for about 20 min: either using the experimental version of a learning game with customization features, or from a control version without them. Null results were found as concerns between-group differences: both for motivation-related variables and learning outcome measures. These findings indicate that user-initiated cosmetic customization features can be omitted by game designers, especially in settings where children are assigned specific instructional materials from which to study.     

Effectiveness of learning in online academic courses compared with face‐to‐face courses in higher education

This study examined the effectiveness of 3 online courses compared with the same 3 courses in a face‐to‐face (F2F) format, which had the same characteristics (e.g., the same instructor and final exam content and place). Effectiveness was examined by utilizing a wide range of variables, including 2 objective measures (N = 968): grades and completion rate; and 9 subjective measures (N = 360): 7 measures include instructional aspects (course structure, learning content, lessons watched, assignments, communication), engagement, and satisfaction. Findings indicate significant differences between online and F2F courses in most of the examined variables. Students in the online courses reported better understanding of the course structure, better communication with the course staff, watching the videos lessens more, and higher engagement and satisfaction. Students in the F2F courses reported better contribution of the learning content. Students' final grades were higher in the online courses, and no differences were found in the completion rate. The findings suggest that in many of the examined effectiveness aspects, online courses are as effective as, or more effective than, F2F courses. Interpretations of the findings are discussed.     

Qualitatively different cognitive processing during online reading primed by different study activities

This article uses eye-tracking technology to examine how study activities such as taking notes or filling in a graphic organizer affect cognitive processing during learning. College students read a computer-presented passage that compared the characteristics of eastern steamboats (top section) and western steamboats (bottom section), either by reading it twice (read-only group), typing notes into a textbox on the right side of the screen (note-taking group), or typing characteristics of the two types of steamboats into a compare-and-contrast graphic organizer on the right side of the screen (graphic organizer group). Compared to the note-taking group, the graphic organizer group displayed more eye movements between the top and bottom of the passage (i.e., integrative saccades, d = 1.03), more eye movements between the text and the type-in window on the right side (i.e., constructive saccades, d = 0.79), fewer constructive saccades during initial reading (d = −0.64), and less time looking to the right side during initial reading (d = −0.81); and scored higher on a comprehension test given afterwards (d = 1.17), although both study groups outscored the read-only group. Results suggest that students in the note-taking group (and read-only group) tended to use a linear learning strategy in which their eyes followed the text in the order presented whereas students in the graphic organizer group tended to use a generative learning strategy in which their eyes searched for connections between specific information across the passage required to make comparisons.     

Benefits of adding anxiety-reducing features to a computer-based multimedia lesson on statistics

The present study examined the effectiveness of techniques intended to reduce anxiety as students learn mathematical content from a computer-based lesson. In a between-subjects experiment, students learned statistical rules through worked examples in a computer-based learning environment that either did (treatment group) or did not (control group) include anxiety reducing features—a coping message delivered through the lesson by an online pedagogical agent concerning how to manage feelings of anxiety, and prompts for expressive writing, in which students summarize their thoughts and feelings. An independent samples t-test showed that the treatment group, which received added anxiety-reducing features, showed higher accuracy than the control group on solving practice problems (d = 0.71) and retention problems (d = 0.63) and reported higher perceived effort on learning the multimedia lesson (d = 0.66). In addition, a standard multiple linear regression found that anxiety, self-efficacy, and cognitive load as a set predicted performance (R² = 0.56), with self-efficacy as the strongest predictor (β = 0.63). Adding anxiety-reducing features to an online lesson may encourage greater effort, which leads to better learning outcomes.     

How teachers integrate a math computer game: Professional development use,teaching practices,and student achievement

As more attention is placed on designing digital educational games to align with schools' academic aims (e.g., Common Core), questions arise regarding how professional development (PD) may support teachers' using games for instruction and how such integration might impact students' achievement. This study seeks to (a) understand how teachers use PD resources (e.g., technology personnel and game‐use workshops) for integration; (b) determine how teachers integrate games into their instruction; and (c) examine how those teaching practices are associated with student achievement. This mixed method study used survey and interview responses from elementary school teachers (n = 863) with access to PD resources for implementing a math game intervention and standardized math‐test scores from their second‐ through sixth‐grade students (n = 10,715). Findings showed few teachers sought PD assistance for integration, but many desired such support. Some reported using integrative practices (i.e., referencing game and using game‐generated progress reports) to identify struggling students, whereas several found integration challenging. Teachers' reordering of game objectives to align with lessons and viewing of game‐based PD videos were associated with increased student math achievement in our OLS‐analysis. However, this result was no longer statistically significant within a school fixed‐effects model, suggesting school differences may influence how strongly teachers' practices are associated with student achievement.     

Instructional effectiveness of a computer-supported program for teaching reading comprehension strategies

This article examines the effectiveness of a computer-based instructional program (e-PELS) aimed at direct instruction in a collection of reading comprehension strategies. In e-PELS, students learn to highlight and outline expository passages based on various types of text structures (such as comparison or cause-and-effect) as well as to paraphrase, self-question, and summarize. The study involved 1041 fourth-grade elementary students from 21 schools distributed in three regions in central Chile. Participant teachers integrated this program into the Spanish language curriculum, instructing their students during thirty sessions of 90 min each during one school semester. Pretest-to-posttest gains in reading comprehension scores were significantly greater for students instructed with this program than for students who received traditional instruction (d = .5), with particularly strong effects for lower-achieving students (d = .7). The findings support the efficacy of direct instruction in specific learning strategies in a computer-based environment.     

To solve or to observe? The case of problem-solving interactivity within child learning games

We explored whether problem-solving interactivity within an instructional game fosters learning for children aged 8–10 years. Participants (N = 139) studied a biological topic either through a game-based learning environment (in which they solved assigned problems by interacting with a plant model) or from a standard learning environment (in which they observed how the problems were solved in an animation) (i.e., between-subject design). The treatments were equal with regard to learning content and guidance. No between-group differences in learning outcomes were detected (comprehension: d = 0.16; transfer: d = −0.01). Self-rating of enjoyment tended to be higher in the game group (d = 0.32), and when the children could choose between the treatments in a free-choice period, they strongly preferred the interactive game (87.5%). The results suggest that both the interactive and the non-interactive treatments are useful, but their applicability may differ depending on the learning context (e.g., school vs. home).     

When graphics improve liking but not learning from online lessons

The multimedia principle states that adding graphics to text can improve student learning (Mayer, 2009), but all graphics are not equally effective. In the present study, students studied a short online lesson on distance education that contained instructive graphics (i.e., directly relevant to the instructional goal), seductive graphics (i.e., highly interesting but not directly relevant to the instructional goal), decorative graphics (i.e., neutral but not directly relevant to the instructional goal), or no graphics. Following instruction, students who received any kind of graphic produced significantly higher satisfaction ratings than the no graphics group, indicating that adding any kind of graphic greatly improves positive feelings. However, on a recall posttest, students who received instructive graphics performed significantly better than the other three groups, indicating that the relevance of graphics affects learning outcomes. The three kinds of graphics had similar effects on affective measures but different effects on cognitive measures. Thus, the multimedia effect is qualified by a version of the coherence principle: Adding relevant graphics to words helps learning but adding irrelevant graphics does not.     

Can video games change attitudes towards history? Results from a laboratory experiment measuring short- and long-term effects

This study investigates a video game's effects on implicit and explicit attitudes towards depicted historical events in the short- and long-term on a sample of 148 young adults. We used, as an intervention tool, a serious game Czechoslovakia 38–89: Borderlands that deals with the expulsion of the Sudeten Germans from the former Czechoslovakia after the WWII. Results showed more negative pretest-posttest explicit attitude changes towards the expulsion on a general level (d = −0.34) and a specific level (d = −0.53) compared to the control group. Over the long-term, group differences in attitude change remained significant for the specific level (d = −0.44), but not for general one (d = −0.16). Exploratory analysis on the item level indicated that especially attitudes towards the expulsion's (un)fairness were affected by the game. However, no significant changes were found in implicit attitudes in the experimental group. This study is the first of such scale to empirically investigate video games' effects on a society's historical awareness.     

Developing a web‐based multimedia assessment system for facilitating science laboratory instruction

This study developed a web‐based multimedia assessment system (WMA system) and applied it to science laboratory instruction. The goal was to improve students' knowledge acquisition under science laboratory instruction. The developed system enabled learners to perform self‐assessments by responding to multimedia technology test items online. The system recorded each learner's complete answer history and provided the students with personalized learning resources. This study adopted a quasi‐experimental research design. The learning content was an “experiment on separating mixtures.” Students participating in the research were divided into a typical science laboratory instruction group (TI group; n = 25) and a group that received instruction through the WMA system (WMA group; n = 26). Before instruction, all the students completed the conceptual knowledge and experimental knowledge pretests. During instruction, the TI group watched the teacher's demonstration experiment, and the students then performed the experiment in a real laboratory. In the WMA group, after learning through the WMA system, the students also performed the experiment in a real laboratory. After instruction, all the students completed the conceptual knowledge and experimental knowledge posttests. The findings indicated that the students in the WMA group showed significantly higher improvements in their scientific conceptual knowledge and experimental knowledge.     

Is contextual animation needed in multimedia learning games for children? An eye tracker study

The present study investigates affective-motivational, attention, and learning effects of unexplored emotional design manipulation: Contextual animation (animation of contextual elements) in multimedia learning game (MLGs) for children. Participants (N = 134; M_age = 9.25; Grades 3 and 4) learned either from an experimental version of the MLG with a high amount of contextual animation or from an identical MLG with no contextual animation (control). Children strongly preferred (χ² = 87.04, p < .001) and found the experimental version more attractive (p < .001, d = −1.11). No significant differences in overall enjoyment and learning outcomes were found. Attention differences, measured by dwell times and fixation durations, were small and reached only borderline significance (p = .035; d = −0.39). The implication is that contextual animation in MLG for children increases such instructional materials' attractiveness without compromising cognitive processes needed for learning; however, it does not lead to their higher instructional efficiency.     

Using eye movement modelling examples to guide visual attention and foster cognitive performance: A meta-analysis

Eye movement modelling examples (EMME) are computer-based videos displaying the visualized eye gaze behaviour of a domain expert person (model) while carefully executing the learning or problem-solving task. The role of EMME in promoting cognitive performance (i.e., final scores of learning outcome or problem solving) has been questioned due to the mixed findings from empirical studies. This study tested the effects of EMME on attention guidance and cognitive performance by means of meta-analytic procedures. Data for both experimental and control groups and both posttest and pretest were extracted to calculate the effect sizes. The EMME group was treated as the experimental group and the non-EMME group was treated as the control group. Twenty-five independent articles were included. The overall analysis showed a significant effect of EMME on time to first fixation (d = −0.83), fixation duration (d = 0.74), as well as cognitive performance (d = 0.43), but not on fixation count, indicating that using EMME not only helped learners attend faster and longer to the task-relevant elements, but also fostered their final cognitive performance. Interestingly, task type significantly moderated the effect of EMME on cognitive performance. Moderation analyses showed that EMME was beneficial to learners' performance when non-procedural tasks (rather than procedural tasks) were used. These findings show contributions for future research as well as practical application in the field of computers and learning regarding videos displaying a model's visualized eye gaze behaviour.     

Teaching genetics with multimedia results in better acquisition of knowledge and improvement in comprehension

The main goal of this study was to explore whether the use of multimedia in genetics instruction contributes more to students' knowledge and comprehension than other instructional modes. We were also concerned with the influence of different instructional modes on the retention of knowledge and comprehension. In a quasi‐experimental design, four comparable groups of 3rd and 4th grade high school students were taught the process of protein synthesis: group 1 was taught in the traditional lecture format (n = 112 students), group 2 only by reading text (n = 124 students), group 3 through multimedia that integrated two short computer animations (n = 115 students) and group 4 by text supplemented with illustrations (n = 117 students). All students received one pre‐test in order to estimate their prior knowledge, and two post‐tests in order to assess knowledge and comprehension immediately after learning and again after 5 weeks. Results showed that students comprising groups 3 and 4 acquired better knowledge and improved comprehension skills than the other two groups. Similar results were observed for retention of acquired knowledge and improved comprehension. These findings lead to the conclusion that better learning outcomes can be obtained by the use of animations or at least illustrations when learning genetics.     

Profiling sympathetic arousal in a physics course: How active are students?

Low arousal states (especially boredom) have been shown to be more deleterious to learning than high arousal states, though the latter have received much more attention (e.g., test anxiety, confusion, and frustration). Aiming at profiling arousal in the classroom (how active students are) and examining how activation levels relate to achievement, we studied sympathetic arousal during two runs of an elective advanced physics course in a real classroom setting, including the course exam. Participants were high school students (N = 24) who were randomly selected from the course population. Arousal was indexed from electrodermal activity, measured unobtrusively via the Empatica E4 wristband. Low arousal was the level with the highest incidence (60% of the lesson on average) and longest persistence, lasting on average three times longer than medium arousal and two times longer than high arousal level occurrences. During the course exam, arousal was positively and highly correlated (r = .66) with achievement as measured by the students' grades. Implications for a need to focus more on addressing low arousal states in learning are discussed, together with potential applications for biofeedback, teacher intervention, and instructional design.     

Effectiveness of virtual reality-based instruction on students' learning outcomes in K-12 and higher education: A meta-analysis

The purpose of this meta-analysis is to examine overall effect as well as the impact of selected instructional design principles in the context of virtual reality technology-based instruction (i.e. games, simulation, virtual worlds) in K-12 or higher education settings. A total of 13 studies (N = 3081) in the category of games, 29 studies (N = 2553) in the category of games, and 27 studies (N = 2798) in the category of virtual worlds were meta-analyzed. The key inclusion criteria were that the study came from K-12 or higher education settings, used experimental or quasi-experimental research designs, and used a learning outcome measure to evaluate the effects of the virtual reality-based instruction.Results suggest games (FEM = 0.77; REM = 0.51), simulations (FEM = 0.38; REM = 0.41), and virtual worlds (FEM = 0.36; REM = 0.41) were effective in improving learning outcome gains. The homogeneity analysis of the effect sizes was statistically significant, indicating that the studies were different from each other. Therefore, we conducted moderator analysis using 13 variables used to code the studies. Key findings included that: games show higher learning gains than simulations and virtual worlds. For simulation studies, elaborate explanation type feedback is more suitable for declarative tasks whereas knowledge of correct response is more appropriate for procedural tasks. Students performance is enhanced when they conduct the game play individually than in a group. In addition, we found an inverse relationship between number of treatment sessions learning gains for games.With regards to the virtual world, we found that if students were repeatedly measured it deteriorates their learning outcome gains. We discuss results to highlight the importance of considering instructional design principles when designing virtual reality-based instruction.     

Responsiveness to a game-based intervention to enhance reading efficiency in first graders

In the present study, a 5-week tablet-based word reading efficiency game intervention (Reading Turbo) was integrated in a comprehensive phonics-based reading curriculum. The aims of the study were to examine whether the game would advance children's word reading efficiency, and to determine the extent to which pre-reading capacities and in-game mechanisms could explain individual variation in responsiveness to the game. To do so, word reading efficiency scores of first graders in an intervention group (n = 132) and a control group that continued with the usual reading curriculum (n = 118) were compared prior to, directly after, and 2 months after the 5-week intervention period. Individual variation in responsiveness was examined by relating reading precursors (i.e., phonological awareness, letter efficiency, rapid automatized naming (RAN), and verbal working memory) measured at the onset of the intervention, and in-game accuracy and efficiency to word reading efficiency outcomes in untrained words. Results indicated that playing the word reading game significantly enhanced first graders' word reading efficiency directly after the intervention, but the effect was no longer significant 2 months after the intervention. With respect to individual variation in game responsiveness, it was found that phonological awareness, letter efficiency, and verbal working memory predicted responsiveness to the game via in-game accuracy. In addition, phonological awareness and RAN predicted responsiveness to the game via in-game efficiency, and letter efficiency and verbal working memory were directly related to responsiveness. The effectiveness of the word reading game thus differentiated between children with higher and lower pre-reading capacities, and operated via in-game child affordances.     

Use of instructional technology to improve teacher candidate knowledge of vocabulary instruction

Teacher educators play an influential role in the chain of improvement needed to address gaps in vocabulary knowledge and performance for some children. If created in careful accordance to design principles, multimedia can serve as a tool to improve preservice teacher knowledge in this domain. The present experimental study investigated a multimedia-based intervention, which pairs a modeling video with a Content Acquisition Podcast (i.e., video plus CAP), to teach preservice teachers (n = 101) about an effective vocabulary intervention for students at risk for or with learning disabilities. Preservice teachers were randomly assigned to either watch a video plus CAP or read a practitioner-friendly reading on vocabulary instruction. Those who watched the video plus CAP significantly outperformed the comparison group on a posttest and maintenance test of knowledge.     

Anthropomorphisms in multimedia learning: Attract attention but do not enhance learning?

Anthropomorphizing graphical elements in multimedia learning materials improves learning outcomes. The reasons for enhanced learning are unclear. We extended a seminal anthropomorphism study in order to examine whether the effect of anthropomorphisms on learning outcomes, both immediate and delayed, is caused by the anthropomorphized elements' effects on attention distribution or by elevated positive affective–motivational states. The study had a partial 3 × 2 design (the materials' graphics: schematic vs. black‐and‐white anthropomorphisms vs. colourful anthropomorphisms × eye tracker: present vs. absent). The participants were university students (N = 181). Unexpectedly, we found no significant effect of anthropomorphisms on learning outcomes. Anthropomorphisms significantly affected attention distribution during initial fixations but not overall. Modest effect on enjoyment was found, but no such effect was detected as concerns flow and generalized positive affect. We also found that the eye tracker's mere presence had slight adverse effects on learners, but these effects did not compromise learning.