Is contextual animation needed in multimedia learning games for children? An eye tracker study

The present study investigates affective-motivational, attention, and learning effects of unexplored emotional design manipulation: Contextual animation (animation of contextual elements) in multimedia learning game (MLGs) for children. Participants (N = 134; M_age = 9.25; Grades 3 and 4) learned either from an experimental version of the MLG with a high amount of contextual animation or from an identical MLG with no contextual animation (control). Children strongly preferred (χ² = 87.04, p < .001) and found the experimental version more attractive (p < .001, d = −1.11). No significant differences in overall enjoyment and learning outcomes were found. Attention differences, measured by dwell times and fixation durations, were small and reached only borderline significance (p = .035; d = −0.39). The implication is that contextual animation in MLG for children increases such instructional materials' attractiveness without compromising cognitive processes needed for learning; however, it does not lead to their higher instructional efficiency.     

Does the emotional design of scaffolds enhance learning and motivational outcomes in game-based learning?

Background

In recent years, the importance of emotions in learning has been increasingly recognized. Applying emotional design to induce positive emotions has been considered a means to enhance the instructional effectiveness of digital learning environments. However, only a few studies have examined the specific effects of emotional design in game-based learning.

Objectives

This quasi-experimental study utilized a value-added research approach to investigate whether emotional design applied to scaffolding in a game-based learning environment improves learning and motivational outcomes more than emotionally neutral scaffolding.

Methods

A total of 138 participants, mean age of 11.5 (SD = 0.73) participated in the study. A total of 68 participants played the base version of a fraction learning game (Number Trace), where scaffolding was provided with emotionally neutral mathematical notations, and 70 participants played the value-added version of the game using emotionally designed animated scaffolding agents. Pre-and post-tests were used to measure conceptual fraction knowledge and self-reported measures of situational interest and situational self-efficacy to evaluate motivational outcomes.

Results and Conclusions

Our results indicate that the emotional design applied to scaffolds can improve the educational value of a game-based learning environment by enhancing players' situational interest and situational self-efficacy. However, although the intervention improved the participants' conceptual fraction knowledge, there was no significant difference between the scaffolding conditions in participants' learning outcomes.

Takeaways

The results suggest that emotional design can increase the educational impact of game-based learning by promoting the development of interest, as well as improving self-efficacy.     

Challenging games help students learn: An empirical study on engagement,flow and immersion in game-based learning

In this paper, we investigate the impact of flow (operationalized as heightened challenge and skill), engagement, and immersion on learning in game-based learning environments. The data was gathered through a survey from players (N = 173) of two learning games (Quantum Spectre: N = 134 and Spumone: N = 40). The results show that engagement in the game has a clear positive effect on learning, however, we did not find a significant effect between immersion in the game and learning. Challenge of the game had a positive effect on learning both directly and via the increased engagement. Being skilled in the game did not affect learning directly but by increasing engagement in the game. Both the challenge of the game and being skilled in the game had a positive effect on both being engaged and immersed in the game. The challenge in the game was an especially strong predictor of learning outcomes. For the design of educational games, the results suggest that the challenge of the game should be able to keep up with the learners growing abilities and learning in order to endorse continued learning in game-based learning environments.     

Effectiveness of virtual reality-based instruction on students' learning outcomes in K-12 and higher education: A meta-analysis

The purpose of this meta-analysis is to examine overall effect as well as the impact of selected instructional design principles in the context of virtual reality technology-based instruction (i.e. games, simulation, virtual worlds) in K-12 or higher education settings. A total of 13 studies (N = 3081) in the category of games, 29 studies (N = 2553) in the category of games, and 27 studies (N = 2798) in the category of virtual worlds were meta-analyzed. The key inclusion criteria were that the study came from K-12 or higher education settings, used experimental or quasi-experimental research designs, and used a learning outcome measure to evaluate the effects of the virtual reality-based instruction.Results suggest games (FEM = 0.77; REM = 0.51), simulations (FEM = 0.38; REM = 0.41), and virtual worlds (FEM = 0.36; REM = 0.41) were effective in improving learning outcome gains. The homogeneity analysis of the effect sizes was statistically significant, indicating that the studies were different from each other. Therefore, we conducted moderator analysis using 13 variables used to code the studies. Key findings included that: games show higher learning gains than simulations and virtual worlds. For simulation studies, elaborate explanation type feedback is more suitable for declarative tasks whereas knowledge of correct response is more appropriate for procedural tasks. Students performance is enhanced when they conduct the game play individually than in a group. In addition, we found an inverse relationship between number of treatment sessions learning gains for games.With regards to the virtual world, we found that if students were repeatedly measured it deteriorates their learning outcome gains. We discuss results to highlight the importance of considering instructional design principles when designing virtual reality-based instruction.     

Using multimedia for e‐learning

This paper reviews 12 research‐based principles for how to design computer‐based multimedia instructional materials to promote academic learning, starting with the multimedia principle (yielding a median effect size of d = 1.67 based on five experimental comparisons), which holds that people learn better from computer‐based instruction containing words and graphics rather than words alone. Principles aimed at reducing extraneous processing (i.e., cognitive processing that is unrelated to the instructional objective) include coherence (d = 0.70), signalling (d = 0.46), redundancy (d = 0.87), spatial contiguity (d = 0.79) and temporal contiguity (d = 1.30). Principles for managing essential processing (i.e., mentally representing the essential material) include segmenting (d = 0.70), pre‐training (d = 0.46) and modality (d = 0.72). Principles for fostering generative processing (i.e., cognitive processing aimed at making sense of the material) include personalization (d = 0.79), voice (d = 0.74) and embodiment (d = 0.36). Some principles have boundary conditions, such as being stronger for low‐ rather than high‐knowledge learners.     

Can video games change attitudes towards history? Results from a laboratory experiment measuring short- and long-term effects

This study investigates a video game's effects on implicit and explicit attitudes towards depicted historical events in the short- and long-term on a sample of 148 young adults. We used, as an intervention tool, a serious game Czechoslovakia 38–89: Borderlands that deals with the expulsion of the Sudeten Germans from the former Czechoslovakia after the WWII. Results showed more negative pretest-posttest explicit attitude changes towards the expulsion on a general level (d = −0.34) and a specific level (d = −0.53) compared to the control group. Over the long-term, group differences in attitude change remained significant for the specific level (d = −0.44), but not for general one (d = −0.16). Exploratory analysis on the item level indicated that especially attitudes towards the expulsion's (un)fairness were affected by the game. However, no significant changes were found in implicit attitudes in the experimental group. This study is the first of such scale to empirically investigate video games' effects on a society's historical awareness.     

The effect of the modality principle to support learning with virtual reality: An eye-tracking and electrodermal activity study

Background

Virtual reality (VR) is considered a promising approach to support learning. An instructional design is essential to optimize cognitive processes. Studies show that VR has unique instructional and pedagogical requirements.

Objectives

To evaluate the effectiveness and applicability of the modality principle, which was previously validated in 2D classic multimedia, for learning with VR. The modality principle states that multimedia information presented as spoken narration is superior to on-screen text.

Methods

A prospective experimental study with two compared conditions of instruction: VR-based learning guided by on-screen text (n = 34) versus spoken narration (n = 28). Students' cognitive learning experiences were captured by eye-tracking and electrodermal activity (EDA). In addition, students' knowledge was evaluated using a pre–post knowledge test.

Results and Conclusions

Overall, there was no significant difference in knowledge retention between the participants who learned with on-screen text compared to spoken narration. However, results from the eye-tracking analysis showed that students who learned with the on-screen text devoted longer visual attention toward important learning activity areas of interest, suggesting a better ability to discern between relevant and irrelevant information. Conversely, students who learned with the spoken narration expressed significantly more EDA peak responses, proposing a higher cognitive load.

Implications

This study outlines that while learning with VR was effective, the modality principle might not apply to learning with VR. Moreover, the analysis of the learning process suggests even an inverse effect, favouring the provision of instructional scaffolds as on-screen text. Future research should evaluate this effect on long-term knowledge retention.     

Exploring the influence of game design on learning and voluntary use in an online vascular anatomy study aid

This research explores the educational impact of an online study aid-game for studying human vascular anatomy (n = 24) versus a similar non-game study aid (n = 22) and how it relates to medical students' demographic traits and voluntary use over a 35-day period. Hierarchical linear regression models revealed that study aid success rate (a metric for assessing performance through the study aids) was a significant predictor of anatomy test improvement with the game (β = 0.41, p = 0.05), but not for the non-game (β = 0.14, p = 0.56). Our analyses suggest that game mechanics encouraged more specific problem-solving strategies than did the control study aid, leading to greater predictability of learning outcomes. There was a non-significant trend among game treatment participants, who were more likely to complete study tasks than those assigned to the control treatment (p = 0.11). It would appear that students' studying habits had the greatest influence (though opposite in both tools) on level of engagement in study aid use. However, contrary to expectations, self-reported gaming habits did not impact participation. Overall, these findings support the integration of game design into undergraduate study aids as a means of increasing use of supplementary educational tools and assessing knowledge.     

Scaffolding game-based learning: Impact on learning achievements,perceived learning,and game experiences

One of the central challenges of integrating game-based learning in school settings is helping learners make the connections between the knowledge learned in the game and the knowledge learned at school, while maintaining a high level of engagement with game narrative and gameplay. The current study evaluated the effect of supplementing a business simulation game with an external conceptual scaffold, which introduces formal knowledge representations, on learners' ability to solve financial-mathematical word problems following the game, and on learners' perceptions regarding learning, flow, and enjoyment in the game. Participants (M_age = 10.10 years) were randomly assigned to three experimental conditions: a “study and play” condition that presented the scaffold first and then the game, a “play and study” condition, and a “play only” condition. Although no significant gains in problem-solving were found following the intervention, learners who studied with the external scaffold before the game performed significantly better in the post-game problem-solving assessment. Adding the external scaffold before the game reduced learners' perceived learning. However, the scaffold did not have a negative impact on reported flow and enjoyment. Flow was found to significantly predict perceived learning and enjoyment. Yet, perceived learning and enjoyment did not predict problem-solving and flow directly predicted problem solving only in the “play and study” condition. We suggest that presenting the scaffold may have “problematized” learners' understandings of the game by connecting them to disciplinary knowledge. Implications for the design of scaffolds for game-based learning are discussed.     

Level of interactivity and executive functions as predictors of learning in computer-based chemistry simulations

High school students’ learning outcomes was examined comparing exploratory vs. worked simulations. The effects of added icons and students’ executive functions were also examined. In Study 1, urban high school students (N = 84) were randomly assigned to one of four versions of a web-based simulation of kinetic molecular theory that varied in instructional format (exploratory vs. worked simulation) and representation (added icons vs. no added icons). Learning was assessed at two levels: comprehension and transfer. For transfer, a main effect was found for instructional format: the exploratory condition yielded greater levels of transfer than the worked simulation. Study 2 used the same conditions and a more complex simulation, the ideal gas law, with a similar sample of students (N = 67). For transfer, an interaction between instructional format and executive functions was found: Whereas students with higher levels of executive functions had better transfer with the exploratory condition, students with lower levels of executive functions had better transfer with the guided simulations. Results are discussed in relation to current theories of instructional design and learning.     

Effects of constructing versus playing an educational game on student motivation and deep learning strategy use

In this study the effects of two different interactive learning tasks, in which simple games were included were described with respect to student motivation and deep strategy use. The research involved 235 students from four elementary schools in The Netherlands. One group of students (N = 128) constructed their own memory ‘drag and drop’ game, whereas the other group (N = 107) played an existing ‘drag and drop’ memory game. Analyses of covariance demonstrated a significant difference between the two conditions both on intrinsic motivation and deep strategy use. The large effect sizes for both motivation and deep strategy use were in favour of the construction condition. The results suggest that constructing a game might be a better way to enhance student motivation and deep learning than playing an existing game. Despite the promising results, the low level of complexity of the games used is a study limitation.     

A gender matching effect in learning with pedagogical agents in an immersive virtual reality science simulation

The main objective of this study is to determine whether boys and girls learn better when the characteristics of the pedagogical agent are matched to the gender of the learner while learning in immersive virtual reality (VR). Sixty‐six middle school students (33 females) were randomly assigned to learn about laboratory safety with one of two pedagogical agents: Marie or a drone, who we predicted serve as a role models for females and males, respectively. The results indicated that there were significant interactions for the dependent variables of performance during learning, retention, and transfer, with girls performing better with Marie (d = 0.98, d = 0.67, and d = 1.03; for performance, retention, and transfer, respectively) and boys performing better with the drone (d = ?0.41, d = ?0.45, d = ?0.23, respectively). The results suggest that gender‐specific design of pedagogical agents may play an important role in VR learning environments.     

Social impact in technologically-mediated communication: An examination of online influence

This study used Social Impact Theory to explore sources and functions of interpersonal influence in Computer-Mediated Communication. Participants were 43 female and 17 male graduate students ranging from 25 to 60 years of age. In each of five distinct graduate classes (n₁ = 15, n₂ = 11, n₃ = 10, n₄ = 12, n₅ = 12) delivered online at a research university, participants engaged in anonymous and computer-mediated discourse and then nominated peers who were directive and/or influential (positive and negative) during the online interaction. High numbers of peer nominations were expected to characterize participants perceived as emanating social impact. Four interpersonal factors were chosen as strength operants in accordance with Social Impact Theory and were, therefore, expected to predict social impact. Of the four, assertiveness and exaggeration were significant, while emotional intensity and sensitivity were not. Two factors, contribution total and word total, were chosen as immediacy operants in accordance with Social Impact Theory. Both factors were found to be significant predictors of social impact. Implications of these findings relative to online learning and interpersonal influence as it occurs in an online context are discussed.     

To solve or to observe? The case of problem-solving interactivity within child learning games

We explored whether problem-solving interactivity within an instructional game fosters learning for children aged 8–10 years. Participants (N = 139) studied a biological topic either through a game-based learning environment (in which they solved assigned problems by interacting with a plant model) or from a standard learning environment (in which they observed how the problems were solved in an animation) (i.e., between-subject design). The treatments were equal with regard to learning content and guidance. No between-group differences in learning outcomes were detected (comprehension: d = 0.16; transfer: d = −0.01). Self-rating of enjoyment tended to be higher in the game group (d = 0.32), and when the children could choose between the treatments in a free-choice period, they strongly preferred the interactive game (87.5%). The results suggest that both the interactive and the non-interactive treatments are useful, but their applicability may differ depending on the learning context (e.g., school vs. home).     

Effectiveness of learning in online academic courses compared with face‐to‐face courses in higher education

This study examined the effectiveness of 3 online courses compared with the same 3 courses in a face‐to‐face (F2F) format, which had the same characteristics (e.g., the same instructor and final exam content and place). Effectiveness was examined by utilizing a wide range of variables, including 2 objective measures (N = 968): grades and completion rate; and 9 subjective measures (N = 360): 7 measures include instructional aspects (course structure, learning content, lessons watched, assignments, communication), engagement, and satisfaction. Findings indicate significant differences between online and F2F courses in most of the examined variables. Students in the online courses reported better understanding of the course structure, better communication with the course staff, watching the videos lessens more, and higher engagement and satisfaction. Students in the F2F courses reported better contribution of the learning content. Students' final grades were higher in the online courses, and no differences were found in the completion rate. The findings suggest that in many of the examined effectiveness aspects, online courses are as effective as, or more effective than, F2F courses. Interpretations of the findings are discussed.     

The impact of an automated learning component against a traditional lecturing environment

This experimental study investigates the effect on the examination performance of a cohort of first‐year undergraduate learners undertaking a Unified Modelling Language (UML) course using an adaptive learning system against a control group of learners undertaking the same UML course through a traditional lecturing environment. The adaptive learning system uses two components for the creation of suitable content for individual learners: a content analyser that automatically generates metadata describing cognitive resources within instructional content and a selection model that utilizes a genetic algorithm to select and construct a course suited to the cognitive ability and pedagogic preference of an individual learner, defined by a digital profile. Using the Kruskal–Wallis H test, it was determined that there was a statistically significant difference between the control group of learners and the learners that participated in the UML course using the adaptive learning system following an examination once the UML course concluded, with p = 0.005, scoring on average 15.71% higher using the adaptive system. However, this observed statistically significant difference observed a small effect size of 20%.     

How teachers integrate a math computer game: Professional development use,teaching practices,and student achievement

As more attention is placed on designing digital educational games to align with schools' academic aims (e.g., Common Core), questions arise regarding how professional development (PD) may support teachers' using games for instruction and how such integration might impact students' achievement. This study seeks to (a) understand how teachers use PD resources (e.g., technology personnel and game‐use workshops) for integration; (b) determine how teachers integrate games into their instruction; and (c) examine how those teaching practices are associated with student achievement. This mixed method study used survey and interview responses from elementary school teachers (n = 863) with access to PD resources for implementing a math game intervention and standardized math‐test scores from their second‐ through sixth‐grade students (n = 10,715). Findings showed few teachers sought PD assistance for integration, but many desired such support. Some reported using integrative practices (i.e., referencing game and using game‐generated progress reports) to identify struggling students, whereas several found integration challenging. Teachers' reordering of game objectives to align with lessons and viewing of game‐based PD videos were associated with increased student math achievement in our OLS‐analysis. However, this result was no longer statistically significant within a school fixed‐effects model, suggesting school differences may influence how strongly teachers' practices are associated with student achievement.     

Learning with quizzes,simulations, and adventures: Students' attitudes,perceptions and intentions to learn with different types of serious games

Students' attitudes, their perceptions of cognitive and affective quality as predictors of attitudes, and the resulting intention toward learning with serious games remains ambiguous, largely due to the use of imprecise measures. The presented studies have aimed to develop and test a measurement of students' attitudes, perceptions, and intentions to learn with serious games in general, and to use the instrument to examine differences for the most common types of serious games, that is quiz, simulation, and adventure. To this end, a pretest (n = 301) and two main studies (Study 1: n = 135, Study 2: n = 375) were conducted. The developed instrument shows high reliability and convergent validity. Results demonstrate positive attitudes, positive cognitive perceptions, and high positive and low negative affective perceptions of students toward learning with serious games in general, as well as with different game types. Findings from a multivariate analysis of variance (MANOVA), however, indicate differences between the three game types that could be related to the perceptions of cognitive and affective quality. Predominately, compared to quizzes and adventures, simulations were perceived as more supportive for the comprehension and application of knowledge while promoting a less positive affect. Additionally, there was a significant difference due to gender. Whereas females reported higher perceptions of negative affective quality compared to males when serious games were addressed in general, answers to questions about the specific game types revealed a more detailed picture. In contrast to previous findings in existing literature, female students reported a more positive attitude, as well as higher perceptions of positive affective quality, than males for all three game types. These results stress the importance of examining the types of serious games separately and considering gender when evaluating students' attitudes and perceptions when learning with serious games.     

Profiling sympathetic arousal in a physics course: How active are students?

Low arousal states (especially boredom) have been shown to be more deleterious to learning than high arousal states, though the latter have received much more attention (e.g., test anxiety, confusion, and frustration). Aiming at profiling arousal in the classroom (how active students are) and examining how activation levels relate to achievement, we studied sympathetic arousal during two runs of an elective advanced physics course in a real classroom setting, including the course exam. Participants were high school students (N = 24) who were randomly selected from the course population. Arousal was indexed from electrodermal activity, measured unobtrusively via the Empatica E4 wristband. Low arousal was the level with the highest incidence (60% of the lesson on average) and longest persistence, lasting on average three times longer than medium arousal and two times longer than high arousal level occurrences. During the course exam, arousal was positively and highly correlated (r = .66) with achievement as measured by the students' grades. Implications for a need to focus more on addressing low arousal states in learning are discussed, together with potential applications for biofeedback, teacher intervention, and instructional design.