The validity of a game-based assessment of persistence

In this study, 154 students individually played a challenging physics video game for roughly 4 h. Based on time data for both solved and unsolved problems derived from log files, we created a game-based assessment of persistence that was validated against an existing measure of persistence. We found that the game-based assessment of persistence predicted learning of qualitative physics after controlling for gender, video game experience, pretest knowledge and enjoyment of the game. These findings support the implementation of a real-time formative assessment of persistence to be used to dynamically change gameplay.     

Scaffolding game-based learning: Impact on learning achievements,perceived learning,and game experiences

One of the central challenges of integrating game-based learning in school settings is helping learners make the connections between the knowledge learned in the game and the knowledge learned at school, while maintaining a high level of engagement with game narrative and gameplay. The current study evaluated the effect of supplementing a business simulation game with an external conceptual scaffold, which introduces formal knowledge representations, on learners' ability to solve financial-mathematical word problems following the game, and on learners' perceptions regarding learning, flow, and enjoyment in the game. Participants (M_age = 10.10 years) were randomly assigned to three experimental conditions: a “study and play” condition that presented the scaffold first and then the game, a “play and study” condition, and a “play only” condition. Although no significant gains in problem-solving were found following the intervention, learners who studied with the external scaffold before the game performed significantly better in the post-game problem-solving assessment. Adding the external scaffold before the game reduced learners' perceived learning. However, the scaffold did not have a negative impact on reported flow and enjoyment. Flow was found to significantly predict perceived learning and enjoyment. Yet, perceived learning and enjoyment did not predict problem-solving and flow directly predicted problem solving only in the “play and study” condition. We suggest that presenting the scaffold may have “problematized” learners' understandings of the game by connecting them to disciplinary knowledge. Implications for the design of scaffolds for game-based learning are discussed.     

Does individual or collaborative self-debriefing better enhance learning from games?

The primary aim of this study is to find out whether use of different self-debriefing modes affects learning from a game. In self-debriefing participants are led to reflect upon their game experiences by a set of debriefing questions. Two conditions were compared: Individual and Collaborative self-debriefing. The 45 participants first played the game of Lemonade Tycoon Deluxe, were tested for knowledge and self-debriefed in pairs or alone. Then they played the game once more and were tested again. Game scores increased significantly from the first to the second round of gameplay to an equal degree in both conditions. Knowledge scores of participants in individual self-debriefing increased significantly more than those of participants in the Collaborative condition. The study shows that game-based learning can be effectively scaffolded with self-debriefing. Future studies might investigate whether the type of self-debriefing differentially affects game motivation. In addition, attention to the role of feedback is called for.     

Maximizing learning without sacrificing the fun: Stealth assessment,adaptivity and learning supports in educational games

In this study, we investigated the validity of a stealth assessment of physics understanding in an educational game, as well as the effectiveness of different game-level delivery methods and various in-game supports on learning. Using a game called Physics Playground, we randomly assigned 263 ninth- to eleventh-grade students into four groups: adaptive, linear, free choice and no-treatment control. Each condition had access to the same in-game learning supports during gameplay. Results showed that: (a) the stealth assessment estimates of physics understanding were valid—significantly correlating with the external physics test scores; (b) there was no significant effect of game-level delivery method on students' learning; and (c) physics animations were the most effective (among eight supports tested) in predicting both learning outcome and in-game performance (e.g. number of game levels solved). We included student enjoyment, gender and ethnicity in our analyses as moderators to further investigate the research questions.     

The evaluation of different gaming modes and feedback types on game-based formative assessment in an online learning environment

This study proposed an online learning system for energy education, modifying the typical rules of tic-tac-toe and incorporating multiple choice tests into the game in order to develop a game-based formative assessment tool for an online learning course. In order to explore how different gaming modes and feedback types in this game-based formative assessment affect knowledge acquisition effectiveness and participation perceptions, a tic-tac-toe quiz game (TRIS-Q) with two gaming modes: single-player online game (SOG) and multi-player online game (MOG), and two feedback types: immediate elaborated feedback (IEF) and no immediate elaborated feedback (no IEF), were developed. A 2(SOG vs. MOG) × 2(IEF vs. no IEF) between-subject experiment was also conducted to investigate the effects on 109 ninth-grade students from four junior high school classes. The research findings indicated that different gaming modes of TRIS-Q did not affect the effectiveness of knowledge acquisition; providing IEF for each question answered in the game facilitated the enhancement of both energy knowledge acquisition and student tic-tac-toe ability when comparing it with the no IEF type. Additionally, the different gaming modes and feedback types did not affect participation perceptions.     

How competition and heterogeneous collaboration interact in prevocational game-based mathematics education

The present study addresses the effectiveness of an educational mathematics game for improving proportional reasoning in students from prevocational education. Though in theory game-based learning is promising, research shows that results are ambiguous and that we should look into ways to support game-based learning. The current study explored two factors (i.e., collaboration and competition) that have been associated with motivational and cognitive effects, and have potential to optimize game-based learning. In a fully crossed design, four conditions were examined: collaboration and competition, collaboration control, competition control, and control. It was found that, over all, gameplay did improve students' proportional reasoning skills but that learning effects did not differ between conditions. However, when students’ ability levels were taken into account, an interaction between collaboration and competition was found. For below-average students, the effect of collaboration was modified by competition, showing a negative effect of competition on domain knowledge gains in a collaborative learning situation. In contrast, for above-average students, the data demonstrated a trend that suggests a positive effect of competition on domain knowledge gain in a collaborative learning situation.     

Assessing implicit science learning in digital games

Building on the promise shown in game-based learning research, this paper explores methods for Game-Based Learning Assessments (GBLA) using a variety of educational data mining techniques (EDM). GBLA research examines patterns of behaviors evident in game data logs for the measurement of implicit learning—the development of unarticulated knowledge that is not yet expressible on a test or formal assessment. This paper reports on the study of two digital games showing how the combination of human coding with EDM has enabled researchers to measure implicit learning of Physics. In the game Impulse, researchers combined human coding of video with educational data mining to create a set of automated detectors of students' implicit understanding of Newtonian mechanics. For Quantum Spectre, an optics puzzle game, human coding of Interaction Networks was used to identify common student errors. Findings show that several of our measures of student implicit learning within these games were significantly correlated with improvements in external postassessments. Methods and detailed findings were different for each type of game. These results suggest GBLA shows promise for future work such as adaptive games and in-class, data-driven formative assessments, but design of the assessment mechanics must be carefully crafted for each game.     

Incorporating customization and personalization into game-based learning: A cognitive style perspective

In recent years, customization and personalization were widely applied to accommodate the needs of different cognitive style groups. Such two approaches have different advantages and disadvantages but there is a lack of studies to compare these two approaches from the perspective of game-based learning, which is currently popular in educational settings. To this end, we developed a customized game-based learning system and a personalized game-based learning system and conducted two empirical studies to examine how cognitive styles affected learner's reactions to these two game-based learning systems. The results from the customized game-based learning system showed that Holists might not always favor to listen to music because they frequently switched on/off music. On the other hand, Serialists did not prefer to use hints. In addition, learners with the customized game-based learning system had more positive perceptions while learners with the personalized game-based learning system had more negative perceptions though both systems were useful to enhance learners' learning performance, regardless of their cognitive styles.     

Challenging games help students learn: An empirical study on engagement,flow and immersion in game-based learning

In this paper, we investigate the impact of flow (operationalized as heightened challenge and skill), engagement, and immersion on learning in game-based learning environments. The data was gathered through a survey from players (N = 173) of two learning games (Quantum Spectre: N = 134 and Spumone: N = 40). The results show that engagement in the game has a clear positive effect on learning, however, we did not find a significant effect between immersion in the game and learning. Challenge of the game had a positive effect on learning both directly and via the increased engagement. Being skilled in the game did not affect learning directly but by increasing engagement in the game. Both the challenge of the game and being skilled in the game had a positive effect on both being engaged and immersed in the game. The challenge in the game was an especially strong predictor of learning outcomes. For the design of educational games, the results suggest that the challenge of the game should be able to keep up with the learners growing abilities and learning in order to endorse continued learning in game-based learning environments.     

The dynamic influence of emotions on game-based creativity: An integrated analysis of emotional valence,activation strength,and regulation focus

Emotion has been identified as an important predictor of creativity, but little attention has been put on investigating how emotion, especially that considers regulation focus, may dynamically influence male and female students' creativity in game-based situations. To explore the dynamic relationship between various types of emotions and creativity during game playing, 266 college students were included and the Creativity Game-based Evaluation System (CGES) was developed in this study. Four types of emotions integrating perspectives of valence (positive vs. negative), activation (high vs. low), and regulatory focus (prevention vs. promotion) were investigated in this study: the positive-low activation-prevention emotion (P-L-Pre) (calm and relaxed), the positive-high activation-promotion emotion (P-H-Pro) (happy and elated), the negative-high activation-prevention emotion (N-H-Pre) (nervous and anxious), and the negative-high activation-promotion emotion (N-H-Pro) (frustrated and angry). The results revealed that, although there was a slight gender difference in game-based creativity, the prediction patterns of emotions in game-based creativity were very similar among participants with different genders. Specifically, emotions during game playing can better predict creativity than those of the baseline; moreover, the P-H-Pro emotion can facilitate performance on creativity, whereas the N-H-Pro emotion can decrease creativity performance. Thus, providing appropriate challenges to induce highly-activated and promotion-focused positive emotions are critical for the success of games designed to improve creativity.     

Digital game-based learning in a Shanghai primary-school mathematics class: A case study

This study examined the perceptions and experiences of a teacher and students in a Shanghai public primary school when digital games were used in a second-grade math class. The participants included one teacher and 45 students. Data collection methods included classroom observation, focus-group and individual interviews, and document analysis. Digital gameplay, when used once daily over a 6-day period, was found to enhance student engagement and interest in learning; many students, however, were concerned about its effect on academic achievement and eyesight. The teacher employed a “making thinking visible” approach using pencil and paper and problem-solving strategies to help students understand the game's mathematical principles and master mathematical knowledge. Obstacles included large class size, difficulty evaluating learning outcomes, balancing fun and learning, and effective game–classroom integration. This study found that exam-oriented education and traditional teacher-centred teaching in China influenced participants' perceptions and experiences of digital game-based learning.     

The format of problem representation for in‐game learning supports

A promising method to support game‐based learning is to facilitate learners' externalization of cognitive and metacognitive processes. Externalizing Problem Representation (EPR) refers to a cognitive behaviour in which a learner constructs her own representations overtly. The purpose of this study is to investigate whether learning supports promoting EPR enhance qualitative understanding and quantitative proficiency in ratios and proportional relationships in a learning game (i.e., E‐Rebuild) context. Specifically, this study investigated the effects of representation format in problem representation on qualitative understanding and quantitative proficiency in a learning game context. The results of this study indicate that (a) symbolic learning supports better facilitate comprehension of math concepts and their relations than iconic learning supports in video game contexts, (b) symbolic learning supports better facilitate players' reflection for implicit understanding and promote their math problem‐solving skills, (c) participants in the symbolic learning support group increased significantly in qualitative understanding but not in quantitative proficiency after gameplay, and (d) participants in the iconic learning support group experienced significant growth in quantitative proficiency but not in qualitative understanding after gameplay.     

Enjoy and learn with educational games: Examining factors affecting learning performance

Educational games have enhanced the value of instruction procedures in institutions and business organizations. Factors that increase students' adoption of learning games have been widely studied in past; however, the effect of these factors on learners' performance is yet to be explored. In this study, factors of Enjoyment, Happiness, and Intention to Use were chosen as important attitudes in learning educational games and increasing learning performance. A two-step between group experiment was conducted: the first study compared game-based learning and traditional instruction in order to verify the value of the game. 41 Gymnasium (middle school) students were involved, and the control and experimental groups were formed based on a pretest method. The second study, involving 46 Gymnasium students, empirically evaluates whether and how certain attitudinal factors affect learners' performance. The results of the two-part experiment showed that a) the game demonstrated good performance (as compared to traditional instruction) concerning the gain of knowledge, b) learners' enjoyment of the game has a significant relation with their performance, and c) learners' intention to use and happiness with the game do not have any relation with their performance. Our results suggest that there are attitudinal factors affecting knowledge acquisition gained by a game.     

Evaluating learners’ motivational and cognitive processing in an online game-based learning environment

This paper describes the process and results of an evaluation on an online game-based learning environment (GBLE) by focusing on learners’ motivational processing and cognitive processing. The goal is to explore how online GBLE might initiate and support learners’ goal-setting activities and impact learners’ cognitive loads. The study surveyed 144 undergraduate students after their autonomous participation in the online game available at the Nobel Prize Foundation website teaching the Heckscher-Ohlin Theory on international trade. Grounded in the integrative theory of motivation, volition, and performance (MVP), the evaluation indicated that participants felt significantly confident in learning the subject. The perceived satisfaction, however, was lower than the rest of motivational components possibly due to heavy cognitive processing. The finding of cognitive load reported that learners perceived a significantly higher level of intrinsic load than the germane load due to the novelty of the subject matter. Data analysis further indicated a significant canonical correlation between learners’ motivational and cognitive processing. This particular finding could inform future research to investigate specific motivational processing components’ effects on learners’ cognitive load levels in online GBLEs.     

The concept of flow in collaborative game-based learning

Generally, high-school students have been characterized as bored and disengaged from the learning process. However, certain educational designs promote excitement and engagement. Game-based learning is assumed to be such a design. In this study, the concept of flow is used as a framework to investigate student engagement in the process of gaming and to explain effects on game performance and student learning outcome. Frequency 1550, a game about medieval Amsterdam merging digital and urban play spaces, has been examined as an exemplar of game-based learning. This 1-day game was played in teams by 216 students of three schools for secondary education in Amsterdam. Generally, these students show flow with their game activities, although they were distracted by solving problems in technology and navigation. Flow was shown to have an effect on their game performance, but not on their learning outcome. Distractive activities and being occupied with competition between teams did show an effect on the learning outcome of students: the fewer students were distracted from the game and the more they were engaged in group competition, the more students learned about the medieval history of Amsterdam. Consequences for the design of game-based learning in secondary education are discussed.     

Does the emotional design of scaffolds enhance learning and motivational outcomes in game-based learning?

Background

In recent years, the importance of emotions in learning has been increasingly recognized. Applying emotional design to induce positive emotions has been considered a means to enhance the instructional effectiveness of digital learning environments. However, only a few studies have examined the specific effects of emotional design in game-based learning.

Objectives

This quasi-experimental study utilized a value-added research approach to investigate whether emotional design applied to scaffolding in a game-based learning environment improves learning and motivational outcomes more than emotionally neutral scaffolding.

Methods

A total of 138 participants, mean age of 11.5 (SD = 0.73) participated in the study. A total of 68 participants played the base version of a fraction learning game (Number Trace), where scaffolding was provided with emotionally neutral mathematical notations, and 70 participants played the value-added version of the game using emotionally designed animated scaffolding agents. Pre-and post-tests were used to measure conceptual fraction knowledge and self-reported measures of situational interest and situational self-efficacy to evaluate motivational outcomes.

Results and Conclusions

Our results indicate that the emotional design applied to scaffolds can improve the educational value of a game-based learning environment by enhancing players' situational interest and situational self-efficacy. However, although the intervention improved the participants' conceptual fraction knowledge, there was no significant difference between the scaffolding conditions in participants' learning outcomes.

Takeaways

The results suggest that emotional design can increase the educational impact of game-based learning by promoting the development of interest, as well as improving self-efficacy.     

Learning immunology in a game: Learning outcomes,the use of player characters,immersion experiences and visual attention distributions

This study contributed to the current body of literature on game-based learning by investigating the way playing an educational game, Humunology, affected learning about the immune system and examining further the association between game immersion and visual attention distribution. A total of 79 undergraduate and graduate students participated, and data were collected both in situ and ex situ. The results showed that the students learned through playing Humunology, and the analyses of the use of player characters indicated that the game design facilitated gameplay behaviours that are consistent with the science content. The use of the eye-tracking method also revealed that students who were more immersed in playing Humunology paid more attention to areas related to player characters. The interpretations and limitations are discussed further.     

Development of a contextual decision-making game for improving students' learning performance in a health education course

Heath education is an important component of the curriculum for fostering children's correct health knowledge and good daily life habits. However, educators have indicated that most children might fail to realize the importance and meaning of health education content owing to the lack of authentic scenarios and daily life experience. With the advancement of computer technologies, researchers have tried to develop multimedia learning content in order to improve students' learning performance. Among various technology-enhanced learning alternatives, digital game-based learning has been recognized as a highly potential approach to motivating students. However, several previous studies have indicated that, without properly incorporating learning content into game scenarios, the effectiveness of digital game-based learning might not be as good as expected in comparison with conventional technology-enhanced learning. In this study, a contextual digital game was developed for improving students' learning performance in an elementary school health education course. A quasi experiment was conducted to evaluate the effectiveness of the proposed approach by situating the experimental group in the game-based learning scenario and the control group to learn with conventional e-books. The experimental results showed that the proposed approach not only improved the students' learning motivation, but also their learning achievement and problem-solving competences. Moreover, the significant two-way interaction suggested that the contextual game-based learning approach benefited the higher motivation students more than the lower motivation ones in terms of the advanced knowledge, showing the importance and potential of applying contextual games to health education activities.     

Using multi-channel data with multi-level modeling to assess in-game performance during gameplay with Crystal Island

Game-based learning environments (GBLEs) have been touted as the solution for failing educational outcomes. In this study, we address some of these major issues by using multi-level modeling with data from eye movements and log files to examine the cognitive and metacognitive self-regulatory processes used by 50 college students as they read books and completed the associated in-game assessments (concept matrices) while playing the Crystal Island game-based learning environment. Results revealed that participants who read fewer books in total, but read each of them more frequently, and who had low proportions of fixations on books and concept matrices exhibited the strongest performance. Results stress the importance of assessing quality vs. quantity during gameplay, such that it is important to read books in-depth (i.e., quality), compared to reading books once (i.e., quantity). Implications for these findings involve designing adaptive GBLEs that scaffold participants based on their trace data, such that we can model efficient behaviors that lead to successful performance.