Modeling how incoming knowledge,persistence, affective states,and in-game progress influence student learning from an educational game

This study investigated the relationships among incoming knowledge, persistence, affective states, in-game progress, and consequently learning outcomes for students using the game Physics Playground. We used structural equation modeling to examine these relations. We tested three models, obtaining a model with good fit to the data. We found evidence that both the pretest and the in-game measure of student performance significantly predicted learning outcome, while the in-game measure of performance was predicted by pretest data, frustration, and engaged concentration. Moreover, we found evidence for two indirect paths from engaged concentration and frustration to learning, via the in-game progress measure. We discuss the importance of these findings, and consider viable next steps concerning the design of effective learning supports within game environments.     

Maximizing learning without sacrificing the fun: Stealth assessment,adaptivity and learning supports in educational games

In this study, we investigated the validity of a stealth assessment of physics understanding in an educational game, as well as the effectiveness of different game-level delivery methods and various in-game supports on learning. Using a game called Physics Playground, we randomly assigned 263 ninth- to eleventh-grade students into four groups: adaptive, linear, free choice and no-treatment control. Each condition had access to the same in-game learning supports during gameplay. Results showed that: (a) the stealth assessment estimates of physics understanding were valid—significantly correlating with the external physics test scores; (b) there was no significant effect of game-level delivery method on students' learning; and (c) physics animations were the most effective (among eight supports tested) in predicting both learning outcome and in-game performance (e.g. number of game levels solved). We included student enjoyment, gender and ethnicity in our analyses as moderators to further investigate the research questions.     

Not just fun, but serious strategies: Using meta-cognitive strategies in game-based learning

The purpose of this study is to explore the effects of the meta-cognitive strategies on the academic and gaming achievements. Exploring the effects of those achievements on the social problem solving of students is also of interest. For this purpose, the MMORPG Gersang was used. The participants, consisting of ninth graders, played the game until they all reached the third level to ensure that they have the same gaming ability prior to gaming for the study. Three meta-cognitive strategies were developed: self-recording, modeling and thinking aloud. Those strategies are specially related to gaming activities and applied in pre-gaming activities, gaming activities, and post-gaming activities. Three meta-cognitive strategies were set as independent variables. The social problem solving ability was set as a mediating variable, and academic achievement and scores in the game were chosen as dependent variables. The path between meta-cognitive strategies and both academic achievement and game performance by mediating social problem solving abilities were discovered. The social problem solving ability, which is the mediating variable, affects the academic achievement and the game performance very strongly. These results imply that a commercial game playing in conjunction with meta-cognitive strategies can be an effective way to increase students’ performance both in learning and gaming by keeping them involved. Talking and observation activities such as thinking aloud and modeling are more effective than writing activities in enhancing the students’ achievements both in learning and gaming.     

Game immersion experience: its hierarchical structure and impact on game‐based science learning

Many studies have shown the positive impact of serious educational games (SEGs) on learning outcomes. However, there still exists insufficient research that delves into the impact of immersive experience in the process of gaming on SEG‐based science learning. The dual purpose of this study was to further explore this impact. One purpose was to develop and validate an innovative measurement, the Game Immersion Questionnaire (GIQ), and to further verify the hierarchical structure of game immersion by construct validity approaches, including exploratory factor analysis (EFA) (n = 257) and confirmatory factor analysis (CFA) (n = 1044). The second purpose was to investigate the impact of game immersion on science learning through SEG play (n = 260). Overall, the results supported the internal structure of the GIQ with good reliability and validity, and the inter factor bivariate correlations for each construct indicated a high internal consistency. Players did learn from playing an SEG, and game immersion experience did lead to higher gaming performance. Moreover, players' gaming performance plays a role in mediating the effect of immersion on science learning outcomes through SEG play. However, as players became more emotionally and subjectively attached to the game, the science learning outcomes were not definitively reliable.     

Attention to eSports advertisement: effects of ad animation and in-game dynamics on viewers’ visual attention

ABSTRACT

ESports refers to professional video gaming that is typically broadcasted with a live commentary on TV or the Internet. Despite the rapid growth of eSports industry and its potential for a valuable advertising platform, there has not been much discussion about effective advertising strategies for the placement of virtual ads in eSports. Based on previous research, one advertisement factor (i.e. ad animation) and one in-game factor (i.e. in-game dynamics) are identified and tested in an experiment (N?=?116) with a 2 (ad animation: static vs. animated ads)?×?2 (in-game dynamics: battle vs. non-battle scenes) mixed design. The results show that both ad animation and in-game dynamics have a significant impact on viewers’ visual attention, in terms of fixation count and duration measured by an eye-tracking device. The results also show a significant interaction in which the impact of ad animation on fixation duration is more magnified when in-game play is less busy (i.e. non-battle scenes), compared to when it is busy (i.e. battle scenes). Theoretical implications based on the limited-capacity model, as well as practical implications for practitioners are discussed.     

Using multi-channel data with multi-level modeling to assess in-game performance during gameplay with Crystal Island

Game-based learning environments (GBLEs) have been touted as the solution for failing educational outcomes. In this study, we address some of these major issues by using multi-level modeling with data from eye movements and log files to examine the cognitive and metacognitive self-regulatory processes used by 50 college students as they read books and completed the associated in-game assessments (concept matrices) while playing the Crystal Island game-based learning environment. Results revealed that participants who read fewer books in total, but read each of them more frequently, and who had low proportions of fixations on books and concept matrices exhibited the strongest performance. Results stress the importance of assessing quality vs. quantity during gameplay, such that it is important to read books in-depth (i.e., quality), compared to reading books once (i.e., quantity). Implications for these findings involve designing adaptive GBLEs that scaffold participants based on their trace data, such that we can model efficient behaviors that lead to successful performance.     

The influence of collaboration styles to children’s cognitive performance in digital problem-solving game “William Adventure”: A comparative case study

Since a large variety of digital games have been used in many fields for educational purposes, their real functions in learning have caught much attention as well. This study first defines learning characteristics of problem-solving digital games and their corresponding cognitive levels, then designs and develops a problem-solving game in accordance to the criteria. Tasks in the game context are inter-related to each other so that players need to critically and creatively think about problem solutions. Learners’ task analyses are performed to observe four elementary learners’ gaming paths, behaviors and cognitive activities, individually and collaboratively. System documentation, video recording, researcher observation, and interviews are conducted to analyze learners’ learning strategies and their cognitive performance during the gaming process.     

Developing a generalizable detector of when students game the system

Some students, when working in interactive learning environments, attempt to “game the system”, attempting to succeed in the environment by exploiting properties of the system rather than by learning the material and trying to use that knowledge to answer correctly. In this paper, we present a system that can accurately detect whether a student is gaming the system, within a Cognitive Tutor mathematics curricula. Our detector also distinguishes between two distinct types of gaming which are associated with different learning outcomes. We explore this detector’s generalizability, and find that it transfers successfully to both new students and new tutor lessons.

The concept of flow in collaborative game-based learning

Generally, high-school students have been characterized as bored and disengaged from the learning process. However, certain educational designs promote excitement and engagement. Game-based learning is assumed to be such a design. In this study, the concept of flow is used as a framework to investigate student engagement in the process of gaming and to explain effects on game performance and student learning outcome. Frequency 1550, a game about medieval Amsterdam merging digital and urban play spaces, has been examined as an exemplar of game-based learning. This 1-day game was played in teams by 216 students of three schools for secondary education in Amsterdam. Generally, these students show flow with their game activities, although they were distracted by solving problems in technology and navigation. Flow was shown to have an effect on their game performance, but not on their learning outcome. Distractive activities and being occupied with competition between teams did show an effect on the learning outcome of students: the fewer students were distracted from the game and the more they were engaged in group competition, the more students learned about the medieval history of Amsterdam. Consequences for the design of game-based learning in secondary education are discussed.     

The Trojan Player Typology: A cross-genre,cross-cultural,behaviorally validated scale of video game play motivations

While many video game researchers have built scales to tackle the motivations that people have for playing video games, these scales are often limited by their focus on specific game genres or player cultures as well as their lack of behavioral validation. The present research offers a new scale for player motivations and then examines its validity across two distinct gaming genres and cultures, drawing from server-side data combined with survey data of 18,627 players of the Multiplayer Online Battle Arena League of Legends and 18,819 players of the Chinese Massively Multiplayer Online Game Chevalier’s Romance Online 3. Six types of player motivations were found: socializer, completionist, competitor, escapist, story-driven, and smarty-pants. Consistent with previous research on player motivations, this typology offers new insights into why people play video games and how player motivations can be used to infer players’ in-game behaviors.     

Investigating the impact of video games on high school students’ engagement and learning about genetics

The popularity of video games has transcended entertainment crossing into the world of education. While the literature base on educational gaming is growing, there is still a lack of systematic study of this emerging technology’s efficacy. This quasi-experimental study evaluated a teacher created video game on genetics in terms of its affective and cognitive impact on student users. While statistical results indicated no differences (p > .05) in student learning as measured by our instrument, there were significant differences (p < .05) found in the participants’ level of engagement while interfacing with the video game. Implications on this emerging line of inquiry are discussed.     

The interplay of game elements with psychometric qualities,learning, and enjoyment in game-based assessment

Educators today are increasingly interested in using game-based assessment to assess and support students' learning. In the present study, we investigated how changing a game design element, linearity in gameplay sequences, influenced the effectiveness of game-based assessment in terms of validity, reliability, fairness, learning, and enjoyment. Two versions of a computer game, Physics Playground (formerly Newton's Playground), with different degrees of linearity in gameplay sequences were compared. Investigation of the assessment qualities—validity, reliability, and fairness—suggested that changing one game element (e.g., linearity) could significantly influence how players interacted with the game, thus changing the evidentiary structure of in-game measures. Although there was no significant group difference in terms of learning between the two conditions, participants who played the nonlinear version of the game showed significant improvement on qualitative physics understanding measured by the pre- and posttests while the participants in the linear condition did not. There was also no significant group difference in terms of enjoyment. Implications of the findings for future researchers and game-based assessment designers are discussed.     

Exploring the influence of game design on learning and voluntary use in an online vascular anatomy study aid

This research explores the educational impact of an online study aid-game for studying human vascular anatomy (n = 24) versus a similar non-game study aid (n = 22) and how it relates to medical students' demographic traits and voluntary use over a 35-day period. Hierarchical linear regression models revealed that study aid success rate (a metric for assessing performance through the study aids) was a significant predictor of anatomy test improvement with the game (β = 0.41, p = 0.05), but not for the non-game (β = 0.14, p = 0.56). Our analyses suggest that game mechanics encouraged more specific problem-solving strategies than did the control study aid, leading to greater predictability of learning outcomes. There was a non-significant trend among game treatment participants, who were more likely to complete study tasks than those assigned to the control treatment (p = 0.11). It would appear that students' studying habits had the greatest influence (though opposite in both tools) on level of engagement in study aid use. However, contrary to expectations, self-reported gaming habits did not impact participation. Overall, these findings support the integration of game design into undergraduate study aids as a means of increasing use of supplementary educational tools and assessing knowledge.     

Children's engagement during digital game-based learning of reading: The effects of time,rewards, and challenge

This study investigated the effects of two game features (the level of challenge and the reward system) on first and second graders' engagement during digital game-based learning of reading. We were particularly interested in determining how well these features managed to maintain children's engagement over the 8-week training period. The children (N = 138) used GraphoGame, a web-based game training letter–sound connections, at home under the supervision of parents. Data regarding the children's gaming and engagement were stored on the GraphoGame online server. A 2 × 2 factorial design was used to investigate the effects of the level of challenge (high challenge vs. high success) and the presence of the reward system (present vs. absent). Children's engagement was measured by session frequency and duration and through an in-game self-report survey that was presented at the end of the each session. According to the results, the children enjoyed GraphoGame but used it less frequently than expected. The reward system seemed to encourage the children to play longer sessions at the beginning of the training period, but this effect vanished after a few sessions. The level of challenge had no significant effect on children's engagement. The results suggest a need to investigate further the effectiveness of various game features in maintaining learner's engagement until the goals set for learning are achieved.     

Effects of anxiety levels on learning performance and gaming performance in digital game‐based learning

Anxiety plays an influential role in foreign language learning. However, a lack of attention was paid to examining the effects of anxiety levels on learning performance and gaming performance in digital game‐based learning. To this end, this study developed a game‐based English learning system and investigated how different levels of anxiety affected learners' learning performance and gaming performance. A quasi‐experiment was conducted in an elementary school. The results showed that high‐anxiety learners performed worse than low‐anxiety learners in speaking, word/sentence match, and overall learning performance. However, they performed similarly in listening performance. Moreover, the results showed that high‐ and low‐anxiety learners demonstrated a similar level of gaming performance. A subsequent analysis showed that significant correlations existed between learning performance and gaming performance for learners with high anxiety whereas such positive correlations were rarely found for learners with low anxiety, indicating that high‐anxiety learners' learning performance could be fostered by their gaming performance. The findings suggested that digital game‐based learning was particularly beneficial to high‐anxiety learners, whose gaming performance was a facilitative factor of their learning performance.     

Digital Game-Based Learning in high school Computer Science education: Impact on educational effectiveness and student motivation

The aim of this study was to assess the learning effectiveness and motivational appeal of a computer game for learning computer memory concepts, which was designed according to the curricular objectives and the subject matter of the Greek high school Computer Science (CS) curriculum, as compared to a similar application, encompassing identical learning objectives and content but lacking the gaming aspect. The study also investigated potential gender differences in the game’s learning effectiveness and motivational appeal. The sample was 88 students, who were randomly assigned to two groups, one of which used the gaming application (Group A, N = 47) and the other one the non-gaming one (Group B, N = 41). A Computer Memory Knowledge Test (CMKT) was used as the pretest and posttest. Students were also observed during the interventions. Furthermore, after the interventions, students’ views on the application they had used were elicited through a feedback questionnaire. Data analyses showed that the gaming approach was both more effective in promoting students’ knowledge of computer memory concepts and more motivational than the non-gaming approach. Despite boys’ greater involvement with, liking of and experience in computer gaming, and their greater initial computer memory knowledge, the learning gains that boys and girls achieved through the use of the game did not differ significantly, and the game was found to be equally motivational for boys and girls. The results suggest that within high school CS, educational computer games can be exploited as effective and motivational learning environments, regardless of students’ gender.     

Assessing implicit science learning in digital games

Building on the promise shown in game-based learning research, this paper explores methods for Game-Based Learning Assessments (GBLA) using a variety of educational data mining techniques (EDM). GBLA research examines patterns of behaviors evident in game data logs for the measurement of implicit learning—the development of unarticulated knowledge that is not yet expressible on a test or formal assessment. This paper reports on the study of two digital games showing how the combination of human coding with EDM has enabled researchers to measure implicit learning of Physics. In the game Impulse, researchers combined human coding of video with educational data mining to create a set of automated detectors of students' implicit understanding of Newtonian mechanics. For Quantum Spectre, an optics puzzle game, human coding of Interaction Networks was used to identify common student errors. Findings show that several of our measures of student implicit learning within these games were significantly correlated with improvements in external postassessments. Methods and detailed findings were different for each type of game. These results suggest GBLA shows promise for future work such as adaptive games and in-class, data-driven formative assessments, but design of the assessment mechanics must be carefully crafted for each game.     

Learning leadership skills in a simulated business environment

In today’s unstable market economy, individuals have to be skilled to work efficiently in constantly changing and complex situations. Thus, graduate students have to be trained to cope with unpredictable situations before they enter the workforce. They need to exercise occupational skills, such as leadership skills, during higher education. Simulation gaming opens up possibilities for active learning of the leadership and other occupational skills needed in complex work environments. The aim of this study is to explore if participation in business simulation gaming sessions can make different leadership types visible and if the simulation gaming sessions provide students with experiences beneficial for the development of leadership skills. In the experiment, a group of multicultural graduate business students (N = 41) participated in gaming sessions with a computerised business simulation game. The participants played the game in virtual teams; some teams had a “satellite member” geographically distant from the rest of the team members. Data consist of the teams’ observations during the simulation game and students’ reflective essays written after the gaming sessions. The results indicate that in the business simulation gaming environment, certain leadership characteristics emerged spontaneously. Experiences about leadership varied between the teams and were dependent on the role individual students had in their team. However, it can be concluded that simulation gaming environment has the potential to be used in higher education to exercise the leadership skills relevant in real-world work contexts.     

The evaluation of different gaming modes and feedback types on game-based formative assessment in an online learning environment

This study proposed an online learning system for energy education, modifying the typical rules of tic-tac-toe and incorporating multiple choice tests into the game in order to develop a game-based formative assessment tool for an online learning course. In order to explore how different gaming modes and feedback types in this game-based formative assessment affect knowledge acquisition effectiveness and participation perceptions, a tic-tac-toe quiz game (TRIS-Q) with two gaming modes: single-player online game (SOG) and multi-player online game (MOG), and two feedback types: immediate elaborated feedback (IEF) and no immediate elaborated feedback (no IEF), were developed. A 2(SOG vs. MOG) × 2(IEF vs. no IEF) between-subject experiment was also conducted to investigate the effects on 109 ninth-grade students from four junior high school classes. The research findings indicated that different gaming modes of TRIS-Q did not affect the effectiveness of knowledge acquisition; providing IEF for each question answered in the game facilitated the enhancement of both energy knowledge acquisition and student tic-tac-toe ability when comparing it with the no IEF type. Additionally, the different gaming modes and feedback types did not affect participation perceptions.     

Responsiveness to a game-based intervention to enhance reading efficiency in first graders

In the present study, a 5-week tablet-based word reading efficiency game intervention (Reading Turbo) was integrated in a comprehensive phonics-based reading curriculum. The aims of the study were to examine whether the game would advance children's word reading efficiency, and to determine the extent to which pre-reading capacities and in-game mechanisms could explain individual variation in responsiveness to the game. To do so, word reading efficiency scores of first graders in an intervention group (n = 132) and a control group that continued with the usual reading curriculum (n = 118) were compared prior to, directly after, and 2 months after the 5-week intervention period. Individual variation in responsiveness was examined by relating reading precursors (i.e., phonological awareness, letter efficiency, rapid automatized naming (RAN), and verbal working memory) measured at the onset of the intervention, and in-game accuracy and efficiency to word reading efficiency outcomes in untrained words. Results indicated that playing the word reading game significantly enhanced first graders' word reading efficiency directly after the intervention, but the effect was no longer significant 2 months after the intervention. With respect to individual variation in game responsiveness, it was found that phonological awareness, letter efficiency, and verbal working memory predicted responsiveness to the game via in-game accuracy. In addition, phonological awareness and RAN predicted responsiveness to the game via in-game efficiency, and letter efficiency and verbal working memory were directly related to responsiveness. The effectiveness of the word reading game thus differentiated between children with higher and lower pre-reading capacities, and operated via in-game child affordances.