The interplay of game elements with psychometric qualities,learning, and enjoyment in game-based assessment

Educators today are increasingly interested in using game-based assessment to assess and support students' learning. In the present study, we investigated how changing a game design element, linearity in gameplay sequences, influenced the effectiveness of game-based assessment in terms of validity, reliability, fairness, learning, and enjoyment. Two versions of a computer game, Physics Playground (formerly Newton's Playground), with different degrees of linearity in gameplay sequences were compared. Investigation of the assessment qualities—validity, reliability, and fairness—suggested that changing one game element (e.g., linearity) could significantly influence how players interacted with the game, thus changing the evidentiary structure of in-game measures. Although there was no significant group difference in terms of learning between the two conditions, participants who played the nonlinear version of the game showed significant improvement on qualitative physics understanding measured by the pre- and posttests while the participants in the linear condition did not. There was also no significant group difference in terms of enjoyment. Implications of the findings for future researchers and game-based assessment designers are discussed.     

The evaluation of different gaming modes and feedback types on game-based formative assessment in an online learning environment

This study proposed an online learning system for energy education, modifying the typical rules of tic-tac-toe and incorporating multiple choice tests into the game in order to develop a game-based formative assessment tool for an online learning course. In order to explore how different gaming modes and feedback types in this game-based formative assessment affect knowledge acquisition effectiveness and participation perceptions, a tic-tac-toe quiz game (TRIS-Q) with two gaming modes: single-player online game (SOG) and multi-player online game (MOG), and two feedback types: immediate elaborated feedback (IEF) and no immediate elaborated feedback (no IEF), were developed. A 2(SOG vs. MOG) × 2(IEF vs. no IEF) between-subject experiment was also conducted to investigate the effects on 109 ninth-grade students from four junior high school classes. The research findings indicated that different gaming modes of TRIS-Q did not affect the effectiveness of knowledge acquisition; providing IEF for each question answered in the game facilitated the enhancement of both energy knowledge acquisition and student tic-tac-toe ability when comparing it with the no IEF type. Additionally, the different gaming modes and feedback types did not affect participation perceptions.     

A framework to meet didactical requirements for serious game design

Interest in game-based training is growing within the industry. In this article, we present an interdisciplinary work on the application of computer game principles and techniques within an automation industry training scenario. A data flow-based component architecture forms the technical foundation of our system and enables us to exploit the capabilities of available middleware components like game or physics engines. An interactive simulation of a real automation plant is built as a combination of state-based and physical object behavior. A training scenario founded on didactical principles of video game is built with the help of our implemented system.     

Assessing implicit science learning in digital games

Building on the promise shown in game-based learning research, this paper explores methods for Game-Based Learning Assessments (GBLA) using a variety of educational data mining techniques (EDM). GBLA research examines patterns of behaviors evident in game data logs for the measurement of implicit learning—the development of unarticulated knowledge that is not yet expressible on a test or formal assessment. This paper reports on the study of two digital games showing how the combination of human coding with EDM has enabled researchers to measure implicit learning of Physics. In the game Impulse, researchers combined human coding of video with educational data mining to create a set of automated detectors of students' implicit understanding of Newtonian mechanics. For Quantum Spectre, an optics puzzle game, human coding of Interaction Networks was used to identify common student errors. Findings show that several of our measures of student implicit learning within these games were significantly correlated with improvements in external postassessments. Methods and detailed findings were different for each type of game. These results suggest GBLA shows promise for future work such as adaptive games and in-class, data-driven formative assessments, but design of the assessment mechanics must be carefully crafted for each game.     

Assessing fraction knowledge by a digital game

Serious or educational games gain increasing research interest as tools to augment traditional instructional approaches on scholastic learning, especially in mathematics education. In this study, we investigated whether game-based approaches may not only be useful to foster numerical learning but may also be valid as an assessment tool. To measure their conceptual knowledge of fractions eleven-year-old students played a math game on tablet computers using tilt-control to navigate an avatar along a number line for a total of 30 min. Findings indicated that hallmark effects of fraction magnitude processing typically observed in basic research, such as the numerical distance effect, were successfully replicated using the game-based assessment. Moreover, fraction comparison performance as well as fraction estimation accuracy correlated significantly with students' math grades. Therefore, the results of the current study suggest that game-based learning environments for fraction education (even using tilt-control) may also allow for a valid assessment of students’ fraction knowledge.     

Effectiveness of using a video game to teach a course in mechanical engineering

One of the core courses in the undergraduate mechanical engineering curriculum has been completely redesigned. In the new numerical methods course, all assignments and learning experiences are built around a video/computer game. Students are given the task of writing computer programs to race a simulated car around a track. In doing so, students learn and implement numerical methods content. The design of the course, around a video game, is rooted in commonly accepted theories of how people learn. The article describes a study to assess the effectiveness of the video game-based course. Results show that students taking the game-based course, on average, spend roughly twice as much time, outside of class, on their course work. In a concept mapping exercise, students taking the game-based course demonstrate deeper learning compared to their counterparts taking traditional lecture/textbook-based numerical methods courses.     

Maximizing learning without sacrificing the fun: Stealth assessment,adaptivity and learning supports in educational games

In this study, we investigated the validity of a stealth assessment of physics understanding in an educational game, as well as the effectiveness of different game-level delivery methods and various in-game supports on learning. Using a game called Physics Playground, we randomly assigned 263 ninth- to eleventh-grade students into four groups: adaptive, linear, free choice and no-treatment control. Each condition had access to the same in-game learning supports during gameplay. Results showed that: (a) the stealth assessment estimates of physics understanding were valid—significantly correlating with the external physics test scores; (b) there was no significant effect of game-level delivery method on students' learning; and (c) physics animations were the most effective (among eight supports tested) in predicting both learning outcome and in-game performance (e.g. number of game levels solved). We included student enjoyment, gender and ethnicity in our analyses as moderators to further investigate the research questions.     

Enhancing instructional outcomes with gamification: An empirical test of the Technology-Enhanced Training Effectiveness Model

BackgroundGamification, the use of game elements in non-game contexts, has become a popular technique to improve instructional outcomes in both organizational and educational contexts. In the organizational context, the Technology-Enhanced Training Effectiveness Model [TETEM] provides a framework to understand how technologies, like gamification, can effect change in various instructional outcomes. Specifically, application of TETEM suggests that gamification may not effect change in instructional outcomes when learner attitudes towards game-based learning and experience with video games are low.MethodIn this study, we test this model in the gamification context by assigning potential learners to read scenarios describing gamified instruction or traditional, PowerPoint instruction in a random order and assessing their training valence.ResultsOn average, participants anticipated greater value from gamified instruction, but as predicted by TETEM, this effect was moderated by both video game experience and attitudes towards game-based learning. Among potential learners with high experience and attitudes, gamification produces better outcomes than PowerPoint, but among potential learners with low experience and attitudes, gamification produces worse outcomes than PowerPoint.ImplicationsWe provide empirical support for TETEM and conclude that for gamification to be successful, the attitudes and experience of participants must be assessed and ensured before gamification is implemented.     

Assessing the educational values of digital games

Abstract   In recent years, digital games have assumed an important place in the lives of children and adolescents. Effective content design is crucial to the success of digital game-based learning. Therefore, the tool for assessing the effectiveness of game design is accordingly very important for parents and teachers, so that they may encourage or discourage students to play. The purpose of this study is to develop an assessment tool to examine the educational values of digital games. In the first phase of this research, the research team developed the indices for assessing the educational values of digital games. An expert panel consisting of game scholars and professional game designers was established to construct the indices for evaluating digital games in three focus group discussions. Seventy-four game evaluation indices were sorted into seven categories: mentality change, emotional fulfilment, knowledge enhancement, thinking skill development, interpersonal skill development, spatial ability development and bodily coordination. In the second phase of the research, the game designers were asked to assess certain games by using the 74 indices. Meanwhile, the game scholars were also asked to evaluate the same pool of games by the same indices. The assessments by both the scholars and designers were then compared and the similarities were found. This research provided a preliminary framework for future game designers, parents and teachers in assessing educational values of digital games.     

The effects of computer games on primary school students’ achievement and motivation in geography learning

The implementation of a computer game for learning about geography by primary school students is the focus of this article. Researchers designed and developed a three-dimensional educational computer game. Twenty four students in fourth and fifth grades in a private school in Ankara, Turkey learnt about world continents and countries through this game for three weeks. The effects of the game environment on students’ achievement and motivation and related implementation issues were examined through both quantitative and qualitative methods. An analysis of pre and post achievement tests showed that students made significant learning gains by participating in the game-based learning environment. When comparing their motivations while learning in the game-based learning environment and in their traditional school environment, it was found that students demonstrated statistically significant higher intrinsic motivations and statistically significant lower extrinsic motivations learning in the game-based environment. In addition, they had decreased focus on getting grades and they were more independent while participating in the game-based activities. These positive effects on learning and motivation, and the positive attitudes of students and teachers suggest that computer games can be used as an ICT tool in formal learning environments to support students in effective geography learning.     

Aim,Shoot, Deplete: Playing Video Games Depletes Self-Regulatory Resources

Two experiments investigated whether playing video games impaired subsequent self regulation. In Experiment 1 (n = 43), participants either played a video game (i.e., Quake III) for 10 min or just browsed the Internet for the same time interval. Participants in the video game condition had slower response time than participants in the no-game condition. In Experiment 2 (n = 94), either participants played Quake III, or watched Quake III game scenes, or they were asked to suppress their thought for 10 min. Participants in the game-playing condition and thought suppression condition showed less persistence on a given unsolvable anagram task than participants in the game-watching condition. Overall, the findings confirm the idea that playing video game consumes self-regulatory sources due to active instead of passive responses in a highly demanding game environment.     

Scaffolding game-based learning: Impact on learning achievements,perceived learning,and game experiences

One of the central challenges of integrating game-based learning in school settings is helping learners make the connections between the knowledge learned in the game and the knowledge learned at school, while maintaining a high level of engagement with game narrative and gameplay. The current study evaluated the effect of supplementing a business simulation game with an external conceptual scaffold, which introduces formal knowledge representations, on learners' ability to solve financial-mathematical word problems following the game, and on learners' perceptions regarding learning, flow, and enjoyment in the game. Participants (M_age = 10.10 years) were randomly assigned to three experimental conditions: a “study and play” condition that presented the scaffold first and then the game, a “play and study” condition, and a “play only” condition. Although no significant gains in problem-solving were found following the intervention, learners who studied with the external scaffold before the game performed significantly better in the post-game problem-solving assessment. Adding the external scaffold before the game reduced learners' perceived learning. However, the scaffold did not have a negative impact on reported flow and enjoyment. Flow was found to significantly predict perceived learning and enjoyment. Yet, perceived learning and enjoyment did not predict problem-solving and flow directly predicted problem solving only in the “play and study” condition. We suggest that presenting the scaffold may have “problematized” learners' understandings of the game by connecting them to disciplinary knowledge. Implications for the design of scaffolds for game-based learning are discussed.     

The effect of pedagogical GAME model on students' PISA scientific competencies

The purpose of this study is to explore the effect of a pedagogical model of digital games on students' scientific competencies that are advocated by the Programme for International Student Assessment (PISA). As a single game-based learning strategy may not be enough to enhance such competencies, the online game in the current study incorporated the design of the proposed pedagogical gamification, assessment, modeling, and enquiry (GAME) model. The participants were 69 sixth grade students at one primary school in Taiwan. A quasi-experimental design was adopted. The experimental group students learned with the GAME model, whereas the comparison group students only learned with traditional learning way. The results showed that the learning gain in scientific competencies of the experimental group was better than those of the comparison group. This study revealed that the GAME model has potential to promote students' PISA scientific competencies. It is suggested that the integral GAME model may serve as one kind of strategies to enhance students' scientific competencies.     

Demonstrating the validity of the Video Game Functional Assessment-Revised (VGFA-R)

Problematic video play has been well documented over the course of the last decade. So much so the DSM-5 (APA, 2013) has included problematic video gaming as disorder categorized as Internet Gaming Disorder. The field of applied behavior analysis has been utilizing functional assessments for the last 30 years and has showed evidence of effective results across different populations and environments. Therefore, the purpose of this investigation (comprising three studies) was to validate an indirect functional assessment entitled the Video Game Functional Assessment-Revised (VGFA-R). Using academic experts in the field of video game addiction and applied behavioral analysis (n = 6), the first study examined the content validity of the VGFA-R and was able to demonstrate the assessment exceeded the criterion for an established assessment. A second study comprising a survey of 467 gamers examined the factorability by using a confirmatory factor analysis, and found that VGFA-R had an overall variance above .60. Within the third laboratory-based study using gamers (n = 11), the VGFA-R was examined for construct validity and found the VGFA-R was able to predict 85% of the appropriate function of behavior. Implications of the study are discussed along with the strengths and limitations of the study and future research directions.     

Implementing digital game-based learning in schools: augmented learning environment of ‘Europe 2045’

It is widely agreed that the traditional process of schooling can benefit from the usage of computers as supportive tools. Of various approaches using computers in education over the last decade, e-learning and edutainment have become the most prominent. Recently, a number of authors have criticised these approaches arguing that they conserve traditional ‘drill and practice’ behaviouristic methods of teaching instead of enhancing and augmenting them. It has been proposed that a ‘paradigm shift’ is needed and that this shift may come through utilizing all the advantages of full-fledged video games, so-called digital game-based learning (DGBL). However, several case studies reported serious problems with the DGBL. Among the most notable issues are the lack of acceptance of games as an educational tool, problems with integration of games into formal schooling environments, and the so-called transfer problem, which is the problem of the inherent tension between game play and learning objectives, the tension that mitigates the ability of students to transfer knowledge gained in the video game to the real-world context. Here, we present a framework for an augmented learning environment (ALE), which verbalises one way of how these problems can be challenged. The ALE framework has been constructed based on our experience with the educational game, Europe 2045, which we developed and which has been implemented in a number of secondary schools in the Czech Republic during 2008. The key feature of this game is that it combines principles of on-line multi-player computer games with social, role-playing games. The evaluation which we present in this paper indicates the successful integration of the game and its acceptance by teachers and students. The ALE framework isolates key principles of the game contributing to this success, abstracts them into theoretical entities we call action-based spaces and causal and grounding links, and condenses them in a coherent methodological structure, which paves the way for further exploitation of the DGBL by educational game researchers and designers.     

Gender and player characteristics in video game play of preadolescents

The present study explores the relation among different characteristics of preadolescents and their video game habits and preferences. Specifically, the predictive power of age, gender, and psychological adjustment on time spent playing video games and game preference was explored. Children ages 10–15 were given two surveys: a video game habits survey and the BASC-II self-report assessment of personality. Results confirm previous findings of significant gender differences in both time spent playing video games and game type preference. For preadolescents, males were found to spend more time overall playing video games, but for both males and females time spent playing increased with age. No relation was found between time spent playing video games and negative psychological adjustment, as assessed by the BASC-II. Game type preference was predicted by several psychological characteristics. For example, females’ positive feelings about the self were associated with increased likelihood of electing First Person Shooters as a favored game type, and males’ internalizing difficulties were associated with decreased likelihood of electing Massively Multiplayer Online Role Playing Games (MMORPGs). The current findings confirm previous results with preadolescents, an under-studied age group, and lend novel insight into the psychological processes that contribute to video game preference.     

A survey on cross-discipline of control and game

In recent years, the cross discipline of game theory and the control theory has been emerging. This paperwill survey this newly growing direction. First, the development from optimization of control systems to games consisting of multi-purpose controls is introduced, which demonstrates the close relationship between control theory and game theory. Secondly, the control-oriented game is considered. Three kinds of problems are discussed in details: i) Learning strategy in game theory, which is basically the same as the adaptive control; ii) state space approach for control systems is applied to evolutionary games; and iii)machine-human game is treated as the optimal control problem. Finally, after introducing some new results on potential games, the game-based control is studied. Three kind of control problems using potential games are investigated: i) The consensus of multi-agent systems is considered; ii) the maximization of the distributed coverage of multi-agents on a graph is discussed; and iii) the congestion control is investigated using congestion game technology. Some other game-based control problems are also briefly introduced. A prediction for the control systems in next generation is presented in conclusion.     

Development of a contextual decision-making game for improving students' learning performance in a health education course

Heath education is an important component of the curriculum for fostering children's correct health knowledge and good daily life habits. However, educators have indicated that most children might fail to realize the importance and meaning of health education content owing to the lack of authentic scenarios and daily life experience. With the advancement of computer technologies, researchers have tried to develop multimedia learning content in order to improve students' learning performance. Among various technology-enhanced learning alternatives, digital game-based learning has been recognized as a highly potential approach to motivating students. However, several previous studies have indicated that, without properly incorporating learning content into game scenarios, the effectiveness of digital game-based learning might not be as good as expected in comparison with conventional technology-enhanced learning. In this study, a contextual digital game was developed for improving students' learning performance in an elementary school health education course. A quasi experiment was conducted to evaluate the effectiveness of the proposed approach by situating the experimental group in the game-based learning scenario and the control group to learn with conventional e-books. The experimental results showed that the proposed approach not only improved the students' learning motivation, but also their learning achievement and problem-solving competences. Moreover, the significant two-way interaction suggested that the contextual game-based learning approach benefited the higher motivation students more than the lower motivation ones in terms of the advanced knowledge, showing the importance and potential of applying contextual games to health education activities.     

Educational game design for online education

The use of educational games in learning environments is an increasingly relevant trend. The motivational and immersive traits of game-based learning have been deeply studied in the literature, but the systematic design and implementation of educational games remain an elusive topic. In this study some relevant requirements for the design of educational games in online education are analyzed, and a general game design method that includes adaptation and assessment features is proposed. Finally, a particular implementation of that design is described in light of its applicability to other implementations and environments.     

Challenging games help students learn: An empirical study on engagement,flow and immersion in game-based learning

In this paper, we investigate the impact of flow (operationalized as heightened challenge and skill), engagement, and immersion on learning in game-based learning environments. The data was gathered through a survey from players (N = 173) of two learning games (Quantum Spectre: N = 134 and Spumone: N = 40). The results show that engagement in the game has a clear positive effect on learning, however, we did not find a significant effect between immersion in the game and learning. Challenge of the game had a positive effect on learning both directly and via the increased engagement. Being skilled in the game did not affect learning directly but by increasing engagement in the game. Both the challenge of the game and being skilled in the game had a positive effect on both being engaged and immersed in the game. The challenge in the game was an especially strong predictor of learning outcomes. For the design of educational games, the results suggest that the challenge of the game should be able to keep up with the learners growing abilities and learning in order to endorse continued learning in game-based learning environments.