An implementation of design-based learning through creating educational computer games: A case study on mathematics learning during design and computing

This mixed-method case study examined the potential of computer-assisted, math game making activities in facilitating design-based math learning for school children. Sixty-four middle school children participated in Scratch-based, math game making activities. Data were collected via activity and conversation observation, artifact analysis, interviewing, and survey. The study findings indicated that participants developed significantly more positive dispositions toward mathematics after computer game making. The study also found that experience-driven game design processes helped to activate children's reflection on everyday mathematical experiences. Mathematical thinking and content experience were intertwined within the process of computer game authoring. On the other hand, children designers were involved in game-world and story crafting more than mathematical representation. And it was still challenging for them to perform computer game coding with abstract reasoning.     

The effectiveness of adaptive versus non-adaptive learning with digital educational games

For the training of academic skills, digital educational games with integrated adaptivity are promising. Adaptive games are considered superior to non-adaptive games, because they constantly assess children's performance, and accordingly adapt the difficulty of the tasks corresponding to the children's individual level. However, empirical evidence with regard to the effectivity of adaptive compared to non-adaptive games is limited. A study was conducted with 191 children from the third year of Kinder garten who were enrolled in one of three conditions, that is, playing an adaptive version of the reading game (RG), a non-adaptive version of the RG or training with pen-and-paper exercises. In all three conditions, children trained emergent reading (phonological awareness and letter knowledge) once a week for 30 min over a period of 5 weeks. Children's performance on cognitive (phonological awareness, letter knowledge, reading fluency) and non-cognitive (motivation, self-concept) factors was assessed. Results revealed a significant improvement in phonological awareness and letter knowledge in all conditions. However, no differences between the conditions were observed with respect to children's improvement on phonological awareness and letter knowledge or on their post-test scores for reading fluency. With regard to motivation and self-concept, again, no differences in these non-cognitive factors were observed across conditions.     

An examination of children's learning progression shifts while using touch screen virtual manipulative mathematics apps

The purpose of this study was to examine shifts in young children's learning progression levels while they interacted with virtual manipulative mathematics apps on touch-screen devices. A total of 100 children participated in six mathematics learning sequences while using 18 virtual manipulative mathematics touch-screen apps during clinical interviews. Researchers developed a micro-scoring tool to analyze video data from two camera sources (i.e., GoPro camera, wall-mounted camera). Our results showed that it is possible to document evidence of shifts in children's learning progressions while they are interacting with mathematics apps on touch-screen devices. Our results also indicated patterns in the children's interactions that were related to the shifts in their learning progression levels. These results suggest that an open-ended number of tasks with a variety of representations and tasks at varying levels of difficulty led to children refining their understanding and shaping their concept image of mathematical ideas resulting in incremental shifts in learning. The results of this study have important implications about how mathematical tasks in touch-screen apps may prompt children's incremental learning progression shifts to occur, and thereby promote opportunities for learning. We propose that design features in mathematics apps can be created to support and encourage these learning shifts.     

Children's engagement during digital game-based learning of reading: The effects of time,rewards, and challenge

This study investigated the effects of two game features (the level of challenge and the reward system) on first and second graders' engagement during digital game-based learning of reading. We were particularly interested in determining how well these features managed to maintain children's engagement over the 8-week training period. The children (N = 138) used GraphoGame, a web-based game training letter–sound connections, at home under the supervision of parents. Data regarding the children's gaming and engagement were stored on the GraphoGame online server. A 2 × 2 factorial design was used to investigate the effects of the level of challenge (high challenge vs. high success) and the presence of the reward system (present vs. absent). Children's engagement was measured by session frequency and duration and through an in-game self-report survey that was presented at the end of the each session. According to the results, the children enjoyed GraphoGame but used it less frequently than expected. The reward system seemed to encourage the children to play longer sessions at the beginning of the training period, but this effect vanished after a few sessions. The level of challenge had no significant effect on children's engagement. The results suggest a need to investigate further the effectiveness of various game features in maintaining learner's engagement until the goals set for learning are achieved.     

Assessing implicit science learning in digital games

Building on the promise shown in game-based learning research, this paper explores methods for Game-Based Learning Assessments (GBLA) using a variety of educational data mining techniques (EDM). GBLA research examines patterns of behaviors evident in game data logs for the measurement of implicit learning—the development of unarticulated knowledge that is not yet expressible on a test or formal assessment. This paper reports on the study of two digital games showing how the combination of human coding with EDM has enabled researchers to measure implicit learning of Physics. In the game Impulse, researchers combined human coding of video with educational data mining to create a set of automated detectors of students' implicit understanding of Newtonian mechanics. For Quantum Spectre, an optics puzzle game, human coding of Interaction Networks was used to identify common student errors. Findings show that several of our measures of student implicit learning within these games were significantly correlated with improvements in external postassessments. Methods and detailed findings were different for each type of game. These results suggest GBLA shows promise for future work such as adaptive games and in-class, data-driven formative assessments, but design of the assessment mechanics must be carefully crafted for each game.     

Development of a contextual decision-making game for improving students' learning performance in a health education course

Heath education is an important component of the curriculum for fostering children's correct health knowledge and good daily life habits. However, educators have indicated that most children might fail to realize the importance and meaning of health education content owing to the lack of authentic scenarios and daily life experience. With the advancement of computer technologies, researchers have tried to develop multimedia learning content in order to improve students' learning performance. Among various technology-enhanced learning alternatives, digital game-based learning has been recognized as a highly potential approach to motivating students. However, several previous studies have indicated that, without properly incorporating learning content into game scenarios, the effectiveness of digital game-based learning might not be as good as expected in comparison with conventional technology-enhanced learning. In this study, a contextual digital game was developed for improving students' learning performance in an elementary school health education course. A quasi experiment was conducted to evaluate the effectiveness of the proposed approach by situating the experimental group in the game-based learning scenario and the control group to learn with conventional e-books. The experimental results showed that the proposed approach not only improved the students' learning motivation, but also their learning achievement and problem-solving competences. Moreover, the significant two-way interaction suggested that the contextual game-based learning approach benefited the higher motivation students more than the lower motivation ones in terms of the advanced knowledge, showing the importance and potential of applying contextual games to health education activities.     

Computer support for learning mathematics: A learning environment based on recreational learning objects

In this paper, we introduce an electronic collaborative learning environment based on Interactive Instructors of Recreational Mathematics (IIRM), establishing an alternative approach for motivating students towards mathematics. The IIRM are educational software components, specializing in mathematical concepts, presented through recreational mathematics, conceived as interactive, recreation-oriented learning objects, integrated within the environment. We present the architecture of the learning environment which integrates communication services that support the interaction processes of the learning community, through instant messaging, chat rooms, and multi-player math games. Through the environment’s interface of their personal workspace, students have access to several easy-to-use mechanisms that allows them to customize its content, its layout, and its appearance. At internal levels, the functionality of IIRM is enhanced with features supported by the environment infrastructure. We evaluated different aspects of the learning environment in three short, motivation-oriented math courses given to Mexican high-school students. The results indicate that the use of the IIRM-based electronic learning environment, positively affects student attitudes towards mathematics. We believe that this approach has the potential to promote the mathematics learning process, basically on its motivational aspects.     

Digital game-based learning in a Shanghai primary-school mathematics class: A case study

This study examined the perceptions and experiences of a teacher and students in a Shanghai public primary school when digital games were used in a second-grade math class. The participants included one teacher and 45 students. Data collection methods included classroom observation, focus-group and individual interviews, and document analysis. Digital gameplay, when used once daily over a 6-day period, was found to enhance student engagement and interest in learning; many students, however, were concerned about its effect on academic achievement and eyesight. The teacher employed a “making thinking visible” approach using pencil and paper and problem-solving strategies to help students understand the game's mathematical principles and master mathematical knowledge. Obstacles included large class size, difficulty evaluating learning outcomes, balancing fun and learning, and effective game–classroom integration. This study found that exam-oriented education and traditional teacher-centred teaching in China influenced participants' perceptions and experiences of digital game-based learning.     

Entering Aladdin's cave: Developing an app for children with Down syndrome

Tablets have much to offer children with learning difficulties, but evidence of their effectiveness to teach academic skills is limited and cannot be easily separated from the quality of the software. This paper analyses data from 3 iterative cycles of designing an app for children with Down syndrome to support their awareness of quantity through an inclusive game. Research with neurotypical children suggests that representation of quantity (or magnitude) is an area with considerable potential in supporting the foundations for children's mathematical learning. It has received little attention as an aspect for intervention for children with Down syndrome. Data collected in this study illustrate the need to carefully align the game mechanic to the target skills, strengthen levels of access, and introduce gradations of attentional demand. They also signal the interrelationship between children's cognitive and affective responses to the game, making it essential to find the optimal level of challenge. Children's strategies in response to mistakes indicate the importance of creating an agile responsive system. The data also suggest that developers routinely extend the number of features that are optional, enabling a greater level of personalization and a more inclusive game.     

World of Warcraft and the impact of game culture and play in an undergraduate game design course

During the past two decades, digital games have become an increasingly popular source of study for academics, educational researchers and instructional designers. Much has been written about the potential of games for teaching and learning, both in the design of educational/serious games and the implementation of off-the-shelf games for learning. Yet relatively little research has been conducted about how game culture and the enmeshed practice of play may impact classroom dynamics. The purpose of this study is to present a case study about how the use of World of Warcraft (WoW) as a teaching tool and medium of play impacted class dynamics in an undergraduate university-level course for game design. Specifically, this study will address how WoW’s game culture and the practice of play impacted (a) student-to-student dynamics and (b) class dynamics. The goal of this study is to explore some of the dynamics of play as a component of learning.     

The development of situational interest during a digital mathematics game

The present study focused on 212 fifth graders' situational interest trajectories during an intervention with a digital mathematics game called Number Navigation. Our aims were to explore the development of situational interest whilst playing the game and to investigate the relationship between situational interest and individual math interest. Growth mixture model analyses showed that in the whole sample situational interest was stable within sessions but decreased across sessions. Three different situational interest trajectories were found. Situational interest trajectories were predicted by pre‐test individual interest. In turn, situational interest had an effect on post‐test individual interest. Students whose situational interest trajectories were stable (either high or low) presented no changes in individual interest, yet the individual interest of students whose situational interest was triggered but not maintained markedly decreased from pre‐test to post‐test. Results suggest that it is important to use game‐based learning not because games are believed to be “motivating”; rather, games with proven learning outcomes should be carefully selected.     

How teachers integrate a math computer game: Professional development use,teaching practices,and student achievement

As more attention is placed on designing digital educational games to align with schools' academic aims (e.g., Common Core), questions arise regarding how professional development (PD) may support teachers' using games for instruction and how such integration might impact students' achievement. This study seeks to (a) understand how teachers use PD resources (e.g., technology personnel and game‐use workshops) for integration; (b) determine how teachers integrate games into their instruction; and (c) examine how those teaching practices are associated with student achievement. This mixed method study used survey and interview responses from elementary school teachers (n = 863) with access to PD resources for implementing a math game intervention and standardized math‐test scores from their second‐ through sixth‐grade students (n = 10,715). Findings showed few teachers sought PD assistance for integration, but many desired such support. Some reported using integrative practices (i.e., referencing game and using game‐generated progress reports) to identify struggling students, whereas several found integration challenging. Teachers' reordering of game objectives to align with lessons and viewing of game‐based PD videos were associated with increased student math achievement in our OLS‐analysis. However, this result was no longer statistically significant within a school fixed‐effects model, suggesting school differences may influence how strongly teachers' practices are associated with student achievement.     

A case study of computer gaming for math: Engaged learning from gameplay?

Employing mixed-method approach, this case study examined the in situ use of educational computer games in a summer math program to facilitate 4th and 5th graders’ cognitive math achievement, metacognitive awareness, and positive attitudes toward math learning. The results indicated that students developed more positive attitudes toward math learning through five-week computer math gaming, but there was no significant effect of computer gaming on students’ cognitive test performance or metacognitive awareness development. The in-field observation and students’ think-aloud protocol informed that not every computer math drill game would engage children in committed learning. The study findings have highlighted the value of situating learning activities within the game story, making games pleasantly challenging, scaffolding reflections, and designing suitable off-computer activities.     

‘I'm a completely different person at home’: using digital technologies to connect learning between home and school

This paper reports on a qualitative study exploring children's, parents', and teachers' experiences of communication between home and school and connections between children's learning at school and home in order to consider how using digital technologies to mediate the home–school relationship might support children's learning. Parents, teachers, and children welcomed the idea of using digital technologies to communicate between home and school, hoping that more timely communication could avoid problems at school. There were few connections between learning at home and in school; participants saw school and home as separate domains and the boundaries between the two were strongly maintained. It is argued that for connections to be made between learning at home and in school, elements of both need to be drawn together in a space in which both are valued, and that digital technologies could support the creation of such virtual third spaces.     

Goal setting outcomes: Examining the role of goal interaction in influencing the experience and learning outcomes of video game play for earthquake preparedness

Video game goals are important features of video games. Player’s interaction with goals can not only shape the gaming experience by evoking cognitive and affective reactions in players, but also lead to learning outcomes. However, there are few empirical studies on the effects of interacting with game goals, and no previous research has manipulated goal setting. In two experimental studies, participants were randomly assigned to one of the following five conditions: self-set goal repetitive play, assigned goal repetitive play, no-set goal repetitive play, no-set goal single play, and no play. Results show that playing earthquake preparedness video games generates significant learning outcomes; playing repeatedly with self-set goals yields greater learning compared to playing once with no-set goals or not playing; and cognitive reactions mediates the relation between goal interaction and learning. Implications of the results for the design and evaluation of future video games for learning are explored.     

Serious games and learning effectiveness: The case of It’s a Deal!

Although the value of serious games in education is undeniable and the potential benefits of using video games as ideal companions to classroom instruction is unquestionable, there is still little consensus on the game features supporting learning effectiveness, the process by which games engage learners, and the types of learning outcomes that can be achieved through game play. Our aim in this discussion is precisely to advance in this direction by providing evidence of some of the factors influencing the learning effectiveness of a serious game called It’s a Deal! This serious game was created for the purpose of teaching intercultural business communication between Spaniards and Britons in business settings in which English is used as the lingua franca. This paper hypothesizes that the immersive, all-embracing and interactive learning environment provided by the video game to its users may contribute to develop and enhance their intercultural communicative competence. The study attempts to answer three main research questions: (a) after playing It’s a Deal!, did the students sampled improve their intercultural awareness, intercultural knowledge and intercultural communicative competence in business English? (b) If they improved their intercultural learning, what are the factors influencing such improvement? And (c) if they did not improve their intercultural learning, what are the factors influencing such failure? The game participants who volunteered to take part in the study were all students of English Studies at the University of Alicante in the academic year 2010-2011. One hundred and six students completed both the pre-test and the post-test questionnaires, and played It’s a Deal! A sample of fifty students was selected randomly for the empirical study. The results obtained in the tests performed were compared and contrasted intra-group, both qualitatively and quantitatively, for the purpose of finding any statistically significant difference that may confirm whether or not there was an improvement in the students’ intercultural communicative competence in business English as a result of the implementation of the It’s a Deal! serious game. Findings of this study demonstrate that the video game is an effective learning tool for the teaching of intercultural communication between Spaniards and Britons in business settings in which English is used as the lingua franca. In particular, whereas the game had a small learning effect on intercultural awareness and a medium learning effect on intercultural knowledge, it had a large learning effect on intercultural communicative competence. The study also documents correlating factors that make serious games effective, since it shows that the learning effectiveness of It’s a Deal! stems from the correct balance of the different dimensions involved in the creation of serious games, specifically instructional content, game dimensions, game cycle, debriefing, perceived educational value, transfer of learnt skills and intrinsic motivation.     

Participatory evaluation of an educational game for social skills acquisition

This paper reports a study conducted to formally evaluate a social problem-solving skills game during the start of the development to ensure that the desired game attributes were successfully embodied in the final game. Two methods, heuristic evaluation and participatory design, were adopted to assess whether the features of the game pose playability issues to the prospective young users and to translate the participants' contributions into game design directions. The participants playtested and evaluated the game based on the Pedagogical Playability Heuristics, which are different from existing heuristics developed for commercial games, as priority was placed on instructional design principles and the concept of playability. Using storyboarding, they built low-fidelity prototypes of the game. Suitable children's design and feedback on the games attributes that would bring about stimulation, connecting instructions to goals, appropriate challenge and influencing goal achievement were integrated into the game design. As a consequence of the study, steps were taken to improve the game as an interactive system to achieve the instructional goals and at the same time foster enjoyment among the users.     

Ubiquitous games for learning (UbiqGames): Weatherlings,a worked example

This paper provides a rationale for a class of mobile, casual, and educational games, which we call UbiqGames. The study is motivated by the desire to understand how students use educational games in light of additional distractions on their devices, and how game design can make those games appealing, educationally useful, and practical. In particular, we explain the choices made to build an engaging and educational first example of this line of games, namely Weatherlings. Further, we report results from a pilot study with 20 students that suggest that students are engaged by the game and are interested in learning more about academic content topics, specifically weather and climate, after playing the game. Research should continue to determine whether Weatherlings specifically does increase learning in these areas, and more generally to determine whether any learning gains and similar results with regard to engagement can be replicated in other content areas following the general model for game design.     

Enjoy and learn with educational games: Examining factors affecting learning performance

Educational games have enhanced the value of instruction procedures in institutions and business organizations. Factors that increase students' adoption of learning games have been widely studied in past; however, the effect of these factors on learners' performance is yet to be explored. In this study, factors of Enjoyment, Happiness, and Intention to Use were chosen as important attitudes in learning educational games and increasing learning performance. A two-step between group experiment was conducted: the first study compared game-based learning and traditional instruction in order to verify the value of the game. 41 Gymnasium (middle school) students were involved, and the control and experimental groups were formed based on a pretest method. The second study, involving 46 Gymnasium students, empirically evaluates whether and how certain attitudinal factors affect learners' performance. The results of the two-part experiment showed that a) the game demonstrated good performance (as compared to traditional instruction) concerning the gain of knowledge, b) learners' enjoyment of the game has a significant relation with their performance, and c) learners' intention to use and happiness with the game do not have any relation with their performance. Our results suggest that there are attitudinal factors affecting knowledge acquisition gained by a game.     

Play and learning in the digital future

Video games are vastly improved; they include embedded computers and new, improved expressions in graphics and music. Soon games and toys will become communication tools that connect with one another through internal embedded technology. Eventual convergence of the visual cyber community and the physical world would let users move toward a new stage of play and a new way of learning. Developing the future digital toys and games so that the toys and their users work in a harmonious way is a task with far-reaching implications for everyone involved in the learning process, but especially for children. In this effort, the Toys of Tomorrow consortium at the MIT Media Laboratory is researching children's play and learning. Here, we comment briefly on the increasingly profitable and influential game and entertainment industry, introduce the various MIT research projects, and discuss how we expect their results to affect our world and enhance the learning process