Mobile learning vs. traditional classroom lessons: a comparative study

Different methods can be used for learning, and they can be compared in several aspects, especially those related to learning outcomes. In this paper, we present a study in order to compare the learning effectiveness and satisfaction of children using an iPhone game for learning the water cycle vs. the traditional classroom lesson. The iPhone game includes multiple interaction forms and combined augmented reality (AR) mini‐games with non‐AR mini‐games. The traditional classroom lesson had the same learning content as the iPhone game. Thirty‐eight children participated in the study. The analyses showed that the children made significant learning gains about the water cycle, regardless of the method used. Even though the results showed that the iPhone method achieved higher knowledge results than the traditional classroom lesson, no statistically significant differences were found between the iPhone and the classroom lesson. When analysing the motivational outcomes, the results showed that the children found the iPhone game to be more satisfying than the classroom lessons. Since the iPhone game achieved similar learning results and a higher motivational effect than the classroom lesson, this suggests that games of this kind could be used as a tool in primary schools to reinforce students' lessons.     

Evaluation of learning outcomes using an educational iPhone game vs. traditional game

In this paper, we present an initial study to determine the subject preferences for educational computer games for children, in which 150 education professionals participated. From the results of this first study, we have developed an iPhone game for transmitting knowledge as part of multiculturalism, solidarity and tolerance following established learning theories, several design principles, and the objectives and competences of the Spanish law for primary education. We also report on a second study to determine whether the iPhone game has better learning outcomes than a traditional game by analyzing the participation of 84 children ranging in age from 8 to 10 years old. The frequency of playing with consoles or computer games was also taken into account in this second study, and the worldwide trend of previous studies has been corroborated. For learning outcomes, the results did not show significant differences between the two groups. However, 96% of the children indicated that they would like to play with the iPhone game again, and 90% indicated that they preferred the experience with the iPhone game over the traditional one. From these results, we can conclude that the children achieved similar knowledge improvements using both the autonomous game (iPhone game) and the custom, guided game (traditional game). This could facilitate versatility in the learning process since the learning activity could be performed at any place and time without requiring supervision. Therefore, it could be a useful tool in the learning process and help teachers to fulfill students' training needs.     

The effectiveness of adaptive versus non-adaptive learning with digital educational games

For the training of academic skills, digital educational games with integrated adaptivity are promising. Adaptive games are considered superior to non-adaptive games, because they constantly assess children's performance, and accordingly adapt the difficulty of the tasks corresponding to the children's individual level. However, empirical evidence with regard to the effectivity of adaptive compared to non-adaptive games is limited. A study was conducted with 191 children from the third year of Kinder garten who were enrolled in one of three conditions, that is, playing an adaptive version of the reading game (RG), a non-adaptive version of the RG or training with pen-and-paper exercises. In all three conditions, children trained emergent reading (phonological awareness and letter knowledge) once a week for 30 min over a period of 5 weeks. Children's performance on cognitive (phonological awareness, letter knowledge, reading fluency) and non-cognitive (motivation, self-concept) factors was assessed. Results revealed a significant improvement in phonological awareness and letter knowledge in all conditions. However, no differences between the conditions were observed with respect to children's improvement on phonological awareness and letter knowledge or on their post-test scores for reading fluency. With regard to motivation and self-concept, again, no differences in these non-cognitive factors were observed across conditions.     

A mixed methods assessment of students' flow experiences during a mobile augmented reality science game

Current studies have reported that secondary students are highly engaged while playing mobile augmented reality (AR) learning games. Some researchers have posited that players' engagement may indicate a flow experience, but no research results have confirmed this hypothesis with vision‐based AR learning games. This study investigated factors related to students' engagement – as characterized by flow theory – during a collaborative AR, forensic science mystery game using mobile devices. School Scene Investigators: The Case of the Stolen Score Sheets is a vision‐based AR game played inside the school environment with Quick Response codes. A mixed methods approach was employed with 68 urban middle school students. Data sources included pre‐ and post‐surveys, field observations and group interviews. Results showed that neither gender nor interest in science was an important predictor of variability in flow experience. Gaming attitude uniquely predicted 23% of the variance in flow experience. Student flow experience features included a flash of intensity, a sense of discovery and the desire for higher performance. The findings demonstrated a potential for mobile AR science games to increase science interest and help students learn collaboration skills. Implications for future research concerning mobile AR science games are discussed.     

Exploring students’ behaviors in a competition-driven educational game

Educational mini-games, one of the applications of game-based learning, have been widely used to benefit student learning. However, few studies have examined the influence of competition-driven educational games on students’ behaviors, which might offer insights into how to develop well-designed educational games. Thus, this study discusses a Pet-Master system, as an example of a competition-driven educational game, in an investigation of students’ behaviors through both event-based and time-based analysis. Two empirical studies were conducted using the two types of analysis. The results of the event-based analysis indicated that the behaviors can be categorized into two parts: competition-driven and learning cycles. Evidence from the time-based analysis showed that the two behavior cycles appeared in an alternating way with a lower transition frequency. Based on the results we develop a design framework for competition-driven educational games, which illustrates the relationship among the social, learning, and gameplay dimensions. The framework and its application might serve to optimize learning outcomes and influence the way games are designed in order to maximize educational benefits in the future.     

Connecting the dots: Understanding the interrelated impacts of type,quality and children's awareness of design features and the mathematics content learning goals in digital math games and related learning outcomes

This study focused on an examination of how type, quality and children's awareness of design features in digital math games, along with an awareness of the mathematics goals of the game, were related to learning outcomes. We conducted a parallel conversion mixed methods study with 45 students in Grades 3 and 4 (ages 9–10). Students participated in clinical interviews using three digital math games. The results suggest a moderated mediation relationship in which the quality of the design features moderated the mediating impact of children's awareness of the game's design features, specifically when the child was aware of the mathematics content learning goal (MCLG) of the game. These findings show how important it is that design features are of high quality in a digital math game, and how this is intertwined with children's awareness of the features and the MCLG. When these variables intertwined in just the right way, the interactions between the children and the digital math game afforded mathematical learning growth.     

A comparative study using an autostereoscopic display with augmented and virtual reality

Advances in display devices are facilitating the integration of stereoscopic visualisation in our daily lives. However, autostereoscopic visualisation has not been extensively exploited. In this paper, we present a system that combines augmented reality (AR) and autostereoscopic visualisation. We also present the first study that compares different aspects using an autostereoscopic display with AR and virtual reality (VR), in which 39 children from 8 to 10 years old participated. In our study, no statistically significant differences were found between AR and VR. However, the scores were very high in nearly all of the questions, and the children also scored the AR version higher in all cases. Moreover, the children explicitly preferred the AR version (81%). For the AR version, a strong and significant correlation was found between the use of the autostereoscopic screen in games and seeing the virtual object on the marker. For the VR version, two strong and significant correlations were found. The first correlation was between the ease of play and the use of the rotatory controller. The second correlation was between depth perception and the game global score. Therefore, the combinations of AR and VR with autostereoscopic visualisation are possibilities for developing edutainment systems for children.     

An inclusive design approach for developing video games for children with Autism Spectrum Disorder

The efficacy of therapeutic treatments for Autism Spectrum Disorder is mainly associated with the treatment's intensity in terms of weekly hours. This has led mental health professionals to explore the use of video games to complement traditional treatments. However, major weaknesses have been found due to poor game design, which has failed to fulfill therapeutic objectives or to properly engage children. These weaknesses are typically characterized by the poor integration of knowledge from mental health experts, children's interests and designers' expertise. Starting from this necessity, we propose an inclusive design approach to develop therapeutic games. The method presents strategies to integrate the expertise of clinicians, contributions of children and experience of designers through a set of elicitation and merging techniques. The goal of this method is to design games that are effective in terms of therapeutic objectives and that are enjoyable for children. To describe this method, we present its application in the design and development of a Kinect-based game for high-functioning children with ASD called “Pico's Adventures”. This game aims at promoting social initiation in young children with autism. Findings from a first exploratory study with 10 children with ASD showed the effectiveness of the game in eliciting social initiation behaviors. This provides a first validation of the method. An essential aspect of the game's success was the use of elements and mechanics that were appealing for the children. As a result, we have identified effective design concepts and paths for further research on games for children with ASD.     

Participatory evaluation of an educational game for social skills acquisition

This paper reports a study conducted to formally evaluate a social problem-solving skills game during the start of the development to ensure that the desired game attributes were successfully embodied in the final game. Two methods, heuristic evaluation and participatory design, were adopted to assess whether the features of the game pose playability issues to the prospective young users and to translate the participants' contributions into game design directions. The participants playtested and evaluated the game based on the Pedagogical Playability Heuristics, which are different from existing heuristics developed for commercial games, as priority was placed on instructional design principles and the concept of playability. Using storyboarding, they built low-fidelity prototypes of the game. Suitable children's design and feedback on the games attributes that would bring about stimulation, connecting instructions to goals, appropriate challenge and influencing goal achievement were integrated into the game design. As a consequence of the study, steps were taken to improve the game as an interactive system to achieve the instructional goals and at the same time foster enjoyment among the users.     

Are educational computer micro-games engaging and effective for knowledge acquisition at high-schools? A quasi-experimental study

Curricular schooling can benefit from the usage of educational computer games, but it is difficult to integrate them in the formal schooling system. Here, we investigate one possible approach to this integration, which capitalizes on using a micro-game that can be played with a teacher’s guidance as a supplement after a traditional expository lecture followed by a debriefing. The game’s purpose is to reinforce and integrate part of the knowledge learnt during the lecture. We investigated feasibility of this approach in a quasi-experimental study in 70 min long seminars on the topic of animal learning at 5 classes at 4 different high-schools in the Czech Republic. Each class was divided to two groups randomly. After an expository lecture, the game group played a game called Orbis Pictus Bestialis while the control group received an extra lecture that used media-rich materials. The time allotment was the same in both groups. We investigated the immediate and one month delayed effects of the game on students’ knowledge reinforced and integrated by the game as well as on knowledge learnt during the expository lecture but not strengthened by the game. We also investigated students’ overall appeal towards the seminar and its perceived educational value. Data from 100 students were analysed. The results showed that a) the game-playing is comparable to the traditional form of teaching concerning immediate knowledge gains and has a significant medium positive effect size regarding retention, b) the game-playing is not detrimental to information transmitted in the expository lecture but not strengthened by the game, c) perceived educational value and the overall appeal were high in the game group, nevertheless the perceived educational value was slightly lower in the game group comparing to the traditional group. Our results suggest that the proposed approach of harnessing educational computer games at high-schools is promising.     

Computer games that exercise cognitive skills: What makes them engaging for children?

This paper stems from a mixed-methods study in which we scientifically tested 15 computer games to investigate their suitability for cognitive training. After determining which cognitive functions are utilized while playing these games, we were able to relate schoolchildren's game performance to their cognitive abilities (e.g., executive functioning, perception, memory). As a continuation, we sought to identify the factors that lead to greater engagement in games, such as children's age, gender, and cognitive skills, as well as game genres and features. Forty-one children played 15 computer games, each three times, under the scrutiny of two raters who completed an observational scale for each game. This scale was constructed as a reliable measure of engagement, comprising factors such as enjoyment, frustration, and effort. The data were analyzed using correlations and content analyses. The results indicated that game performance increased with greater levels of engagement and that games involving planning and problem solving tended to be too difficult for younger children. The findings of this study are informative for psychologists, educators, as well as game designers, and can be used to recommend engaging and beneficial games for children.     

A method of two-handed gesture interactions with applications based on commodity devices

Recent progress on human–computer interface technology has enabled more intuitive and natural communications between humans and sensor-based devices in many fields such as games, e-learning, augmented reality (AR), and medical image processing. While traditional human–computer interface devices such as the keyboard and mouse still dominate in our daily life, we propose a new method of two-handed gesture interactions to control applications based on commodity devices such as Wiimote, the primary controller for Nintendo’s Wii game console. Our main goal is to construct a unified way to interact with computers and their application systems just like using home appliances. The proposed system allows users to track their fingers moving in three-dimensional space in real time and define each gesture’s function by using the commodity devices.     

Lightweight graphics instrumentation for game state-specific power management in Android

Battery life is a major concern on portable devices like smartphones and tablet PCs. On these devices, games constitute the class of most popular applications and are at the same time highly compute-intensive. Every game consists of several states like the loading, main menu and the gaming state. Each of those states has its own workload characteristics, e.g., the loading phase is likely to be memory bound and the main menu state is less interactive than the gaming state. We propose an interception technique that allows to profile the game and detect its current state based on the game’s communication with the underlying OS. Current power management governors are unaware of the running applications and scale the processor’s voltage and frequency merely based on the system’s utilization. We provide the game’s state information and workload profile to our governor which selects the processing frequency such that the desired frame rate of the current state is ensured. This leads to an optimal choice of processing frequencies and thereby significantly reduces power consumption. We have implemented the scheme on an Android-based Samsung Galaxy Nexus smartphone using popular games like Jetpack Joyride and Temple Run. We reduced the CPU’s power consumption by up to 43.2 % compared to the Android interactive governor without impacting the gaming experience. Motivated by these results we propose a power management API that would allow game developers to significantly reduce the power consumption of their game using simple API calls.     

Using augmented reality to support a software editing course for college students

This study aimed to explore whether integrating augmented reality (AR) techniques could support a software editing course and to examine the different learning effects for students using online‐based and AR‐based blended learning strategies. The researcher adopted a comparative research approach with a total of 103 college students participating in the study. The experimental group (E.G.) learned with the AR‐based contents, while the control group (C.G.) learned with the online‐based support. The findings demonstrated the potential of AR techniques for supporting students' learning motivation and peer learning interaction, and the AR‐based contents could be used as scaffolding to better support blended learning strategies. The AR‐based learning interaction could also be a trigger arousing learners' interest in becoming active learners and the students presented great learning involvement after the AR‐based supports were removed, while the learners in the C.G. were passive once the supports had been removed. Moreover, it was found that (1) their lack of experience with AR interaction and applications, (2) the slow speed of the Internet in the school, (3) the affordances of each learner's mobile learning devices, (4) the screen size of the learning interface and (5) the overloading of the learning information from the AR contents and teacher lectures might be the reasons why the learners were still more used to the online‐based support. It was therefore concluded that when integrating AR applications into a course, technology educational researchers should take into careful consideration the target learning content design, the amount of information displayed on the mobile screen and the affordances of the learning equipment and classroom environment so as to achieve a suitable learning scenario.     

The effectiveness of adaptive difficulty adjustments on students' motivation and learning in an educational computer game

Computer games that adaptively adjust difficulty are used to continuously challenge players according to their abilities. The adjustment of difficulty occurs automatically in response to a game's ongoing assessment of a player's performance. This approach to difficulty adjustment is likely to be of value in educational computer games as a means of scaffolding learning for students. However, there is limited research evaluating the effectiveness of educational computer games with adaptive difficulty adjustment when compared to non-adaptive difficulty adjustment. To expand on this research a quasi-experimental study was designed to isolate the impact of the difficulty adjustment game element on motivation and learning. A total of 234 secondary school students were allocated to one of three activities involving learning about Spanish cognates: an adaptive difficulty adjustment game, an incremental difficulty adjustment game that was non-adaptive, and a written activity. The three learning activities were designed following the same learning and motivation theories. The two games were identical apart from the difficulty adjustment mechanism. The results for motivation indicated that all students experienced high levels and there was no significant difference between the three learning activities. The pre- and post-tests results for learning indicated that significantly higher learning outcomes were achieved by students who played the adaptive game. Analysis of a game log recording the correctness of students' responses indicated that the adaptive difficulty adjustment game, in contrast to the non-adaptive incremental difficulty adjustment game, provided a scaffolding structure to enhance student learning.     

Effects of Interactivity in Educational Games: A Mediating Role of Social Presence on Learning Outcomes

Networked interactivity is one of the essential factors that differentiate recent online educational games from traditional stand-alone CD-based games. Despite the growing popularity of online educational games, empirical studies about the effects of networked interactivity are relatively rare. The current study tests the effects of networked interactivity on game users' learning outcomes by comparing three groups (online educational quiz game vs. off-line educational quiz game vs. traditional classroom lecture). In addition, the study examines the mediating role of social presence in the context of educational games. Results indicate that networked interactivity in the online educational quiz game condition enhances game users' positive evaluation of learning, test performance, and feelings of social presence. However, there was no significant difference between the off-line educational quiz game and the lecture-based conditions in terms of learning outcomes. Further analyses indicate that feelings of social presence mediate the effect of networked interactivity on various learning outcomes. Theoretical and practical implications are discussed.     

Bombs, fish, and coral reefs

Often, the way subject matter is included in educational games does not fully utilize or sometimes even inhibits the full learning potential of games. This paper argues that in order to optimally use the potential of games for learning, games should be endogenous. An endogenous educational game is a game where the educational content is integrated in the game play mechanics themselves, rather than bolted-on using explicit messages. This research examines the relation between explicit messages, explorative game behavior, and comprehension by developing two versions of an endogenous educational game about overfishing, one with and one without an explicit purpose. The game was tested with 13 children aged 8 to 11. The results indicate that factual knowledge and comprehension is increased with explicit messages, and in particular deep comprehension is fostered by explorative game behavior. This confirms the plea for endogenous games to teach about bombs, fish, coral reefs, and more.     

Assessing implicit science learning in digital games

Building on the promise shown in game-based learning research, this paper explores methods for Game-Based Learning Assessments (GBLA) using a variety of educational data mining techniques (EDM). GBLA research examines patterns of behaviors evident in game data logs for the measurement of implicit learning—the development of unarticulated knowledge that is not yet expressible on a test or formal assessment. This paper reports on the study of two digital games showing how the combination of human coding with EDM has enabled researchers to measure implicit learning of Physics. In the game Impulse, researchers combined human coding of video with educational data mining to create a set of automated detectors of students' implicit understanding of Newtonian mechanics. For Quantum Spectre, an optics puzzle game, human coding of Interaction Networks was used to identify common student errors. Findings show that several of our measures of student implicit learning within these games were significantly correlated with improvements in external postassessments. Methods and detailed findings were different for each type of game. These results suggest GBLA shows promise for future work such as adaptive games and in-class, data-driven formative assessments, but design of the assessment mechanics must be carefully crafted for each game.     

Benefits of educational games as an introductory activity in industrial engineering education

This study evaluates the use of educational games as an introductory activity in the first year of undergraduate degree programs in industrial engineering. This proposal exploit the potential use of games to present complex situations without discouraging players, allowing new students to examine important elements of the professional field. Therefore, an educational game designed for use during the first year of classes was developed. The contribution of this game proposed for student learning and motivation was evaluated using a questionnaire, as was the receptivity to the use of educational games. The results show that this activity motivated students to participate and to better understand the course content. They also indicate that educational games are well accepted by the first-year students. The following benefits of educational games as an introductory activity in higher education contribute to these results: the opportunity to present different concepts in an integrated manner, the possibility of offering a comprehensive and dynamic example that can be shared by students and professors, the greater freedom afforded to the professor for individual interaction with students and the ability to simultaneously satisfy the demand for knowledge and motivation.     

Outcomes for design and learning when teenagers with autism codesign a serious game: A pilot study

Digital educational games research tends to lack ecological validity by not adequately taking into account the views and perspectives of children and young people with autism spectrum disorders (ASD). This paper is a pilot study that explores and analyses an academic‐based educational game that was co‐designed with and for young people with ASD. The serious game aims to help the players learn Geography‐specific knowledge and integrates several strategic features so that users can collaborate together against the computer or compete against each other. The educational game was evaluated over 5 sessions by 3 peer teams from 2 different special educational institutions, involving a total of 6 students with ASD. The participants were positive about their enjoyment, motivation, and social engagement. The results showed that the players' level of competitiveness not only influenced the experience within the game but also the interaction within the peer teams. The game mechanisms did help the participants with ASD increase their knowledge in Geography content. The main conclusion is that there are considerable benefits of including children with ASD in the design process and future research should explore more fully on how their involvement can enhance curriculum‐based learning as well as social engagement within the classroom.