The effect of simulation games on the learning of computational problem solving

Simulation games are now increasingly applied to many subject domains as they allow students to engage in discovery processes, and may facilitate a flow learning experience. However, the relationship between learning experiences and problem solving strategies in simulation games still remains unclear in the literature. This study, thus, analyzed the feedback and problem solving behaviors of 117 students in a simulation game, designed to assist them to learn computational problem solving. It was found that students when learning computational problem solving with the game were more likely to perceive a flow learning experience than in traditional lectures. The students’ intrinsic motivation was also enhanced when they learned with the simulation game. In particular, the results of the study found a close association between the students’ learning experience states and their problem solving strategies. The students who perceived a flow experience state frequently applied trial-and-error, learning-by-example, and analytical reasoning strategies to learn the computational problem solving skills. However, a certain portion of students who experienced states of boredom and anxiety did not demonstrate in-depth problem solving strategies. For instance, the students who felt anxious in the simulation game did not apply the learning-by-example strategy as frequently as those in the flow state. In addition, the students who felt bored in the simulation game only learned to solve the problem at a superficial level.     

A mixed methods assessment of students' flow experiences during a mobile augmented reality science game

Current studies have reported that secondary students are highly engaged while playing mobile augmented reality (AR) learning games. Some researchers have posited that players' engagement may indicate a flow experience, but no research results have confirmed this hypothesis with vision‐based AR learning games. This study investigated factors related to students' engagement – as characterized by flow theory – during a collaborative AR, forensic science mystery game using mobile devices. School Scene Investigators: The Case of the Stolen Score Sheets is a vision‐based AR game played inside the school environment with Quick Response codes. A mixed methods approach was employed with 68 urban middle school students. Data sources included pre‐ and post‐surveys, field observations and group interviews. Results showed that neither gender nor interest in science was an important predictor of variability in flow experience. Gaming attitude uniquely predicted 23% of the variance in flow experience. Student flow experience features included a flash of intensity, a sense of discovery and the desire for higher performance. The findings demonstrated a potential for mobile AR science games to increase science interest and help students learn collaboration skills. Implications for future research concerning mobile AR science games are discussed.     

EGameFlow: A scale to measure learners’ enjoyment of e-learning games

In an effective e-learning game, the learner’s enjoyment acts as a catalyst to encourage his/her learning initiative. Therefore, the availability of a scale that effectively measures the enjoyment offered by e-learning games assist the game designer to understanding the strength and flaw of the game efficiently from the learner’s points of view. E-learning games are aimed at the achievement of learning objectives via the creation of a flow effect. Thus, this study is based on Sweetser’s & Wyeth’s framework to develop a more rigorous scale that assesses user enjoyment of e-learning games. The scale developed in the present study consists of eight dimensions: Immersion, social interaction, challenge, goal clarity, feedback, concentration, control, and knowledge improvement. Four learning games employed in a university’s online learning course “Introduction to Software Application” were used as the instruments of scale verification. Survey questionnaires were distributed to students taking the course and 166 valid samples were subsequently collected. The results showed that the validity and reliability of the scale, EGameFlow, were satisfactory. Thus, the measurement is an effective tool for evaluating the level of enjoyment provided by e-learning games to their users.     

What influences college students to continue using business simulation games? The Taiwan experience

Previous studies have pointed out that computer games could improve students’ motivation to learn, but these studies have mostly targeted teachers or students in elementary and secondary education and are without user adoption models. Because business and management institutions in higher education have been increasingly using educational simulation games in recent years, factors influencing the continuing use of business simulation games by higher-education students are worth probing into. This research adopted the technology acceptance model, expectation confirmation theory, and agency theory as its theoretical base. Moreover, learning motivation and classroom climate from the perspective of learning, as well as perceived attractiveness and perceived playfulness from the perspective of playfulness and attractiveness were also added to the final research model. A total of 185 valid student respondents in Taiwan’s higher education who have used business simulation games in their classes participated in the survey. The results show that perceived playfulness and learning performance positively influence students’ satisfaction, which further influence the intention to use computer simulation games. Furthermore, perceived ease of use and perceived attraction play a critical role in determining perceived playfulness. Perceived ease of use was also positively influenced by perceived attraction. The research results on the students’ perspective provide a strong support for the teachers to adopt or continue using computer simulation games in classrooms. However, the agency theory failed to be sustained as a useful tool in motivating students’ learning activities, which is worthy of further research.     

The effect of competences on learning results an educational experience with a business simulator

Business games constitute a relevant e-learning method in management training. Their use and application has grown progressively, especially in business schools, universities and professional associations all over the world. The main reason for their popularity is that business games are seen as learning tools that allow students to acquire certain skills and competences above and beyond the skills fostered by other online or face-to-face methodologies. This study aims to analyse the relationship between generic competences and the learning results perceived by students in a business game. Analysis of the skills acquired using business simulators provides a wide field for potential future experimentation. The design of education plans is based entirely on the developing these skills. This study helps identify and assess which competencies are most linked to achieving the best learning outcomes, based on the value that students place on them, their satisfaction with them and their expectations of them. Only 16 of the 23 generic skills have a significant impact on achieving any of the objectives of the study variables.     

Do emotions matter in technology training? Exploring their effects on individual perceptions and willingness to learn

Due to the growing importance of enterprise resource planning (ERP) systems in organizations today, many universities and corporate training programs now incorporate such systems into their curricula using novel tools, such as ERP simulation games. To improve the understanding of individuals' learning patterns, we extend prior cognition based models by incorporating emotions. Moreover, we highlight the role of perceived radicalness, which mediates the relationship between emotions and individuals' willingness to learn. The proposed research model draws from the appraisal tendency framework and includes four distinct classes of emotions: challenge, achievement, loss, and deterrence. The model was tested via a lab experiment in which participants (N = 145) played an ERP simulation game. The hypothesized links were tested using structural equation modeling. Anger and excitement were negatively associated with perceived radicalness. Anxiety was positively associated with perceived radicalness and the positive effect of happiness on perceived radicalness was insignificant. Finally, perceived radicalness was positively related to individuals' willingness to learn. Results indicate that perceived radicalness is an important mechanism via which classes of emotions impact students' ERP learning behaviors. In addition, negative emotions have greater effects on radicalness perceptions compared to positive emotions.     

Using Serious Games in Data Communications and Networking Management Course

Data communications and networking management is one important course taught in business schools. To prepare themselves for future career, students need to acquire the data communications skills and the higher-order cognitive skills (HOCS) from this course so that they relate the relevance of the theory to practical problems. Prior literature shows that serious games offer an ability to trigger enjoyment in learning this difficult subject. Therefore, in this study, we empirically examined the effects of serious game feature on students’ learning experience, focusing particularly on concentration and enjoyment, as well as measuring the perceived improvement in their HOCS. The results revealed that features of serious games have positive effects on students’ concentration and enjoyment, and such learning experience did indeed significantly improve their perceived HOCS. The results encourage faculty members to adopt serious games to teach difficult subjects in the field of management information systems.     

A concept map-embedded educational computer game for improving students' learning performance in natural science courses

Many recent studies have reported the benefits of educational computer games in promoting students' learning motivations. On the other hand, however, the effect of digital game-based learning in improving students' learning performance has been questioned. Several previous studies have reported that without properly integrating learning strategies into gaming scenarios, the effectiveness of educational computer games could be limited, or may be even worse than that of the conventional technology-enhanced learning approach. In this study, a concept map-embedded gaming approach is proposed for developing educational computer games by integrating concept mapping as part of the gaming scenarios to help students organize what they have learned during the game-based learning process. Moreover, a role-playing game has been developed for an elementary school natural science course based on the proposed approach. From the experimental results, it is found that the concept map-embedded gaming approach can significantly improve the students' learning achievement and decrease their cognitive load. Moreover, the students who learned with the proposed approach revealed a significantly higher degree of perceived usefulness than those who learned with the conventional game-based learning approach.     

Motivational beliefs and perceptions of instructional quality: predicting satisfaction with online training*

Abstract Many would agree that learning on the Web – a highly autonomous learning environment – may be difficult for individuals who lack motivation and self‐regulated learning skills. Using a social cognitive view of academic motivation and self‐regulation, the objective of the present study was to investigate the relations between students' motivational beliefs, their perceptions of the learning environment and their satisfaction with a self‐paced, online course. Service academy undergraduates (n = 646) completed a questionnaire following online training. Pearson correlations indicate that task value, self‐efficacy and perceived instructional quality were significantly positively related to each other and to students' overall satisfaction with the self‐paced, online course. Additionally, results from a three‐step hierarchical regression reveal that task value, self‐efficacy and instructional quality were significant positive predictors of students' satisfaction; the final regression model accounted for approximately 54% of the variance in the outcome measure. These findings support and extend prior research in traditional classrooms and online education in university settings, indicating that military students' motivational beliefs about a learning task and their perceptions of instructional quality are related, in important ways, to their overall satisfaction with online instruction. Educational implications and suggestions for future research are discussed.     

Micro‐adaptivity: protecting immersion in didactically adaptive digital educational games

The idea of utilizing the rich potential of today's computer games for educational purposes excites educators, scientists and technicians. Despite the significant hype over digital game‐based learning, the genre is currently at an early stage. One of the most significant challenges for research and development in this area is establishing intelligent mechanisms to support and guide the learner, and to realize a subtle balance between learning and gaming, and between challenge and ability on an individual basis. In contrast to traditional approaches of adaptive and intelligent tutoring, the key advantage of games is their immersive and motivational potential. Because of this, the psycho‐pedagogical and didactic measures must not compromise gaming experience, immersion and flow. In the present paper, we introduce the concept of micro‐adaptivity, an approach that enables an educational game to intelligently monitor and interpret the learner's behaviour in the game's virtual world in a non‐invasive manner. On this basis, micro‐adaptivity enables interventions, support, guidance or feedback in a meaningful, personalized way that is embedded in the game's flow. The presented approach was developed in the context of the European Enhanced Learning Experience and Knowledge TRAnsfer project. This project also realized a prototype game, demonstrating the capabilities, strengths and weaknesses of micro‐adaptivity.     

Assessing implicit science learning in digital games

Building on the promise shown in game-based learning research, this paper explores methods for Game-Based Learning Assessments (GBLA) using a variety of educational data mining techniques (EDM). GBLA research examines patterns of behaviors evident in game data logs for the measurement of implicit learning—the development of unarticulated knowledge that is not yet expressible on a test or formal assessment. This paper reports on the study of two digital games showing how the combination of human coding with EDM has enabled researchers to measure implicit learning of Physics. In the game Impulse, researchers combined human coding of video with educational data mining to create a set of automated detectors of students' implicit understanding of Newtonian mechanics. For Quantum Spectre, an optics puzzle game, human coding of Interaction Networks was used to identify common student errors. Findings show that several of our measures of student implicit learning within these games were significantly correlated with improvements in external postassessments. Methods and detailed findings were different for each type of game. These results suggest GBLA shows promise for future work such as adaptive games and in-class, data-driven formative assessments, but design of the assessment mechanics must be carefully crafted for each game.     

Effects of Collaborative Web Based Vocational Education and Training (VET) on Learning Outcomes

Considering the increase in need of skilled human capital, the vocational training and education through e-learning has widely been adopted all over the world. It serves as a major alternative for training and teaching professionals, technicians, skilled workers, amateurs and students who cannot manage regular college education due to time, cost and distance factors. Prior research focuses on learning enhancement from several perspectives like computer mediated methods, learning games, personalized learning environments and web based instructional design. The proposed work contributes to this debate by investigating the role of collaboration i.e. student–student and student–instructor interaction, support material, instructor's feedback and evaluating their effects on learning outcome and students' learning experience. The investigation is performed through a case study presenting four vocational courses offered in three consecutive sessions. The findings revealed that collaborative practices i.e. group work, team effort, in time instructor's feedback and consolidated support material enhances learning experience of student and contributes positively to the learning outcome.     

Mobile learning vs. traditional classroom lessons: a comparative study

Different methods can be used for learning, and they can be compared in several aspects, especially those related to learning outcomes. In this paper, we present a study in order to compare the learning effectiveness and satisfaction of children using an iPhone game for learning the water cycle vs. the traditional classroom lesson. The iPhone game includes multiple interaction forms and combined augmented reality (AR) mini‐games with non‐AR mini‐games. The traditional classroom lesson had the same learning content as the iPhone game. Thirty‐eight children participated in the study. The analyses showed that the children made significant learning gains about the water cycle, regardless of the method used. Even though the results showed that the iPhone method achieved higher knowledge results than the traditional classroom lesson, no statistically significant differences were found between the iPhone and the classroom lesson. When analysing the motivational outcomes, the results showed that the children found the iPhone game to be more satisfying than the classroom lessons. Since the iPhone game achieved similar learning results and a higher motivational effect than the classroom lesson, this suggests that games of this kind could be used as a tool in primary schools to reinforce students' lessons.     

Learning with quizzes,simulations, and adventures: Students' attitudes,perceptions and intentions to learn with different types of serious games

Students' attitudes, their perceptions of cognitive and affective quality as predictors of attitudes, and the resulting intention toward learning with serious games remains ambiguous, largely due to the use of imprecise measures. The presented studies have aimed to develop and test a measurement of students' attitudes, perceptions, and intentions to learn with serious games in general, and to use the instrument to examine differences for the most common types of serious games, that is quiz, simulation, and adventure. To this end, a pretest (n = 301) and two main studies (Study 1: n = 135, Study 2: n = 375) were conducted. The developed instrument shows high reliability and convergent validity. Results demonstrate positive attitudes, positive cognitive perceptions, and high positive and low negative affective perceptions of students toward learning with serious games in general, as well as with different game types. Findings from a multivariate analysis of variance (MANOVA), however, indicate differences between the three game types that could be related to the perceptions of cognitive and affective quality. Predominately, compared to quizzes and adventures, simulations were perceived as more supportive for the comprehension and application of knowledge while promoting a less positive affect. Additionally, there was a significant difference due to gender. Whereas females reported higher perceptions of negative affective quality compared to males when serious games were addressed in general, answers to questions about the specific game types revealed a more detailed picture. In contrast to previous findings in existing literature, female students reported a more positive attitude, as well as higher perceptions of positive affective quality, than males for all three game types. These results stress the importance of examining the types of serious games separately and considering gender when evaluating students' attitudes and perceptions when learning with serious games.     

The effectiveness of adaptive difficulty adjustments on students' motivation and learning in an educational computer game

Computer games that adaptively adjust difficulty are used to continuously challenge players according to their abilities. The adjustment of difficulty occurs automatically in response to a game's ongoing assessment of a player's performance. This approach to difficulty adjustment is likely to be of value in educational computer games as a means of scaffolding learning for students. However, there is limited research evaluating the effectiveness of educational computer games with adaptive difficulty adjustment when compared to non-adaptive difficulty adjustment. To expand on this research a quasi-experimental study was designed to isolate the impact of the difficulty adjustment game element on motivation and learning. A total of 234 secondary school students were allocated to one of three activities involving learning about Spanish cognates: an adaptive difficulty adjustment game, an incremental difficulty adjustment game that was non-adaptive, and a written activity. The three learning activities were designed following the same learning and motivation theories. The two games were identical apart from the difficulty adjustment mechanism. The results for motivation indicated that all students experienced high levels and there was no significant difference between the three learning activities. The pre- and post-tests results for learning indicated that significantly higher learning outcomes were achieved by students who played the adaptive game. Analysis of a game log recording the correctness of students' responses indicated that the adaptive difficulty adjustment game, in contrast to the non-adaptive incremental difficulty adjustment game, provided a scaffolding structure to enhance student learning.     

Can computer models be used for social learning? A serious game in water management

Computer simulation models are increasingly used to support solving complex problems in natural resource management, with social learning as subsidiary goal of the solution process. In this research, a serious game on water management is used where participants receive feedback on consequences of their choices from an Integrated Assessment Meta Model. This study aims to determine if and how social learning takes place and explores the role of the model in social learning. Group discussions were qualitatively analysed to uncover and understand the mechanisms in this process. Results show that social learning took place in 10 of the 12 game sessions. Though model feedback was an important driver for social learning, social learning was driven most by the team's reflection on their perspective. We conclude that using a model can facilitate social learning in a serious-game setting, in particular in combination with reflection on teams' perspectives.     

Empowering students through digital game authorship: Enhancing concentration,critical thinking,and academic achievement

Digital game-based learning is a popular strategy for engaging students by making learning fun. Actively involving students as designers and producers of digital games may have even greater potential for student empowerment through enhancing concentration and engagement, fostering higher order thinking, and improving learning outcomes. Thus, this study empirically investigated the impact of digital game authoring on students' concentration, critical thinking skills, and academic achievement. A total of 67 students in two seventh-grade classes participated in this 19-week-long experiment, and were divided into an experimental group (32 students designing digital games) and a comparison group (35 students designing Flash animations). The interdisciplinary approach involved integrating biology and computer programming classes. Students in the experimental group designed digital games based upon biology course content, while the comparison group collaboratively produced Flash animations based upon the same course content. The experimental results, using MANCOVA for pretest, posttest, and delayed posttest scores, demonstrate significant improvements in critical thinking skills, and academic achievement, with increased retention of both course content and critical thinking skills observed for the delayed posttest. For concentration, a relative advantage for the experimental group as compared with the comparison group was noted, but did not reach statistical significance. Based on the results of this study, implications for practitioners and researchers are provided, including the integration of programming or computer science with other courses for digital game authoring and the evaluation of other learning outcomes such as creative thinking, problem-solving, and flow.     

Participatory evaluation of an educational game for social skills acquisition

This paper reports a study conducted to formally evaluate a social problem-solving skills game during the start of the development to ensure that the desired game attributes were successfully embodied in the final game. Two methods, heuristic evaluation and participatory design, were adopted to assess whether the features of the game pose playability issues to the prospective young users and to translate the participants' contributions into game design directions. The participants playtested and evaluated the game based on the Pedagogical Playability Heuristics, which are different from existing heuristics developed for commercial games, as priority was placed on instructional design principles and the concept of playability. Using storyboarding, they built low-fidelity prototypes of the game. Suitable children's design and feedback on the games attributes that would bring about stimulation, connecting instructions to goals, appropriate challenge and influencing goal achievement were integrated into the game design. As a consequence of the study, steps were taken to improve the game as an interactive system to achieve the instructional goals and at the same time foster enjoyment among the users.     

Serious games and learning effectiveness: The case of It’s a Deal!

Although the value of serious games in education is undeniable and the potential benefits of using video games as ideal companions to classroom instruction is unquestionable, there is still little consensus on the game features supporting learning effectiveness, the process by which games engage learners, and the types of learning outcomes that can be achieved through game play. Our aim in this discussion is precisely to advance in this direction by providing evidence of some of the factors influencing the learning effectiveness of a serious game called It’s a Deal! This serious game was created for the purpose of teaching intercultural business communication between Spaniards and Britons in business settings in which English is used as the lingua franca. This paper hypothesizes that the immersive, all-embracing and interactive learning environment provided by the video game to its users may contribute to develop and enhance their intercultural communicative competence. The study attempts to answer three main research questions: (a) after playing It’s a Deal!, did the students sampled improve their intercultural awareness, intercultural knowledge and intercultural communicative competence in business English? (b) If they improved their intercultural learning, what are the factors influencing such improvement? And (c) if they did not improve their intercultural learning, what are the factors influencing such failure? The game participants who volunteered to take part in the study were all students of English Studies at the University of Alicante in the academic year 2010-2011. One hundred and six students completed both the pre-test and the post-test questionnaires, and played It’s a Deal! A sample of fifty students was selected randomly for the empirical study. The results obtained in the tests performed were compared and contrasted intra-group, both qualitatively and quantitatively, for the purpose of finding any statistically significant difference that may confirm whether or not there was an improvement in the students’ intercultural communicative competence in business English as a result of the implementation of the It’s a Deal! serious game. Findings of this study demonstrate that the video game is an effective learning tool for the teaching of intercultural communication between Spaniards and Britons in business settings in which English is used as the lingua franca. In particular, whereas the game had a small learning effect on intercultural awareness and a medium learning effect on intercultural knowledge, it had a large learning effect on intercultural communicative competence. The study also documents correlating factors that make serious games effective, since it shows that the learning effectiveness of It’s a Deal! stems from the correct balance of the different dimensions involved in the creation of serious games, specifically instructional content, game dimensions, game cycle, debriefing, perceived educational value, transfer of learnt skills and intrinsic motivation.     

Development of a contextual decision-making game for improving students' learning performance in a health education course

Heath education is an important component of the curriculum for fostering children's correct health knowledge and good daily life habits. However, educators have indicated that most children might fail to realize the importance and meaning of health education content owing to the lack of authentic scenarios and daily life experience. With the advancement of computer technologies, researchers have tried to develop multimedia learning content in order to improve students' learning performance. Among various technology-enhanced learning alternatives, digital game-based learning has been recognized as a highly potential approach to motivating students. However, several previous studies have indicated that, without properly incorporating learning content into game scenarios, the effectiveness of digital game-based learning might not be as good as expected in comparison with conventional technology-enhanced learning. In this study, a contextual digital game was developed for improving students' learning performance in an elementary school health education course. A quasi experiment was conducted to evaluate the effectiveness of the proposed approach by situating the experimental group in the game-based learning scenario and the control group to learn with conventional e-books. The experimental results showed that the proposed approach not only improved the students' learning motivation, but also their learning achievement and problem-solving competences. Moreover, the significant two-way interaction suggested that the contextual game-based learning approach benefited the higher motivation students more than the lower motivation ones in terms of the advanced knowledge, showing the importance and potential of applying contextual games to health education activities.