Challenging games help students learn: An empirical study on engagement,flow and immersion in game-based learning

In this paper, we investigate the impact of flow (operationalized as heightened challenge and skill), engagement, and immersion on learning in game-based learning environments. The data was gathered through a survey from players (N = 173) of two learning games (Quantum Spectre: N = 134 and Spumone: N = 40). The results show that engagement in the game has a clear positive effect on learning, however, we did not find a significant effect between immersion in the game and learning. Challenge of the game had a positive effect on learning both directly and via the increased engagement. Being skilled in the game did not affect learning directly but by increasing engagement in the game. Both the challenge of the game and being skilled in the game had a positive effect on both being engaged and immersed in the game. The challenge in the game was an especially strong predictor of learning outcomes. For the design of educational games, the results suggest that the challenge of the game should be able to keep up with the learners growing abilities and learning in order to endorse continued learning in game-based learning environments.     

The effects of peer intrinsic and extrinsic motivation on MMOG game-based collaborative learning

We combined Massively Multiplayer Online Game and technology-based collaborative learning methods to examine peer motivational factors influencing intention to learn; these have seldom been jointly examined. We proposed two new constructs, peer intrinsic motivation and peer extrinsic motivation, and investigated their effect on a player's intention to learn individually and collaboratively. Our survey and interview findings showed that an individual player's peer intrinsic and extrinsic motivations had significantly positive influence on his or her intention to learn collaboratively and individually. Implications for academics, educators, game developers, and players are discussed.     

Parental acceptance of digital game-based learning

In research about digital game-based learning, the likely negative perceptions of parents are often enlisted as a barrier toward the adoption of games in classroom settings. Teachers, students and policy makers appear to be influenced by what parents think about games in the classroom. Therefore, it is important to study these parental beliefs about games. The present research develops and validates a path model to explain and predict parental acceptation of video games in the classrooms of their children. The hypothetical model was found reliable and valid, based on a survey of 858 parents with at least one child in secondary education. Overall, the results show that 59% of the variance in parents’ preference for video games can be explained by the model comprising hypotheses about learning opportunities, subjective norm, perceived negative effects of gaming, experience with video games, personal innovativeness, and gender.     

The interplay of game elements with psychometric qualities,learning, and enjoyment in game-based assessment

Educators today are increasingly interested in using game-based assessment to assess and support students' learning. In the present study, we investigated how changing a game design element, linearity in gameplay sequences, influenced the effectiveness of game-based assessment in terms of validity, reliability, fairness, learning, and enjoyment. Two versions of a computer game, Physics Playground (formerly Newton's Playground), with different degrees of linearity in gameplay sequences were compared. Investigation of the assessment qualities—validity, reliability, and fairness—suggested that changing one game element (e.g., linearity) could significantly influence how players interacted with the game, thus changing the evidentiary structure of in-game measures. Although there was no significant group difference in terms of learning between the two conditions, participants who played the nonlinear version of the game showed significant improvement on qualitative physics understanding measured by the pre- and posttests while the participants in the linear condition did not. There was also no significant group difference in terms of enjoyment. Implications of the findings for future researchers and game-based assessment designers are discussed.     

Supporting collaborative learning in engineering design

In team-based project courses, collaborative learning is the dominant learning mode. Collaborative learning has been shown to increase individual learning through co-construction and personal reflection. Rapid adoption of web-based communication and mobile computing by students provide opportunities to take advantage of computer-supported collaboration for engineering education. We present preliminary findings on a computer environment, the Kiva Web, that supports the activities of group collaboration for interdisciplinary engineering design teams. We have employed methods from human–computer interaction (HCI) to iterate on the design in the context of use. In this paper, we discuss the evolution of the Kiva Web and the implications for both student design teams and professional design teams.     

Evaluating learners’ motivational and cognitive processing in an online game-based learning environment

This paper describes the process and results of an evaluation on an online game-based learning environment (GBLE) by focusing on learners’ motivational processing and cognitive processing. The goal is to explore how online GBLE might initiate and support learners’ goal-setting activities and impact learners’ cognitive loads. The study surveyed 144 undergraduate students after their autonomous participation in the online game available at the Nobel Prize Foundation website teaching the Heckscher-Ohlin Theory on international trade. Grounded in the integrative theory of motivation, volition, and performance (MVP), the evaluation indicated that participants felt significantly confident in learning the subject. The perceived satisfaction, however, was lower than the rest of motivational components possibly due to heavy cognitive processing. The finding of cognitive load reported that learners perceived a significantly higher level of intrinsic load than the germane load due to the novelty of the subject matter. Data analysis further indicated a significant canonical correlation between learners’ motivational and cognitive processing. This particular finding could inform future research to investigate specific motivational processing components’ effects on learners’ cognitive load levels in online GBLEs.     

Prototyping a collaborative learning tool for nurses

Abstract  A Nurse Collaborative Learning (Nurse Co-Learn) tool was designed and developed to help the Department of Nursing to introduce Information Technology to undergraduate nursing students. The MUCH (Many Using and Creating Hypermedia) system was used as the basis for this tool. The Nurse Co-Learn tool supported coordination between clinic personnel. Students were required to take on a role in the clinic, and to perform the relevant tasks for that role. Through participating in this role-playing game students learned word processing, database and spreadsheet skills, whilst performing authentic tasks. Three prototypes were developed and trialled; this paper highlights the features of the prototypes and the responses of the users.     

Student perceptions of collaborative learning,social presence and satisfaction in a blended learning environment: Relationships and critical factors

The purpose of this study was to examine the relationships of the students’ perceived levels of collaborative learning, social presence and overall satisfaction in a blended learning environment. This research studied the relationship of these three variables and identified critical factors related to them. The participants were 48 graduate students who took a blended-format course in health education and worked on a collaborative group project related to the development of a comprehensive HIV-AIDS prevention plan. Data was collected from the Student Perception Questionnaire and face-to-face interviews. The analysis of quantitative data indicated that student perceptions of collaborative learning have statistically positive relationships with perceptions of social presence and satisfaction. This means that students who perceived high levels of collaborative learning tended to be more satisfied with their distance course than those who perceived low levels of collaborative learning. Similarly, students with high perceptions of collaborative learning perceived high levels of social presence as well. Surprisingly, the relationship between social presence and overall satisfaction was positive but not statistically significant. Interview data revealed that (a) course structure, (b) emotional support, and (c) communication medium were critical factors associated with student perceptions of collaborative learning, social presence, and satisfaction. Explanations about findings and implications for instructional design are discussed in the conclusion.     

Enhancing 5th graders’ science content knowledge and self-efficacy through game-based learning

Many argue that games can positively impact learning by providing an intrinsically motivating and engaging learning environment for students in ways that traditional school cannot. Recent research demonstrates that games have the potential to impact student learning in STEM content areas and that collaborative gameplay may be of particular importance for learning gains. This study investigated the effects of collaborative and single game player conditions on science content learning and science self-efficacy. Results indicated that there were no differences between the two playing conditions; however, when conditions were collapsed, science content learning and self-efficacy significantly increased. Future research should focus on the composition of collaboration interaction among game players to assess what types of collaborative tasks may yield positive learning gains.     

Using computer supported collaborative learning strategies for helping students acquire self-regulated problem-solving skills in mathematics

The main objective of this paper is to investigate the effectiveness of a proposed computer-based instructional method in Primary Education for self-regulated problem solving. The proposed instructional method is based on Sternberg’s model of problem solving within an authentic context. It consists of three main phases: observation, collaboration and semi-structured guidance. The ultimate learning objective is to augment the autonomous problem-solving skills of primary school children. In our study the Synergo tool was used, which is a synchronous computer supported collaborative learning tool, as well as the Moodle learning management system. The context which frames the method is authentic, very close to a students’ realistic learning situation. The findings of this study advocate that students can increase their problem-solving skills in a relatively short period of time. At the same time, they can improve their approach to the solution of a given mathematical problem, performing significant signs of autonomy.     

Analyzing collaborative learning processes automatically: Exploiting the advances of computational linguistics in computer-supported collaborative learning

In this article we describe the emerging area of text classification research focused on the problem of collaborative learning process analysis both from a broad perspective and more specifically in terms of a publicly available tool set called TagHelper tools. Analyzing the variety of pedagogically valuable facets of learners’ interactions is a time consuming and effortful process. Improving automated analyses of such highly valued processes of collaborative learning by adapting and applying recent text classification technologies would make it a less arduous task to obtain insights from corpus data. This endeavor also holds the potential for enabling substantially improved on-line instruction both by providing teachers and facilitators with reports about the groups they are moderating and by triggering context sensitive collaborative learning support on an as-needed basis. In this article, we report on an interdisciplinary research project, which has been investigating the effectiveness of applying text classification technology to a large CSCL corpus that has been analyzed by human coders using a theory-based multi-dimensional coding scheme. We report promising results and include an in-depth discussion of important issues such as reliability, validity, and efficiency that should be considered when deciding on the appropriateness of adopting a new technology such as TagHelper tools. One major technical contribution of this work is a demonstration that an important piece of the work towards making text classification technology effective for this purpose is designing and building linguistic pattern detectors, otherwise known as features, that can be extracted reliably from texts and that have high predictive power for the categories of discourse actions that the CSCL community is interested in.

The learning kit project: Software tools for supporting and researching regulation of collaborative learning

Computer-supported collaborative learning (CSCL) is a dynamic and varied area of research. Ideally, tools for CSCL support and encourage solo and group learning processes and products. However, most CSCL research does not focus on supporting and sustaining the co-construction of knowledge. We identify four reasons for this situation and identify three critical resources every collaborator brings to collaborations that are underutilized in CSCL research: (a) prior knowledge, (b) information not yet transformed into knowledge that is judged relevant to the task(s) addressed in collaboration, and (c) cognitive processes used to construct these informational resources. Finally, we introduce gStudy, a software tool designed to advance research in the learning sciences. gStudy helps learners manage cognitive load so they can re-assign cognitive resources to self-, co-, and shared regulation; and it automatically and unobtrusively traces each user′s engagement with content and the means chosen for cognitively processing content, thus generating real-time performance data about processes of collaborative learning.     

Computer-supported collaborative learning with digital video cases in teacher education: The impact of teaching experience on knowledge convergence

Case-based learning is ascribed high potential with respect to the education of pre-service teachers as well as the further education of experienced in-service teachers, as it can provide opportunities for the application of professional knowledge to authentic classroom situations. In addition to the application and acquisition of knowledge, the aspect of knowledge convergence (i.e., increasing similarity of collaborative learners with respect to their knowledge) should be taken into account when homogeneous benefits are desired for all participants of a case-based training. A field study with 29 pre-service teachers and 24 in-service teachers from adult education was conducted to examine effects of different levels of teaching experience on knowledge application, knowledge acquisition, and knowledge convergence in a computer-supported collaborative case-based learning environment. An innovative approach to measuring knowledge convergence was introduced, using the positions of annotations (i.e., flags placed on the timeline of the case video) made by learners during their case analyses as an indicator of their shared focus of attention. This measure was found to positively correlate with the application and acquisition of professional knowledge. Teaching experience affected both processes and outcomes of case-based learning, suggesting different means of instructional support for pre-service and in-service teachers.     

Students’ experiences with collaborative learning in asynchronous Computer-Supported Collaborative Learning environments

This paper describes an explorative study carried out to gain response from distance students on their experiences with collaborative learning in asynchronous computer supported collaborative learning (CSCL) environments. In addition, this study also attempts to have a good grip of crucial aspects concerning collaborative learning. The study was undertaken among distance learners from the Open University of the Netherlands who were working in groups of 4–11 persons. During and after the course students’ experiences with collaborative learning were measured and after the course also students’ satisfaction with collaborative learning was assessed. The finding revealed that distance learners appreciate the opportunities to work collaboratively. They show positive experiences and are quite satisfied with collaborative learning. This study also sought to explore individuals as well as course characteristics that influenced aspects of collaborative learning, and to search aspects of collaborative learning that influenced students’ satisfaction. The findings suggested that a group product influences group process regulation and group cohesion influences students’ satisfaction with collaborative learning.     

Mediating team effectiveness in the context of collaborative learning: The importance of team and task awareness

Learning teams in higher education executing a collaborative assignment are not always effective. To remedy this, there is a need to determine and understand the variables that influence team effectiveness. This study aimed at developing a conceptual framework, based on research in various contexts on team effectiveness and specifically team and task awareness. Core aspects of the framework were tested to establish its value for future experiments on influencing team effectiveness. Results confirmed the importance of shared mental models, and to some extent mutual performance monitoring for learning teams to become effective, but also of interpersonal trust as being conditional for building adequate shared mental models. Apart from the importance of team and task awareness for team effectiveness it showed that learning teams in higher education tend to be pragmatic by focusing primarily on task aspects of performance and not team aspects. Further steps have to be taken to validate this conceptual framework on team effectiveness.     

Does individual or collaborative self-debriefing better enhance learning from games?

The primary aim of this study is to find out whether use of different self-debriefing modes affects learning from a game. In self-debriefing participants are led to reflect upon their game experiences by a set of debriefing questions. Two conditions were compared: Individual and Collaborative self-debriefing. The 45 participants first played the game of Lemonade Tycoon Deluxe, were tested for knowledge and self-debriefed in pairs or alone. Then they played the game once more and were tested again. Game scores increased significantly from the first to the second round of gameplay to an equal degree in both conditions. Knowledge scores of participants in individual self-debriefing increased significantly more than those of participants in the Collaborative condition. The study shows that game-based learning can be effectively scaffolded with self-debriefing. Future studies might investigate whether the type of self-debriefing differentially affects game motivation. In addition, attention to the role of feedback is called for.     

Visualization of agreement and discussion processes during computer-supported collaborative learning

This study examined the effects of the shared space (SS) on students’ behaviors in a computer-supported collaborative learning (CSCL) environment. The SS visualizes discussion and agreement during online discussions. It was hypothesized the SS would increase the media richness of the CSCL-environment, would stimulate critical and exploratory group-norms, would lead to more positive perceptions of online collaboration, and would have an impact on students’ collaborative activities. In total, 59 students working in 20 groups had access to the SS visualization, while 58 students working in 20 groups did not. The results show that students with access to the SS visualization: (a) perceived higher media richness; (b) had a more exploratory group-norm perception; (b) perceived more positive group behavior; (c) perceived their group’s task strategies to be more effective; (d) engaged in different collaborative activities and (e) performed better on one part of the group task. These results demonstrate the potential benefits of visualizing agreement and discussion during CSCL.     

Multiple Mice based collaborative one-to-one learning

Exchange is a collaborative learning application, originally developed for wirelessly interconnected Pocket PCs, that provides support for students and a teacher performing a face-to-face computer supported collaborative learning (CSCL) activity in a Single Input/Single Display (SISD) mode. We extend the application to support a single display groupware (SDG) mode. In this new version, named Exchange-MM, three users each with their own mouse (Multiple Mice) interact on a single display with mediation by a technological network. The original collaborative interaction is maintained. We describe a collaborative learning activity and the software architecture that supports both interaction modes, and also present a usability analysis of the activity conducted with second-grade schoolchildren. The results show that as in SISD mode, in SDG with Multiple Mice (MM) the technological network improves communication, negotiation, interactivity, coordination and appropriability between members of collaborative learning groups.     

Competitive collaborative learning

Intuitively, it is clear that trust or shared taste enables a community of users to make better decisions over time, by learning cooperatively and avoiding one another's mistakes. However, it is also clear that the presence of malicious, dishonest users in the community threatens the usefulness of such collaborative learning processes. We investigate this issue by developing algorithms for a multi-user online learning problem in which each user makes a sequence of decisions about selecting products or resources. Our model, which generalizes the adversarial multi-armed bandit problem, is characterized by two key features:

(1)

The quality of the products or resources may vary over time.

(2)

Some of the users in the system may be dishonest, Byzantine agents.

Decision problems with these features underlie applications such as reputation and recommendation systems in e-commerce, and resource location systems in peer-to-peer networks. Assuming the number of honest users is at least a constant fraction of the number of resources, and that the honest users can be partitioned into groups such that individuals in a group make identical assessments of resources, we present an algorithm whose expected regret per user is linear in the number of groups and only logarithmic in the number of resources. This bound compares favorably with the naïve approach in which each user ignores feedback from peers and chooses resources using a multi-armed bandit algorithm; in this case the expected regret per user would be polynomial in the number of resources.