Digital Game-Based Learning in high school Computer Science education: Impact on educational effectiveness and student motivation

The aim of this study was to assess the learning effectiveness and motivational appeal of a computer game for learning computer memory concepts, which was designed according to the curricular objectives and the subject matter of the Greek high school Computer Science (CS) curriculum, as compared to a similar application, encompassing identical learning objectives and content but lacking the gaming aspect. The study also investigated potential gender differences in the game’s learning effectiveness and motivational appeal. The sample was 88 students, who were randomly assigned to two groups, one of which used the gaming application (Group A, N = 47) and the other one the non-gaming one (Group B, N = 41). A Computer Memory Knowledge Test (CMKT) was used as the pretest and posttest. Students were also observed during the interventions. Furthermore, after the interventions, students’ views on the application they had used were elicited through a feedback questionnaire. Data analyses showed that the gaming approach was both more effective in promoting students’ knowledge of computer memory concepts and more motivational than the non-gaming approach. Despite boys’ greater involvement with, liking of and experience in computer gaming, and their greater initial computer memory knowledge, the learning gains that boys and girls achieved through the use of the game did not differ significantly, and the game was found to be equally motivational for boys and girls. The results suggest that within high school CS, educational computer games can be exploited as effective and motivational learning environments, regardless of students’ gender.     

The effects of instructional support and learner interests when learning using computer simulations

Within the scope of this study, the effectiveness of two kinds of instructional support was evaluated with regard to the learner’s interests. Two versions of a simulation program about the respiratory chain were developed, differing only in the kind of tasks provided for instructional support: One version contained problem-solving tasks, the other one contained worked-out examples. The focus was on the learner’s interest in the subject and in computers. The first goal of the study was to find to what extent computer simulations incorporating the different kinds of instructional support have positive effects on situational subject-interest. The second goal was to evaluate the interactions between the learner’s interests and the instructional support with regard to the learning results (subdivided into factual knowledge and understanding). Simulations with worked-out examples were shown to have positive effects on the learner’s situational interest in the subject. This was not found to be the case in simulations with problem-solving tasks. Regardless of the kind of instructional support, learners with little interest in the subject were able to achieve significant gains in factual knowledge. However, improvement in understanding was dependent on the kind of instructional support.     

Learning through playing Virtual Age: Exploring the interactions among student concept learning,gaming performance,in-game behaviors,and the use of in-game characters

Video games possess many unique features that facilitate learning. Meanwhile, teaching about evolution is never an easy task due to the existence of some barriers to its learning. Virtual Age, therefore, has been developed in an attempt to harness the power of gaming to increase student understanding of biological evolution. The aim of this study was to examine whether Virtual Age is effective for learning about evolution and to further explore the interplay of student concept learning, gaming performance, and in-game behaviors. A total of 62 7th graders took part in the study, and significant findings were revealed. The students did learn by playing Virtual Age, and their long-term knowledge retention was promising. The in-game behaviors, such as times and duration of viewing the relevant information embedded in Virtual Age, were significantly related to gaming performance (game score), which subsequently influenced learning outcomes. Moreover, the results of cluster analysis indicated that three clusters of low learning outcomes/low gaming performance, high learning outcomes, and high gaming performance emerged. Overall, Virtual Age is an effective game for learning about evolution based on its sound and sophisticated design. Implications derived from the study and suggestions for future work are proposed.     

Investigating the impact of video games on high school students’ engagement and learning about genetics

The popularity of video games has transcended entertainment crossing into the world of education. While the literature base on educational gaming is growing, there is still a lack of systematic study of this emerging technology’s efficacy. This quasi-experimental study evaluated a teacher created video game on genetics in terms of its affective and cognitive impact on student users. While statistical results indicated no differences (p > .05) in student learning as measured by our instrument, there were significant differences (p < .05) found in the participants’ level of engagement while interfacing with the video game. Implications on this emerging line of inquiry are discussed.     

Are educational computer micro-games engaging and effective for knowledge acquisition at high-schools? A quasi-experimental study

Curricular schooling can benefit from the usage of educational computer games, but it is difficult to integrate them in the formal schooling system. Here, we investigate one possible approach to this integration, which capitalizes on using a micro-game that can be played with a teacher’s guidance as a supplement after a traditional expository lecture followed by a debriefing. The game’s purpose is to reinforce and integrate part of the knowledge learnt during the lecture. We investigated feasibility of this approach in a quasi-experimental study in 70 min long seminars on the topic of animal learning at 5 classes at 4 different high-schools in the Czech Republic. Each class was divided to two groups randomly. After an expository lecture, the game group played a game called Orbis Pictus Bestialis while the control group received an extra lecture that used media-rich materials. The time allotment was the same in both groups. We investigated the immediate and one month delayed effects of the game on students’ knowledge reinforced and integrated by the game as well as on knowledge learnt during the expository lecture but not strengthened by the game. We also investigated students’ overall appeal towards the seminar and its perceived educational value. Data from 100 students were analysed. The results showed that a) the game-playing is comparable to the traditional form of teaching concerning immediate knowledge gains and has a significant medium positive effect size regarding retention, b) the game-playing is not detrimental to information transmitted in the expository lecture but not strengthened by the game, c) perceived educational value and the overall appeal were high in the game group, nevertheless the perceived educational value was slightly lower in the game group comparing to the traditional group. Our results suggest that the proposed approach of harnessing educational computer games at high-schools is promising.     

Development and behavioral pattern analysis of a mobile guide system with augmented reality for painting appreciation instruction in an art museum

A mobile guide system that integrates art appreciation instruction with augmented reality (AR) was designed as an auxiliary tool for painting appreciation, and the learning performance of three groups of visiting participants was explored: AR-guided, audio-guided, and nonguided (i.e., without carrying auxiliary devices). The participants were 135 college students, and a quasi-experimental research design was employed. Several learning performance factors of the museum visitors aided with different guided modes were evaluated, including their learning effectiveness, flow experience, the amount of time spent focusing on the paintings, behavioral patterns, and attitude of using the guide systems. The results showed that compared to the audio- and nonguided participants, the AR guide effectively enhanced visitors' learning effectiveness, promoted their flow experience, and extended the amount of time the visitors spent focusing on the paintings. In addition, the visitors' behavioral patterns were dependent upon the guided mode that they used; the visitors who were the most engaged in the gallery experience were those who were using the AR guide. Most of the visitors using the mobile AR-guide system elicited positive responses and acceptance attitudes.     

The view of scientific inquiry conveyed by simulation-based virtual laboratories

With an increasing number of studies evincing the effectiveness of simulation-based virtual laboratories (VLs), researchers have discussed replacing traditional laboratories. However, the approach of doing science endorsed by VLs has not been carefully examined. A survey of 233 online VLs revealed that hypothetico-deductive (HD) logic prevails in VL design. Most VLs convey an oversimplified view of scientific inquiry, which might handicap science education in terms of cultivating the ability to conduct authentic scientific inquiry and to solve everyday problems, or promoting students’ scientific literacy. Ever since Duhem and Kuhn, philosophers of science have learned that the relationship between hypotheses and evidence is holistic rather than deductive; however the pedagogical value of this point has not received enough attention in science education. Many science educators and VL-designers still uncritically adhere to the HD method. This article comments on the HD method and how VLs can avoid embracing it.     

Effects of attitudes and behaviours on learning mathematics with computer tools

This mixed-methods study investigates the effects of student attitudes and behaviours on the outcomes of learning mathematics with computer tools. A computer tool was used to help students develop the mathematical concept of function. In the whole sample (N = 521), student attitudes could account for a 3.4 point difference in test scores between individuals on a 10-point scale. General attitude towards mathematics positively predicted test scores. However, more able students who were well-disposed towards mathematical computer tools achieved lower scores. Self-reported behaviours were unrelated to test scores. Detailed observation of a small number of students (N = 8) revealed that positive attitudes towards mathematics and mathematical computer tools augmented exhibited learning behaviours, and that both a positive attitude to mathematical computer tools and exhibited learning behaviours benefited tool mastery. Although tool mastery and test scores are intimately related, reflective processes appear to mediate this relationship. Promoting learning with mathematical computer tools needs to take several factors into account, including improving student attitudes, raising levels of learning behaviours, and giving sufficient opportunity for constructing new mathematical knowledge within meaningful mathematical discourse.     

A concept map-embedded educational computer game for improving students' learning performance in natural science courses

Many recent studies have reported the benefits of educational computer games in promoting students' learning motivations. On the other hand, however, the effect of digital game-based learning in improving students' learning performance has been questioned. Several previous studies have reported that without properly integrating learning strategies into gaming scenarios, the effectiveness of educational computer games could be limited, or may be even worse than that of the conventional technology-enhanced learning approach. In this study, a concept map-embedded gaming approach is proposed for developing educational computer games by integrating concept mapping as part of the gaming scenarios to help students organize what they have learned during the game-based learning process. Moreover, a role-playing game has been developed for an elementary school natural science course based on the proposed approach. From the experimental results, it is found that the concept map-embedded gaming approach can significantly improve the students' learning achievement and decrease their cognitive load. Moreover, the students who learned with the proposed approach revealed a significantly higher degree of perceived usefulness than those who learned with the conventional game-based learning approach.     

An online image analysis tool for science education

This paper describes an online image analysis tool developed as part of an iterative, user-centered development of an online Virtual Learning Environment (VLE) called the Education through Virtual Experience (EVE) Portal. The VLE provides a Web portal through which schoolchildren and their teachers create scientific proposals, retrieve images and other resources, and produce collaborative scientific papers summarizing their learning experiences. The VLE underwent substantive formative testing involving over 200 schoolchildren producing over 50 collaboratively written research papers. Detailed analysis of these research papers identified some shortfalls toward the goal of producing authentic scientific engagement. The absence of data collection and data analysis within these research papers was disappointing despite having scheduled time for this activity and having several professional imaging tools available. The post-evaluation analyses have enabled the development team to identify specific design flaws in the previous VLE and have shaped the design of the new custom-built tool. The success of the tool will be born out through content analysis of future collaboratively written student papers.     

Learning differences and eye fixation patterns in virtual and physical science laboratories

This project analyzed high school students' performance and eye movement while learning in a simulation-based laboratory (SBL) and a microcomputer-based laboratory (MBL). Although the SBL and the MBL both used computers to collect, graph, and analyze data, the MBL involved manual manipulation of concrete materials, whereas the SBL displayed everything on a monitor. Fifty senior high school students at three urban public high schools in Taipei were randomly assigned to the MBL and SBL settings. The participants conducted the Boyle's Law experiment with an accompanying worksheet and completed pre- and post-conceptual tests. FaceLAB and ASL MobileEye were used to record each participant's eye movements in the SBL and MBL settings, respectively. The results showed that lower achievers improved significantly from the pre-to post-conceptual tests. The SBL group tended to carry out more experiments. Moreover, the MBL group's performance on the worksheet was moderately correlated with their post-test. However, this correlation was not found for the SBL group. Furthermore, at the beginning of the laboratories, the SBL group had a higher percentage of fixations with longer fixation duration, which implies more attention to and deeper cognitive processing of the equipment and running experiments, while the MBL group focused on the worksheet. This study concludes that, for e-learning like SBLs, students tend to start off doing an experiment, and then think about the questions on the worksheets, whereas for physical laboratories like MBLs, they tend to think before doing.     

The impact of Web3D technologies on medical education and training

This paper provides a survey of medical applications that make use of Web3D technologies, covering the period from 1995 to 2005. We assess the impact that Web3D has made on medical education and training during this time and highlight current and future trends. The applications identified are categorized into: general education tools; tools for diagnosis; procedures training; and collaborative training. A summary of work that has been carried out to validate these tools is also included in the survey.     

The effects of computer games on primary school students’ achievement and motivation in geography learning

The implementation of a computer game for learning about geography by primary school students is the focus of this article. Researchers designed and developed a three-dimensional educational computer game. Twenty four students in fourth and fifth grades in a private school in Ankara, Turkey learnt about world continents and countries through this game for three weeks. The effects of the game environment on students’ achievement and motivation and related implementation issues were examined through both quantitative and qualitative methods. An analysis of pre and post achievement tests showed that students made significant learning gains by participating in the game-based learning environment. When comparing their motivations while learning in the game-based learning environment and in their traditional school environment, it was found that students demonstrated statistically significant higher intrinsic motivations and statistically significant lower extrinsic motivations learning in the game-based environment. In addition, they had decreased focus on getting grades and they were more independent while participating in the game-based activities. These positive effects on learning and motivation, and the positive attitudes of students and teachers suggest that computer games can be used as an ICT tool in formal learning environments to support students in effective geography learning.     

Educational virtual environments: A ten-year review of empirical research (1999–2009)

This study is a ten-year critical review of empirical research on the educational applications of Virtual Reality (VR). Results show that although the majority of the 53 reviewed articles refer to science and mathematics, researchers from social sciences also seem to appreciate the educational value of VR and incorporate their learning goals in Educational Virtual Environments (EVEs). Although VR supports multisensory interaction channels, visual representations predominate. Few are the studies that incorporate intuitive interactivity, indicating a research trend in this direction. Few are the settings that use immersive EVEs reporting positive results on users’ attitudes and learning outcomes, indicating that there is a need for further research on the capabilities of such systems. Features of VR that contribute to learning such as first order experiences, natural semantics, size, transduction, reification, autonomy and presence are exploited according to the educational context and content. Presence seems to play an important role in learning and it is a subject needing further and intensive studies. Constructivism seems to be the theoretical model the majority of the EVEs are based on. The studies present real world, authentic tasks that enable context and content dependent knowledge construction. They also provide multiple representations of reality by representing the natural complexity of the world. Findings show that collaboration and social negotiation are not only limited to the participants of an EVE, but exist between participants and avatars, offering a new dimension to computer assisted learning. Little can yet be concluded regarding the retention of the knowledge acquired in EVEs. Longitudinal studies are necessary, and we believe that the main outcome of this study is the future research perspectives it brings to light.     

A web-based learning tool improves student performance in statistics: A randomized masked trial

Background

e-status is a web-based tool able to generate different statistical exercises and to provide immediate feedback to students’ answers. Although the use of Information and Communication Technologies (ICTs) is becoming widespread in undergraduate education, there are few experimental studies evaluating its effects on learning.

Method

All of the students (121) from an introductory course for statistics in dentistry were randomly assigned to use the tool with one of two 6-problem sets, known as types A and B. The primary endpoint was the grade difference obtained in the final exam, composed of two blocks of questions related to types A and B. The exam evaluator was masked to the intervention group.

Results

We found that the effect of e-status on the student grade was an improvement of 0.48 points (95% CI: 0.10–0.86) on a ten-point scale. Among the 94 students who actually employed e-status, the effect size was 0.63 (95% CI: 0.17–1.10).

Conclusions

It is feasible to formally assess the learning effect of an innovative tool. Providing e-status exercises to students has a direct effect on learning numerical operations related to statistics. Further effects on higher cognitive levels still have to be explored.     

A Comparison of learning gains when using a 2D simulation tool versus a 3D virtual world: An experiment to find the right representation involving the Marginal Value Theorem

The use of three-dimensional Virtual Worlds in the classroom offers the promise of engaging and authentic learning experiences. Given the effort and investment involved in the creation of these worlds, more studies are needed which measure the learning gains. In particular, greater understanding is needed concerning what aspects of the technology are beneficial for learning what sort of content and in what context. We conducted two experimental studies involving 129 biology students over a two-year period that sought to make a contribution towards this understanding. Our study compared the knowledge of students after a traditional classroom lecture about a biological theorem known as Marginal Value Theorem, with their knowledge after they were exposed to simulations of two-dimensional models developed in NetLogo and three-dimensional models developed in Unity3D. Perhaps due to cognitive overload and distractors in the virtual world, it appears that the two-dimensional NetLogo model delivered better learning outcomes.     

Identifying students’ mathematical skills from a multiple-choice diagnostic test using an iterative technique to minimise false positives

There is anecdotal evidence that a significant number of students studying computing related courses at degree level have difficulty with sub-GCE mathematics. Testing of students’ skills is often performed using diagnostic tests and a number of computer-based diagnostic tests exist, which work, essentially, by testing one specific diagnostic skill at a time.     

The use of a computer simulation to promote conceptual change: A quasi-experimental study

This mixed-methods investigation compared the effectiveness of three instructional approaches in achieving desired conceptual change among early childhood preservice teachers (n = 157). Each of the three treatments employed inquiry-based instruction on moon phases using data collected from: (1) the planetarium software program, Starry Night™, (2) nature observations and Starry Night™, or (3) nature observations alone. Data sources included drawings, intensive interviews, and a lunar shapes card sort. The data sets were analyzed via a constant comparative method in order to produce profiles of each participant’s pre- and post-instruction conceptual understandings of moon phases. Non-parametric tests of significance revealed that pre- to post-instruction gains were significant for all three treatments across all targeted concepts. The Starry Night™-Only treatment demonstrated statistically greater gains for sequencing moon phases than the other two treatments. However, there were no significant differences among the three treatments in regard to participants’ abilities to draw scientific moon shapes or in their conceptions of the causes of moon phases. Thus, the three treatments were equally effective in facilitating desired conceptual change.     

Exploring Newtonian mechanics in a conceptually-integrated digital game: Comparison of learning and affective outcomes for students in Taiwan and the United States

This study investigates the potential of a digital game that overlays popular game-play mechanics with formal physics representations and terminology to support explicit learning and exploration of Newtonian mechanics. The analysis compares test data, survey data, and observational data collected during implementations in Taiwan and the United States with students in grades 7–9. Results demonstrate learning on some core disciplinary measures and high levels of learner engagement, indicating the potential benefits of this genre of conceptually-integrated games, but also suggesting that further research and development will be needed to more fully harness this potential. Encouragingly, striking similarities were observed across the two countries in terms of learning and engagement, suggesting that this genre of learning games may prove suitable for engaging students in active exploration of core science concepts across multiple countries.     

Effects of an integrated concept mapping and web-based problem-solving approach on students' learning achievements,perceptions and cognitive loads

Although students could effectively search for web data with proper keywords and select web pages related to the studied core issue, however summarizing or organizing the retrieved information remains a difficult task for them. Concept mapping is known to be an effective knowledge construction tool for helping learners organize important concepts related to a core issue. To address the problem, an integrated concept mapping and web-based problem-solving environment, CM-Quest, has been developed; moreover, an experiment has been conducted to evaluate the effectiveness of the approach on students' learning performance, learning satisfaction and cognitive load in an elementary school social studies course. The results show that the concept map-integrated approach can significantly enhance the students' web-based problem-solving performance, although the students showed lower degrees of technology acceptance and learning satisfaction in comparison with the conventional web-based problem-solving approach. Moreover, it is found that the students in the concept mapping group revealed higher cognitive loads than those in the control group, which could be the factor contributing to the lower technology acceptance degree and learning satisfaction. As a consequence, it is concluded that the integrated concept mapping and web-based problem-solving approach is helpful to students in guiding them to learn in a more effective way. On the other hand, it remains an open issue to find a suitable way of integrating concept maps into the learning process without introducing too much extra cognitive load so as to promote students' acceptance degree of using technology for better learning.