Effects of an online problem based learning course on content knowledge acquisition and critical thinking skills

This study investigated how the online problem based learning (PBL) approach employed in an online learning environment influenced undergraduate students’ critical thinking skills (CTS) and content knowledge acquisition. The pretest–posttest control group design was used in the study. The subjects included the students who were enrolled at the Department of Primary School Mathematics Teaching in Anadolu University Education Faculty. Subjects attended to Computer II course in 2008 spring. Experiment group attended the online PBL course whereas the control group attended the online instructor-led course. Each group consisted of 20 students. Data collection tools consisted of a multiple choice content knowledge acquisition scale and the Watson–Glaser critical thinking skills test. The results of two-way mixed design ANOVA indicated that learning in the online PBL group did not have a significant effect on the content knowledge acquisition scores. It was also revealed that learning in the online PBL group had a significant effect on increasing the critical thinking skills.     

Building virtual cities,inspiring intelligent citizens: Digital games for developing students’ problem solving and learning motivation

This study investigates the effectiveness digital game-based learning (DGBL) on students’ problem solving, learning motivation, and academic achievement. In order to provide substantive empirical evidence, a quasi-experimental design was implemented over the course of a full semester (23 weeks). Two ninth-grade Civics and Society classes, with a total of 44 students (15–16 years old), were randomly assigned to one of two conditions: an experimental group (incorporating DGBL) and a comparison group (taught using traditional instruction). Two-way mixed ANOVA was employed to evaluate changes in problem solving ability and compare the effectiveness the two strategies, while ANCOVA was used to analyze the effects on learning motivation and academic achievement. The results of this study are summarized as follows: (1) The DGBL strategy was clearly effective in promoting students’ problem solving skills, while the control group showed no improvement. Additionally, data from the mid-test and post-test demonstrate that, as a higher order thinking skill, problem-solving requires a full semester to develop. (2). DGBL resulted in better learning motivation for students in the experimental group as compared to learners receiving TI. (3) Contrary to some suggestions that digital games could inhibit academic achievement, no statistically significant difference was found between the two groups. Most importantly, the quantitative improvement in problem-solving and learning motivation suggest that DGBL can be exploited as a useful and productive tool to support students in effective learning while enhancing the classroom atmosphere. Future research in DGBL should emphasize the evaluation of other higher order elements of the cognitive domain in terms of academic achievement outcomes and skills, such as critical and creative thinking.     

Development of a contextual decision-making game for improving students' learning performance in a health education course

Heath education is an important component of the curriculum for fostering children's correct health knowledge and good daily life habits. However, educators have indicated that most children might fail to realize the importance and meaning of health education content owing to the lack of authentic scenarios and daily life experience. With the advancement of computer technologies, researchers have tried to develop multimedia learning content in order to improve students' learning performance. Among various technology-enhanced learning alternatives, digital game-based learning has been recognized as a highly potential approach to motivating students. However, several previous studies have indicated that, without properly incorporating learning content into game scenarios, the effectiveness of digital game-based learning might not be as good as expected in comparison with conventional technology-enhanced learning. In this study, a contextual digital game was developed for improving students' learning performance in an elementary school health education course. A quasi experiment was conducted to evaluate the effectiveness of the proposed approach by situating the experimental group in the game-based learning scenario and the control group to learn with conventional e-books. The experimental results showed that the proposed approach not only improved the students' learning motivation, but also their learning achievement and problem-solving competences. Moreover, the significant two-way interaction suggested that the contextual game-based learning approach benefited the higher motivation students more than the lower motivation ones in terms of the advanced knowledge, showing the importance and potential of applying contextual games to health education activities.     

Virtual CEOs: A blended approach to digital gaming for enhancing higher order thinking and academic achievement among vocational high school students

The requirements of a contemporary workplace include the ability to think critically and creatively in order to solve problems and respond to changes in economic and social conditions. Unfortunately, vocational education often fails to prepare graduates for this environment due to limited resources, low student motivation, or the reliance upon outdated instructional strategies. The use of digital game-based learning (DGBL) for vocational education has been proposed, but has yet to be effectively implemented, particularly in terms of the promotion of higher order thinking skills (HOTS). Data from 68 eleventh grade vocational high school students were evaluated after a quasi-experimental, 27 week intervention. Pretest and posttest results were evaluated by MANCOVA and demonstrated that the experimental group (blended DGBL incorporating integrative HOTS activities) outperformed the comparison group (technology enhanced learning) in terms of creative thinking, critical thinking, problem solving, and academic achievement, with significant improvements on all four measures. While technology-enhanced learning was effective in promoting academic achievement and creative thinking, the DGBL condition was deemed most effective in providing an authentic context for developing employment-related skills and knowledge. Based on these results, a blended approach for DGBL, which incorporates instructor orchestration and scaffolding, provision of learning aids, and the use of collaborative learning, is recommended, particularly for vocational learners. This paper provides examples of a concrete model of DGBL instruction that was verified empirically as successful in significantly improving all three higher order thinking skills, including creative thinking, critical thinking, and problem solving.     

AgentCubes: Incremental 3D end-user development

3D game development can be an enticing way to attract K-12 students to computer science, but designing and programming 3D games is far from trivial. Students need to achieve a certain level of 3D fluency in modeling, animation, and programming to be able to create compelling 3D content. The combination of innovative end-user development tools and standards-based curriculum that promotes IT fluency by shifting the pedagogical focus from programming to design, can address motivational aspects without sacrificing principled educational goals. The AgentCubes 3D game-authoring environment raises the ceiling of end-user development without raising the threshold. Our formal user study shows that with Incremental 3D, the gradual approach to transition from 2D to 3D authoring, middle school students can build sophisticated 3D games including 3D models, animations, and programming.     

A narrative literature review of games,animations and simulations to teach research methods and statistics

Basic competence in research methods and statistics is core for many undergraduates but many students experience difficulties in acquiring knowledge and skills in this area. Interest has recently turned to serious games as providing engaging ways of learning. The CHERMUG project was developed against this background to develop games to support students in learning about research methods and statistics. As a first step in designing the CHERMUG games a narrative literature review was carried out to establish whether similar games, animations and simulations already existed. Search terms used in the literature review included varied terms for digital games, simulations and animations, terms relevant to the twin goals of learning and engagement in games and terms for research methods and statistics. Application of the inclusion criteria led to 26 papers which were considered relevant. Synthesis of the papers suggested that there is reason to be optimistic that a game-based approach might be effective in learning in this area.     

An experience of a three-year study on the development of critical thinking skills in flipped secondary classrooms with pedagogical and technological support

The aim of this study was attempting to investigate the outcome of critical thinking achievement of learners when its development is infused into subject teaching with pedagogical and technological support. A total of 124 junior secondary students participated in the three-year trial teaching in Integrated Humanities subject. Flipped classroom strategy was implemented to engage learners in online pre-lesson learning preparation, in-class group discussion inside digital classroom and after-class extended learning using social learning platform. The critical thinking tests found that the students had good performance in the tasks on hypothesis identification, induction and deduction; and some achievements in the tasks on explanation and evaluation. It was found that students needed more time to develop capacities of deduction, explanation and evaluation. The semi-structured interviews found that the teachers and students valued the pedagogical way of providing guidance for students' group sharing for fostering critical thinking skills development. Three implications are discussed to shed light on the infusion of critical thinking skills development into the process of domain knowledge learning, the deployment of appropriate pedagogy to mobilize learners to engage in learning process, and the use of appropriate technology to facilitate learning process inside and outside of classroom.     

A concept map-embedded educational computer game for improving students' learning performance in natural science courses

Many recent studies have reported the benefits of educational computer games in promoting students' learning motivations. On the other hand, however, the effect of digital game-based learning in improving students' learning performance has been questioned. Several previous studies have reported that without properly integrating learning strategies into gaming scenarios, the effectiveness of educational computer games could be limited, or may be even worse than that of the conventional technology-enhanced learning approach. In this study, a concept map-embedded gaming approach is proposed for developing educational computer games by integrating concept mapping as part of the gaming scenarios to help students organize what they have learned during the game-based learning process. Moreover, a role-playing game has been developed for an elementary school natural science course based on the proposed approach. From the experimental results, it is found that the concept map-embedded gaming approach can significantly improve the students' learning achievement and decrease their cognitive load. Moreover, the students who learned with the proposed approach revealed a significantly higher degree of perceived usefulness than those who learned with the conventional game-based learning approach.     

Using Serious Games in Data Communications and Networking Management Course

Data communications and networking management is one important course taught in business schools. To prepare themselves for future career, students need to acquire the data communications skills and the higher-order cognitive skills (HOCS) from this course so that they relate the relevance of the theory to practical problems. Prior literature shows that serious games offer an ability to trigger enjoyment in learning this difficult subject. Therefore, in this study, we empirically examined the effects of serious game feature on students’ learning experience, focusing particularly on concentration and enjoyment, as well as measuring the perceived improvement in their HOCS. The results revealed that features of serious games have positive effects on students’ concentration and enjoyment, and such learning experience did indeed significantly improve their perceived HOCS. The results encourage faculty members to adopt serious games to teach difficult subjects in the field of management information systems.     

Interactive story authoring: A viable form of creative expression for the classroom

The unprecedented growth in numbers of children playing computer games has stimulated discussion and research regarding what, if any, educational value these games have for teaching and learning. The research on this topic has primarily focused on children as players of computer games rather than builders/constructors of computer games. Recently, several game companies, such as BioWare Corp. and Bethesda Softworks, have released game story creation tools to the public, along with their games. However, a major obstacle to using these commercial tools is the level of programming experience required to create interactive game stories. In this paper, we demonstrate that a commercial game story construction tool, BioWare Corp.’s Aurora Toolset, can be augmented by our new tool, ScriptEase, to enable students in two grade ten English classes to successfully construct interactive game stories. We present evidence that describes the relationship between interactive story authoring and traditional story authoring, along with a series of factors that can potentially affect success at these activities: gender, creativity, intellectual ability, previous experiences with programming, time playing computer games, and time spent online. Results indicate that students can successfully construct sophisticated interactive stories with very little training. The results also show no gender differences in the quality of these interactive stories, regardless of programming experience or the amount of time per week playing computer games or participating in general online activities, although a subset of female students did show a slightly higher level of performance on interactive story authoring. In the educational context of this study, we show that ScriptEase provides an easy-to-use tool for interactive story authoring in a constructionist learning environment.     

Computer game development as a literacy activity

This study examined computer game development as a pedagogical activity to motivate and engage students in curriculum-related literacy activities. We hypothesized that as a consequence, students would improve their traditional reading and writing skills as well as develop new digital literacy skills. Eighteen classes of grade 4 students were assigned to either an experimental or control group. Both groups studied the same curriculum unit over a 10 week period, however, in addition the experimental group developed computer games related to the unit using a game development shell. An analysis of pre- and post-unit scores on two standardized literacy test batteries revealed that the experimental students performed significantly better on one of the subtests, a measure of logical sentence construction (p = .002). Field notes and teacher interview data indicated that game development helped improve student content retention, ability to compare and contrast information presented, utilize more and different kinds of research materials including digital resources, editing skills, and develop an insight into questioning skills.     

An interactive peer-assessment criteria development approach to improving students' art design performance using handheld devices

Engaging students in higher order thinking such as evaluation and analysis has been recognized as being an important strategy for helping them develop knowledge and skills, in particular, in creativeness-oriented learning activities such as artwork design. In this paper, an interactive peer-assessment criteria development approach is proposed to help students develop assessment criteria, learn from viewing peers' work, and make reflections in artwork design activities using mobile devices. To evaluate the effectiveness of the proposed approach, an experiment was conducted in an elementary school art course. A total of 103 students participating in the experiment were assigned to an experimental group and a control group. The students in the experimental group learned with the proposed approach, while those in the control group learned with the conventional peer assessment approach. From the experimental results, it was found that the proposed approach significantly improved the students' learning achievement, learning motivation and meta-cognitive awareness, suggesting the effectiveness of engaging students in assessment criteria development in an interactive manner.     

EGameFlow: A scale to measure learners’ enjoyment of e-learning games

In an effective e-learning game, the learner’s enjoyment acts as a catalyst to encourage his/her learning initiative. Therefore, the availability of a scale that effectively measures the enjoyment offered by e-learning games assist the game designer to understanding the strength and flaw of the game efficiently from the learner’s points of view. E-learning games are aimed at the achievement of learning objectives via the creation of a flow effect. Thus, this study is based on Sweetser’s & Wyeth’s framework to develop a more rigorous scale that assesses user enjoyment of e-learning games. The scale developed in the present study consists of eight dimensions: Immersion, social interaction, challenge, goal clarity, feedback, concentration, control, and knowledge improvement. Four learning games employed in a university’s online learning course “Introduction to Software Application” were used as the instruments of scale verification. Survey questionnaires were distributed to students taking the course and 166 valid samples were subsequently collected. The results showed that the validity and reliability of the scale, EGameFlow, were satisfactory. Thus, the measurement is an effective tool for evaluating the level of enjoyment provided by e-learning games to their users.     

Using a Murder Mystery to Teach Evaluation Skills: A Case Study

Evaluation of sources and information is an important part of information literacy and the research process. Evaluation skills and their application to daily life might be reduced to a checklist in a one-shot lesson or a semester-long information literacy class. To demonstrate the transferability of evaluation skills, one teaching librarian created an active-learning, online murder mystery to engage students. Instructors have established using games as an active-learning lesson in the face-to-face classroom. A murder mystery game challenges students to evaluate information from the course, verify the information using online searches, and demonstrate critical thinking skills in the context of a game. This case study explains the rationale of using such a game in an online, semester-long class, the process of creating the mystery, and its benefits in the virtual classroom.     

Stochastic frontier estimation of efficient learning in video games

Stochastic Frontier Regression Analysis was used to investigate strategies and skills that are associated with the minimization of time required to achieve proficiency in video games among students in grades four and five. Students self-reported their video game play habits, including strategies and skills used to become good at the video games they play. Results indicated an association between game play time spent during vacation weeks and proficiency at the game, but no such association existed with game play time during typical weeks when school is in session. Several strategies and skills were associated with the minimization of time spent to achieve proficiency at the game, while a few strategies and skills held a negative association with efficient learning in games. Some of the findings paralleled those of prior research on formal education. Gender differences, as well as implications for games and learning are discussed.     

Kes Sesi: A mobile game designed to improve kindergarteners' recognition of letter sounds

Learning letters is an important area of language learning, conducive to the beginning of reading and writing. Indeed, today's generation prefers to learn through digital games rather than through formal teaching processes. Inspired by this need, the researcher designed this study (a) to test the effectiveness of an instructional digital game, “Kes Sesi,” designed to teach letter recognition skills and (b) to briefly present its instructional development process, which was based on the ADDIE model. This was a quasi‐experimental study with two treatment groups and a control group involving 87 kindergarteners. Treatment groups played the game for 12–6 weeks for learning, 6 weeks for practice. The control group continued with its regular class activities. One treatment group played the game based on predefined sound categorization, the other without any categorization. A test on children's sound recognition abilities was administered three times as a pretest, a midtest, and a posttest. The treatment groups performed significantly better than the control group. The game enhanced the kindergarteners' ability to practice uncategorized content while it enhanced their ability to learn categorized content. The results are promising in that Kes Sesi can be useful in self‐supported learning contexts with little adult input and with minimum outside interference.     

Assessing the educational values of digital games

Abstract   In recent years, digital games have assumed an important place in the lives of children and adolescents. Effective content design is crucial to the success of digital game-based learning. Therefore, the tool for assessing the effectiveness of game design is accordingly very important for parents and teachers, so that they may encourage or discourage students to play. The purpose of this study is to develop an assessment tool to examine the educational values of digital games. In the first phase of this research, the research team developed the indices for assessing the educational values of digital games. An expert panel consisting of game scholars and professional game designers was established to construct the indices for evaluating digital games in three focus group discussions. Seventy-four game evaluation indices were sorted into seven categories: mentality change, emotional fulfilment, knowledge enhancement, thinking skill development, interpersonal skill development, spatial ability development and bodily coordination. In the second phase of the research, the game designers were asked to assess certain games by using the 74 indices. Meanwhile, the game scholars were also asked to evaluate the same pool of games by the same indices. The assessments by both the scholars and designers were then compared and the similarities were found. This research provided a preliminary framework for future game designers, parents and teachers in assessing educational values of digital games.     

Using commercial video games in flipped classrooms to support physical concept construction

Based on the flipped‐classroom model and the potential motivational and instructional benefits of digital games, we describe a flipped game‐based learning (FGBL) strategy focused on preclass and overall learning outcomes. A secondary goal is to determine the effects, if any, of the classroom aspects of the FGBL strategy on learning efficiency. Our experiments involved 2 commercial games featuring physical motion concepts: Ballance (Newton's law of motion) and Angry Birds (mechanical energy conservation). We randomly assigned 87 8th‐grade students to game instruction (digital game before class and lecture‐based instruction in class), FGBL strategy (digital game before class and cooperative learning in the form of group discussion and practice in class), or lecture‐based instruction groups (no gameplay). Results indicate that the digital games exerted a positive effect on preclass learning outcomes and that FGBL‐strategy students achieved better overall learning outcomes than their lecture‐based peers. Our observation of similar overall outcomes between the cooperative learning and lecture‐based groups suggests a need to provide additional teaching materials or technical support when introducing video games to cooperative classroom learning activities.     

Pairing practice and feedback with animations optimizes student learning in online module

In this study, we investigated the optimal placement of animations and practice and feedback exercises with respect to each other and to static text and graphics in an online DNA replication module. We randomly assigned students in a first‐semester introductory biology course for freshmen biology majors and nonmajors to one of four online modules with animations and practice exercises (assets) either embedded with the text and images or saved until the end after all the text and images. Although we expected to find that embedding assets with text and images would improve learning outcomes, we were surprised to find that outcomes did not change with the location of these assets with respect to the text and static images. Instead, we found that colocation of exercises with animations was correlated with the biggest student learning gains, independent of where these assets appeared relative to the static text and static images. This held true both for immediate posttest scores and delayed application questions on a midterm exam. Our findings could have potential implications for how to best design online learning modules that feature multiple assets.