When a game supports prevocational math education but integrated reflection does not

The present study addressed the effectiveness of an educational math game for improving proportional reasoning in prevocational education, and examined the added value of support in the form of reflection. The study compared four conditions: the game with reflection prompts, the game with reflection prompts plus procedural information, the game with procedural information only and the game without additional support. It was found that students' proportional reasoning skill improved after playing the game. The game managed to target prevocational students with low prior knowledge, a group that has the potential to understand proportional reasoning but has not yet encountered the right learning situation to live up to their potential. However, it was also found that students need to be computational fluent to profit from the game. Furthermore, no added value of the support was found. The way the support was structured may have been too demanding for most of the students. The fact that the prevocational students (and specifically those with low prior knowledge) improved by playing the game is noteworthy, because the topic of proportional reasoning is demanding for this group of students who often have lower abilities as well as in some cases a high resistance to learning.     

Predicting students' knowledge after playing a serious game based on learning analytics data: A case study

Serious games have proven to be a powerful tool in education to engage, motivate, and help students learn. However, the change in student knowledge after playing games is usually measured with traditional (paper) prequestionnaires–postquestionnaires. We propose a combination of game learning analytics and data mining techniques to predict knowledge change based on in-game student interactions. We have tested this approach in a case study for which we have conducted preexperiments–postexperiments with 227 students playing a previously validated serious game on first aid techniques. We collected student interaction data while students played, using a game learning analytics infrastructure and the standard data format Experience API for Serious Games. After data collection, we developed and tested prediction models to determine whether knowledge, given as posttest results, can be accurately predicted. Additionally, we compared models both with and without pretest information to determine the importance of previous knowledge when predicting postgame knowledge. The high accuracy of the obtained prediction models suggests that serious games can be used not only to teach but also to measure knowledge acquisition after playing. This will simplify serious games application for educational settings and especially in the classroom easing teachers' evaluation tasks.     

Effects of anxiety levels on learning performance and gaming performance in digital game‐based learning

Anxiety plays an influential role in foreign language learning. However, a lack of attention was paid to examining the effects of anxiety levels on learning performance and gaming performance in digital game‐based learning. To this end, this study developed a game‐based English learning system and investigated how different levels of anxiety affected learners' learning performance and gaming performance. A quasi‐experiment was conducted in an elementary school. The results showed that high‐anxiety learners performed worse than low‐anxiety learners in speaking, word/sentence match, and overall learning performance. However, they performed similarly in listening performance. Moreover, the results showed that high‐ and low‐anxiety learners demonstrated a similar level of gaming performance. A subsequent analysis showed that significant correlations existed between learning performance and gaming performance for learners with high anxiety whereas such positive correlations were rarely found for learners with low anxiety, indicating that high‐anxiety learners' learning performance could be fostered by their gaming performance. The findings suggested that digital game‐based learning was particularly beneficial to high‐anxiety learners, whose gaming performance was a facilitative factor of their learning performance.     

My‐Mini‐Pet: a handheld pet‐nurturing game to engage students in arithmetic practices

In the last decade, more and more games have been developed for handheld devices. Furthermore, the popularity of handheld devices and increase of wireless computing can be taken advantage of to provide students with more learning opportunities. Games also could bring promising benefits – specifically, motivating students to learn/play, sustaining their interest, reflecting their learning/playing status, and facilitating the learning/playing progress. However, most of these have been designed for entertainment rather than education. Hence, in this study we incorporate game elements into a learning environment. The My‐Mini‐Pet system is a handheld pet‐nurturing game environment, in which students learn with an animal learning companion, their My‐Mini‐Pet. Three design strategies are adopted. First, the pet‐nurturing strategy, which simulates the relationship between the pet and its owner, the My‐Mini‐Pet becomes a motivator/sustainer of learning. Second, the pet appearance‐changing strategy, which externalizes the learning status of the student. In other words, the My‐Mini‐Pet plays the role of a reflector. Third, the pet feedback strategy, which links the behaviours of the student and his/her pet, the My‐Mini‐Pet acts as a facilitator of learning. A pilot study was also conducted to preliminarily investigate the effectiveness and experiences of the strategies on allowing the student to understand arithmetic practices. The results showed that the strategy was effective, encouraging the students to engage in learning activities. Furthermore, the game attracted the students’ attention and stimulated discussion between peers. Some implications about the further developments are also discussed.     

Enhancing middle school students' scientific learning and motivation through agent‐based learning

Facing students' decreasing motivation to pursue scientific study, schools and educators need to coordinate new technologies with pedagogical agents to effectively sustain or promote students' scientific learning and motivation to learn. Although the provision of pedagogical agents in student learning has been studied previously, it is not clear what benefits the strategy might offer with regard to student motivation. This study proposes an agent‐based mechanism that integrates problem‐solving and inquiry‐based instructions to help students better understand complex scientific concepts and to sustain their motivation to learn science. In this study, a quasi‐experiment was conducted to evaluate the performance and feasibility of our proposed mechanism. The results revealed that the agent‐based mechanism was effective and feasible for enhancing students' learning and motivation to learn. The mechanism was associated with increases in the acquisition of knowledge when compared with the control group. Its effect in promoting and sustaining students' motivation was also statistically significant. Detailed discussions of the findings are provided in this study.     

Designing a technology‐enhanced flipped learning system to facilitate students' self‐regulation and performance

In recent years, the flipped classroom has become prevalent in many educational settings. Flipped classroom adopts a pedagogical model in which short video lectures are viewed by students at home before class so that the teacher can lead students to participate in activities, problem‐solving, and discussions. Yet the design or use of technology that employs planned instructional strategies with sustainable support of self‐regulation is scant. We propose a technology‐enhanced flipped language learning system (Flip2Learn) that provides facilitation and guidance for learning performance and self‐regulation. A quasi‐experimental study was carried out to examine whether Flip2Learn could enhance college students' self‐regulatory skills and later contribute to the learning performance in the flipped classrooms. The results showed that Flip2Learn not only better prepared students for flipped classrooms but also better promoted learning performance compared to the conventional flipped classrooms. The results of this research advanced our understanding of the dynamics of flipped classrooms and represented a revolutionary new approach to the technology‐enhanced learning for flipped classrooms.     

Mobile‐Based micro‐Learning and Assessment: Impact on learning performance and motivation of high school students

Mobile‐based micro‐learning has gained a lot of attention lately, especially for work‐based and corporate training. It combines features of mobile learning and micro‐learning to deliver small learning units and short‐term learning activities. The current study uses the lens of the Self‐Determination Theory of motivation and proposes a series of Mobile‐Based micro‐Learning and Assessment (MBmLA) homework activities to improve high school students' motivation and learning performance in science. An experiment was conducted to evaluate the effectiveness of the proposed approach. One hundred and eight students of a senior‐level high school in Europe were randomly assigned into either a control condition (conventional paper‐based homework approach) or an experimental (MBmLA approach) condition. The study carried out for a period of 5 weeks. From the experimental results, it was found that, in comparison to the conventional paper‐based approach, the proposed MBmLA approach enhanced students' basic psychological needs of self‐perceived autonomy, competence, and relatedness and improved students' exam performance in terms of factual knowledge. Moreover, students self‐reported greater learning satisfaction with the mobile‐based microassessment and micro‐learning homework tasks. Implications on educational practices as well as future research are discussed.     

Improving the effectiveness of English vocabulary review by integrating ARCS with mobile game‐based learning

Memorizing English vocabulary is often considered uninteresting, and a lack of motivation exists during learning activities. Moreover, most vocabulary practice systems automatically select words from articles and do not provide integrated model methods for students. Therefore, this study constructed a mobile game‐based English vocabulary practice system, which imitates the popular block elimination game and combines test items of article, difficulty, and teacher model in accordance with curriculum objectives and demands. The participants were first‐year students and classified into traditional group (Group T) and game‐based group (Group G), and learning effectiveness and motivation were analysed in this study. According to statistical analysis results, students who used the game‐based vocabulary practice system, which could captivate their attention and interest, had higher learning effectiveness and provided positive feedback of learning motivation. Furthermore, English teachers could select teaching materials that are consistent with the features, knowledge, and cultural background of learners to improve the relevance dimension of learning motivation.     

Supervised machine learning in multimodal learning analytics for estimating success in project‐based learning

Multimodal learning analytics provides researchers new tools and techniques to capture different types of data from complex learning activities in dynamic learning environments. This paper investigates the use of diverse sensors, including computer vision, user‐generated content, and data from the learning objects (physical computing components), to record high‐fidelity synchronised multimodal recordings of small groups of learners interacting. We processed and extracted different aspects of the students' interactions to answer the following question: Which features of student group work are good predictors of team success in open‐ended tasks with physical computing? To answer this question, we have explored different supervised machine learning approaches (traditional and deep learning techniques) to analyse the data coming from multiple sources. The results illustrate that state‐of‐the‐art computational techniques can be used to generate insights into the "black box" of learning in students' project‐based activities. The features identified from the analysis show that distance between learners' hands and faces is a strong predictor of students' artefact quality, which can indicate the value of student collaboration. Our research shows that new and promising approaches such as neural networks, and more traditional regression approaches can both be used to classify multimodal learning analytics data, and both have advantages and disadvantages depending on the research questions and contexts being investigated. The work presented here is a significant contribution towards developing techniques to automatically identify the key aspects of students success in project‐based learning environments, and to ultimately help teachers provide appropriate and timely support to students in these fundamental aspects.     

Developing a web‐based multimedia assessment system for facilitating science laboratory instruction

This study developed a web‐based multimedia assessment system (WMA system) and applied it to science laboratory instruction. The goal was to improve students' knowledge acquisition under science laboratory instruction. The developed system enabled learners to perform self‐assessments by responding to multimedia technology test items online. The system recorded each learner's complete answer history and provided the students with personalized learning resources. This study adopted a quasi‐experimental research design. The learning content was an “experiment on separating mixtures.” Students participating in the research were divided into a typical science laboratory instruction group (TI group; n = 25) and a group that received instruction through the WMA system (WMA group; n = 26). Before instruction, all the students completed the conceptual knowledge and experimental knowledge pretests. During instruction, the TI group watched the teacher's demonstration experiment, and the students then performed the experiment in a real laboratory. In the WMA group, after learning through the WMA system, the students also performed the experiment in a real laboratory. After instruction, all the students completed the conceptual knowledge and experimental knowledge posttests. The findings indicated that the students in the WMA group showed significantly higher improvements in their scientific conceptual knowledge and experimental knowledge.     

Quality in e‐learning – a conceptual framework based on experiences from three international benchmarking projects

Between 2008 and 2010, Lund University took part in three international benchmarking projects, E‐xcellence+, the eLearning Benchmarking Exercise 2009, and the First Dual‐Mode Distance Learning Benchmarking Club. A comparison of these models revealed a rather high level of correspondence. From this finding and from desktop studies of the current discourse regarding e‐learning, a conceptual framework for e‐learning has emerged based on a range of critical success factors. This model could be used as a foundation for future e‐learning and as an inspiration to develop, implement, evaluate, and internalize e‐learning. It shows that various aspects of accessibility, flexibility, interactiveness, personalization, and productivity should be embedded in all levels of management and services within the field of e‐learning in higher education. To meet students' expectations, demands, and rights, these critical issues should be taken into account from a holistic perspective with transparency and innovation in mind. Therefore, successful e‐learning requires change from an organizational as well as a pedagogical perspective. One conclusion from this study is that a revolution is on the way and that learning will be reoriented along paradigms of collaboration and networking. Globalization, sustainability, and lifelong learning will be some of the leading concepts in this process.     

Inventing motivates and prepares student teachers for computer‐based learning

A brief, problem‐oriented phase such as an inventing activity is one potential instructional method for preparing learners not only cognitively but also motivationally for learning. Student teachers often need to overcome motivational barriers in order to use computer‐based learning opportunities. In a preliminary experiment, we found that student teachers who were given paper‐based course material spent more time on follow‐up coursework than teachers who were given a well‐developed computer‐based learning environment (CBLE), leading to higher learning outcomes. Thus, we tested inventing as an instructional method that may help overcome motivational barriers of teachers' use of computer‐supported tools or learning environments in our main experimental study (N = 44). As a computer‐based environment, we used the ‘Assessment of Learning strategies in Learning journals’. The inventing group produced ideas about criteria to evaluate learning strategies based on student cases prior to the learning phase. The control condition read a text containing possible answers to the inventing problem. The inventing activity enhanced motivation prior to the learning phase and assessment skills as assessed by transfer problems. Hence, the inventing activity prepared student teachers to learn from a CBLE in a motivational as well as cognitive way.     

Supporting self‐regulated learning in computer‐based learning environments: systematic review of effects of scaffolding in the domain of science education

Despite the widespread assumption that students require scaffolding support for self‐regulated learning (SRL) processes in computer‐based learning environments (CBLEs), there is little clarity as to which types of scaffolds are most effective. This study offers a literature review covering the various scaffolds that support SRL processes in the domain of science education. Effective scaffolds are categorized and discussed according to the different areas and phases of SRL. The results reveal that most studies on scaffolding processes focus on cognition, whereas few focus on the non‐cognitive areas of SRL. In the field of cognition, prompts appear to be the most effective scaffolds, especially for processes during the control phase. This review also shows that studies have paid little attention to scaffold designs, learner characteristics, or various task characteristics, despite the fact that these variables have been found to have a significant influence. We conclude with the implications of our results on future design and research in the field of SRL using CBLEs.     

Engaging middle school students in scientific practice with a collaborative mobile game

Previous research using collaborative mobile augmented reality games in science education revealed that such games can be used to promote learner engagement and have found that engagement in such mobile games is related to flow. This study investigated whether player's flow experience differed by achievement track, gender, or gender composition of working groups. In an urban school district, 202 students from two eighth‐grade science classes participated in a collaborative mobile science game. Data included a self‐report survey collected after the game that measured player's flow experience. Using a regression model, the relationship of flow experience with achievement track and gender was explored while controlling for group composition and teacher effects. The study found that gender was related to flow experience; specifically, girls reported higher flow experience scores (d = 0.30). Flow experience did not have a statistically significant relationship with achievement track showing that the activity engaged all observed students similarly.     

Learning adaptivity in support of flipped learning: An ontological problem‐solving approach

In recent years, flipped learning has received tremendous attention from educational practitioners and researchers. However, this study argues that existing e‐learning systems mainly serve for learning management and content delivery purposes, although they lack support for flipped learning. As an innovative educational approach, flipped learning requires more pedagogical elements, such as integrated instructional design and adaptive content delivery, to achieve effective direct instruction. This study aims to create a learning adaptivity design to support effective learning in the flipped individual learning space in which the teacher is absent. Because teaching involves various pedagogical and content knowledge sources, we propose a conceptual model of teaching as a function of the knowledge triad of Guideline (G), Teaching Activity (T), and Material (M). To realize this conceptualization, an ontological problem‐solving approach is used for knowledge‐based systems development to integrate the relevant knowledge sources. The knowledge model is created using the Protégé platform to develop OWL‐based domain ontology, task ontology, and SWRL‐based semantic rules to enable inference in the GTM triad for learning adaptivity. The case illustration shows that the knowledge‐based system prototype can adaptively guide student learning in the flipped individual learning space with the knowledge sources integrated.     

Mobile game-based learning in secondary education: engagement, motivation and learning in a mobile city game

Using mobile games in education combines situated and active learning with fun in a potentially excellent manner. The effects of a mobile city game called Frequency 1550, which was developed by The Waag Society to help pupils in their first year of secondary education playfully acquire historical knowledge of medieval Amsterdam, were investigated in terms of pupil engagement in the game, historical knowledge, and motivation for History in general and the topic of the Middle Ages in particular. A quasi-experimental design was used with 458 pupils from 20 classes from five schools. The pupils in 10 of the classes played the mobile history game whereas the pupils in the other 10 classes received a regular, project-based lesson series. The results showed those pupils who played the game to be engaged and to gain significantly more knowledge about medieval Amsterdam than those pupils who received regular project-based instruction. No significant differences were found between the two groups with respect to motivation for History or the Middle Ages. The impact of location-based technology and game-based learning on pupil knowledge and motivation are discussed along with suggestions for future research.