Effect of blended learning environment on transfer of learning: an experimental study

The main purpose of the study is to investigate the effect of the blended learning and face‐to‐face learning on students' academic achievements and transfer of learning. The first aim of the study is to analyse the students' academic achievements to determine the change of theoretical knowledge in terms of the instructional method applied in this study. However, students' performances during the learning process are not always a good indicator. Therefore, the second aim of the study is to examine transferring students' theoretical knowledge to their educational multimedia projects. For this purpose, 14 weeks of pre‐ and post‐test experimental study is designed. The study is administered through an educational technology course in which students learn how to develop educational multimedia materials. The participants are undergraduate pre‐service teachers; they are assigned randomly to the experimental and control group. While the experimental group has both online and classroom sessions, the control group has only face‐to‐face classroom sessions. Although there is no significant difference between the groups in terms of academic achievement, the students in the blended group are more successful in transferring their knowledge to their projects than the ones in the face‐to‐face group. In conclusion, the results show that the blended learning approach has a positive effect on the transfer of learning.     

Evaluation of fostering students' creativity in preparing aided recalls for revision courses using electronic revision and recapitulation tools 2.0

In this study, the electronic revision and recapitulation tools 2.0 (EREP2.0) were used to foster creative moments while creating aided recalls (ARs) (pictures electronic notes etc.). Creative and critical thinking is associated with vital skills which enable students to deal with often complex knowledge domains through an informal way of learning. Enabling learners to develop their own representations of information can be a first step to deal with complexity and to foster creativity. In an exploratory study, n = 25 students used EREP2.0 to develop learning questions and ARs for an ongoing course on biological psychology. EREP 2.0 was evaluated with respect to user friendliness, the fostering of creativity and the expected support for cognitive skills according to Bloom's taxonomy. The influence of students' experienced creativity on experienced learning support was tested via Kruskal–Wallis test. Fifteen students reported moderate to high, 4 students low and 5 students no support in creativity. Students who experienced their work as creative felt better supported in comprehension, χ ²(3) = 9.04; p = 0.029, and synthesis, χ ²(3) = 9.46; p = 0.024. No statistically significant effects were found for other categories of Bloom's taxonomy. EREP 2.0 did support the experience of creativity and thus synthesis and comprehension skills.     

Powering up flipped learning: An online learning environment with a concept map-guided problem-posing strategy

Scholars have suggested that flipped learning can be enhanced by designing effective in-class learning activities to improve students' higher order thinking skills. Problem posing has been recognized as such a learning strategy that has great potential for improving students' higher order thinking skills. However, it has been reported as a challenging task for most students. Research evidence has indicated the potential of engaging students in group learning with step-by-step hints when conducting problem-posing activities. Therefore, this study proposed a multilevel concept mapping-based problem-posing strategy to assist students in completing the problem-posing tasks in flipped learning. To understand the effectiveness of the proposed strategy, a flipped learning system was developed and adopted in the science class of an elementary school. Seventy-five fifth graders from three classes were divided into experimental group A, experimental Group B and a control group. Students in Group A used the concept map-guided problem-posing strategy for flipped learning (CMPP-FL), students in Group B used the problem-posing strategy-based flipped learning, while students in the control group used the conventional flipped learning strategy. The results showed that the CMPP-FL was effective in terms of improving students' learning performance, especially for students with higher levels of critical thinking tendency.     

Could a mobile‐assisted learning system support flipped classrooms for classical Chinese learning?

In this study, the researcher aimed to develop a mobile‐assisted learning system and to investigate whether it could promote teenage learners' classical Chinese learning through the flipped classroom approach. The researcher first proposed the structure of the Cross‐device Mobile‐Assisted Classical Chinese (CMACC) system according to the pilot survey and reviewed literature, and then adopted a quasi‐experimental design to understand whether the developed system could promote and support flipped classroom learning for classical Chinese. A total of 56 eleventh graders from two classes participated in the experiment. The learners in the experimental group learned classical Chinese with the flipped classroom learning strategy with the assistance of the CMACC system, while the control group adopted the flipped classroom learning strategy without using the CMACC system. The results reveal that all of the students improved their Chinese performance, but it was noticeable that the learners who used the CMACC system showed better motivation in terms of self‐directed preview learning, while those who only learned with the traditional textbooks tended to be more passive. In sum, the mobile‐assisted learning system added value in providing learners with opportunities to achieve anytime and anywhere flipped classroom learning. The integration of ubiquitous mobile learning technology and the flipped classroom strategy can be viewed as a critical factor leading to students achieving self‐regulated learning. It is also suggested that instructors should carefully take the targeted learners' cultural background and the availability of supporting learning devices into consideration so as to prevent the flipped classroom from exacerbating the digital divide. Other suggestions for educators and instructional designers are also proposed.     

Designing a technology‐enhanced flipped learning system to facilitate students' self‐regulation and performance

In recent years, the flipped classroom has become prevalent in many educational settings. Flipped classroom adopts a pedagogical model in which short video lectures are viewed by students at home before class so that the teacher can lead students to participate in activities, problem‐solving, and discussions. Yet the design or use of technology that employs planned instructional strategies with sustainable support of self‐regulation is scant. We propose a technology‐enhanced flipped language learning system (Flip2Learn) that provides facilitation and guidance for learning performance and self‐regulation. A quasi‐experimental study was carried out to examine whether Flip2Learn could enhance college students' self‐regulatory skills and later contribute to the learning performance in the flipped classrooms. The results showed that Flip2Learn not only better prepared students for flipped classrooms but also better promoted learning performance compared to the conventional flipped classrooms. The results of this research advanced our understanding of the dynamics of flipped classrooms and represented a revolutionary new approach to the technology‐enhanced learning for flipped classrooms.     

Adaptive assessment of student's knowledge in programming courses

This paper presents Programming Adaptive Testing (PAT), a Web‐based adaptive testing system for assessing students' programming knowledge. PAT was used in two high school programming classes by 73 students. The question bank of PAT is composed of 443 questions. A question is classified in one out of three difficulty levels. In PAT, the levels of difficulties are adapted to Bloom's taxonomy lower levels, and students are examined in their cognitive domain. This means that PAT has been designed according to pedagogical theories in order to be appropriate for the needs of the course ‘Application Development in a Programming Environment’. If a student answers a question correctly, a harder question is presented, otherwise an easier one. Easy questions examine the student's knowledge, while difficult questions examine the student's skills to apply prior knowledge to new problems. A student answers a personalized test composed of 30 questions. PAT classifies a student in one out of three programming skills' levels. It can predict the corresponding classification of students in Greek National Exams. Furthermore, it can be helpful to both students and teachers. A student could discover his or her programming shortcomings. Similarly, a teacher could objectively assess his or her students as well as discover the subjects that need to be repeated.     

An experience of a three-year study on the development of critical thinking skills in flipped secondary classrooms with pedagogical and technological support

The aim of this study was attempting to investigate the outcome of critical thinking achievement of learners when its development is infused into subject teaching with pedagogical and technological support. A total of 124 junior secondary students participated in the three-year trial teaching in Integrated Humanities subject. Flipped classroom strategy was implemented to engage learners in online pre-lesson learning preparation, in-class group discussion inside digital classroom and after-class extended learning using social learning platform. The critical thinking tests found that the students had good performance in the tasks on hypothesis identification, induction and deduction; and some achievements in the tasks on explanation and evaluation. It was found that students needed more time to develop capacities of deduction, explanation and evaluation. The semi-structured interviews found that the teachers and students valued the pedagogical way of providing guidance for students' group sharing for fostering critical thinking skills development. Three implications are discussed to shed light on the infusion of critical thinking skills development into the process of domain knowledge learning, the deployment of appropriate pedagogy to mobilize learners to engage in learning process, and the use of appropriate technology to facilitate learning process inside and outside of classroom.     

Exploring undergraduates' perspectives and flipped learning readiness in their flipped classrooms

This study surveyed 84 undergraduate students, majoring in education, in order to gather their perspectives regarding flipped classrooms and investigate their readiness levels for flipped learning. After the implementation of flipped learning for an entire semester, surveys were distributed in two flipped classrooms that were taught by the same instructor. Students showed particular preferences for the “Bring Your Own Device” and the Instant Response System features of the flipped classroom. Approximately 60% agreed with the idea of flipped classrooms, but only 39% agreed that the flipped classrooms met their learning needs. Their readiness levels for flipped learning were moderately above the average levels, and males or juniors (compared with freshmen), felt more prepared for flipped learning. In general, course grades, self-directed learning readiness, and group work preference can predict the different readiness dimensions. The findings may enhance educators' understanding in how to apply the flipped learning model in ways that are most beneficial for their own students.     

Building virtual cities,inspiring intelligent citizens: Digital games for developing students’ problem solving and learning motivation

This study investigates the effectiveness digital game-based learning (DGBL) on students’ problem solving, learning motivation, and academic achievement. In order to provide substantive empirical evidence, a quasi-experimental design was implemented over the course of a full semester (23 weeks). Two ninth-grade Civics and Society classes, with a total of 44 students (15–16 years old), were randomly assigned to one of two conditions: an experimental group (incorporating DGBL) and a comparison group (taught using traditional instruction). Two-way mixed ANOVA was employed to evaluate changes in problem solving ability and compare the effectiveness the two strategies, while ANCOVA was used to analyze the effects on learning motivation and academic achievement. The results of this study are summarized as follows: (1) The DGBL strategy was clearly effective in promoting students’ problem solving skills, while the control group showed no improvement. Additionally, data from the mid-test and post-test demonstrate that, as a higher order thinking skill, problem-solving requires a full semester to develop. (2). DGBL resulted in better learning motivation for students in the experimental group as compared to learners receiving TI. (3) Contrary to some suggestions that digital games could inhibit academic achievement, no statistically significant difference was found between the two groups. Most importantly, the quantitative improvement in problem-solving and learning motivation suggest that DGBL can be exploited as a useful and productive tool to support students in effective learning while enhancing the classroom atmosphere. Future research in DGBL should emphasize the evaluation of other higher order elements of the cognitive domain in terms of academic achievement outcomes and skills, such as critical and creative thinking.     

Applying learning analytics dashboards based on process-oriented feedback to improve students' learning effectiveness

With the development of a technology-supported environment, it is plausible to provide rich process-oriented feedback in a timely manner. In this paper, we developed a learning analytics dashboard (LAD) based on process-oriented feedback in iTutor to offer learners their final scores, sub-scale reports, and corresponding suggestions on further learning content. We adopted a quasi-experimental design to investigate the effectiveness of the report on students' learning. Ninety-four freshman from two classes participated in this research. The two classes were divided into the LAD group and the original analytics report (OAR) based on a product-oriented feedback group. Before the experiment, all the students took the prior knowledge assessment. After a semester's instruction, all the students took the post-test of the summative assessment. Results indicated that students in the LAD group experienced better learning effectiveness than students in the OAR group. LAD based on process-oriented feedback was also effective in improving the skill learning effectiveness of the students with low-level prior knowledge.     

Enhancing community of inquiry and reflective thinking skills of undergraduates through using learning analytics-based process feedback

This research aims to investigate into the effect of using learning analytics (LA)-based process feedback on students' perceptions of community of inquiry (teaching, social and cognitive presence) and their reflective thinking skills. By using a mixed-method research approach (QUAN + qual), this study was conducted as an experimental design with the pretest–posttest control group. A total of 104 university students who were randomly assigned to the experiment group (EG) and control group (CG) were recruited in this study. The procedure was conducted within the scope of the computing course based on the flipped classroom (FC) model. While the participants in the EG received LA-based process feedback which shows their LA results in a weekly manner, those in the CG did not get any LA-based process feedback. The data were collected through the Community of Inquiry Scale, the Reflective Thinking Scale and a semi-structured student opinion form. The findings indicated that sending feedback including the students' LA results had a statistically significant effect on the students' perceptions of community of inquiry and reflective thinking skills. Based on the findings of the study, several recommendations for teachers, instructional designers and researchers have been made.     

Developing a web‐based multimedia assessment system for facilitating science laboratory instruction

This study developed a web‐based multimedia assessment system (WMA system) and applied it to science laboratory instruction. The goal was to improve students' knowledge acquisition under science laboratory instruction. The developed system enabled learners to perform self‐assessments by responding to multimedia technology test items online. The system recorded each learner's complete answer history and provided the students with personalized learning resources. This study adopted a quasi‐experimental research design. The learning content was an “experiment on separating mixtures.” Students participating in the research were divided into a typical science laboratory instruction group (TI group; n = 25) and a group that received instruction through the WMA system (WMA group; n = 26). Before instruction, all the students completed the conceptual knowledge and experimental knowledge pretests. During instruction, the TI group watched the teacher's demonstration experiment, and the students then performed the experiment in a real laboratory. In the WMA group, after learning through the WMA system, the students also performed the experiment in a real laboratory. After instruction, all the students completed the conceptual knowledge and experimental knowledge posttests. The findings indicated that the students in the WMA group showed significantly higher improvements in their scientific conceptual knowledge and experimental knowledge.     

Differential impact of unguided versus guided use of a multimedia introduction to equine obstetrics in veterinary education

In view of supporting the study of the complex domain of equine obstetrics, a FoalinMare multimedia package with 3D designs has been developed. The present study centers on questions as to the most optimal implementation of the multimedia package in veterinary education. In a pretest-posttest cross-over design, students were randomly assigned to one of four conditions. Experimental conditions varied - next to a traditional lecture based introduction to equine obstetrics - from independent exploration of the FoalinMare DVD, to independent guided DVD usage, to guided classroom usage of the DVD. As dependent measures, student mastery of knowledge and skills, cognitive load and self-efficacy were measured. Results point at the significant superior impact of studying with the FoalinMare DVD on skills acquisition and higher levels of self-efficacy. In addition, experimental conditions that build on guided usage of the multimedia application, result in superior performance. Building on the cross-over design, the guided classroom usage boosts in a significant way the knowledge acquisition in the subsequent learning phase in the control condition. Building on these results, implications and directions for future research are presented.     

Using a knowledge learning framework to predict errors in database design

Conceptual data modeling is a critical but difficult part of database development. Little research has attempted to find the underlying causes of the cognitive challenges or errors made during this stage. This paper describes a Modeling Expertise Framework (MEF) that uses modeler expertise to predict errors based on the revised Bloom's taxonomy (RBT). The utility of RBT is in providing a classification of cognitive processes that can be applied to knowledge activities such as conceptual modeling. We employ the MEF to map conceptual modeling tasks to different levels of cognitive complexity and classify current modeler expertise levels. An experimental exercise confirms our predictions of errors. Our work provides an understanding into why novices can handle entity classes and identifying binary relationships with some ease, but find other components like ternary relationships difficult. We discuss implications for data modeling training at a novice and intermediate level, which can be extended to other areas of Information Systems education and training.     

Saying the wrong thing: improving learning with multimedia by including misconceptions

Abstract   In this study, 364 first-year physics students were randomly assigned to one of four online multimedia treatments on Newton's First and Second Laws of Motion: (1) the 'Exposition', a concise lecture-style presentation; (2) the 'Extended Exposition', the Exposition with additional interesting information; (3) the 'Refutation', the Exposition with common misconceptions explicitly stated and refuted; or (4) the 'Dialogue', a student–tutor discussion of the same material as in the Refutation. Students were tested using questions from mechanics conceptual inventories before and after watching the multimedia treatments. Results show the Refutation and Dialogue produced the greatest learning gains, with effect sizes of 0.79 and 0.83, respectively, compared with the Exposition. Students with low prior knowledge benefited most, however high prior knowledge learners were not disadvantaged by the misconception-based approach. The findings suggest that online multimedia can be greatly improved, promoting conceptual change in students with all levels of experience, by including a discussion of misconceptions.     

Automatic identification of knowledge-transforming content in argument essays developed from multiple sources

Developing knowledge-transforming skills in writing may help students increase learning by actively building knowledge, regardless of the domain. However, many undergraduate students struggle to transform knowledge when drafting essays based on multiple sources. Writing analytics can be used to scaffold knowledge transforming as writers bring evidence to bear in supporting claims. We investigated how to automatically identify sentences representing knowledge transformation in argumentative essays. A synthesis of cognitive theories of writing and Bloom's typology identified 22 linguistic features to model processes of knowledge transforming in a corpus of 38 undergraduates' essays. Findings indicate undergraduates mostly paraphrase or copy information from multiple sources rather than engage deeply with sources' content. Eight linguistic features were important for discriminating evidential sentences as telling versus transforming source knowledge. We trained a machine learning algorithm that accurately classified nearly three of four evidential sentences as knowledge-telling or knowledge-transforming, offering potential for use in future research.     

The effects of computer simulation and animation (CSA) on students' cognitive processes: A comparative case study in an undergraduate engineering course

This study focuses on the investigation of the effects of computer simulation and animation (CSA) on students' cognitive processes in an undergraduate engineering course. The revised Bloom's taxonomy, which consists of six categories in the cognitive process domain, was employed in this study. Five of the six categories were investigated, including remember, understand, apply, analyze, and evaluate. Data were collected via a think‐aloud protocol involving two groups of student participants: One group learned a worked example problem with a CSA module, and the other group learned the same problem with traditional textbook‐style instruction. A new concept called frequency index was proposed for use in qualitative research that involves the quantitative comparison of the overall popularity of a particular mental activity performed by two groups of students. The results show that as compared to traditional textbook‐style instruction, CSA significantly increases students' activities in the understand category of the revised Bloom's taxonomy during learning and significantly increases students' activities in the understand, apply, analyse, and evaluate categories during subsequent problem‐solving. That learning via CSA has a profound impact on subsequent problem‐solving is attributed to intensive human–computer interactions built in the CSA learning module.     

Teaching genetics with multimedia results in better acquisition of knowledge and improvement in comprehension

The main goal of this study was to explore whether the use of multimedia in genetics instruction contributes more to students' knowledge and comprehension than other instructional modes. We were also concerned with the influence of different instructional modes on the retention of knowledge and comprehension. In a quasi‐experimental design, four comparable groups of 3rd and 4th grade high school students were taught the process of protein synthesis: group 1 was taught in the traditional lecture format (n = 112 students), group 2 only by reading text (n = 124 students), group 3 through multimedia that integrated two short computer animations (n = 115 students) and group 4 by text supplemented with illustrations (n = 117 students). All students received one pre‐test in order to estimate their prior knowledge, and two post‐tests in order to assess knowledge and comprehension immediately after learning and again after 5 weeks. Results showed that students comprising groups 3 and 4 acquired better knowledge and improved comprehension skills than the other two groups. Similar results were observed for retention of acquired knowledge and improved comprehension. These findings lead to the conclusion that better learning outcomes can be obtained by the use of animations or at least illustrations when learning genetics.     

Polite web-based intelligent tutors: Can they improve learning in classrooms?

Should an intelligent software tutor be polite, in an effort to motivate and cajole students to learn, or should it use more direct language? If it should be polite, under what conditions? In a series of studies in different contexts (e.g., lab versus classroom) with a variety of students (e.g., low prior knowledge versus high prior knowledge), the politeness effect was investigated in the context of web-based intelligent tutoring systems, software that runs on the Internet and employs artificial intelligence and learning science techniques to help students learn. The goal was to pinpoint the appropriate conditions for having the web-based tutors provide polite feedback and hints (e.g., “Let’s convert the units of the first item”) versus direct feedback and hints (e.g., “Convert the units of the first item now”). In the study presented in this paper, 132 high school students in a classroom setting, grouped as low and high prior knowledge learners according to a pre-intervention knowledge questionnaire, did not benefit more from polite feedback and hints than direct feedback and hints on either an immediate or delayed posttest, both of which contained near transfer and conceptual test items. Of particular interest and contrary to an earlier lab study, low prior knowledge students did not benefit more from using the polite version of a tutor. On the other hand, a politeness effect was observed for the students who made the most errors during the intervention, a different proxy for low prior knowledge, hinting that even in a classroom setting, politeness may be beneficial for more needy students. This article presents and discusses these results, as well as discussing the politeness effect more generally, its theoretical underpinnings, and future directions.