Supporting self‐regulated learning in computer‐based learning environments: systematic review of effects of scaffolding in the domain of science education

Despite the widespread assumption that students require scaffolding support for self‐regulated learning (SRL) processes in computer‐based learning environments (CBLEs), there is little clarity as to which types of scaffolds are most effective. This study offers a literature review covering the various scaffolds that support SRL processes in the domain of science education. Effective scaffolds are categorized and discussed according to the different areas and phases of SRL. The results reveal that most studies on scaffolding processes focus on cognition, whereas few focus on the non‐cognitive areas of SRL. In the field of cognition, prompts appear to be the most effective scaffolds, especially for processes during the control phase. This review also shows that studies have paid little attention to scaffold designs, learner characteristics, or various task characteristics, despite the fact that these variables have been found to have a significant influence. We conclude with the implications of our results on future design and research in the field of SRL using CBLEs.     

The effect of a graph‐oriented computer‐assisted project‐based learning environment on argumentation skills

The purpose of this quasi‐experimental study was to explore how seventh graders in a suburban school in the United States developed argumentation skills and science knowledge in a project‐based learning environment that incorporated a graph‐oriented, computer‐assisted application. A total of 54 students (three classes) comprised this treatment condition and were engaged in a project‐based learning environment that incorporated a graph‐oriented, computer‐assisted application, whereas a total of 57 students (three classes) comprised the control condition and were engaged in a project‐based learning environment without this graph‐oriented, computer‐assisted application. Verbal collaborative argumentation was recorded and the students' post essays were collected. A random effects analysis of variance (ANOVA) was conducted and a significant difference in science knowledge about alternative energies between conditions was observed. A multivariate analysis of variance (MANOVA) was conducted and there was a significant difference in counterargument and rebuttal skills between conditions. A qualitative analysis was conducted to examine how the graph‐oriented, computer‐assisted application supported students' development of argumentation skills and affected the quality of collaborative argumentation. The difference in argumentation structure and quality of argumentation between conditions might explain a difference in science knowledge as well counterargument and rebuttal skills (argumentation) between both conditions. This study concluded that a project‐based learning environment incorporating a graph‐oriented, computer‐assisted application was effective in improving students' science knowledge and developing their scientific argumentation skills.     

From integrative to game‐based integrative peer response: high ability versus low ability

Peer response is useful to improve student writing. However, traditional peer response takes a single mode, which has some problems, such as effort for preparation of documents or ambiguous feedback. To address these problems, this study presents two peer response approaches, that is, an integrative approach and a game‐based integrative approach. Additionally, whether students with these two peer response approaches and those with a non‐peer response approach performed differently is examined in this study, where students' ability levels were also considered. The findings suggest that students with the peer response generally demonstrated better writing performance than those without the peer response. Furthermore, students with the game‐based integrative approach showed better writing quality than those with the integrative approach. Moreover, the former was more helpful in giving direct feedback on surface features and criticism than the latter. However, the usefulness of peer response approaches was associated with ability levels. More specifically, the integrative approach was beneficial for the high‐ability students to improve on their written expression in the aspect of length of composition, while the game‐based integrative approach was advantageous to enhance the low‐ability students' writing quality in the aspect of clear paragraph.     

Level of intrinsic motivation of distance education students in e‐learning environments

According to researches, motivation that initiates and sustains behaviour is one of the most significant components of learning in any environment. Accordingly, level of intrinsic motivation triggers and sustains the interest of the open and distance education students when it comes to learning on their own in e‐learning environments. Despite a comprehensive literature regarding the motivation of those learning in traditional learning environments, the number of studies addressing the motivation of open and distance education students in e‐learning environments is not sufficient. In this context, this study aims at determining the level of intrinsic motivation of open and distance education students. Thus, data were collected from 1,639 distance education students in 22 programmes, through Intrinsic Motivation in e‐Learning Questionnaire developed and validated to that end. Analyses carried out indicate that the level of intrinsic motivation of open and distance education students is high in e‐learning environments, but there is not a statistically significant difference by gender, programme structure (graduate/undergraduate), instruction type (distance–blended), and academic disciplines.     

Interplay of prior knowledge,self‐regulation and motivation in complex multimedia learning environments

This study examined the direct and indirect effects of medical clerkship students' prior knowledge, self‐regulation and motivation on learning performance in complex multimedia learning environments. The data from 386 medical clerkship students from six medical schools were analysed using structural equation modeling. The structural model revealed that medical students' prior knowledge directly positively affected their learning outcome, self‐efficacy and performance approach goal orientation. The learners' self‐regulation had a significant positive direct effect on learning outcome. The learners' mastery goal orientation directly affected their learning outcome. Interestingly, inconsistent with our hypothesis, the learners' performance approach goal orientation showed a significant negative direct effect on learning outcome, and performance avoidance goal orientation had a significant positive effect on learning outcome. These findings help develop a more comprehensive understanding of the role of individual characteristics on learning performance of complex tasks in multimedia learning environments.     

The challenge of promoting algorithmic thinking of both sciences‐ and humanities‐oriented learners

The research results we present in this paper reveal that properly calibrated e‐learning tools have potential to effectively promote the algorithmic thinking of both science‐oriented and humanities‐oriented students. After students had watched an illustration (by a folk dance choreography) and an animation of the studied sorting algorithm (bubble sort), they were invited to predict and perform [(1) to reconstruct on the same input; (2) to orchestrate on a random sequence stored in a white array; (3) to orchestrate on a black‐box sequence] the entire step sequence of the algorithm (using the interactive visual learning environment we developed). The results of the experiment show that while science‐oriented students' performance proved superior to those of their humanities‐oriented colleagues, the differences were observed to diminish as both groups advanced with their e‐learning tasks. Although drawing general conclusions would be premature, we can conclude that there are no unbridgeable differences in the way these two groups relate to e‐learning processes that aim to promote algorithmic thinking. Our findings also emphasize the key importance of some motivational principles in facilitating algorithmic thinking: the principle of moderate and progressive challenge, the principle of gradual shift from concrete to abstract and the principle of genuine active involvement.     

Enhancing middle school students' scientific learning and motivation through agent‐based learning

Facing students' decreasing motivation to pursue scientific study, schools and educators need to coordinate new technologies with pedagogical agents to effectively sustain or promote students' scientific learning and motivation to learn. Although the provision of pedagogical agents in student learning has been studied previously, it is not clear what benefits the strategy might offer with regard to student motivation. This study proposes an agent‐based mechanism that integrates problem‐solving and inquiry‐based instructions to help students better understand complex scientific concepts and to sustain their motivation to learn science. In this study, a quasi‐experiment was conducted to evaluate the performance and feasibility of our proposed mechanism. The results revealed that the agent‐based mechanism was effective and feasible for enhancing students' learning and motivation to learn. The mechanism was associated with increases in the acquisition of knowledge when compared with the control group. Its effect in promoting and sustaining students' motivation was also statistically significant. Detailed discussions of the findings are provided in this study.     

Students' mathematics word problem‐solving achievement in a computer‐based story

The purpose of this study was to investigate the effect of a computer‐based story, which was designed in anchored instruction framework, on sixth‐grade students' mathematics word problem‐solving achievement. Problems were embedded in a story presented on a computer as computer story, and then compared with the paper‐based version of the same story and to a condition that presented the problems as typical, isolated word problems (i.e., a non‐story condition including only problems). One hundred twenty‐eight sixth‐grade students from two public middle schools in Turkey participated in this study. In a pretest–posttest experimental design, students were randomly assigned to one of the treatment groups mentioned earlier in which they solved the same mathematics word problems. A one‐way analysis of covariance was used to analyse students' achievement in the treatment groups. The results indicated that students who solved the problems in the computer story treatment had significantly higher achievement scores than students who solved the problems in the paper story and isolated word problems treatments. In addition, the story was found to be significantly more effective than the non‐story treatment when it was presented on computer.     

Promoting contextual vocabulary learning through an adaptive computer‐assisted EFL reading system

The study developed an adaptive computer‐assisted reading system and investigated its effect on promoting English as a foreign language learner‐readers' contextual vocabulary learning performance. Seventy Taiwanese college students were assigned to two reading groups. Participants in the customised reading group read online English texts, each of which was customised by the developed system to offer immediate and repeated meetings with previously encountered unknown words, while participants in the typical reading group read online texts without control on unknown word recurrence. After the 4‐week online reading treatment, the two groups of learners were tested by online immediate and delayed vocabulary tests, and the students from the customised reading group were also required to complete the questionnaire regarding system use. The results showed that the vocabulary mean scores from both immediate and delayed testing demonstrated significantly better results in word gain and word retention with the customised reading group and that the adaptive reading system was appealing for the students. The study demonstrated that by providing customised reading with word recurrence specific to individuals' unknown words, this adaptive computer‐assisted English as a foreign language reading system creates a more favourable condition for foreign language vocabulary growth.     

Mobile‐Based micro‐Learning and Assessment: Impact on learning performance and motivation of high school students

Mobile‐based micro‐learning has gained a lot of attention lately, especially for work‐based and corporate training. It combines features of mobile learning and micro‐learning to deliver small learning units and short‐term learning activities. The current study uses the lens of the Self‐Determination Theory of motivation and proposes a series of Mobile‐Based micro‐Learning and Assessment (MBmLA) homework activities to improve high school students' motivation and learning performance in science. An experiment was conducted to evaluate the effectiveness of the proposed approach. One hundred and eight students of a senior‐level high school in Europe were randomly assigned into either a control condition (conventional paper‐based homework approach) or an experimental (MBmLA approach) condition. The study carried out for a period of 5 weeks. From the experimental results, it was found that, in comparison to the conventional paper‐based approach, the proposed MBmLA approach enhanced students' basic psychological needs of self‐perceived autonomy, competence, and relatedness and improved students' exam performance in terms of factual knowledge. Moreover, students self‐reported greater learning satisfaction with the mobile‐based microassessment and micro‐learning homework tasks. Implications on educational practices as well as future research are discussed.     

The impact of computer‐based instruction on the development of EFL learners' writing skills

The current study investigated the application and effectiveness of computer assisted language learning (CALL) in teaching academic writing to Iranian EFL (English as a Foreign Language) learners by means of Microsoft Word Office. To this end, 44 sophomore intermediate university students majoring in English Language and Literature at an Iranian university who had enrolled in a course called Advanced Writing were randomly divided into two groups. As a pre‐test, a pen‐and‐paper writing task was given to both groups at the beginning of the semester. The control group including 24 male and female students was taught based on traditional approach while the experimental group including 20 male and female students was taught based on CALL. At the end of one semester, a pen‐and‐paper writing task was given to both groups. The results of the post‐test revealed that the students who were exposed to computer‐based instruction outperformed their counterparts in terms of using appropriate articles, tense, plural forms and spelling. Moreover, the students in the experimental group produced paragraphs of higher quality. The findings of this study confirmed the efficacy of computer‐based instruction in the development of EFL learners' writing skills.     

A cross‐cultural study of the effect of a graph‐oriented computer‐assisted project‐based learning environment on middle school students' science knowledge and argumentation skills

The purpose of this mixed‐methods study was to explore how seventh graders in a suburban school in the United States and sixth graders in an urban school in Taiwan developed argumentation skills and science knowledge in a project‐based learning environment that incorporated a graph‐oriented, computer‐assisted application (GOCAA). A total of 42 students comprised the treatment condition and were engaged in a project‐based learning environment that incorporated a GOCAA. Of these 42 students, 21 were located in the United States and 21 were located in Taiwan. A total of 26 students comprised the control condition and were engaged in a project‐based learning environment without the GOCAA. Of these 26 students, 15 were in the United States and 11 were in Taiwan. In each country, verbal collaborative argumentation was recorded and the students' post‐essays were collected. A one‐way analysis of variance (ANOVA) was conducted for each measure of science knowledge about alternative energies. The results showed a significant treatment effect for the outcome of scientific explanation among U.S. students, while among Taiwanese students, a significant treatment effect on scientific facts was observed. A one‐way ANOVA was additionally conducted for each measure of argumentation skills and a significant treatment effect on counterarguments and rebuttals was observed among the U.S. students, while in Taiwan, a significant treatment effect on reasoning and rebuttals was observed. A qualitative analysis was conducted to examine how the GOCAA supported students' development of argumentation skills in different countries. This study found distinct argumentation patterns between the U.S. and Taiwanese intervention teams. Additionally, a distinct gender difference in the use of evidence and division of labour was noted when the Taiwanese teams were compared with the U.S. teams, which may be explained by cultural differences. This study concluded that, in both the United States and Taiwan, a project‐based learning environment incorporating a GOCAA was effective in improving students' science knowledge and developing their scientific argumentation skills.     

Schoenfeld’s problem solving theory in a student controlled learning environment

This paper evaluates the effectiveness of a student controlled computer program for high school mathematics based on instruction principles derived from Schoenfeld’s theory of problem solving. The computer program allows students to choose problems and to make use of hints during different episodes of solving problems. Crucial episodes are: analyzing the problem, selecting appropriate mathematical knowledge, making a plan, carrying it out, and checking the answer against the question asked.     

Improving the effectiveness of English vocabulary review by integrating ARCS with mobile game‐based learning

Memorizing English vocabulary is often considered uninteresting, and a lack of motivation exists during learning activities. Moreover, most vocabulary practice systems automatically select words from articles and do not provide integrated model methods for students. Therefore, this study constructed a mobile game‐based English vocabulary practice system, which imitates the popular block elimination game and combines test items of article, difficulty, and teacher model in accordance with curriculum objectives and demands. The participants were first‐year students and classified into traditional group (Group T) and game‐based group (Group G), and learning effectiveness and motivation were analysed in this study. According to statistical analysis results, students who used the game‐based vocabulary practice system, which could captivate their attention and interest, had higher learning effectiveness and provided positive feedback of learning motivation. Furthermore, English teachers could select teaching materials that are consistent with the features, knowledge, and cultural background of learners to improve the relevance dimension of learning motivation.     

Developing a diagnosis system of work‐related capabilities for students: A computer‐assisted assessment

A gap exists between students' employment needs and higher education offerings. Thus, developing the capability to meet the learning needs of students in supporting their future aspirations should be facilitated. To bridge this gap in practice, this study uses multiple methods (i.e., nominal group technique and instructional systems development) and robust tests (e.g., reliability and validity) to develop a diagnosis system of work‐related capabilities. The research participants are twofold. At the early stage, this study invites three professors and three senior Human Resources managers to join the panel and help this study develop required capabilities. At the design and implementation stages, the research participants are freshman students at a famous university in Taiwan. This system enables college students to evaluate their capability scores by comparing themselves with the performances of prior students. The diagnosis results not only help students make learning plans during their university education, but also assist educators in adjusting the structure of the curriculum. Future studies are invited to use or adapt the assessment of work‐related capabilities, as well as proposed system procedure and architecture this study developed.     

The effects of directive self‐explanation prompts to support active processing of multiple representations in a simulation‐based learning environment

Processing of multiple representations in multimedia learning environments is considered to help learners obtain a more complete overview of the domain and gain deeper knowledge. This is based on the idea that relating and translating different representations leads to reflection beyond the boundaries and details of the separate representations. To achieve this, the design of a learning environment should support learners in adequately processing multiple representations. In this study, we compared a scientific inquiry learning environment providing instructional support with directive self‐explanation prompts to relate and translate between representations with a scientific inquiry learning environment providing instructional support with general self‐explanation prompts. Learners who received the directive prompts outperformed the learners who received general prompts on test items assessing domain knowledge. These positive results did not stretch to transfer items and items measuring learners' capabilities to relate and translate representations in general. The results suggest that learner support should promote the active relation of representations and translation between them to foster domain knowledge, and that other forms of support (e.g. extended training) might be necessary to make learners more expert processors of multiple representations.     

Supervised machine learning in multimodal learning analytics for estimating success in project‐based learning

Multimodal learning analytics provides researchers new tools and techniques to capture different types of data from complex learning activities in dynamic learning environments. This paper investigates the use of diverse sensors, including computer vision, user‐generated content, and data from the learning objects (physical computing components), to record high‐fidelity synchronised multimodal recordings of small groups of learners interacting. We processed and extracted different aspects of the students' interactions to answer the following question: Which features of student group work are good predictors of team success in open‐ended tasks with physical computing? To answer this question, we have explored different supervised machine learning approaches (traditional and deep learning techniques) to analyse the data coming from multiple sources. The results illustrate that state‐of‐the‐art computational techniques can be used to generate insights into the "black box" of learning in students' project‐based activities. The features identified from the analysis show that distance between learners' hands and faces is a strong predictor of students' artefact quality, which can indicate the value of student collaboration. Our research shows that new and promising approaches such as neural networks, and more traditional regression approaches can both be used to classify multimodal learning analytics data, and both have advantages and disadvantages depending on the research questions and contexts being investigated. The work presented here is a significant contribution towards developing techniques to automatically identify the key aspects of students success in project‐based learning environments, and to ultimately help teachers provide appropriate and timely support to students in these fundamental aspects.     

Effects of teaching and learning styles on students’ reflection levels for ubiquitous learning

Ubiquitous learning (u-learning), in conjunction with supports from the digital world, is recognized as an effective approach for situating students in real-world learning environments. Earlier studies concerning u-learning have mainly focused on investigating the learning attitudes and learning achievements of students, while the causations such as learning style and teaching style were usually ignored. This study aims to investigate the effects of teaching styles and learning styles on reflection levels of students within the context of u-learning. In particular, we investigated the teaching styles at the dimensions of brainstorming and instruction and recall and the learning styles at the dimensions of active and reflective learning. The experiment was conducted with 39 fifth grader students at an elementary school in southern Taiwan. A u-learning environment was established at a butterfly ecology garden to conduct experiments for natural science courses. The experimental results of one-way ANCOVA show that those students who received a matching teaching–learning style presented a significant improvement in their reflection level. That is, matching the learning styles of students with the appropriate teaching styles can significantly improve students’ reflection levels in a u-learning environment.