Are two heads always better than one? Differential effects of collaboration on students�� computer-supported learning in mathematics

While some studies found positive effects of collaboration on student learning in mathematics, others found none or even negative effects. This study evaluates whether the varying impact of collaboration can be explained by differences in the type of knowledge that is promoted by the instruction. If the instructional material requires students to reason with mathematical concepts, collaboration may increase students’ learning outcome as it promotes mutual elaboration. If, however, the instructional material is focused on practicing procedures, collaboration may result in task distribution and thus reduce practice opportunities necessary for procedural skill fluency. To evaluate differential influences of collaboration, we compared four conditions: individual vs. collaborative learning with conceptual instructional material, and individual vs. collaborative learning with procedural instructional material. The instruction was computer-supported and provided adaptive feedback. We analyzed the effect of the conditions on several levels: Logfiles of students’ problem-solving actions and video-recordings enabled a detailed analysis of performance and learning processes during instruction. In addition, a post-test assessed individual knowledge acquisition. We found that collaboration improved performance during the learning phase in both the conceptual and the procedural condition; however, conceptual and procedural material had a differential effect on the quality of student collaboration: Conceptual material promoted mutual elaboration; procedural material promoted task distribution and ineffective learning behaviors. Consequently, collaboration positively influenced conceptual knowledge acquisition, while no positive effect on procedural knowledge acquisition was found. We discuss limitations of our study, address methodological implications, and suggest practical implications for the school context.     

Applying learning analytics dashboards based on process-oriented feedback to improve students' learning effectiveness

With the development of a technology-supported environment, it is plausible to provide rich process-oriented feedback in a timely manner. In this paper, we developed a learning analytics dashboard (LAD) based on process-oriented feedback in iTutor to offer learners their final scores, sub-scale reports, and corresponding suggestions on further learning content. We adopted a quasi-experimental design to investigate the effectiveness of the report on students' learning. Ninety-four freshman from two classes participated in this research. The two classes were divided into the LAD group and the original analytics report (OAR) based on a product-oriented feedback group. Before the experiment, all the students took the prior knowledge assessment. After a semester's instruction, all the students took the post-test of the summative assessment. Results indicated that students in the LAD group experienced better learning effectiveness than students in the OAR group. LAD based on process-oriented feedback was also effective in improving the skill learning effectiveness of the students with low-level prior knowledge.     

Effects of feedback in a computer-based assessment for learning

The effects of written feedback in a computer-based assessment for learning on students’ learning outcomes were investigated in an experiment at a Higher Education institute in the Netherlands. Students were randomly assigned to three groups, and were subjected to an assessment for learning with different kinds of feedback. These are immediate knowledge of correct response (KCR) + elaborated feedback (EF), delayed KCR + EF, and delayed knowledge of results (KR). A summative assessment was used as a post-test. No significant effect was found for the feedback condition on student achievement on the post-test. Results suggest that students paid more attention to immediate than to delayed feedback. Furthermore, the time spent reading feedback was positively influenced by students’ attitude and motivation. Students perceived immediate KCR + EF feedback to be more useful for learning than KR. Students also had a more positive attitude towards feedback in a CBA when they received KCR + EF rather than KR only.     

Delaying elaborated feedback within computer-based learning environments: The role of summative and question-based feedback

Elaborative feedback (EF) containing explanations on students' responses benefits learning. Computer-based environments provide learners with EF in different ways, for example, on an immediate question-by-question basis or after answering a set of questions. Recent findings also suggest that delaying EF enhances learning. However, it is unclear to what extent different types of delayed-EF favour students' performance. This study examines whether and how two types of delayed-EF (question-based vs. summative) influence students' question-answering performance and final learning over immediate-EF. One hundred thirty-three secondary-school students read a scientific text and answered 12 multiple-choice questions in a computer-based environment. A day later, students completed a final learning test with 20 open-ended questions. Results showed that neither question-based delayed EF nor summative delayed EF outperformed immediate EF. However, EF moderated the relationship between students' prior knowledge and their performance outcomes, suggesting that students with higher levels of prior knowledge receiving summative delayed EF benefited more.     

Analysing the role of a pedagogical agent in psychological and cognitive preparatory activities

There is a lack of studies that examine the role of a pedagogical agent on student development in a specific learning situation that involves psychological and cognitive preparatory activities in high school settings. We examined the effectiveness of pedagogical agent (APT) cognitive and affective feedback on learner motivation and well-being. We applied an experimental research design, involving 45 fourth-year high school students, divided in experimental and control groups (APT vs. human tutor). We performed a quantitative analysis to collect and analyse data of students using our APT. APT cognitive feedback had a positive effect on students' motivation for learning by encouraging students' proposals and initiatives and arousing students' interest in the topic. In addition, APT affective feedback fostered an appropriate emotional climate and creative environment for learning by enhancing students' curiosity, creativity and confidence for carrying out the activity, while reducing students' negative emotions such as boredom and anger. This study provided us useful insights about the affective (and cognitive) competencies that a virtual affective pedagogical agent needs to have in order to support students' mental and emotional health throughout a learning situation. Yet, further research is needed to consolidate these findings and make APT more adaptive to different learning situations.     

Combined inner and outer loop feedback in an intelligent tutoring system for statistics in higher education

Intelligent tutoring systems (ITSs) can provide inner loop feedback about steps within tasks, and outer loop feedback about performance on multiple tasks. While research typically addresses these feedback types separately, many ITSs offer them simultaneously. This study evaluates the effects of providing combined inner and outer loop feedback on social sciences students' learning process and performance in a first-year university statistics course. In a 2 x 2 factorial design (elaborate inner loop vs. minimal inner loop and outer loop vs. no outer loop feedback) with 521 participants, the effects of both feedback types and their combination were assessed through multiple linear regression models. Results showed mixed effects, depending on students' prior knowledge and experience, and no overall effects on course performance. Students tended to use outer loop feedback less when also receiving elaborate inner loop feedback. We therefore recommend introducing feedback types one by one and offering them for substantial periods of time.     

E-portfolios supporting primary students' writing performance and peer feedback

E-portfolios show great promise for supporting students' writing performance and facilitating peer feedback, but empirical research of their use in primary education is limited. To address this gap, a yearlong study was conducted in a 4th grade primary class in Cyprus implementing e-portfolios (n = 20) to help students document their progress and send feedback to peers. A generic, open source weblog tool localized into Greek was used as an e-portfolio tool. Data sources included 176 student-essays, 1306 instances of peer feedback, students pre- and post-tests on writing performance, nine videotaped student interviews and one teacher interview. A paired samples t-test analysis showed that there was a statistically significant difference between students' pre-test (M = 62.6, SD = 9.82, n = 20) and post-test (M = 76.5, SD = 12.6, n = 20) on writing performance (t (19) = −8.03, p < .01). A repeated measures analysis of variance on e-portfolio artifacts showed that there were learning gains with respect to students' writing performance over time [F(4.01, 76.25) = 31.59, p < .01, η² = 0.89]. A qualitative analysis of students' comments showed that students provided more thorough peer feedback over time and became gradually more capable of providing corrective feedback. The qualitative analysis of student interviews provided evidence that students valued peer feedback in their portfolios. The analysis of the teacher interview showed that average and high-ability students benefited the most from peer feedback. This study provided evidence that e-portfolios can support the development of students' writing performance and peer feedback skills in the context of primary school essay writing. Instructional implications for portfolio implementation are offered.     

The role of feedback and self-efficacy on web-based learning: The social cognitive perspective

The social cognitive perspective of self-regulated learning suggests that effective learning is determined by the interactions among personal, behavioral, and environmental influences; particularly, high self-regulated learners hold higher motivation (personal), apply better learning strategies (behavioral) and respond to environmental demand more appropriately (environmental). The study thus uses the social cognitive perspective to explore the role of self-efficacy (personal), student feedback behavior, use of learning strategies (behavioral), performance and receiving feedback (environmental) in Web-based learning. There were 76 university students participated in this study. Both quantitative and qualitative methods were applied for data analysis. The results supported that self-efficacy predicted student use of learning strategies and related to elaborated feedback behavior (personal → behavioral). High self-efficacy students applied more high-level learning strategies, such as elaborative strategy and critical thinking. Students who provided elaborated feedback also had higher self-efficacy than those who did not. Moreover, receiving elaborative feedback significantly promoted student self-efficacy (environmental → personal), while receiving knowledge of correct response improved student performance. However, the results indicated that feedback behaviors did not predict academic performance, which may be interfered by modeling effects.     

Reflection prompts and tutor feedback in a web-based learning environment: effects on students' self-regulated learning competence

This study investigated the effects of reflection prompts and tutor feedback on the development of students' self-regulated learning competence (i.e. SRLC). In a web-based learning environment forty-two students completed a study task with embedded prompts eliciting reflection. The reflection prompts could either deal with aspects of self-regulated learning or not. In addition, the students could either receive electronic feedback from a tutor on their reflection expressions or not. The inventory of learning styles that was used to register development of the SRLC revealed a significant progress on the regulation subscales as a function of tutor feedback. An interaction between the students' evaluations of reflection prompts and tutor feedback indicated that the prompts that were related to aspects of self-regulated learning were perceived as less disturbing than the non-SRLC related prompts, especially when combined with tutor feedback. This study offers indications for the practical value of the combination of reflection prompts and tutor feedback as a promising means to develop students' SRLC in distance education applying a web-based learning environment.     

The role of feedback and self-efficacy on web-based learning: The social cognitive perspective

The social cognitive perspective of self-regulated learning suggests that effective learning is determined by the interactions among personal, behavioral, and environmental influences; particularly, high self-regulated learners hold higher motivation (personal), apply better learning strategies (behavioral) and respond to environmental demand more appropriately (environmental). The study thus uses the social cognitive perspective to explore the role of self-efficacy (personal), student feedback behavior, use of learning strategies (behavioral), performance and receiving feedback (environmental) in Web-based learning. There were 76 university students participated in this study. Both quantitative and qualitative methods were applied for data analysis. The results supported that self-efficacy predicted student use of learning strategies and related to elaborated feedback behavior (personal → behavioral). High self-efficacy students applied more high-level learning strategies, such as elaborative strategy and critical thinking. Students who provided elaborated feedback also had higher self-efficacy than those who did not. Moreover, receiving elaborative feedback significantly promoted student self-efficacy (environmental → personal), while receiving knowledge of correct response improved student performance. However, the results indicated that feedback behaviors did not predict academic performance, which may be interfered by modeling effects.     

Enhancing middle school students' scientific learning and motivation through agent‐based learning

Facing students' decreasing motivation to pursue scientific study, schools and educators need to coordinate new technologies with pedagogical agents to effectively sustain or promote students' scientific learning and motivation to learn. Although the provision of pedagogical agents in student learning has been studied previously, it is not clear what benefits the strategy might offer with regard to student motivation. This study proposes an agent‐based mechanism that integrates problem‐solving and inquiry‐based instructions to help students better understand complex scientific concepts and to sustain their motivation to learn science. In this study, a quasi‐experiment was conducted to evaluate the performance and feasibility of our proposed mechanism. The results revealed that the agent‐based mechanism was effective and feasible for enhancing students' learning and motivation to learn. The mechanism was associated with increases in the acquisition of knowledge when compared with the control group. Its effect in promoting and sustaining students' motivation was also statistically significant. Detailed discussions of the findings are provided in this study.     

Investigating students' learning approaches,perceptions of online discussions,and students' online and academic performance

The main purpose of this study was to understand the relationships between students' approaches to learning, their perceptions of online discussions, students' contributions in asynchronous discussions, and their academic performance. Two sets of questionnaires were used for understanding students' approaches of learning and perceptions of online discussions. The online postings from seven weeks of discussions were coded into three major categories: Initiation, Elaborated Response (ER), and Response with Resources (RWR). The results showed, first, some aspects of students' perceptions influenced the numbers of ERs and RWRs. Secondly, students' contributions to Initiation messages and RWR significantly related to deep motivation and deep strategies; however, the numbers of these two types of messages were negatively correlated to surface strategies. Finally, cluster analysis revealed three distinct groups who scored significantly different in almost all aspects of approaches to learning and perceptions of online discussions. Students in the cluster who adopted deep approaches and scored highest in the perception scales outperformed students in the other two clusters, both in terms of the number of ER messages and academic performance. Pedagogical implications for teaching with online discussions are discussed in this study.     

The impact of paper-based,computer-based and mobile-based self-assessment on students' science motivation and achievement

The present study focuses on the implementation of a self - assessment procedure in a Physics class, extended during a seven weeks period in a European secondary level school. The researchers used three modes of assessment based on paper and pencil, computer-web and mobile devices respectively. The aim of the study is to investigate the effect of each mode of assessment on students' motivation and achievement. Analysis of pre- and post-motivation tests revealed a more positive motivational orientation of students towards computers and mobile devices as assessment delivery mediums. Also, student evaluation implemented after the phase of the experimental procedure showed a significant increase in learning achievement for low-achieving students who participated in the mobile-based and computer-based assessment. The positive effects of computers and mobile devices on students' learning motivation suggest that they can be used as a promising alternative to paper and pencil assessment procedures.     

When educational agents meet surrogate competition: Impacts of competitive educational agents on students' motivation and performance

The design of educational agents increasingly attracts researchers' attention recently. One of major reasons is that educational agents could enhance student learning in various aspects. Although research in this area has mushroomed, such research mainly emphasizes on students in higher education. It is still unclear how educational agents influence young student learning. In addition, competition is a significant element, but fewer studies take competition into account while designing educational agents. Although some studies have indicated that educational agents in competitive environments has positive effects on students' perception and attribution, its impacts on students' motivation and performance are unclear. Thus, the study develops an integrative agent that combines educational and competitive elements for young students, and further examines its influences, in terms of motivation and learning performance. The results revealed that such competitive educational agents could enhance students' motivation and learning performance.     

An experimental study of cyber face-to-face vs. cyber text-based English tutorial programs for low-achieving university students

This study examines the effects of two types of e-tutoring interventions (text-based vs. face-to-face videoconferencing, TB vs. F2F) on the grammar performance and motivation of low-achieving students. The study investigates the patterns of interaction between tutors and students in both platforms, including the manner in which tutors and students engage during the tutoring sessions. The students' experiences and perceptions of e-tutoring interventions are also explored. The findings reveal that although the two modes of tutoring were equally effective (both groups showed improvement in their grammar performance, with no discernible difference between the two groups), the F2F group members overcame their negative feelings toward English to a greater extent than the TB group members. Interestingly, although the findings reveal that the TB tutors engaged in more tutoring strategies than the F2F tutors, the F2F students perceived more self-improvement in their English performance and were more likely to evaluate the tutors and the e-tutoring program positively than the TB group. The paper concludes by offering some recommendations for future studies on different tutoring modes using computer conferencing.     

Gaze tutor: A gaze-reactive intelligent tutoring system

We developed an intelligent tutoring system (ITS) that aims to promote engagement and learning by dynamically detecting and responding to students' boredom and disengagement. The tutor uses a commercial eye tracker to monitor a student's gaze patterns and identify when the student is bored, disengaged, or is zoning out. The tutor then attempts to reengage the student with dialog moves that direct the student to reorient his or her attentional patterns towards the animated pedagogical agent embodying the tutor. We evaluated the efficacy of the gaze-reactive tutor in promoting learning, motivation, and engagement in a controlled experiment where 48 students were tutored on four biology topics with both gaze-reactive and non-gaze-reactive (control condition) versions of the tutor. The results indicated that: (a) gaze-sensitive dialogs were successful in dynamically reorienting students’ attentional patterns to the important areas of the interface, (b) gaze-reactivity was effective in promoting learning gains for questions that required deep reasoning, (c) gaze-reactivity had minimal impact on students’ state motivation and on self-reported engagement, and (d) individual differences in scholastic aptitude moderated the impact of gaze-reactivity on overall learning gains. We discuss the implications of our findings, limitations, future work, and consider the possibility of using gaze-reactive ITSs in classrooms.     

The influences of a two-tier test strategy on student learning: A lag sequential analysis approach

Recently, programming skills have become a core competence. Many teaching strategies were developed to improve programming skills. Among them, online tests were widely applied to enhance students learning. Nonetheless, they may not be able to engage students in deep thinking and reflections. Thus, a two-tier test strategy was proposed to address this issue. However, previous research mainly focused on investigating the effectiveness of the two-tier test strategy but there is a lack of studies that investigate why the two-tier test approach is effective. To this end, we developed an online test, where the two-tier test strategy was implemented. Additionally, an empirical study was conducted to explore the influences of the two-tier test approach on students' learning performance and behavior patterns. Pre-test and post-test scores were applied to assess students' learning performance while a lag sequential analysis was used to analyze behavior patterns. Regarding learning performance, the proposed two-tier test can improve students' programming skills. Regarding behavior patterns, the two-tier test approach facilitates students to develop a learning by reviewing strategy, which is useful to improve their programming skills.     

Use of blogs in pre-service teacher education to improve student engagement

Web 2.0 technologies allow average computer users to be able to publish on the Internet without having to know complex computer technical knowledge, which gives these technologies powerful potential to facilitate student engagement in various learning environments. However, a knowledge gap exists in the literature related to factors affecting student engagement with Web 2.0 technologies. The purpose of this study is to understand factors affecting student engagement in a pre-service teacher education program that uses blogs to expand in-class discussions about technology integration. First year pre-service teachers in a mathematics education department participated in the study. Data were collected with a survey that was developed to measure student engagement with blog use. Results show that student motivation, reasons to use blog in the course, and level of challenge perceived by the students affect students' engagement with blog use. Gender and technical ability of students do not impact students' engagement. As a result, blogs can be utilized to expand in-class discussions equally well for all students.     

Interactive computer simulation and animation for improving student learning of particle kinetics

Computer simulation and animation (CSA) has been receiving growing attention and wide application in engineering education in recent years. A new interactive CSA module was developed in the present study to improve student learning of particle kinetics in an undergraduate engineering dynamics course. The unique feature of this CSA module is that it integrates computer visualization with mathematical modeling, so students can directly connect engineering dynamics phenomena to underlying mathematics. A quasi‐experimental pretest–post‐test research design including a comparison group (n = 65) and an intervention group (n = 77) was implemented to assess to what extent the developed CSA module improved student learning. The results show that this new CSA module increased students' class‐average conceptual and procedural learning gains by 29% and 37% respectively. The difference in learning gains between the two groups is statistically significant (Z = ?4.526, p = 0.000) based on a nonparametric statistical Mann–Whitney U test. It is found that the improvement of students' conceptual understanding and the improvement of their procedural skills are asymmetrical in this CSA learning environment. The CSA module can serve as an excellent tool to supplement traditional lectures, but cannot fully replace human teachers or tutors in teaching.     

Integrating reviewing strategies into shared electronic note-taking: Questioning,summarizing and note reading

This study compared the effects of reviewing strategies in shared electronic note-taking activities, including questioning, summarizing, and note reading, on elementary school student note-taking quality and achievement. A non-equivalent pre- and post-test design was adopted. The participants were 188 sixth grade Taiwanese students in six computing classes. Through random assignment, two classes were assigned to the shared note-taking with questioning condition (SN-SQ), two classes to the shared note-taking with summarizing condition (SN-SS), and two classes to the shared note-taking with note reading condition (SN-SR). Students in each condition were arranged into same-sex dyads. The members of a dyad were assigned to separate computers, seated side-by-side, and required to collaborate with one another on a shared note-taking with reviewing task. The results revealed that the SN-SS students' notes contained more facts and concepts than the SN-SR students', and the SN-SS students achieved better grades on the unit quizzes and overall assessment two weeks later than those in the SN-SR condition.