A quasi-experimental study of three online learning courses in computing

This paper presents the results of a 3-year quasi-experimental study of three Masters courses in computing. The purpose of this study was to investigate the extent to which the teaching and learning of these courses were enhanced by being developed and delivered in an online format as compared to face-to-face full-time and part-time delivery. Key methodological questions and issues to be examined were: (a) any observable difference in student performance as measured by end-of-module grades/marks; (b) any observable difference between coursework and exam performance in the technically-oriented modules; (c) any observable difference in dropout rates, student satisfaction and faculty satisfaction. The study examined the results from 4684 module enrolments, consisting of 269 online students, 796 part-time students, and 3619 full-time students distributed across 7 modules and 79 module instantiations. The data was gathered using a variety of different means which included interviews, end of module questionnaires, student records and enrolment data. The results show that the online students consistently perform better then the face-to-face students and the paper reflects on this finding.     

Evaluating the use and impact of lecture recording in undergraduates: Evidence for distinct approaches by different groups of students

Lecture recordings are increasingly used to supplement lecture attendance within higher education, but their impact on student learning remains unclear. Here we describe a study to evaluate student use of lecture recordings and quantify their impact on academic performance. Questionnaire responses and online monitoring of student's access to recordings indicate that ∼75% students use this material, the majority in a targeted manner. In contrast, a small subset of students (∼5%) are highly dependent on recordings downloading every lecture, and viewing the material for long periods, such that this represents a large proportion of their independent study. This ‘high user’ group is atypical, as it contains a high proportion of dyslexic and Non-English Speaking Background students. Despite high usage, lecture recordings do not have a significant impact on academic performance, either across the cohort or with students that use the recordings. Overall, this approach appears to be beneficial, but may reduce lecture attendance and encourage surface learning approaches in a minority of students.     

基于C/S模式的软件工程网络教学系统设计与实现

针对于软件工程专业设计基于C/S模式的网络教学系统包括课件、题库与操作实践3部分组成。系统设计将教学内容模块化,划分为课件模块、实时互动教学模块、题库模块、资源下载模块和学习交流模块,内容包含有文字资料、视频资料和图片资料,采用C/S模式,以网页的形式展现在系统前台。该系统不仅能够实现学生点播学习、教师远程实时授课、师生在线互动等功能,并且能够为学生提供在线阶段性知识掌握情况测评,为师生打造了良好的网络学习环境。     

The impact of learning design on student behaviour,satisfaction and performance: A cross-institutional comparison across 151 modules

Pedagogically informed designs of learning are increasingly of interest to researchers in blended and online learning, as learning design is shown to have an impact on student behaviour and outcomes. Although learning design is widely studied, often these studies are individual courses or programmes and few empirical studies have connected learning designs of a substantial number of courses with learning behaviour. In this study we linked 151 modules and 111.256 students with students' behaviour (<400 million minutes of online behaviour), satisfaction and performance at the Open University UK using multiple regression models. Our findings strongly indicate the importance of learning design in predicting and understanding Virtual Learning Environment behaviour and performance of students in blended and online environments. In line with proponents of social learning theories, our primary predictor for academic retention was the time learners spent on communication activities, controlling for various institutional and disciplinary factors. Where possible, appropriate and well designed communication tasks that align with the learning objectives of the course may be a way forward to enhance academic retention.     

Paying attention to adult learners online: The pedagogy and politics of community

Our article profiles the evolution of a fully online writing course designed for adult learners in our university's Prior Learning Assessment Program. Based on our own observations and experiences teaching adult learners online, we question if the virtual learning environment presents different challenges and prospects for the adult learner versus the traditional student learner, along with an extension and complication of the more social metaphors of “virtual community.” Moreover, because of the changing demographic from traditional to adult students, we argue that this change also fosters a change in the relationship between teachers and students. In chronicling this relationship, we note problems when the labor of adult education becomes invisible to those supervising online instructors. Because of these “invisible” labor issues, we argue that successful online instruction must include a range of interactions between students and instructors that extend the more public concept of community to better acknowledge the importance of personal, private interaction. Thus, we conclude with a call to rethink our online writing pedagogies to be more flexible to adult learner needs and learning styles, simultaneously recognizing the impact of adult online education on faculty workload.     

So you are going to be an online writing instructor: issues in designing,developing, and delivering an online course

Online education is increasing exponentially in colleges and universities. In this article, writing instructors are introduced to theories of instructional design that form the foundation to support effective student learning. We present a series of guidelines, derived from these theories and our research and teaching, that writing instructors may use to design, develop and deliver their online courses. We present considerations for instructors such as the need for the course, an analysis of the learners, appropriateness of the course for online delivery, pedagogical concerns, and resources. We then discuss how best to support students in online environments. We conclude with suggestions for faculty support and training for online course delivery.     

Implementing flexible hybrid instruction in an electrical engineering course: The best of three worlds?

This study explored a modified version of hybrid instruction, referred to as the flexible hybrid format, in a lower division electrical engineering course offered at a large public university. The objective of the study is to use longitudinal data to investigate the impact of class attendance, out-of-class study time, and motivation on student exam performance. Generalized least squares and fixed effects models were used in the analyses. It was found that class attendance was indispensable; it was associated with exam performance even when all essential course material was made available online and students generally rated the online instruction component to be of higher quality. The benefit of class attendance was then explained by the ICAP hypothesis and spaced learning practice and it was suggested that online education might be more effective in teaching relatively simpler contents. Out-of-class effort significantly predicated performance in previous weeks, but not in the final period. The harmful effect of cramming was cited to explain this phenomenon. Hence, by implication, time management might be an issue in a flexible hybrid environment. Finally, motivation was found to be a robust predicator of performance and its effect was the strongest when the course was at its most challenging stage. Besides, the relationship between motivation and exam performance was likely to be bidirectional, as higher motivation resulted in better performance, which in turn further boosted motivation. Based on current findings, directions for future research were also suggested to verify our claims and improve our implementation.     

eTeacher: Providing personalized assistance to e-learning students

In this paper we present eTeacher, an intelligent agent that provides personalized assistance to e-learning students. eTeacher observes a student’s behavior while he/she is taking online courses and automatically builds the student’s profile. This profile comprises the student’s learning style and information about the student’s performance, such as exercises done, topics studied, exam results. In our approach, a student’s learning style is automatically detected from the student’s actions in an e-learning system using Bayesian networks. Then, eTeacher uses the information contained in the student profile to proactively assist the student by suggesting him/her personalized courses of action that will help him/her during the learning process. eTeacher has been evaluated when assisting System Engineering students and the results obtained thus far are promising.     

Learning in asynchronous discussion groups: a multilevel approach to study the influence of student, group and task characteristics

The research reported in the current article studies the impact of learning in asynchronous discussion groups on students' final exam scores and levels of knowledge construction. Multilevel analyses were applied to uncover the specific influence of student, group and task variables. The results indicate that the impact of student characteristics on both dependent variables is of higher significance than characteristics of the discussion group students are allocated to. With regard to levels of knowledge construction, task characteristics also appear to be of importance.

 With regard to final exam scores the analyses reveal a significant impact from student learning style, attitude towards task-based learning, the number of student contributions and the level of knowledge construction in these contributions. No significant group characteristics were observed.

 As to levels of knowledge construction, the analyses revealed that the amount of contributions and the attitude towards the online learning environment are significant predictors. The intensity of the interaction in a group had a significant impact. As to task characteristics, significant differences were found between consecutive themes. These disappeared when taking into account task complexity.     

Students' engagement characteristics predict success and completion of online courses

This study examined students' engagement characteristics in online courses and their impact on academic achievements, trying to distinguish between course completers and noncompleters. Moreover, this research is intended to differentiate between those who pass the final exam and those who do not. Four online courses were examined with a similar pedagogical model (N_students = 646) using learning analytics methods. The results revealed significant differences between students who completed the courses and students who did not, in all 13 variables. Completers' learning activities were more than twice as high, except for writing in the forums. Course subject and ongoing task and assignment submissions predicted course completion, whereas, in addition to these variables, engagement with course materials and reading the forums predicted final exam success, as well. Thus, the prediction of success in final exam emphasized the significant importance of engagement in various activities in the online course.     

BOOK REVIEWS

With the continuing trend in online university course offerings, there is a corresponding need for academic librarians to support students in those digital spaces. We developed a sustainable model for embedding librarians to provide research support in online courses, and then investigated its impact on student learning outcomes and student and faculty perceptions of our efforts. This article outlines our model, includes survey feedback from students, and presents user data from our course management system to discuss how well we are meeting our objectives and how this evidence can inform our embedded librarian service going forward.     

Using an electronic voting system in logic lectures: one practitioner's application

This paper reports the introduction of electronic handsets, like those used on the television show ‘Who Wants To Be A Millionaire?’ into the teaching of philosophical logic. Logic lectures can provide quite a formidable challenge for many students, occasionally to the point of making them ill. Our rationale for introducing handsets was threefold: (i) to get the students thinking and talking about the subject in a public environment; (ii) to make them feel secure enough to answer questions in the lectures because the system enabled them to do this anonymously; and (iii) to build their confidence about their learning by their being able to see how they were progressing in relation to the rest of the students in the class. We have achieved all of these and more. Our experience has revealed that the use of handsets encourages a more dynamic form of student interaction in an environment – the lecture – that can, in the wrong hands, be utterly enervating, but they also provide an opportunity for the lecturer to respond to students' difficulties at the time when they really matter. In this paper, we discuss our case of rapid adoption, our grounds for judging it a success, and what that success seems to have depended on.     

Information retention from PowerPoint and traditional lectures

The benefit of PowerPoint^™ is continuously debated, but both supporters and detractors have insufficient empirical evidence. Its use in university lectures has influenced investigations of PowerPoint’s effects on student performance (e.g., overall quiz/exam scores) in comparison to lectures based on overhead projectors, traditional lectures (e.g., “chalk-and-talk”), and online lectures. Thus far, comparisons of overall exam scores have yielded mixed results. The present study decomposes overall quiz scores into auditory, graphic, and alphanumeric scores to reveal new insights into effects of PowerPoint presentations on student performance. Analyses considered retention of lecture information presented to students without the presence of PowerPoint (i.e., traditional lecture), auditory information in the presence of PowerPoint, and visual (i.e., graphic and alphanumeric) information displayed on PowerPoint slides. Data were collected from 62 students via quiz and questionnaire. Students retained 15% less information delivered verbally by the lecturer during PowerPoint presentations, but they preferred PowerPoint presentations over traditional presentations.     

Recent development in multimedia e-learning technologies

Multimedia and networking technologies have significantly impacted on our daily activities, particularly in terms of how we learn. Nowadays, classroom teaching no longer simply relies on chalk and blackboard as the prime medium for course dissemination. E-learning technologies have made it possible to provide a virtual classroom environment on the Web through supporting teacher-student and student-student communications, course material distribution as well as online student assessments. They provide students with more control over their learning schedule and pace. On top of this, multimedia technologies further offer students different forms of media to match their learning styles, leading to enhancements of their learning effectiveness. This extended introduction discusses the latest e-learning specific multimedia technologies, their research challenges and future trends from both pedagogical and technological perspectives. We also summarize the papers included in this special issue.     

Predicting student performance in a blended MOOC

Predicting student performance is a major tool in learning analytics. This study aims to identify how different measures of massive open online course (MOOC) data can be used to identify points of improvement in MOOCs. In the context of MOOCs, student performance is often defined as course completion. However, students could have other learning objectives than MOOC completion. Therefore, we define student performance as obtaining personal learning objective(s). This study examines a subsample of students in a graduate‐level blended MOOC who shared on‐campus course completion as a learning objective. Aggregated activity frequencies, specific course item frequencies, and order of activities were analysed to predict student performance using correlations, multiple regressions, and process mining. All aggregated MOOC activity frequencies related positively to on‐campus exam grade. However, this relation is less clear when controlling for past performance. In total, 65% of the specific course items showed significant correlations with final exam grade. Students who passed the course spread their learning over more days compared with students who failed. Little difference was found in the order of activities within the MOOC between students who passed and who failed. The results are combined with course evaluations to identify points of improvement within the MOOC.     

Virtual reality for collaborative e-learning

In the past, the term e-learning referred to any method of learning that used electronic delivery methods. With the advent of the Internet however, e-learning has evolved and the term is now most commonly used to refer to online courses. A multitude of systems are now available to manage and deliver learning content online. While these have proved popular, they are often single-user learning environments which provide little in the way of interaction or stimulation for the student. As the concept of lifelong learning now becomes a reality and thus more and more people are partaking in online courses, researchers are constantly exploring innovative techniques to motivate online students and enhance the e-learning experience. This article presents our research in this area and the resulting development of CLEV-R, a Collaborative Learning Environment with Virtual Reality. This web-based system uses Virtual Reality (VR) and multimedia and provides communication tools to support collaboration among students. In this article, we describe the features of CLEV-R, its adaptation for mobile devices and present the findings from an initial evaluation.     

‘Pretty Lights’ and Maths! Increasing student engagement and enhancing learning through the use of electronic voting systems

University classes in Mathematics are traditionally perceived to be uninspiring and devoid of active student–lecturer communication. Large undergraduate classes further compound the difficulty of engaging students and enabling viable student–lecturer feedback. At the Mathematics Education Centre, Loughborough University, some staff members have been using electronic voting systems (EVS) to enliven the classroom and enable large numbers of students to respond to questions in real time during class. In this paper, we present an evaluation case study, based on student perceptions, of the impact of EVS use on student learning and engagement. The results show that majority of students are hugely positive about the usefulness and overall advantageousness of EVS use in classes. Results also show that EVS use does increase the likelihood of students participating and engaging in class, as even students who do not view EVS as being particularly useful stated that they are more likely to participate in classes where EVS are used than otherwise. However, there seems to be no correlation between EVS use and improvement (or otherwise) in student grades.     

A blended learning lecture delivery model for large and diverse undergraduate cohorts

A blended learning model was developed to enhance lecture delivery in a large, diverse introductory psychology unit, introducing the use of an online, personalized learning system for lecture preparation and using lecture time to extend students' understanding. Changes to the assessment included diagnostic, formative and summative online quizzes. Using hierarchical multiple regression to account for the variance associated with prior achievement and background knowledge, the results show that students who completed the online formative assessments had significantly higher scores on summative assessment tasks, and that scores were even higher for students who used these resources repeatedly. Changes to future implementations of the model are suggested to improve student engagement in formative assessment, and to facilitate lecturer's use of reports on student progress to focus and improve the quality of discussion in the face-to-face lectures.     

Pairing practice and feedback with animations optimizes student learning in online module

In this study, we investigated the optimal placement of animations and practice and feedback exercises with respect to each other and to static text and graphics in an online DNA replication module. We randomly assigned students in a first‐semester introductory biology course for freshmen biology majors and nonmajors to one of four online modules with animations and practice exercises (assets) either embedded with the text and images or saved until the end after all the text and images. Although we expected to find that embedding assets with text and images would improve learning outcomes, we were surprised to find that outcomes did not change with the location of these assets with respect to the text and static images. Instead, we found that colocation of exercises with animations was correlated with the biggest student learning gains, independent of where these assets appeared relative to the static text and static images. This held true both for immediate posttest scores and delayed application questions on a midterm exam. Our findings could have potential implications for how to best design online learning modules that feature multiple assets.     

Factors impacting university students' online learning experiences during the COVID-19 epidemic

Due to the COVID-19 epidemic crisis, students from higher education institutions around the world are forced to participate in comprehensive online curriculums. In such a scenario, it is worth investigating how students perceived their learning outcomes and satisfaction based on this method of teaching and learning online. This study aims to explore the role of six factors, namely, system quality, course design, learner-learner interaction, learner-instructor interaction, learner-content interaction, and self-discipline, on university students' perceived learning outcomes and their effect on student satisfaction with online curricula during the COVID-19 epidemic. A structural equation modelling technique was used to assess survey questionnaires obtained from 457 validated students at a Public University in China. The results demonstrated that these determinants had a positive effect on satisfaction and learning outcomes, whereas learner-instructor interaction had no significant effect. Furthermore, the strongest determinant that affected not only students' satisfaction but also their learning outcomes was the learner-content interaction.