Effectiveness of learning in online academic courses compared with face‐to‐face courses in higher education

This study examined the effectiveness of 3 online courses compared with the same 3 courses in a face‐to‐face (F2F) format, which had the same characteristics (e.g., the same instructor and final exam content and place). Effectiveness was examined by utilizing a wide range of variables, including 2 objective measures (N = 968): grades and completion rate; and 9 subjective measures (N = 360): 7 measures include instructional aspects (course structure, learning content, lessons watched, assignments, communication), engagement, and satisfaction. Findings indicate significant differences between online and F2F courses in most of the examined variables. Students in the online courses reported better understanding of the course structure, better communication with the course staff, watching the videos lessens more, and higher engagement and satisfaction. Students in the F2F courses reported better contribution of the learning content. Students' final grades were higher in the online courses, and no differences were found in the completion rate. The findings suggest that in many of the examined effectiveness aspects, online courses are as effective as, or more effective than, F2F courses. Interpretations of the findings are discussed.     

Predicting online learning success: Applying the situational theory of publics to the virtual classroom

Following the trend of increased interest by students to take online courses and by institutions to offer them, scholars have taken many different approaches to understand what makes one student successful in online learning while another may fail. This study proposes that using the situational theory of publics will provide a better understanding of online learning success. The situational theory of publics states that an individual's ability to recognize the value of a situation and the desire and ability to remove obstacles in that situation will lead to greater involvement in that situation. Results from a survey of students (n = 182) who completed an online “Introduction to Public Relations” course shows that awareness of course concepts and recognition that the field was important for their post-college careers and that the students' abilities to overcome course and technical constraints significantly impacted students' information processing abilities, which lead to greater involvement in the class and greater exam scores. The implications of the findings are discussed to better inform online instructors about methods to increase awareness and involvement in the course and reduce constraints to participation.     

Assessing the effectiveness of a voluntary online discussion forum on improving students’ course performance

The purpose of this study was to evaluate the effectiveness of voluntary discussion forums in a higher education setting. Specifically, we examined intrinsic forum participation and investigated its relation to course performance across two experiments. In Experiment 1 (N = 1284) an online discussion forum was implemented at the beginning of an undergraduate introductory psychology course, and measures of course performance (i.e., writing assignment grades, exam grades, and extra-credits obtained) were compared with measures of forum participation. In Experiment 2 (N = 1334) an online discussion forum was implemented halfway through a second undergraduate introductory psychology course, after an initial measure of course performance was obtained, to control for the potential confound of student engagement (e.g., students who perform better in the course use the forum more). Overall, the results showed that students who participated in the forum tended to have better performance in the course, and furthermore that participating in the discussion forum, particularly reading posts on the forum, slightly improved exam performance. This study provides empirical support for the theoretical proposition that there is a facilitation effect of discussion forum participation on course performance. The results also suggest that implementation of an online discussion forum is beneficial even if a teacher only invests minimal time on the forum.     

Mining LMS data to develop an “early warning system” for educators: A proof of concept

Earlier studies have suggested that higher education institutions could harness the predictive power of Learning Management System (LMS) data to develop reporting tools that identify at-risk students and allow for more timely pedagogical interventions. This paper confirms and extends this proposition by providing data from an international research project investigating which student online activities accurately predict academic achievement. Analysis of LMS tracking data from a Blackboard Vista-supported course identified 15 variables demonstrating a significant simple correlation with student final grade. Regression modelling generated a best-fit predictive model for this course which incorporates key variables such as total number of discussion messages posted, total number of mail messages sent, and total number of assessments completed and which explains more than 30% of the variation in student final grade. Logistic modelling demonstrated the predictive power of this model, which correctly identified 81% of students who achieved a failing grade. Moreover, network analysis of course discussion forums afforded insight into the development of the student learning community by identifying disconnected students, patterns of student-to-student communication, and instructor positioning within the network. This study affirms that pedagogically meaningful information can be extracted from LMS-generated student tracking data, and discusses how these findings are informing the development of a customizable dashboard-like reporting tool for educators that will extract and visualize real-time data on student engagement and likelihood of success.     

Using U‐Pace instruction to improve the academic performance of economically disadvantaged undergraduates

This study was undertaken to evaluate whether the student success associated with the U‐Pace instructional approach, which integrates mastery‐based learning with proactive instructor support in an online learning environment, would replicate for both economically disadvantaged students and students who are not economically disadvantaged. Undergraduates were enrolled in U‐Pace (intervention) or comparison sections of a gateway course at two universities with different learning management systems. Course content was held constant. At both universities, intervention students earned a significantly greater percentage of objectively determined final grades of A or B. This academic success was found for both economically disadvantaged intervention students and intervention students who were not economically disadvantaged. Improvement from the beginning to the end of the semester in intervention students' rate of mastering concepts was found at University 1, but not at University 2. The assessment of learning conducted at University 1, independent of final course grades, showed that intervention students scored significantly higher on the proctored cumulative exam than comparison students. Findings suggest that the U‐Pace instructional intervention holds promise for increasing the success of undergraduates regardless of economic status.     

Efficient learning using a virtual learning environment in a university class

This study examines a blended learning setting in an undergraduate course in psychology. A virtual learning environment (VLE) complemented the face-to-face lecture. The usage was voluntary and the VLE was designed to support the learning process of the students. Data from users (N = 80) and non-users (N = 82) from two cohorts were collected. Control variables such as demographical data, attitude towards the learning subject, computer literacy, motivation, learning effort and available infrastructure were captured by means of a self-report. As a learning outcome, the grade in the final exam was included. For the VLE-users, the mean performance in the VLE was taken as a predictor for success in the final exam. Two different groups of VLE-users were observed and classified into ’light and ’heavy’ users. The results showed that among those students who had spent two or more hours per week for pre- and post processing of the lectures, ‘heavy’ VLE-users performed better than non-users in the final exam. Additionally, the ‘heavy’ users’ performance in the VLE was the best predictor for the grade in the final exam. We discuss the results in the context of self-regulated learning competence.     

The importance of personality in students’ perceptions of the online learning experience

The current research examined the relationship between the Big Five personality dimensions and five specific types of online course impressions (engagement, value to career, overall evaluation, anxiety/frustration, and preference for online courses). Results revealed that conscientiousness was the most consistent predictor of an individual’s impressions of online courses. Specifically, conscientiousness was significantly related with each of the five online course impressions studied. In addition, agreeableness and openness were both positively related with the perceived value of online courses to one’s career. Work experience was positively associated with engagement, value to career, and overall evaluation, and negatively associated with anxiety/frustration. Undergraduates reported stronger preferences for online courses than did graduate students, and married students reported lower levels of anxiety/frustration with online courses. Results are interpreted with the intent of providing an enhanced understanding of the importance of personality in students’ impressions of the online learning experience.     

Predicting student performance in a blended MOOC

Predicting student performance is a major tool in learning analytics. This study aims to identify how different measures of massive open online course (MOOC) data can be used to identify points of improvement in MOOCs. In the context of MOOCs, student performance is often defined as course completion. However, students could have other learning objectives than MOOC completion. Therefore, we define student performance as obtaining personal learning objective(s). This study examines a subsample of students in a graduate‐level blended MOOC who shared on‐campus course completion as a learning objective. Aggregated activity frequencies, specific course item frequencies, and order of activities were analysed to predict student performance using correlations, multiple regressions, and process mining. All aggregated MOOC activity frequencies related positively to on‐campus exam grade. However, this relation is less clear when controlling for past performance. In total, 65% of the specific course items showed significant correlations with final exam grade. Students who passed the course spread their learning over more days compared with students who failed. Little difference was found in the order of activities within the MOOC between students who passed and who failed. The results are combined with course evaluations to identify points of improvement within the MOOC.     

The role of new technologies in the learning process: Moodle as a teaching tool in Physics

In this work we present an overview of the undergraduate online Physics course that we have implemented in the Moodle platform. This course has been developed as an enhancement of the face-to-face courses. The aim of this course is to create an online learning community which helps both teachers and students to have a virtual space where we can share knowledge through different kinds of supervised activities, chats and forums. As we will show in this paper, the students’ response to this initiative has been very good: the online Physics course helps them to reinforce their abilities and knowledge.     

Social presence in online discussions as a process predictor of academic performance

With the steady development of online education and online learning environments, possibilities to support social interactions between students have advanced significantly. This study examined the relationship between indicators of social presence and academic performance. Social presence is defined as students' ability to engage socially with an online learning community. The results of a multiple regression analysis showed that certain indicators of social presence were significant predictors of final grades in a master's level computer science online course. Moreover, the study also revealed that teaching presence moderated the association between social presence and academic performance, indicating that a course design that increased the level of meaningful interactions between students had a significant impact on the development of social presence, and thus could positively affect students' academic performance. This is especially important in situations when discussions are introduced to promote the development of learning outcomes assessed in courses. Another implication of our results is that indicators of social presence can be used for early detection of students at risk of failing a course. Findings inform research and practice in the emerging field of learning analytics by prompting the opportunities to offer actionable insights into the reasons why certain students are lagging behind.     

Performance measures in courses using computer-aided personalized system of instruction

Archived data from four courses taught with computer-aided personalized system of instruction (CAPSI) – an online, self-paced, instructional program – were used to explore the relationship between objectively rescored final exam grades, peer reviewing, and progress rate – i.e., the rate at which students completed unit tests. There was a strong positive correlation (r = .68, p < .01) between rate of progress and the amount of peer reviewing students did. This was predictable because peer reviewers had to be further along in the course than the students whose unit tests they reviewed. Students who completed all the units tended to obtain higher final exam scores than those who did not. For students who completed all the units there was little difference between the final exam performance of those who had a high progress rate and those who had a low progress rate. Considering all students together there was a moderate correlation between progress rate and final exam performance (r = .36, p < .01). In addition, there was a moderate positive correlation (r = .33, p < .01) between the amount of peer reviewing students did and their performance on the final exam. This correlation was substantially reduced (r = .13, p < .20) when rate of progress was partialed out. Thus, overall, students who progressed more rapidly through the course did more peer reviewing and learned more as measured by final exam performance. Interestingly, there were students who showed good learning without much participation in course related behaviors such as completing unit tests and peer reviewing. It is concluded that the CAPSI instructional program provides a good learning environment for students who utilize its components but it also accommodates other learning styles. In addition, there may be a distinction between students who complete all assigned units and those who do not regardless of their tendencies to procrastinate.     

Online and hybrid university-level courses with the utilization of Second Life: Investigating the factors that predict student choice in Second Life supported online and hybrid university-level courses

The radical restructure of hybrid and online learning course delivery methods at university-level held in Second Life has been widely and positively acknowledged from a large academic literature body. However, it is still absent the clarification of students’ socio-cognitive factors that predict their choice to attend at least in one of these course delivery methods. The main purpose of this study is to examine the relation between several personal factors and students’ choice to participate in these contemporary methods. A targeted sample of 325 voluntary students (170 who participated in hybrid sessions and 155 who participated in online sessions) completed a survey to assess socio-cognitive factors (self-efficacy, metacognitive self-regulation and task value), achievement-related emotions (pride, anger, relief and shame) in academic settings (before and after finishing various learning activities) and satisfaction levels of each method with also final grades from their examination processes to be included. Logistic regression confirmed higher levels of students’ self-efficacy and satisfaction in learning outcomes for those who took part in (fully) online rather than those who enrolled in hybrid courses. The study results revealed that students would prefer to take further courses in the online course delivery method. Conclusive remarks may provide meaningful information to the educational community in order to understand better how the socio-cognitive constructs of motivation are related to the students’ participation in future-driven educational activities held in Second Life by using the online or hybrid course delivery methods.     

Can more interactivity improve learning achievement in an online course? Effects of college students' perception and actual use of a course-management system on their learning achievement

This study aims to investigate how interactivity influence learners' use of interactive functions in the course-management system (CMS) and their online learning performance. A two-tier mediation framework is proposed to examine the mediating effects of different actual-use records concerning the CMS's interactive functions. Data are collected from 381 undergraduate students who enrolled in a general-education asynchronous online course from three universities in Taiwan. The results indicate that the relationships among students' self-reported use of interactive functions, students' perceptions of the usefulness of interactive functions, and students' actual-use logs have some direct influences on students' online learning performance (online-discussion scores, exam scores, and group-project scores). In addition, students' actual-use logs (the number of times of log-ins to the online course, the number of times students read learning materials, and the number of postings on the discussion board) have a mediated effect on students' self-reported frequency of logging into the CMS, students' self-reported frequency of using the learner–instructor/learner–learner interactive functions, and online learning performance. The findings and implications could constitute a useful guide for educational practitioners and designers concerned with the effective integration of interactivity into future online courses.     

Toward a Complexity of Online Learning: Learners in Online First-Year Writing

In response to the growing presence of online first-year writing courses, this paper describes a case study of two online first-year writing courses and addresses the questions: What do students in an online first-year writing course perceive as good study habits, and what helps them succeed? Data includes surveys, online discussions, course management statistics, and selected interviews. The study is supported by social cognitive theory described by psychologist Albert Bandura; this methodology allows for examination of internal, external, and behavioral characteristics of participating students. Results of the study indicate that students who rated themselves as making good use of study time also succeeded in the course. Insights from students include information about study activities, management of study time, access to technology, and attitudes about online courses. A surprising result of the study was that students did not consider communication with peers as a productive study activity, despite a deliberate attempt by instructors to build peer interaction into the course. Yet students also reported high levels of engagement and positive attitudes about online learning. The social cognitive lens provides helpful insights about these complex findings by examining the external, internal, and behavioral aspects of online first-year writing students in this study.     

Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation,social comparison,satisfaction, effort,and academic performance

Gamification, the application of game elements to non-game settings, continues to grow in popularity as a method to increase student engagement in the classroom. We tested students across two courses, measuring their motivation, social comparison, effort, satisfaction, learner empowerment, and academic performance at four points during a 16-week semester. One course received a gamified curriculum, featuring a leaderboard and badges, whereas the other course received the same curriculum without the gamified elements. Our results found that students in the gamified course showed less motivation, satisfaction, and empowerment over time than those in the non-gamified class. The effect of course type on students' final exam scores was mediated by students' levels of intrinsic motivation, with students in the gamified course showing less motivation and lower final exam scores than the non-gamified class. This suggests that some care should be taken when applying certain gamification mechanics to educational settings.     

Increasing Participation in Distance Learning Courses

Web-based discussion forums are key tools in online education environments. Extant studies have shown that active participation helps drive the success of these forums. The integrated participation evaluation tool (iPET) is a Web-based application combining social network analysis and visualization to enable distance learning instructors and students to improve their participation in online discourse and so improve their overall learning experience. An analysis of the results obtained in a study using iPET in a distance learning context shows that iPET increases participation and motivation in distance learning courses without increasing facilitator workload     

Hypertext — a Bibliometric Briefing

Students' opinions about the degree of impact, status, and socio-cognitive viability with the utilization of the emerging three-dimensional (3D) computer-generated technologies may vary. Indisputably, 3D technology-enhanced environments have provided considerable benefits and affordances to the contemporary e-Education. In these circumstances, virtual worlds (VWs) like second life (SL) have generally intensified with an extensive perpetuation and penetration of innovative performances that encapsulated or enacted from the vast majority of higher education fields. At the same time, there is growing widespread recognition of reasons affecting the high or low degree of students' engagement in online and blended course delivery methods held in 3D VWs. Notwithstanding that most notable studies have disclosed SL functional capabilities from a plethora of pilot case studies, however, it is still lacking an experiential-based research approach to determine the degree of students' engagement in blended and online courses at university level through SL. The present comparative study explores students' engagement overall as a multidimensional construct consisting of emotional, behavioral, and cognitive factors. One hundred and thirty-five undergraduate and postgraduate students in almost identical blended and online instructional conditions held in SL took part in this project. Preliminary results have decoded students' satisfaction for both methods, despite the fact that the voluntary sample composed of different educational disciplines. The quantitative analysis showed that postgraduate students of the online course had more positive results and the degree of engagement significantly increased compared to those who enrolled with the blended course delivery method. The instructional affordances from the utilization of SL were the collaborative climate between users (instructor and students) who eliminated various intractable boundaries which were predominantly observed by several conventional methods. Specifically it was revealed that the online course delivery method engaged more students with the collaborative activities. Educational implications and recommendations for future research are also included.     

When groups decide to use asynchronous online discussions: collaborative learning and social presence under a voluntary participation structure

The purpose of this study is to explore how groups decide to use asynchronous online discussion forums in a non-mandatory setting, and, after the group decision is made, how group members use online discussion forums to complete a collaborative learning project requiring complex data gathering and research processes. While a large body of research on computer-mediated communication (CMC) has documented successful intervention strategies to promote and sustain online discussion forums, little of the research has examined the use of online discussion forums in voluntarily contexts, wherein the decision to use online discussion forums is a personal decision and participation is not a graded component. This study approaches the research questions using a naturalistic case study of one graduate-level blended learning course with 55 students. Employing both student interviews and content analysis methods, this study revealed that the factors affecting the group decision to use online discussion forums are (1) successful or unsuccessful experiences during the first trial, (2) perceived affordances of CMC tools, and (3) the interplay between the nature of collaborative tasks and perceived efficiency. The content analysis of online postings in two voluntary groups revealed that when groups decided to use online discussion forums, participation levels were almost equal among individual group members, and discussion threads were sustained until the final completion of the collaborative project.     

The timing of online lecture slide availability and its effect on attendance, participation, and exam performance

The use of PowerPoint slides has become an almost ubiquitous practice in university classrooms, however little research has examined whether the timing of lecture slide availability to students (either before or after lecture) affects classroom behaviour or exam performance. Using a 2 (slide availability condition) × 2 (course type) between-subjects design, the present study examined lecture slide availability differences in attendance, participation, and exam performance in two courses – Research Methods and Cognitive Development – taught in both the Fall and Winter semesters. For each type of course, lecture slides were made available on the course website before lecture in one semester and after lecture in the other semester. Course material was held constant across semesters. Results showed that mean attendance was higher when slides were available before lecture, but only for the type of course that did not include attendance points as part of students’ final grades. For students who participated in class, participation was more frequent when slides were available before lecture. No significant difference in exam performance was found between lecture slide availability conditions, however. These findings suggest that making lecture slides available to students before lecture may lead to better overall attendance and participation, but exam performance is determined by more than just whether or not students have lecture slides available for their note-taking.