Using online assessments to stimulate learning strategies and achievement of learning goals

The main goals of this research are: (i) to explore the influence that announcement of certain type of online assessment has on students' learning strategies and (ii) to explore the influence of stimulated learning strategies on achievement levels that students exhibit during assessments. Research has been conducted by testing and surveying 351 students from higher education institutions. Results indicate that students' learning strategies can be influenced in a relatively short period of time by announcing various types of online assessments and that steering to more desirable deep learning strategies has positive impact on both formal and perceived levels of success in achieving the desired learning goals. These findings can be used to create a novel adaptive online assessment system that incorporates the elements of adaptivity within a series of assessments and uses post-assessment feedback to steer students’ learning strategies.     

Learner readiness for online learning: Scale development and student perceptions

The purpose of this study was to develop and validate a multidimensional instrument for college students’ readiness for online learning. Through a confirmatory factor analysis, the Online Learning Readiness Scale (OLRS) was validated in five dimensions: self-directed learning, motivation for learning, computer/Internet self-efficacy, learner control, and online communication self-efficacy. Research data gathered from 1051 college students in five online courses in Taiwan revealed that students’ levels of readiness were high in computer/Internet self-efficacy, motivation for learning, and online communication self-efficacy and were low in learner control and self-directed learning. This study found that gender made no statistical differences in the five OLRS dimensions, but that higher grade (junior and senior) students exhibited significantly greater readiness in the dimensions of self-directed learning, online communication self-efficacy, motivation for learning, and learner control than did lower grade (freshman and sophomore) students.     

Characterizing communication networks in a web-based classroom: Cognitive styles and linguistic behavior of self-organizing groups in online discussions

In this study, we explore the cognitive style profiles and linguistic patterns of self-organizing groups within a web-based graduate education course to determine how cognitive preferences and individual behaviors influence the patterns of information exchange and the formation of communication hierarchies in an online classroom. Network analysis was performed on communication data collected from 1131 student messages posted in 19 asynchronous online discussion forums to determine centrality, clique membership, and core-periphery structure in the communication networks. The social network data were examined in relation to the students' cognitive style profiles, which were assessed using the Kirton Adaption-Innovation Inventory (KAI) (32 and 33). The cognitive style composition of small cliques (dyadic and triadic) was found to be highly heterogeneous, often with large cognitive gaps between clique members, which suggests that web-based environments may mask cognitive style differences that have been shown to create conflict in face-to-face interactions. In addition, the cognitive style mean of the students in the core of the network was found to be significantly more adaptive than that of the periphery group. To further characterize the nature of the communicative interactions, automated linguistic analysis was used to analyze the students' writing samples. Interestingly, students in the core of the social network demonstrated a significantly higher usage of several language features associated with individuals who actively promote enhanced group performance and cohesion. For our sample, the linguistic behaviors of students in the core of the social network, coupled with their more adaptive cognitive style preferences, suggest that these students may inherently place greater value on fostering group cohesion than those in the periphery.     

Impact of podcasting on student motivation in the online learning environment

Researchers investigated the impact of podcasting on student motivation in the online environment during fall 2008 and spring 2009. Data were collected from students enrolled in fourteen online courses at a research university in the United States. One hundred and ninety-one students completed a modified version of the Instructional Materials Motivation Survey (Keller, 2006); it has four subscales: attention, relevance, confidence, and satisfaction. Strong positive relationships between all subscales were detected. Results indicate students were moderately motivated by the use of podcasts in their online courses. Statistically significant differences in student motivation based on gender, class standing, and prior online learning experience were found. Benefits of using podcasts and recommendations for improvement of the multimedia files were offered by users.     

How media choice affects learner interactions in distance learning classes

In this research we explore aspects of learning, social interaction and community across online learning, also known as distance learning, in higher education. We measure the impact of online social networking (OSN) software versus traditional learning management system (LMS) software. Guided by a theoretical model for how individuals learn and interact within online communities, we measure student perceptions of learning, social interaction and course community before and after our interventions. Survey instruments measure perceived learning, social interaction and community, which we further explore using social network analysis (SNA). Survey results identified that students experienced higher levels of perceived social interaction and course community and, overall, had higher levels of satisfaction with OSN software than those using LMS software. Along this line, SNA results corroborated that OSN software yielded a higher number of interactions, providing a more engaging learning experience.     

Interpersonal exchanges in discussion forums: A study of learning communities in distance learning settings

Cooperative relationships are the foundation of a model of online learning based on communities. The development of a community depends on the interaction between community members. This study is based on the belief that the dynamics of exchange of thought, from a Piagetian perspective, are one possibility for understanding the process of interaction within a virtual community. The study therefore investigates the dynamics of conversations in discussion forums in order to lead to an understanding of the processes involved in the formation of virtual learning communities. The research path involved content analysis of messages, interaction mapping and an analysis of the relationship between them. The results indicate that there is a relationship between the texts of discussion forum messages and continuation of interpersonal exchanges.     

Applying the Practical Inquiry Model to investigate the quality of students’ online discourse in an information ethics course based on Bloom’s teaching goal and Bird’s 3C model

The goal of this study is to better understand how the study participants’ cognitive discourse is displayed in their learning transaction in an asynchronous, text-based conferencing environment based on Garrison’s Practical Inquiry Model (2001). The authors designed an online information ethics course based on Bloom’s taxonomy of educational objectives and Bird’s 3C model (Content–Construction–Consolidation). The content analyzed included the participants’ message posts, the quality of the dialogue and the scaffolding strategies for mentoring used by group leaders and teachers.     

Influence of group configuration on online discourse reading

Online discourse reading plays a very important role in collaborative discussions. However, not many studies have examined the influence of group configuration on online discourse note reading. The current study examined note reading workloads and participants' perceptions of the three group configurations (large whole class, small whole class, large with subgroups) in online graduate-level courses from one institute. In this mixed-methods study, we analyzed tracking logs from 25 graduate-level online courses (25 instructors and 341 students) and interviews from 10 instructors and 12 graduate students with diverse backgrounds. Findings suggest that all three configurations had their own advantages and disadvantages in fostering online discourse reading. However, our analysis suggests that the advantages of subgroup discussions in supporting note reading outweigh those of the Small and Large configurations. The overload effects in information reading due to large class sizes can be minimized by dividing students into small groups for discussion purposes. Group configuration into proper-size groups may reduce students' reading loads. Interviewees felt that the waving of small groups into large classes benefited their collaborative discussions. We conclude this paper with a list of pedagogical recommendations and new software features that may help group configuration and enhance learning in online courses. This study may have implications for both practitioners and researchers to seek optimal group configurations to achieve more fruitful online discussions through note reading.     

Influence of group configuration on online discourse writing

This study examines the impact of different strategies for grouping students in online, discourse-intensive distance education courses. The mixed methods research focused on note writing productivity (based on 366 participants in 25 classes) and participants' perceptions (12 graduate students and 10 instructors) relating to three different class configurations (large whole class, small whole class, large class divided into subgroups). Each configuration exhibited advantages and disadvantages in terms of supporting note writing, however, the data analyses suggested that the advantages for writing in subgroups outweighed those of the other two conditions. Splitting larger classes into smaller subgroups appears to reduce information overload and encourages more focused, in-depth discussions. The research concludes with a list of pedagogical recommendations and suggests new software features that may help learning within specific group configurations. This study may have implications for both practitioners and researchers who wish to promote more fruitful online discussions.     

Research in online learning environments: Priorities and methodologies

Due to increasing demand for education and training in the information age, online learning and teaching is becoming a necessity in our future. However, lack of research goals to understand impact of online learning environments on students is a problem in research on online learning environments. We identified four main research goals to pursue in online learning environments based on their impact on learner achievement, engagement, and retention (opposite of attrition). Those goals are (a) enhancing learner engagement & collaboration, (b) promoting effective facilitation, (c) developing assessment techniques, and (d) designing faculty development programs. Current promising work in those areas is presented. Four methods that are common in the instructional technology literature are recommended to pursue those goals. Formative research and developmental research are relevant for all four. Although appropriate for any of the goals, experimental research is a better fit for goals b and c, and activity theory is useful for goals a and b.     

Assistance and possibilities: Analysis of learning-related factors affecting the online learning satisfaction of underprivileged students

Online learning is used for different purposes such as the actualization of equal opportunity in education or excellence in education. In Korea, nationwide online learning has been launched since 2005 to boost the self-directed learning capabilities and academic achievement of underprivileged students. The purpose of this study was to examine factors affecting the online learning satisfaction of underprivileged students. The subjects in this study were 1043 students and 915 underprivileged students. The underprivileged students were found to be more satisfied with online learning than the students, and the students who were under the guidance of their online homeroom teachers (hereinafter called the students of class type) expressed better satisfaction than the others who studied on their own (hereinafter called the students of self-study type). And the learning support function (F3) was identified as the variable that exerted the largest influence on the satisfaction level of the underprivileged students. This study was significant in that it attempted to suggest what kind of assistance should be provided to raise the online learning satisfaction of underprivileged students and to set up learning assistance models geared toward underprivileged students by covering diverse relevant elements without leaning toward any particular one.     

Social metacognition and the creation of correct,new ideas: A statistical discourse analysis of online mathematics discussions

During asynchronous, online mathematics discussions, new ideas and justifications (knowledge content) and evaluations and invitations to participate (social metacognition) can influence the likelihood of a correct, new idea (CNI) in the current message. Using statistical discourse analysis, we modeled 894 messages by 183 participants on 60 high school mathematics topics on a mathematics problem solving website not connected to any class or school. Results showed that CNIs, justifications, and social metacognition (correct evaluations and questions) in recent messages increased the likelihood of a CNI in the current message. Meanwhile, more experienced participants (who had posted more messages on the website) had more CNIs, and participants who initiated topics had fewer CNIs. Applied to practice, these results suggest that teachers can facilitate students’ creation of CNIs by encouraging them to justify their ideas, evaluate one another’s ideas carefully, and ask questions during online mathematics discussions.     

Finnish high school students’ readiness to adopt online learning: Questioning the assumptions

The Finnish high school system in rural areas is facing challenges because of a decreasing number of the students. This situation places new emphasis on online learning. Online learning offers new possibilities for high schools to provide equal learning opportunities for their students. This paper explores students’ readiness to adapt their studying habits in the networked high schools by outlining their beliefs about online learning. Beliefs are assumed to direct people’s actions, in this case activities concerning studying online. Three hundred second year high school students from Eastern Finland who had not had the experiences of learning online were studied. The findings suggest that students polarize into negative, neutral and positive groups based on their beliefs concerning online learning. Results also indicate that students’ knowledge about the possibilities of online learning is quite superficial. In contrast to theories about collaborative learning practices, students see online learning rather differently. Students with negative and neutral beliefs especially see online learning merely as a static “warehouse” of materials and study-alone learning tasks instead of offering possibilities for collaborative knowledge building.     

A blended learning Approach to teaching foreign policy: Student experiences of learning through face-to-face and online discussion and their relationship to academic performance

This article presents research on students’ experiences of learning through a blend of face-to-face and online discussion. The participants in our study were students enrolled in a foreign policy course at a major Australian university. Students’ conceptions of learning through discussion, and their approaches to both face-to-face and online discussion, were elicited through open-ended questionnaires and semi-structured interviews. Students’ responses to both open-ended questionnaires and interviews were analysed using a phenomenographic framework. Qualitative variations in students’ conceptions and approaches were categorised and were found to form a hierarchy. Subsequent quantitative analysis found associations between students’ conceptions of learning through discussion, their approaches to both face-to-face and online discussion and their academic performance (as indicated by the final mark for the course). Implications for teaching and further research are discussed.     

Cui bono?: Revisiting the promises and perils of online learning

We chronicle—in both an historical and bibliographic framework—the discussion of rhetorics of empowerment and disempowerment throughout the last 15 years, and we also examine the promises and perils of current trends in online teaching and learning, with a special emphasis on the role of universities in promoting distance education. This article addresses the question cui bono?, or who benefits, from the rush to technologize teaching and learning? We address the extent to which the continued rush to technologize teaching and learning is a perilous return to a rhetoric of empowerment that as compositionists we must continue to interrogate critically; we question how, in an era of 24/7 learning, students may or may not benefit and also how teachers may lose out, based on the increased workload and course management surrounding online learning.     

Prompting authentic blogging practice in an online graduate course

Blogging is characterized by an individual exploration of ideas of personal interest through frequent online posts, documenting ideas as they emerge over time. Community emerges as bloggers read and link across blogs, based on shared interests. Blogs have gained acceptance in higher education for a variety of instructional activities, among which, reflective journal writing is popular. In this study, we examine a project in which blogs were implemented within an online graduate course in order to create opportunities for students to reflect on their academic, professional and personal interests, with the goal of establishing consistent blogging that exhibits the timely, frequent and interest-driven practices of blogging practices outside educational contexts. Students enrolled in an online graduate course maintained individual blogs in which they were prompted to write about their interests and experiences as graduate students. Through an analysis of the patterns of prompt use and blog content, as well as data from a post-course survey and an online discussion, we explore how to support student engagement with blogging practice within an educational setting. Findings suggest that frequency of writing, topic resonance with the students own interests, and the timeliness of entries were key factors in scaffolding writing that aligns with blogging practice. By focusing on writing as characterized by authentic blogging practice, this study contributes to an understanding of how to harness the unique communicative elements of the blog in post-secondary settings.     

Teaching composition online: Whose side is time on?

Although online education is at times envisioned as a time-saving enterprise, a recent, mostly anecdotal consensus indicates that, in fact, online education is more labor intensive for the instructor, if not for the student as well. Previous studies both confirm and deny this consensus because they examine different design paradigms that resist comparison. This study compares the workload for a student-centered paradigm in one face-to-face (F2F) and three online sections of the same composition course, and finds that teaching composition online takes almost twice as much time as face-to-face teaching. The major causes of this disparity appear to be hardware and applications, instructional design, and student learner characteristics.     

Students' perceptions of instructors' roles in blended and online learning environments: A comparative study

This study develops an instrument—the Online Instructor Role and Behavior Scale (OIRBS)—and uses it to examine students' perceptions of instructors' roles in blended and online learning environments. A total sample of 750 university students participated in this study. Through a confirmatory factor analysis, the OIRBS was validated in five constructs: course designer and organizer (CDO), discussion facilitator (DF), social supporter (SS), technology facilitator (TF), and assessment designer (AD). The results show that the five factor structures remained invariant across the blended learning and online learning. Both students in blended learning environments and students in online learning environments exhibited the greatest weight in the CDO dimension, followed by the TF and DF dimensions. In addition, students in the online learning environments scored higher in the DF dimension than did those in the blended learning environments.     

A theory of online learning as online participation

In this paper, an initial theory of online learning as online participation is suggested. It is argued that online learner participation (1) is a complex process of taking part and maintaining relations with others, (2) is supported by physical and psychological tools, (3) is not synonymous with talking or writing, and (4) is supported by all kinds of engaging activities. Participation and learning are argued to be inseparable and jointly constituting. The implication of the theory is straightforward: If we want to enhance online learning, we need to enhance online learner participation.     

Selective reading of large online forum discussions: The impact of rating visualizations on navigation and learning

As discussions in online forums can become quite large, participants must be highly selective in their reading behavior. Standard, chronological displays of discussions provide little guidance in how to find valuable content. An experimental study tested whether a group awareness tool can support individual navigation and subsequent learning within a forum. 127 participants read through a large online discussion in which contributions were rated on average quality and average agreement. In a 2 × 2 factorial design, posts were visualized along continua indicating average quality ratings (absent vs. present) and/or average agreement ratings (absent vs. present). Results showed that the visualization of discussion contributions led to stronger deviations from a chronological reading order. Moreover, it was found that the presence of a quality dimension shifted readers’ focus to high-quality contributions (unipolar navigation). Moreover, the quality dimension was weakly associated with better performance in a knowledge test. In contrast, it was found that the presence of an agreement dimension shifted readers’ focus to both high-agreement and low-agreement contributions (bipolar navigation). Moreover, the agreement dimension was associated with stronger attitude change and a higher intention to participate. Implications for the use of group awareness tools in full-scale online forum environments are drawn.